Talent.com
Senior Data Engineer - Aws Glue - Full Remote - Contractor In Usd

Senior Data Engineer - Aws Glue - Full Remote - Contractor In Usd

All European CareersThāne, Republic Of India, IN
3 days ago
Job type
  • Remote
Job description

For an international organization in Geneva, Switzerland, we are urgently looking for a Full Remote Senior Data Engineer. The Senior Data Engineer is responsible for the implementation of the set of automated ETL pipelines, implementation of the analytics of the platform operations and importing new data sources and its maintenance. The Analytics Data Platform is a cloud-native application deployed on AWS through CloudFormation templates

using the following resources : Glue, S3, Lambda, Step Function, Airflow, Athena, RDS, Redshift, and Lake Formation.

Candidates need to be willing to work normal office hours in Switzerland. This positions is long-term.

Tasks and Responsibilities :

  • Refactor, develop, maintain the web analytics ETL pipeline

Use data pipeline jobs to extract data from various sources including on premise relational databases, APIs,

Use data pipeline jobs to curate extracted raw data

Use data pipeline jobs to apply transformation based on reporting needs

Data source connectors to ingest the data from various data sources

Write the spark SQLs to produce the datasets

Monitor, troubleshoot and remediate the above jobs

  • Data Modelling
  • Maintenance of the existing data models in the data lake and data warehouse

    Design & Implement data models for new data sources as required

  • Refactor, maintain the CloudFormation templates and CDK as per the CICD guidelines / requirements
  • Other ad hoc deliverables required by the project
  • Profile :

  • University degree in computer science, engineering or other related discipline;
  • 5 years of experience as Data Engineer;
  • Hands-on experience writing code for AWS Glue in python with PySpark and Spark SQL;
  • Relational databases such as PostgreSQL (preferably AWS Redshift) with expertise in SQL, query optimization;
  • Serverless Query Service, preferably AWS Athena;
  • Experience in implementing an end to end cloud native Data warehouse platform - data modelling;
  • ETL, data integration and data migration, preferably related to AWS Redshift;
  • Expertise in SQL, query optimization;
  • Experience in implementing data integration from different sources;
  • Experience withAWS IaC (CloudFormation & CDK) and CICD pipelines;
  • Experience in Python programming and using PySpark for distributed computing in AWS Cloud;
  • Experience in working with ERP applications such as PeopleSoft is an added advantage;
  • Development of Reports / Dashboards using Tableau is an added advantage;
  • Fluent in English;
  • Create a job alert for this search

    Senior Data Engineer • Thāne, Republic Of India, IN

    Related jobs
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    HealthyMe AIThane, IN
    We are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data.You will report to the Head of AI and Engineering and be responsible for designi...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer (AWS / Databricks)

    Senior Data Engineer (AWS / Databricks)

    Accoladethane, maharashtra, in
    The multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront.We are building the industry's first AI-native Operations Centralization Platform, desi...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Celebal Technologiesnavi mumbai, maharashtra, in
    We are seeking a highly skilled Data Engineer with deep expertise in Apache Kafka integration with Databricks, structured streaming, and large-scale data pipeline design using the Medallion Archite...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer - Snowflake / AWS

    Senior Data Engineer - Snowflake / AWS

    ResourcetreeMumbai
    About the Role : A "Senior Data Engineer" is mid-level professional leading the design, build and evolution of the inhouse data platforms.You lead the const...Show moreLast updated: 30+ days ago
    • Promoted
    Collinson Group - Senior Data Engineer

    Collinson Group - Senior Data Engineer

    Collinson Loyalty & Benefits Private Limited”Mumbai
    Description : - Design, develop and maintain data pipelines for collecting, transforming and loading data into various data stores. Build and maintain data warehousing...Show moreLast updated: 10 days ago
    • Promoted
    Senior Data Integration Engineer

    Senior Data Integration Engineer

    IndsafriKalyan-Dombivli, IN
    Senior Data Integration Engineer.We are seeking a highly experienced and strategic Senior Data Integration Engineer to architect, build, and manage the data pipelines that power our customer intell...Show moreLast updated: 24 days ago
    • Promoted
    Data Engineer

    Data Engineer

    FornaxMumbai, Mumbai (district)
    If solving business challenges drives you.Fornax is a team of cross-functional individuals who solve critial business challenges using core concept of analytics, critical thinking.We are seeking a ...Show moreLast updated: 1 day ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Guidanz IncMumbai, IN
    BI Connector is the industry leading solution for integrating Oracle Fusion Cloud data into modern BI platforms like Power BI, Tableau, and Data Warehouse, without complex ETL.Our Data Architecture...Show moreLast updated: 3 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    StraiveMumbai, Maharashtra, India
    Analyse relevant internally and externally sourced data (raw data) to generate BI and Advanced.Analytics datasets based on your stakeholders’ requirements. Design data pipelines to curate sourced da...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer - AWS Glue - Full Remote - Contractor in USD

    Senior Data Engineer - AWS Glue - Full Remote - Contractor in USD

    All European CareersMumbai, IN
    Remote
    For an international organization in Geneva, Switzerland, we are urgently looking for a Full Remote Senior Data Engineer. The Senior Data Engineer is responsible for the implementation of the set of...Show moreLast updated: 3 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Masteknavi mumbai, maharashtra, in
    We are looking for a Senior Data Engineer with good exposure to Cloud Services in AWS(IAM, RDS, Lambda, DMS) along with Snowflake / Postgresql, ETL and Streaming Services like Kafka.Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer-Remote

    Senior Data Engineer-Remote

    Cimpress Indiathane, maharashtra, in
    Remote
    NASDAQ : CMPR) is the world leader in mass customisation.Our unmatched technology, production, and supply chain operations allow us to offer products that can be personalised by an individual custom...Show moreLast updated: 22 days ago
    • Promoted
    Senior Azure Data Engineer

    Senior Azure Data Engineer

    Programmers.iothane, maharashtra, in
    Job Title : Senior Azure Data Engineer.Skills Required : Azure Synapse, Azure Data Factory, Azure Databricks, and ADLS Gen2, PySpark, SQL,Microsoft Fabrics. Experience Range : 5 Years - 12 years.We are...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    QuantiphiMumbai, Maharashtra, India
    Quantiphi is an award-winning Data Science and Machine Learning Software and Services Company focused on helping organizations translate the big promise of Machine Learning technologies into quanti...Show moreLast updated: 2 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AIKalyan-Dombivli, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Fluent Healthmumbai, maharashtra, in
    Fluent Health is a dynamic healthcare startup revolutionizing how you manage your healthcare and that of your family.The company will provide customers with high-quality, personalized options, cred...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    AWS Lead Data engineer

    AWS Lead Data engineer

    Tata Consultancy Servicesnavi mumbai, India
    In this key leadership role, you will lead the development of foundational components for a Lakehouse architecture on AWS and drive the migration of existing data processing workflows to the new La...Show moreLast updated: 5 hours ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    SGS & Codombivli, India
    Position Title : Senior Data Engineer.Experience Required : 8 to 12 Years.We are looking for a highly skilled and experienced Data Engineer with strong expertise in. The ideal candidate will play a ke...Show moreLast updated: 17 hours ago