Talent.com
Senior Data Engineer - AWS Glue - Full Remote - Contractor in USD

Senior Data Engineer - AWS Glue - Full Remote - Contractor in USD

All European CareersPune, IN
8 days ago
Job type
  • Remote
Job description

For an international organization in Geneva, Switzerland, we are urgently looking for a Full Remote Senior Data Engineer. The Senior Data Engineer is responsible for the implementation of the set of automated ETL pipelines, implementation of the analytics of the platform operations and importing new data sources and its maintenance. The Analytics Data Platform is a cloud-native application deployed on AWS through CloudFormation templates

using the following resources : Glue, S3, Lambda, Step Function, Airflow, Athena, RDS, Redshift, and Lake Formation.

Candidates need to be willing to work normal office hours in Switzerland. This positions is long-term.

Tasks and Responsibilities :

  • Refactor, develop, maintain the web analytics ETL pipeline

Use data pipeline jobs to extract data from various sources including on premise relational databases, APIs,

Use data pipeline jobs to curate extracted raw data

Use data pipeline jobs to apply transformation based on reporting needs

Data source connectors to ingest the data from various data sources

Write the spark SQLs to produce the datasets

Monitor, troubleshoot and remediate the above jobs

  • Data Modelling
  • Maintenance of the existing data models in the data lake and data warehouse

    Design & Implement data models for new data sources as required

  • Refactor, maintain the CloudFormation templates and CDK as per the CICD guidelines / requirements
  • Other ad hoc deliverables required by the project
  • Profile :

  • University degree in computer science, engineering or other related discipline;
  • 5 years of experience as Data Engineer;
  • Hands-on experience writing code for AWS Glue in python with PySpark and Spark SQL;
  • Relational databases such as PostgreSQL (preferably AWS Redshift) with expertise in SQL, query optimization;
  • Serverless Query Service, preferably AWS Athena;
  • Experience in implementing an end to end cloud native Data warehouse platform - data modelling;
  • ETL, data integration and data migration, preferably related to AWS Redshift;
  • Expertise in SQL, query optimization;
  • Experience in implementing data integration from different sources;
  • Experience with AWS IaC (CloudFormation & CDK) and CICD pipelines;
  • Experience in Python programming and using PySpark for distributed computing in AWS Cloud;
  • Experience in working with ERP applications such as PeopleSoft is an added advantage;
  • Development of Reports / Dashboards using Tableau is an added advantage;
  • Fluent in English;
  • Create a job alert for this search

    Senior Data Engineer • Pune, IN

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgePune, IN
    We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team. You will be responsible for building scalable and reli...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    EXLpune, maharashtra, in
    We are seeking a Senior Data Engineer to build and optimize data systems that power batch processing, real-time streaming, pipeline orchestration, data lake management, and data cataloging.You will...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Innova SolutionsPune, Maharashtra, India
    We're Hiring : Lead Data Consultant / Senior Data Engineer Location : [Insert Location] | Industry : Financial Services & Insurance (FSI) Are you passionate about building scalable, cloud-native d...Show moreLast updated: 8 days ago
    • Promoted
    Senior Data Engineer- AWS

    Senior Data Engineer- AWS

    InfoCeptspune, maharashtra, in
    Key Result Areas and Activities : .Study existing technology landscape and understand current data integration frameworks and do impact assessment for the requirements. Should be able to design comple...Show moreLast updated: 30+ days ago
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Tata Consultancy Servicespune, maharashtra, in
    Aws data engineer having strong experience of Python.Technical / Behavioral Competency.Proficient in Python, with experience in deploying Python packages and OOP, Experience in ingesting data from di...Show moreLast updated: 16 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Mastekpune, maharashtra, in
    We are looking for a Senior Data Engineer with good exposure to Cloud Services in AWS(IAM, RDS, Lambda, DMS) along with Snowflake / Postgresql, ETL and Streaming Services like Kafka.Show moreLast updated: 30+ days ago
    • Promoted
    Senior AWS Data Engineer

    Senior AWS Data Engineer

    CYAN360Pune, IN
    Position : Senior AWS Data Engineer.Work Timings : 2 : 30 PM to 11 : 30 PM IST.Need someone who can join immediately or in 15 days • • •. Design, develop, and deploy end-to-end data pipelines on AWS cloud in...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SGS & Copune, maharashtra, in
    Position Title : Senior Data Engineer.Experience Required : 8 to 12 Years.We are looking for a highly skilled and experienced Data Engineer with strong expertise in. The ideal candidate will play a ke...Show moreLast updated: 8 days ago
    • Promoted
    AWS Database Eng

    AWS Database Eng

    Tata Consultancy Servicespune, maharashtra, in
    Desired Competencies (Technical / Behavioral Competency).Should have expertise in creating data warehouses in AWS utilizing the following tools : EC2, S3, EMR, Athena, Sagemaker, Aurora and Snowflake....Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Saras Analyticspune, maharashtra, in
    We are an ecommerce focused end to end data analytics firm assisting enterprises & brands in data driven decision making to maximize business value. Our suite of work spans extraction, transformatio...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Azure Databricks Engineer

    Senior Azure Databricks Engineer

    Newscape ConsultingPune, Maharashtra, India
    We’re Hiring : Senior Databricks Engineer / Azure Data Engineer / Lead Data engineer.Immediate Joiners / Notice Period ≤ 15 Days. Only local Pune candidates may apply.L2 interviews will be conducted....Show moreLast updated: 1 day ago
    • Promoted
    Senior Data Platform Engineer

    Senior Data Platform Engineer

    Persistent SystemsPune, India
    We are seeking a Senior Platform Engineer to architect, build, and manage enterprise-scale data platforms that power advanced analytics and AI initiatives. This role blends cloud engineering, DevOps...Show moreLast updated: 26 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AIPune, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Futran Solutionspune, maharashtra, in
    We are seeking a highly skilled and experienced Senior Data Engineer with a strong background in Microsoft Azure data platforms. The ideal candidate will have a proven track record of designing, imp...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Tata Consultancy ServicesPune, Maharashtra, India
    TCS is hiring for AWS Data engineer, please find the below JD.Experience range – 6 to 8 years.Location - Hyderabad / Pune / Indore. Skills Required - AWS, Pyspark, EMR, Glue.AMI Rehydration, Cloud for...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Persistent SystemsPune, Maharashtra, India
    We are looking for an experienced Azure Databricks and Snowflake Data Engineer to lead and execute complex user migrations from legacy systems to modern cloud-based solutions.This role involves col...Show moreLast updated: 28 days ago
    • Promoted
    Senior Databricks Engineer

    Senior Databricks Engineer

    Newscape ConsultingPune, Maharashtra, India
    About the Role We are seeking a Senior Databricks Engineer to design, develop, and optimize scalable data pipelines and analytics solutions on the Databricks platform. The ideal candidate will be a...Show moreLast updated: 7 days ago
    • Promoted
    Senior Data Engineer - Snowflake / AWS

    Senior Data Engineer - Snowflake / AWS

    ResourcetreePune
    About the Role : A "Senior Data Engineer" is mid-level professional leading the design, build and evolution of the inhouse data platforms.You lead the const...Show moreLast updated: 30+ days ago