Talent.com
Senior Data Engineer - AWS Glue - Full Remote - Contractor in USD

Senior Data Engineer - AWS Glue - Full Remote - Contractor in USD

All European Careersludhiana, punjab, in
16 hours ago
Job type
  • Remote
Job description

For an international organization in Geneva, Switzerland, we are urgently looking for a Full Remote Senior Data Engineer. The Senior Data Engineer is responsible for the implementation of the set of automated ETL pipelines, implementation of the analytics of the platform operations and importing new data sources and its maintenance. The Analytics Data Platform is a cloud-native application deployed on AWS through CloudFormation templates

using the following resources : Glue, S3, Lambda, Step Function, Airflow, Athena, RDS, Redshift, and Lake Formation.

Candidates need to be willing to work normal office hours in Switzerland. This positions is long-term.

Tasks and Responsibilities :

  • Refactor, develop, maintain the web analytics ETL pipeline

Use data pipeline jobs to extract data from various sources including on premise relational databases, APIs,

Use data pipeline jobs to curate extracted raw data

Use data pipeline jobs to apply transformation based on reporting needs

Data source connectors to ingest the data from various data sources

Write the spark SQLs to produce the datasets

Monitor, troubleshoot and remediate the above jobs

  • Data Modelling
  • Maintenance of the existing data models in the data lake and data warehouse

    Design & Implement data models for new data sources as required

  • Refactor, maintain the CloudFormation templates and CDK as per the CICD guidelines / requirements
  • Other ad hoc deliverables required by the project
  • Profile :

  • University degree in computer science, engineering or other related discipline;
  • 5 years of experience as Data Engineer;
  • Hands-on experience writing code for AWS Glue in python with PySpark and Spark SQL;
  • Relational databases such as PostgreSQL (preferably AWS Redshift) with expertise in SQL, query optimization;
  • Serverless Query Service, preferably AWS Athena;
  • Experience in implementing an end to end cloud native Data warehouse platform - data modelling;
  • ETL, data integration and data migration, preferably related to AWS Redshift;
  • Expertise in SQL, query optimization;
  • Experience in implementing data integration from different sources;
  • Experience with AWS IaC (CloudFormation & CDK) and CICD pipelines;
  • Experience in Python programming and using PySpark for distributed computing in AWS Cloud;
  • Experience in working with ERP applications such as PeopleSoft is an added advantage;
  • Development of Reports / Dashboards using Tableau is an added advantage;
  • Fluent in English;
  • Create a job alert for this search

    Senior Data Engineer • ludhiana, punjab, in

    Related jobs
    • Promoted
    Senior Data Engineer (AWS / Databricks)

    Senior Data Engineer (AWS / Databricks)

    Accoladeludhiana, punjab, in
    The multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront.We are building the industry's first AI-native Operations Centralization Platform, desi...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Response Informaticsludhiana, punjab, in
    We’re Hiring | Data Engineering Experts (Hyderabad / Remote).We’re looking for passionate and experienced.Data Engineering professionals. If you love building scalable data pipelines, optimizing clo...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Straiveludhiana, punjab, in
    The ideal candidate is a strong software engineer with hands-on experience in Spark (3.You'll be responsible for designing and implementing ETL / ELT solutions, collaborating with teams to deliver da...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    VeraxionLudhiana, Punjab, India
    We’re looking for a Data Engineer to design, build, and scale modern data platforms on AWS.You’ll work with Python, Spark, DBT, and AWS-native services in an Agile environment to deliver sca...Show moreLast updated: 11 days ago
    • Promoted
    AWS Cloud Engineer

    AWS Cloud Engineer

    Progliteludhiana, punjab, in
    Infrastructure & System Administration : .Deploy, manage, and optimize EC2 instances across dev, test, and production environments. Perform system administration and troubleshooting for Linux and Wind...Show moreLast updated: 30+ days ago
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    TerraGiGludhiana, punjab, in
    Design, development, and implementation of performant ETL pipelines using python API (pySpark) of Apache Spark on AWS EMR. Writing reusable, testable, and efficient code.Integration of data storage ...Show moreLast updated: 11 days ago
    • Promoted
    Senior AI Engineer

    Senior AI Engineer

    Kanerika Includhiana, punjab, in
    We are seeking an experienced Senior AI Engineer with 3+years of experience to join our dynamic team, driving innovation in AI-driven solutions with a global impact. This role is specifically tailor...Show moreLast updated: 30+ days ago
    • Promoted
    Azure Cloud Data Engineer

    Azure Cloud Data Engineer

    Intelebeeludhiana, punjab, in
    Data Factory, Synapse, and Databricks.Python, PySpark, and Advanced SQL.Lakehouse / Medallion architecture.Customer Interaction & Technical Documentation. Interact with clients and business stakehol...Show moreLast updated: 14 days ago
    • Promoted
    Senior Azure Data Engineer

    Senior Azure Data Engineer

    Programmers.ioludhiana, punjab, in
    Job Title : Senior Azure Data Engineer.Skills Required : Azure Synapse, Azure Data Factory, Azure Databricks, and ADLS Gen2, PySpark, SQL,Microsoft Fabrics. Experience Range : 5 Years - 12 years.We are...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Recroludhiana, punjab, in
    Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement : Collaborate wi...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Saransh Includhiana, punjab, in
    Data Engineer (Contract-to-Hire | Remote).Full-Time / Fixed-Term Contract (12 months, extendable based on performance).We are seeking a highly skilled. The ideal candidate will be hands-on, detail-o...Show moreLast updated: 22 days ago
    • Promoted
    • New!
    Cloud Engineer

    Cloud Engineer

    Gunpowder Innovationsludhiana, punjab, in
    Gunpowder Innovations is a technology-first company building high-performance applications in fintech and health tech.Our engineering team is passionate about solving complex problems at scale, del...Show moreLast updated: 16 hours ago
    • Promoted
    Data Engineer(Azure / AWS, Python / Pyspark, SQL)

    Data Engineer(Azure / AWS, Python / Pyspark, SQL)

    Sail Analyticsludhiana, India
    Architect, develop, test and maintain scalable data warehouses and data pipelines.Expertise in SQL, PySpark / Python and Azure(ADB, ADF) or AWS(Glue, Lambda, Redshift). Bachelor's degree or equivalent...Show moreLast updated: 15 days ago
    • Promoted
    Data Engineer(Azure / AWS, Python / Pyspark, SQL)

    Data Engineer(Azure / AWS, Python / Pyspark, SQL)

    Sail Analyticsludhiana, punjab, in
    Architect, develop, test and maintain scalable data warehouses and data pipelines.Expertise in SQL, PySpark / Python and Azure(ADB, ADF) or AWS(Glue, Lambda, Redshift). Bachelor's degree or equivalent...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AIludhiana, punjab, in
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago
    • Promoted
    Sr Azure Data Engineer - Remote work

    Sr Azure Data Engineer - Remote work

    techolutionludhiana, punjab, in
    Remote
    The ideal candidate will have a strong foundation in.Work Timings : 5 : 00 PM to 2 : 00 AM IST.If your expertise is primarily in. Lead the migration of large-scale SQL workloads from on-premise environme...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    HealthyMe AIludhiana, punjab, in
    We are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data.You will report to the Head of AI and Engineering and be responsible for designi...Show moreLast updated: 30+ days ago
    • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Tata Consultancy ServicesLudhiana, Punjab, India
    TCS has always been in the spotlight for being adept in the next big technologies.What we can offer you is a space to explore varied technologies and quench your techie soul.Role : Data Engineer Req...Show moreLast updated: 8 days ago