Talent.com
Senior Data Engineer - AWS Glue - Full Remote - Contractor in USD
Senior Data Engineer - AWS Glue - Full Remote - Contractor in USDAll European Careers • belgaum, karnataka, in
No longer accepting applications
Senior Data Engineer - AWS Glue - Full Remote - Contractor in USD

Senior Data Engineer - AWS Glue - Full Remote - Contractor in USD

All European Careers • belgaum, karnataka, in
20 days ago
Job type
  • Remote
Job description

For an international organization in Geneva, Switzerland, we are urgently looking for a Full Remote Senior Data Engineer. The Senior Data Engineer is responsible for the implementation of the set of automated ETL pipelines, implementation of the analytics of the platform operations and importing new data sources and its maintenance. The Analytics Data Platform is a cloud-native application deployed on AWS through CloudFormation templates

using the following resources : Glue, S3, Lambda, Step Function, Airflow, Athena, RDS, Redshift, and Lake Formation.

Candidates need to be willing to work normal office hours in Switzerland. This positions is long-term.

Tasks and Responsibilities :

  • Refactor, develop, maintain the web analytics ETL pipeline

Use data pipeline jobs to extract data from various sources including on premise relational databases, APIs,

Use data pipeline jobs to curate extracted raw data

Use data pipeline jobs to apply transformation based on reporting needs

Data source connectors to ingest the data from various data sources

Write the spark SQLs to produce the datasets

Monitor, troubleshoot and remediate the above jobs

  • Data Modelling
  • Maintenance of the existing data models in the data lake and data warehouse

    Design & Implement data models for new data sources as required

  • Refactor, maintain the CloudFormation templates and CDK as per the CICD guidelines / requirements
  • Other ad hoc deliverables required by the project
  • Profile :

  • University degree in computer science, engineering or other related discipline;
  • 5 years of experience as Data Engineer;
  • Hands-on experience writing code for AWS Glue in python with PySpark and Spark SQL;
  • Relational databases such as PostgreSQL (preferably AWS Redshift) with expertise in SQL, query optimization;
  • Serverless Query Service, preferably AWS Athena;
  • Experience in implementing an end to end cloud native Data warehouse platform - data modelling;
  • ETL, data integration and data migration, preferably related to AWS Redshift;
  • Expertise in SQL, query optimization;
  • Experience in implementing data integration from different sources;
  • Experience with AWS IaC (CloudFormation & CDK) and CICD pipelines;
  • Experience in Python programming and using PySpark for distributed computing in AWS Cloud;
  • Experience in working with ERP applications such as PeopleSoft is an added advantage;
  • Development of Reports / Dashboards using Tableau is an added advantage;
  • Fluent in English;
  • Create a job alert for this search

    Senior Data Engineer • belgaum, karnataka, in

    Related jobs
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AI • Belgaum, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SGS & Co • belagavi, karnataka, in
    Position Title : Senior Data Engineer.Experience Required : 8 to 12 Years.We are looking for a highly skilled and experienced Data Engineer with strong expertise in. The ideal candidate will play a ke...Show more
    Last updated: 20 days ago • Promoted
    Senior AWS Data Engineer_Exp : 5+ Years

    Senior AWS Data Engineer_Exp : 5+ Years

    Atyeti Inc • belagavi, karnataka, in
    Required Skills & Qualifications.Bachelor’s or Master’s degree in Computer Science or equivalent experience.Application Developer or in similar software engineering roles.Python; strong SQL and clo...Show more
    Last updated: 20 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Mindlance • Belgaum, IN
    We’re looking for a strong, hands-on Sr Data Engineer who can independently drive client conversations, collaborate with SMEs, and deliver high-quality data solutions in a cloud-native environment....Show more
    Last updated: 4 days ago • Promoted
    Senior Data Engineer - Data Acquisition

    Senior Data Engineer - Data Acquisition

    InfoBeans • Belgaum, IN
    We are seeking a highly skilled.Senior Data Engineer – Data Acquisition (ODS).The ideal candidate will have extensive hands-on experience in building and optimizing data ingestion and transformatio...Show more
    Last updated: 13 days ago • Promoted
    AWS Cloud Engineer

    AWS Cloud Engineer

    Proglite • Belgaum, IN
    Infrastructure & System Administration : .Deploy, manage, and optimize EC2 instances across dev, test, and production environments. Perform system administration and troubleshooting for Linux and Wind...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    MyData Insights Pvt Ltd • Belgaum, IN
    The ideal candidate has a strong background in building scalable data solutions on.CI / CD pipelines, infrastructure automation using Terraform, and cloud-native data engineering practices.Design, bu...Show more
    Last updated: 4 days ago • Promoted
    Data Engineer

    Data Engineer

    Insight Global • Belgaum, IN
    GCP DATA ENGINEER - Contract (Long term).Data Engineer with hands-on support for Google Looker.Strong experience in data modeling and building data marts. Proficiency in ETL / ELT pipeline development...Show more
    Last updated: 30+ days ago • Promoted
    Senior Snowflake Data Engineer

    Senior Snowflake Data Engineer

    Luxoft • belagavi, karnataka, in
    We are seeking a highly skilled Snowflake Data Engineer with 7 years of IT experience to design, build, and optimize scalable data pipelines and cloud-based solutions across AWS, Azure, and GCP.The...Show more
    Last updated: 6 hours ago • Promoted • New!
    AWS Data Engineer

    AWS Data Engineer

    People Prime Worldwide • belagavi, karnataka, in
    Data Engineer (L4) – Python & AWS.We are looking for a Senior Data Engineer with strong expertise in.You will design and build scalable data pipelines, manage cloud-based data platforms, ensure dat...Show more
    Last updated: 6 hours ago • Promoted • New!
    (Senior) Azure Data Engineer - Full remote - contractor in USD

    (Senior) Azure Data Engineer - Full remote - contractor in USD

    All European Careers • Belgaum, IN
    Remote
    For an international project in Chennai, we are urgently looking for a Full Remote Senior Azure Data Engineer, who will build data pipeline for enterprise search applications using ADF and Databric...Show more
    Last updated: 6 days ago • Promoted
    Data Engineer

    Data Engineer

    IntraEdge • Belgaum, IN
    Python, PySpark, AWS services (Glue, Lambda), and Snowflake.The ideal candidate will design, build, and maintain scalable data pipelines, ensure efficient data integration, and enable advanced anal...Show more
    Last updated: 30+ days ago • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Tata Consultancy Services • belgaum, karnataka, in
    Aws data engineer having strong experience of Python.Technical / Behavioral Competency.Proficient in Python, with experience in deploying Python packages and OOP, Experience in ingesting data from di...Show more
    Last updated: 29 days ago • Promoted
    AWS Data Architect

    AWS Data Architect

    ACL Digital • Belgaum, IN
    Environment review, architecture diagrams.AWS (S3, Redshift, Glue, Lake Formation, IAM).Proficient in data modeling, performance tuning, and security best practices. AWS Certified Solutions Archite...Show more
    Last updated: 11 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    DataOrbit AI • Belgaum, IN
    DataOrbit AI is a leading AI consulting firm dedicated to empowering small and medium investment managers to achieve AI readiness. By uniting strategy, data preparation, technology, and execution, w...Show more
    Last updated: 1 day ago • Promoted
    Databricks Engineer

    Databricks Engineer

    DataE2E Technologies • Belgaum, IN
    We are looking for an experienced.The ideal candidate has hands-on experience in Databricks production environments, along with. You will collaborate with cross-functional teams to create robust dat...Show more
    Last updated: 30+ days ago • Promoted
    AWS Data Engineer

    AWS Data Engineer

    Vista Applied Solutions Group Inc • Belgaum, IN
    Job Summary for AWS Data Engineer : .Job Qualification and Responsibilities for AWS Data Engineer : .Advanced SQL (performance tuning, joins, windows functions). Hands-on with AWS : Glue, Lambda, Redshif...Show more
    Last updated: 6 days ago • Promoted
    AWS Engineer

    AWS Engineer

    Spryc Systems • Belgaum, IN
    We are seeking an experienced AWS Engineer to design, implement, and maintain AWS infrastructure and services in a managed service environment. The ideal candidate will possess deep expertise in AWS...Show more
    Last updated: 20 days ago • Promoted