Talent.com
Lead Data Engineer With Aws
Lead Data Engineer With AwsPeople Prime Worldwide • Baddi, Republic Of India, IN
No longer accepting applications
Lead Data Engineer With Aws

Lead Data Engineer With Aws

People Prime Worldwide • Baddi, Republic Of India, IN
23 hours ago
Job description

Senior Data Engineer- (Python & AWS (Simplified JD)

Experience : 7–16 years

Location : Hyderabad

Job Summary

We are looking for a Senior Data Engineer who can build, maintain, and optimize large-scale data systems using AWS and Python . You will design data pipelines, ensure data quality, automate workflows, and support analytics / AI teams. The role needs strong technical expertise and leadership.

Key Responsibilities (Simplified)

  • Build and manage scalable data pipelines using AWS Glue, Lambda, EMR, Step Functions, Redshift.
  • Create and optimize data lakes and data warehouses on AWS (S3, Redshift, Athena).
  • Develop ETL / ELT processes using Python (pandas, PySpark).
  • Integrate data from various sources like RDBMS, APIs, Kafka / Kinesis.
  • Design efficient data models and schemas.
  • Ensure data quality, monitoring, and lineage using AWS tools.
  • Implement data governance, security, and compliance (IAM, encryption).
  • Work with Data Science, Analytics, Product, and DevOps teams.
  • Set up CI / CD for data pipelines.
  • Mentor junior engineers and review their code.
  • Monitor system performance and handle troubleshooting.

Required Skills

  • Bachelor’s / Master’s degree in Computer Science or related field.
  • 5–10 years of experience in data engineering.
  • Strong Python skills (pandas, PySpark, boto3, SQLAlchemy).
  • Expertise with AWS services : Glue, Lambda, EMR, Step Functions, Redshift, Athena, S3, Kinesis, DynamoDB.
  • Strong SQL and data modeling skills.
  • Experience building data lakes, warehouses, and streaming solutions.
  • Knowledge of ETL best practices.
  • Experience with Git and CI / CD pipelines.
  • Understanding of Docker / Kubernetes and DevOps concepts.
  • Good communication and problem-solving skills.
  • Nice-to-Have Skills

  • Spark / PySpark on EMR or Glue.
  • Airflow, dbt, or Dagster.
  • Kafka / Kinesis streaming.
  • AWS Lake Formation, Glue Studio, DataBrew.
  • SageMaker or QuickSight integration.
  • AWS Certifications (optional)
  • Create a job alert for this search

    Data Engineer Aws • Baddi, Republic Of India, IN

    Related jobs
    Data Engineer

    Data Engineer

    Arete Healthtech Pvt. Ltd. • baddi, India
    We are looking for a skilled and detail-oriented.In this role, you will work closely with cross-functional teams to build scalable data pipelines, manage large datasets, and ensure the reliability ...Show more
    Last updated: 21 hours ago • Promoted • New!
    AI Data Engineer

    AI Data Engineer

    People Prime Worldwide • baddi, India
    Specializing in Oracle Cloud, automation, data intelligence, and enterprise consulting, they help businesses modernize their systems and accelerate innovation at scale. We are seeking a highly skill...Show more
    Last updated: 15 hours ago • Promoted • New!
    Senior Data Engineer

    Senior Data Engineer

    Zeza Technologies • baddi, India
    Zeza is a vibrant team of programmers, data engineers, and data scientists passionate about innovation.We specialize in using data to drive business growth, solve complex challenges, and optimize o...Show more
    Last updated: 21 hours ago • Promoted • New!
    Data Engineer

    Data Engineer

    MRF • baddi, India
    Azure / SQL / Application - Data Engineer.Responsible to maintain the data required for managed application like Advanced Planning System, Dealer Management System, etc. Responsible for user access mana...Show more
    Last updated: 21 hours ago • Promoted • New!
    Big Data Engineer

    Big Data Engineer

    K&K Talents - India • baddi, India
    This position is with one of our.Title : Big Data Engineer (Scala & Spark).Required Experience : 8 Years and above.We are seeking a highly skilled. Azure cloud, Big Data technologies, and distributed ...Show more
    Last updated: 21 hours ago • Promoted • New!
    AWS Data Engineer

    AWS Data Engineer

    9NEXUS • baddi, India
    Job Title : Senior AWS Data Engineer.We are seeking a Senior AWS Data Engineer to design, build, and optimize large-scale data pipelines and analytics solutions using AWS services and Databricks.The...Show more
    Last updated: 3 hours ago • Promoted • New!
    Senior Data Engineer

    Senior Data Engineer

    Sonatype • baddi, India
    Sonatype is the software supply chain security company.We provide the world’s best end-to-end software supply chain security solution, combining the only proactive protection against malicious open...Show more
    Last updated: 3 hours ago • Promoted • New!
    Data Engineer (SQL | Python | Databricks | Power BI - Optional)

    Data Engineer (SQL | Python | Databricks | Power BI - Optional)

    The Datalytix Solutions • baddi, India
    The Datalytix Solutions is a modern data and analytics consulting company specializing in data engineering, BI, and cloud-based lakehouse architectures. We work with international clients across ind...Show more
    Last updated: 15 hours ago • Promoted • New!
    Data Engineer

    Data Engineer

    TerraGiG • baddi, India
    Lead the design, development, and implementation of data solutions using AWS and Snowflake.Collaborate with cross-functional teams to understand business requirements and translate them into techni...Show more
    Last updated: 1 day ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    CXC • baddi, India
    Please apply only if you are available to work in Australian time zone and comfortable with 6 months contract duration • •. We’re seeking a highly skilled and autonomous.Power BI implementations to jo...Show more
    Last updated: 1 day ago • Promoted
    SAP BW / 4HANA Engineer

    SAP BW / 4HANA Engineer

    Yoda Tech • baddi, India
    We are seeking a highly skilled.ABAP expertise to design, build, and optimize enterprise-grade data warehousing and analytics solutions. This role is hands-on and requires deep technical proficiency...Show more
    Last updated: 15 days ago • Promoted
    Azure Data Engineer (BI Expertise)

    Azure Data Engineer (BI Expertise)

    Seosaph-infotech • baddi, India
    We are seeking a highly skilled.Business Intelligence (BI) expertise.The ideal candidate will have strong hands-on development skills, experience in. BI solution design, data modeling, and the abili...Show more
    Last updated: 21 hours ago • Promoted • New!
    Senior Data Engineer - GCP

    Senior Data Engineer - GCP

    AuxoAI • baddi, India
    AuxoAI is seeking a Senior Data Engineer to lead the design, development, and optimization of modern data pipelines and cloud-native platforms using Google Cloud Platform (GCP).This role is ideal f...Show more
    Last updated: 15 hours ago • Promoted • New!
    Senior Data Engineer

    Senior Data Engineer

    Talentgigs • baddi, India
    Senior Data Engineer -GCP, SQL, Architect, Data Modeller.GCP, SQL, Architect, Data Modeller.Technical role 7+ Years Experience. Specific Contribution : We are looking for an experienced Senior Data E...Show more
    Last updated: 19 hours ago • Promoted • New!
    Databricks Lead

    Databricks Lead

    Mastech Digital • baddi, India
    Immediate joiner / Serving notice with less than 60 days / Notice is less than 60 days.We are looking for a highly skilled. The ideal candidate will lead teams in designing, building, and optimizing sc...Show more
    Last updated: 15 hours ago • Promoted • New!
    GCP Data Engineer

    GCP Data Engineer

    RB Consultancy Services • baddi, India
    Location : TCS - Chennai, Hyderabad, Bangalore, Pune, Delhi.Develops and maintain scalable data pipelines using GCP cloud Infrastructure. Work closely with Client Business teams to help build complex...Show more
    Last updated: 3 hours ago • Promoted • New!
    Data AI Engineer

    Data AI Engineer

    Verdantas • baddi, India
    Join Verdantas – A Top #ENR 81 Firm!.Your duties will include but are not limited to the following : .Architect and develop AI-powered agents using low-code platforms (e. Power Platform) and pro-code ...Show more
    Last updated: 15 hours ago • Promoted • New!
    Senior Databricks Data Engineer

    Senior Databricks Data Engineer

    Squash Apps • baddi, India
    Squash Apps is a top-rated full-stack consulting company dedicated to building the next generation of scalable and robust web applications for visionary clients. We specialize in modern technologies...Show more
    Last updated: 21 hours ago • Promoted • New!