Talent.com
Lead Data Pipeline Engineer
Lead Data Pipeline EngineerPeople Tech Group Inc • Hyderabad, Republic Of India, IN
No longer accepting applications
Lead Data Pipeline Engineer

Lead Data Pipeline Engineer

People Tech Group Inc • Hyderabad, Republic Of India, IN
30+ days ago
Job description

Job Title : Data Engineer

Location : Hyderabad

Experience : 5+Years (Work from Office)

Job Summary :

We are looking for a skilled and experienced Data Engineer with over 5 years of experience in data engineering and data migration projects. The ideal candidate should possess strong expertise in SQL, Python, data modeling, data warehousing, and ETL pipeline development. Experience with big data tools like Hadoop and Spark, along with AWS services such as Redshift, S3, Glue, EMR, and Lambda, is essential. This role provides an excellent opportunity to work on large-scale data solutions, enabling data-driven decision-making and operational excellence.

Key Responsibilities :

  • Design, build, and maintain scalable data pipelines and ETL processes.
  • Develop and optimize data models and data warehouse architectures.
  • Implement and manage big data technologies and cloud-based data solutions.
  • Perform data migration, data transformation, and integration from multiple sources.
  • Collaborate with data scientists, analysts, and business teams to understand data needs and deliver solutions.
  • Ensure data quality, consistency, and security across all data pipelines and storage systems.
  • Optimize performance and manage cost-efficient AWS cloud resources.

Basic Qualifications :

  • Master's degree in Computer Science, Engineering, Analytics, Mathematics, Statistics, IT, or equivalent.
  • 5+ years of experience in Data Engineering and data migration projects.
  • Proficient in SQL and Python for data processing and analysis.
  • Strong experience in data modeling, data warehousing, and building data pipelines.
  • Hands-on experience with big data technologies like Hadoop, Spark, etc.
  • Expertise in AWS services including Redshift, S3, AWS Glue, EMR, Kinesis, Firehose, Lambda, and IAM.
  • Understanding of ETL development best practices and principles.
  • Preferred Qualifications :

  • Knowledge of data security and data privacy best practices.
  • Experience with DevOps and CI / CD practices related to data workflows.
  • Familiarity with data lake architectures and real-time data streaming.
  • Strong problem-solving abilities and attention to detail.
  • Excellent verbal and written communication skills.
  • Ability to work independently and in a team-oriented environment.
  • Good to Have :

  • Experience with orchestration tools like Airflow or Step Functions.
  • Exposure to BI / Visualization tools like QuickSight, Tableau, or Power BI.
  • Understanding of data governance and compliance standards.
  • Create a job alert for this search

    Data Pipeline Engineer • Hyderabad, Republic Of India, IN

    Related jobs
    Lead Data Pipeline Engineer

    Lead Data Pipeline Engineer

    Multiscale Technologies India • Hyderabad, Republic Of India, IN
    Data Engineer, Forward Deployed Applications.Location : Hyderabad, India (on-site at client location).Role Type : Individual Contributor. We are hiring a Data Engineer to build reliable data pipelines...Show more
    Last updated: 21 days ago • Promoted
    AI Engineer (Data Pipelines & RAG)

    AI Engineer (Data Pipelines & RAG)

    BeGig • Hyderabad, IN
    Job Role- AI Engineer (Data Pipelines & RAG).Work Mode- Remote(6 days working).We are looking for a hands-on AI / Data Engineer (4–7 years) to build and scale data pipelines powering GenAI and agenti...Show more
    Last updated: 11 days ago • Promoted
    Cloud Data Pipeline Engineer

    Cloud Data Pipeline Engineer

    RapidBrains • Hyderabad, Republic Of India, IN
    Design, develop, and optimize large-scale data analytics and data warehouse solutions using Azure Data Factory and Azure Databricks. Build and maintain data lake architectures to process multi-forma...Show more
    Last updated: 1 day ago • Promoted
    Data Pipeline Engineer

    Data Pipeline Engineer

    HCLTech • Hyderabad, Republic Of India, IN
    Data Engineer - Databricks Job Description.The Data Engineer - Databricks will be responsible for building and optimizing our data pipelines, architectures, and data sets.He will work closely with ...Show more
    Last updated: 17 days ago • Promoted
    Lead Data Pipeline Architect

    Lead Data Pipeline Architect

    EXL • Hyderabad, Republic Of India, IN
    AWS (S3, Redshift, Glue, EMR, Lambda, Kinesis, Athena).Collaborate with data scientists, analysts, and stakeholders to deliver reliable and scalable data solutions. Ensure high availability, scalabi...Show more
    Last updated: 17 days ago • Promoted
    Lead Data Pipeline Engineer

    Lead Data Pipeline Engineer

    Saras Analytics • Hyderabad, Republic Of India, IN
    We are an ecommerce focused end to end data analytics firm assisting enterprises & brands in data driven decision making to maximize business value. Our suite of work spans extraction, transformatio...Show more
    Last updated: 30+ days ago • Promoted
    Data Pipeline Engineer

    Data Pipeline Engineer

    Luxoft • Hyderabad, Republic Of India, IN
    This project is part of a strategic initiative to migrate legacy on-premises data systems to a modern, scalable cloud-based data platform using Snowflake on Azure. The goal is to enhance data access...Show more
    Last updated: 3 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Accordion India • Hyderabad, Telangana, India
    Accordion is a global private equity-focused financial consulting firm specializing in driving value creation through services rooted in Data & Analytics and powered by technology.Accordion works a...Show more
    Last updated: 21 days ago • Promoted
    Data Engineer Lead

    Data Engineer Lead

    JRD Systems • Hyderabad, Telangana, India
    The ideal candidate will have a strong background in.Databricks, Azure Data Factory, Alteryx, Ab Initio, Talend, and Informatica. This role will lead the design and delivery of.Databricks (PySpark, ...Show more
    Last updated: 9 days ago • Promoted
    Principal Data Pipeline Engineer

    Principal Data Pipeline Engineer

    EverestDX Inc • Hyderabad, Republic Of India, IN
    Everest DX – We are a Digital Platform Services company, headquartered in Stamford.Our Platform / Solution includes Orchestration, Intelligent operations with BOTs’, AI-powered analytics for Enterpri...Show more
    Last updated: 11 days ago • Promoted
    Databricks Data Engineer Lead – Sustainability Project

    Databricks Data Engineer Lead – Sustainability Project

    Blue Cloud Softech Solutions Limited • Hyderabad, IN
    BCSS is seeking a Databricks Data Engineer to support its enterprise-wide Sustainability initiative.The engineer will be responsible for building data pipelines and models to support product-level ...Show more
    Last updated: 10 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    nexocean • Hyderabad, India
    We are excited to announce an opening for Lead Data Engineer !.SQL, Python, Snowflake, ADF, ETL, Data Pipeline.Work closely with Product owners / managers to understand the business needs.Collaborate...Show more
    Last updated: 13 hours ago • Promoted • New!
    Lead Data Pipeline Engineer

    Lead Data Pipeline Engineer

    Straive • Hyderabad, Republic Of India, IN
    The ideal candidate is a strong software engineer with hands-on experience in Spark (3.You'll be responsible for designing and implementing ETL / ELT solutions, collaborating with teams to deliver da...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Pipeline Engineer

    Senior Data Pipeline Engineer

    Creditsafe Technology • Hyderabad, Republic Of India, IN
    With the largest owned database supported by a partner network, Creditsafe provides data on 320 million companies in over 100 countries to support its customers in this regard.Creditsafe is scaling...Show more
    Last updated: 4 hours ago • Promoted • New!
    Data Pipeline Engineer

    Data Pipeline Engineer

    Travel & Payments • Hyderabad, Republic Of India, IN
    At Yuno, we are building the payment infrastructure that enables all companies to participate in the global market.Founded by a team of seasoned experts in the payments and IT industries, Yuno prov...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Pipeline Engineer

    Senior Data Pipeline Engineer

    nexocean • Hyderabad, Republic Of India, IN
    We are excited to announce an opening for Lead Data Engineer !.SQL, Python, Snowflake, ADF, ETL, Data Pipeline.Work closely with Product owners / managers to understand the business needs.Collaborate...Show more
    Last updated: 1 day ago • Promoted
    Data Pipeline Engineer

    Data Pipeline Engineer

    People Prime Worldwide • Hyderabad, Republic Of India, IN
    Our client is a global technology company headquartered in Santa Clara, California.OT) and more than 60 years in IT to unlock the power of data from your business, your people and your machines.We ...Show more
    Last updated: 30+ days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    ValueMomentum • Hyderabad, Telangana, India
    Primary skills : Databricks, PySpark, SQL.Secondary skills : Advanced SQL, Azure Data Factory, and Azure Data Lake.About the Job We are seeking a Tech Lead –. Databricks Data Engineer with experience ...Show more
    Last updated: 1 day ago • Promoted