Talent.com
Lead Data Pipeline Engineer

Lead Data Pipeline Engineer

People Tech Group IncHyderabad, Republic Of India, IN
30+ days ago
Job description

Job Title : Data Engineer

Location : Hyderabad

Experience : 5+Years (Work from Office)

Job Summary :

We are looking for a skilled and experienced Data Engineer with over 5 years of experience in data engineering and data migration projects. The ideal candidate should possess strong expertise in SQL, Python, data modeling, data warehousing, and ETL pipeline development. Experience with big data tools like Hadoop and Spark, along with AWS services such as Redshift, S3, Glue, EMR, and Lambda, is essential. This role provides an excellent opportunity to work on large-scale data solutions, enabling data-driven decision-making and operational excellence.

Key Responsibilities :

  • Design, build, and maintain scalable data pipelines and ETL processes.
  • Develop and optimize data models and data warehouse architectures.
  • Implement and manage big data technologies and cloud-based data solutions.
  • Perform data migration, data transformation, and integration from multiple sources.
  • Collaborate with data scientists, analysts, and business teams to understand data needs and deliver solutions.
  • Ensure data quality, consistency, and security across all data pipelines and storage systems.
  • Optimize performance and manage cost-efficient AWS cloud resources.

Basic Qualifications :

  • Master's degree in Computer Science, Engineering, Analytics, Mathematics, Statistics, IT, or equivalent.
  • 5+ years of experience in Data Engineering and data migration projects.
  • Proficient in SQL and Python for data processing and analysis.
  • Strong experience in data modeling, data warehousing, and building data pipelines.
  • Hands-on experience with big data technologies like Hadoop, Spark, etc.
  • Expertise in AWS services including Redshift, S3, AWS Glue, EMR, Kinesis, Firehose, Lambda, and IAM.
  • Understanding of ETL development best practices and principles.
  • Preferred Qualifications :

  • Knowledge of data security and data privacy best practices.
  • Experience with DevOps and CI / CD practices related to data workflows.
  • Familiarity with data lake architectures and real-time data streaming.
  • Strong problem-solving abilities and attention to detail.
  • Excellent verbal and written communication skills.
  • Ability to work independently and in a team-oriented environment.
  • Good to Have :

  • Experience with orchestration tools like Airflow or Step Functions.
  • Exposure to BI / Visualization tools like QuickSight, Tableau, or Power BI.
  • Understanding of data governance and compliance standards.
  • Create a job alert for this search

    Data Pipeline Engineer • Hyderabad, Republic Of India, IN

    Related jobs
    • Promoted
    Tech Lead - Data Engineer

    Tech Lead - Data Engineer

    Recrohyderabad, telangana, in
    Data Engineering and Analytics team.The ideal candidate will be responsible for configuring, deploying, and maintaining Quantexa software on leading cloud platforms while leveraging their expertise...Show moreLast updated: 13 days ago
    • Promoted
    Data Pipeline Engineer

    Data Pipeline Engineer

    ValueLabsHyderabad, Republic Of India, IN
    We are seeking a talented Data Engineer to join our dynamic team at ValueLabs.As a Data Engineer, you will be responsible for designing, developing, and maintaining scalable data pipelines that sup...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    EverestDX Inchyderabad, telangana, in
    Everest DX – We are a Digital Platform Services company, headquartered in Stamford.Our Platform / Solution includes Orchestration, Intelligent operations with BOTs’, AI-powered analytics for Enterpri...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Saras Analyticshyderabad, telangana, in
    We are an ecommerce focused end to end data analytics firm assisting enterprises & brands in data driven decision making to maximize business value. Our suite of work spans extraction, transformatio...Show moreLast updated: 30+ days ago
    • Promoted
    Data Pipeline Engineer

    Data Pipeline Engineer

    Integrated Personnel Services LimitedHyderabad, Republic Of India, IN
    Design, develop, and maintain scalable.Work closely with business stakeholders, analysts, and data scientists to understand data requirements and deliver reliable solutions.Optimize ETL workflows f...Show moreLast updated: 13 days ago
    • Promoted
    • New!
    Lead Data Engineer

    Lead Data Engineer

    Cimpresshyderabad, telangana, in
    Our Team : Enterprise Business Solutions.Vista’s Enterprise Business Solutions (EBS) domain is working to make our company one of the most data-driven organizations to support Finance, Supply Chain,...Show moreLast updated: 22 hours ago
    • Promoted
    Lead Data Pipeline Engineer

    Lead Data Pipeline Engineer

    ValueLabsHyderabad, Republic Of India, IN
    We are seeking a Data Engineer with strong expertise in Data Engineering—including data modeling, ETL pipeline development, data governance, and Data Build Tool (DBT)—along with proficiency in Pyth...Show moreLast updated: 22 days ago
    • Promoted
    Data Pipeline Engineer

    Data Pipeline Engineer

    OptumHyderabad, Republic Of India, IN
    Support the full data engineering lifecycle including research, proof of concepts, design, development, testing, deployment, and maintenance of data management solutions. Utilize knowledge of variou...Show moreLast updated: 22 days ago
    • Promoted
    Lead Data Pipeline Engineer

    Lead Data Pipeline Engineer

    EXLHyderabad, Republic Of India, IN
    The role involves building and optimizing ETL / ELT workflows, managing big data environments, and ensuring seamless data availability for analytics, AI / ML, and business intelligence use cases.AWS (S...Show moreLast updated: 30+ days ago
    • Promoted
    Data Pipeline Engineer

    Data Pipeline Engineer

    TMUS Global SolutionsHyderabad, Republic Of India, IN
    NASDAQ : TMUS), headquartered in Bellevue, Washington, is America’s supercharged Un-carrier, connecting millions through its strong nationwide network and flagship brands, T-Mobile and Metro by T-Mo...Show moreLast updated: 26 days ago
    • Promoted
    Lead Data Pipeline Engineer

    Lead Data Pipeline Engineer

    SID Information TechnologiesHyderabad, Republic Of India, IN
    Role : Senior Data Engineer (Python, Spark / Databricks, SQL, AWS).Hybrid (3 days / week in-office).S3, Glue, Redshift, EMR, Lambda. Strong SQL skills for data transformation and analytics.Expertise in s...Show moreLast updated: 30+ days ago
    • Promoted
    Backend and Data Pipeline Engineer

    Backend and Data Pipeline Engineer

    JRD SystemsHyderabad, IN
    Job Role : Backend and Data Pipeline Engineer - Python.We’re investing in technology to develop new products that help our customers drive their growth and transformation agenda.These include new da...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Response InformaticsHyderabad, Telangana, India
    AWS services : Must be proficient in building scalable data pipelines and managing cloud-native ETL workflows.Snowflake : Moderate understanding of Snowflake architecture. CICD - Terraform or CloudFo...Show moreLast updated: 21 days ago
    • Promoted
    Lead Data Pipeline Engineer

    Lead Data Pipeline Engineer

    StraiveHyderabad, Republic Of India, IN
    The ideal candidate is a strong software engineer with hands-on experience in Spark (3.You'll be responsible for designing and implementing ETL / ELT solutions, collaborating with teams to deliver da...Show moreLast updated: 30+ days ago
    • Promoted
    Data Pipeline Architect

    Data Pipeline Architect

    Prudent Technologies and Consulting, Inc.Hyderabad, Republic Of India, IN
    Seeking an experienced Senior Data Engineer with over 9 years of industry experience to architect, build, and manage advanced data pipelines and platforms in a cloud environment.The ideal candidate...Show moreLast updated: 30+ days ago
    • Promoted
    AWS Data Pipeline Engineer

    AWS Data Pipeline Engineer

    Tata Consultancy ServicesHyderabad, Republic Of India, IN
    Snowflake, dbt, Snowpipe, AWS services : AWS Lambda, Managed Airflow (MWAA),.Interview Date : Weekend InPerson Drive 18-Oct-25. Experience Range : 10 to 15 yrs.Location of Requirement- Hyderabad.Follow...Show moreLast updated: 22 days ago
    • Promoted
    Data Pipeline Engineer

    Data Pipeline Engineer

    ExperianHyderabad, Republic Of India, IN
    Experian Consumer Services – Careers That Define “What’s the Next Big (Data) Thing” for Consumers?.What could be more exciting – personally and professionally – than being part of a “disruptive” bu...Show moreLast updated: 23 hours ago
    • Promoted
    Data Pipeline Engineer

    Data Pipeline Engineer

    Tata Consultancy ServicesHyderabad, Republic Of India, IN
    Greetings from TATA Consultancy Services.Chennai / Pune / Bangalore / Hyd / Delhi.Pls find the Job Description below.Should be able to develop big data solution recommendations and ensure implementation of...Show moreLast updated: 30+ days ago