Talent.com
lead Data Engineer

lead Data Engineer

CozzeraHyderabad, IN
1 day ago
Job description

Job Title : Lead Data Engineer

Experience : 8–10 Years

Location : Remote ( 1 week from noida office then remote)

Job Overview :

We are looking for an accomplished Lead Data Engineer with 8–10 years of experience in

architecting, building, and managing complex data ecosystems using Python, Databricks

(Delta Lake, Spark, MLflow), and modern orchestration frameworks. The candidate should

possess strong leadership and technical acumen to drive data strategy, pipeline

optimization, and AI / ML workflow automation across large-scale projects.

The role involves architecting scalable data solutions, ensuring data governance and

compliance (HIPAA, SOC 2, GDPR), and mentoring data engineering teams to deliver high

performance solutions in healthcare or life sciences domains.

Key Responsibilities :

  • Lead the architecture, design, and implementation of scalable and reliable data

solutions using Databricks, Delta Lake, and Spark.

  • Oversee the development and optimization of ETL / ELT pipelines using Python and
  • modern orchestration tools (Airflow, Prefect, Dagster).

  • Drive data platform modernization and migration to cloud-native architectures
  • (AWS, Azure, or GCP).

  • Collaborate with Data Scientists, Analysts, and Architects to enable advanced
  • analytics and ML model deployment using MLflow.

  • Establish and enforce data engineering standards, best practices, and code reviews
  • across teams.

  • Ensure data governance, lineage, and compliance with regulatory frameworks
  • (HIPAA, SOC 2, GDPR).

  • Manage performance tuning, cost optimization, and scalability planning for data
  • workflows.

  • Mentor and guide junior data engineers, fostering a culture of technical excellence.
  • Partner with stakeholders to align business objectives with data strategy and delivery
  • roadmap.

    Technical Skills Required :

  • Languages : Python, SQL, PySpark
  • Data Platforms : Databricks, Delta Lake, MLflow, Apache Spark
  • Workflow Orchestration : Airflow, Prefect, Dagster
  • Cloud Platforms : AWS, Azure, or GCP (with focus on data services)
  • Data Architecture : Data Lakes, Warehouses, and Streaming Architectures
  • DevOps & Version Control : Git, Jenkins, Terraform, CI / CD pipelines
  • Governance & Security : HIPAA, SOC 2, GDPR compliance expertise
  • Nice to Have : Knowledge of Kafka, dbt, and Infrastructure-as-Code (IaC) tools
  • Soft Skills :

  • Proven leadership and mentorship capabilities
  • Excellent communication and client interaction skills
  • Strategic mindset with strong analytical and problem-solving ability
  • Ability to manage multiple projects and distributed teams in Agile environments
  • Education :

  • Bachelor’s or Master’s degree in Computer Science, Data Engineering, or related field
  • Chances of Closure

    Yes

    Create a job alert for this search

    Lead Data Engineer • Hyderabad, IN

    Related jobs
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Searce IncHyderabad, IN
    Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’.It signifies our way of working : To improve to the finest degree of excellence, ‘solving for better’ every time.Searcians...Show moreLast updated: 22 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Saras AnalyticsHyderabad, Telangana, India
    We are an ecommerce focused end to end data analytics firm assisting enterprises & brands in data driven decision making to maximize business value. Our suite of work spans extraction, transformatio...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    AnblicksHyderabad, Telangana, India
    Location : Hyderabad or Ahmedabad.Skills : Snowflake, Python / Pyspark, SQL.Only Immediate to 15 Days joiners apply.Lead the end-to-end Snowflake platform implementation, including architecture, design...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Response Informaticssecunderabad, India
    AWS services : Must be proficient in building scalable data pipelines and managing cloud-native ETL workflows.Snowflake : Moderate understanding of Snowflake architecture. CICD - Terraform or CloudFo...Show moreLast updated: 5 days ago
    • Promoted
    Senior / Lead Data Engineer

    Senior / Lead Data Engineer

    People Prime WorldwideHyderabad, Telangana, India
    Job Details : Role : Senior & lead Data Engineer Experience : 6-12 Years Location : Hyderabad Interview Mode : F2F Notice Period Preference : Immediate to 30 Days Senior & Lead Data Enginee...Show moreLast updated: 8 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    ITQube LTDsecunderabad, telangana, in
    Looking for a Data Engineer to join our engineering will contribute directly to the design, automation, and optimization of our data processes, primarily developing solutions in Python within the A...Show moreLast updated: 22 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Prudent Technologies and Consulting, Inc.Hyderabad, Telangana, India
    Job Summary : Seeking an experienced Senior Data Engineer with over 9 years of industry experience to architect, build, and manage advanced data pipelines and platforms in a cloud environment.The id...Show moreLast updated: 21 days ago
    • Promoted
    • New!
    ▷ Urgent : Data Engineer

    ▷ Urgent : Data Engineer

    Prudent Technologies and Consulting, Inc.Hyderabad, Telangana, India
    Job Summary : Seeking an experienced Senior Data Engineer with over 9 years of industry experience to architect, build, and manage advanced data pipelines and platforms in a cloud environment.The i...Show moreLast updated: 2 hours ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    EverestDX IncHyderabad, Telangana, India
    Everest DX – We are a Digital Platform Services company, headquartered in Stamford.Our Platform / Solution includes Orchestration, Intelligent operations with BOTs’, AI-powered analytics for Enterpri...Show moreLast updated: 21 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    People Prime WorldwideHyderabad, Telangana, India
    Specializing in Oracle Cloud, automation, data intelligence, and enterprise consulting, they help businesses modernize their systems and accelerate innovation at scale. Microsoft Azure data ecosyste...Show moreLast updated: 8 days ago
    • Promoted
    • New!
    Lead Data Engineer GCP

    Lead Data Engineer GCP

    EgenHyderabad, Telangana, India
    We are looking for a skilled and motivated Lead Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our data engineering team.The ideal candidate will...Show moreLast updated: 12 hours ago
    • Promoted
    Lead / Staff Data Engineer

    Lead / Staff Data Engineer

    ConfidentialHyderabad / Secunderabad, Telangana
    Data Engineering at the Heart of AI Marketing.Marketing AI / ML Algorithms and Applications.Salesforce s marketing organization, directly influencing how we . Drive state-of-the-art ML solutions.Work ...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Lead Engineer

    Lead Engineer

    People Prime WorldwideHyderabad, Telangana, India
    Our client is a trusted global innovator of IT and business services, present in 50+ countries.They specialize in digital & IT modernization, consulting, managed services, and industry-specific sol...Show moreLast updated: 18 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    Veraxionhyderabad, India
    Python, Spark, DBT, and AWS-native services.Agile environment to deliver scalable, secure, and high-performance data solutions. Python, DBT, and AWS services (Data Ops Live).Deliver end-to-end data ...Show moreLast updated: 1 day ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    9NEXUShyderabad, telangana, in
    Job Title : Azure Data Engineer.We are seeking an experienced Azure Data Engineer to design, develop, and optimize scalable data solutions in a cloud environment. The role involves building high-perf...Show moreLast updated: 1 day ago
    • Promoted
    Lead Data engineer

    Lead Data engineer

    ConfidentialHyderabad / Secunderabad, Telangana, Pune, Chennai
    A minimum of 6+ years of experience in data modeling, data warehousing, and building ETL pipelines.Strong experience in ETL platforms like Informatica ETL, Powercenter, IICS, or similar tools.Deep ...Show moreLast updated: 12 days ago
    • Promoted
    Data Lead Engineer

    Data Lead Engineer

    ConfidentialHyderabad / Secunderabad, Telangana
    Expertise in Large-Scale Modernization programs in the Data domain.Experience in responding to RFPs and crafting winning proposals. Proven ability to create end-to-end architecture solutions in Data...Show moreLast updated: 30+ days ago
    • Promoted
    Tech Lead - Data Engineer

    Tech Lead - Data Engineer

    RecroHyderabad, Telangana, India
    Data Engineering and Analytics team.The ideal candidate will be responsible for configuring, deploying, and maintaining Quantexa software on leading cloud platforms while leveraging their expertise...Show moreLast updated: 3 days ago