Talent.com
Lead Data Engineer
Lead Data EngineerConfidential • mangalore, India
No longer accepting applications
Lead Data Engineer

Lead Data Engineer

Confidential • mangalore, India
4 days ago
Job description

Skillset Required

  • 7+ years of experience in software development, with a strong foundation in distributed systems, cloud-native architectures, and data platforms.
  • Expertise in big data technologies such as Apache Spark and real-time streaming technologies like Apache Kafka.
  • Strong programming skills in Python, Java, C++, SQL etc.
  • Advanced knowledge of a major cloud platform (AWS, Azure, GCP) and its ecosystem of data services.
  • Proficiency with Infrastructure as Code (IaC) tools like Terraform or AWS CloudFormation.
  • Strong understanding of advanced data modeling techniques and modern data warehouses.
  • Ability to design scalable, fault-tolerant, and maintainable distributed systems.
  • Excellent communication and stakeholder management skills.

What You’ll Do

  • Design, build, deploy, and own complete, scalable, and reliable data platforms and solutions.
  • Lead the technical design of new data pipelines, services, and systems.
  • Build reusable frameworks, libraries, and data management tools to improve productivity.
  • Optimize performance and cost-efficiency of data workflows and compute layers.
  • Collaborate with stakeholders such as data scientists, business analysts, and product managers to understand and translate business requirements into technical solutions.
  • Provide technical leadership and mentorship to junior engineers.
  • Ensure the uptime, reliability, and monitoring of the systems you build and own.
  • Create a job alert for this search

    Lead Data Engineer • mangalore, India

    Related jobs
    Data Engineer

    Data Engineer

    TerraGiG • Mangalore, IN
    Lead the design, development, and implementation of data solutions using AWS and Snowflake.Collaborate with cross-functional teams to understand business requirements and translate them into techni...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Vriba Solutions • Mangalore, IN
    AWS, Snowflake, Kafka, Airflow, GitHub, PySpark, Python.Design, develop, and maintain scalable ETL / ELT pipelines.Ingest data from various sources (APIs, databases, files, etc.Implement both real-ti...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Tata Consultancy Services • Mangalore, IN
    TCS has been a great pioneer in feeding the fire of Techies like you.We are a global leader in the technology arena and there’s nothing that can stop us from growing together.Your role is of key im...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AI • Mangalore, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show more
    Last updated: 30+ days ago • Promoted
    Customer Engineer (Data Engineer)

    Customer Engineer (Data Engineer)

    Konecta • Mangalore, IN
    In this role, you will be the technical point of contact for the customer – a trusted partner for their IT leadership – as the primary engineer on the project, working with multifunctional teams bo...Show more
    Last updated: 16 days ago • Promoted
    Data Engineer

    Data Engineer

    BayOne Solutions • Mangalore, IN
    We are seeking a highly experienced Data Engineer to join our MarTech team and play a pivotal role in driving innovation within our microservices architecture, with a strong emphasis on data engine...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Donyati • Mangalore, IN
    We are seeking a highly skilled Senior Data Engineer to join our team in building a modern data platform on AWS.You will play a key role in transitioning from legacy systems to a scalable, cloud-na...Show more
    Last updated: 21 days ago • Promoted
    Senior / Lead AWS Data Engineer (Remote)

    Senior / Lead AWS Data Engineer (Remote)

    Mindcraft Labs • Mangalore, IN
    Remote
    This role leads the design and scaling of a modern data platform on AWS.You will own the end-to-end data architecture across services like S3, Glue, Redshift, Athena, Lake Formation, SNS / SQS, Airfl...Show more
    Last updated: 1 hour ago • Promoted • New!
    Data Engineer

    Data Engineer

    Senovo IT Ltd • Mangalore, IN
    GST registration required! B2B contract.Design, implement, and manage large-scale cloud infrastructure on.Ensure cloud environments follow best practices for. Automate deployment, configuration, and...Show more
    Last updated: 1 hour ago • Promoted • New!
    Data Engineer – Databricks + GCP (5+ yrs)

    Data Engineer – Databricks + GCP (5+ yrs)

    MindBrain • Mangalore, IN
    Data Engineer – Databricks + GCP (5+ yrs ).Skills : PySpark, Databricks, Delta Lake, SQL.Design, build, and maintain robust. ACID-compliant data storage, versioning, and data retention.Ingest data fr...Show more
    Last updated: 1 hour ago • Promoted • New!
    Senior Data Engineer (Databricks + GCP)

    Senior Data Engineer (Databricks + GCP)

    MindBrain • Mangalore, IN
    Job Title : Data Engineer (Databricks + GCP).We are looking for a Data Engineer with strong experience in Databricks and Google Cloud Platform (GCP) to design, build, and optimize scalable data pipe...Show more
    Last updated: 1 hour ago • Promoted • New!
    Data Engineer

    Data Engineer

    Randstad Enterprise • Mangalore, IN
    Shift Timing : 2 : 00 Pm - 11 : 00 Pm.Experience : 2- 4 years relevant Experience only ( this is a Junior position with us ). GCP - 2 years minimum working Experience.Worked with global stakeholders.Ran...Show more
    Last updated: 30+ days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Ironbook AI • Mangalore, IN
    The ideal candidate will have strong experience with cloud platforms, modern ETL / ELT tools, and deep technical skills in Python, SQL, and distributed data frameworks. Design, develop, and maintain s...Show more
    Last updated: 5 days ago • Promoted
    Data Engineer

    Data Engineer

    EXL • Mangalore, IN
    The person will be part of the EDP Data Platform (EDP) team for a major Insurance client.He / She will work with different stakeholders for architecting & Building EDP application platform to suppor...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer

    Data Engineer

    Mandéva HR Shared Services • Mangalore, IN
    We are looking for a highly motivated Junior Dev Cloud Engineer.The ideal candidate will have strong hands-on experience in Java 17+, Apache Beam, and Airflow / Cloud Composer, with exposure to GCP B...Show more
    Last updated: 17 hours ago • Promoted • New!
    Data Engineer

    Data Engineer

    IntraEdge • Mangalore, IN
    We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team. You will be responsible for building scalable and reli...Show more
    Last updated: 30+ days ago • Promoted
    Data Engineer / Data Modeler

    Data Engineer / Data Modeler

    Salt • Mangalore, IN
    I am looking for Data Engineers to work on a short 10 week contract for one of my clients in Abu Dhabi.This role is fully remote and may extend beyond the end of the contract.Job Title – Data Engin...Show more
    Last updated: 18 hours ago • Promoted • New!
    Data Engineer

    Data Engineer

    ShimentoX Technologies • Mangalore, IN
    Data Engineer (Strong with Building data connectors).Key Skills : Python, Data Connectors, Metadata, API Integration-Rest / GraphQL. Must have proven background in building data connectors.Experience s...Show more
    Last updated: 6 days ago • Promoted