Talent.com
This job offer is not available in your country.
Lead Data Engineer

Lead Data Engineer

ITQube LTDnavi mumbai, maharashtra, in
18 hours ago
Job description
  • Looking for a Data Engineer to join our engineering will contribute directly to the design, automation, and optimization of our data processes, primarily developing solutions in Python within the AWS cloud ecosystem, including Lambda, Glue, Redshift, and other key services.
  • The role also involves working with infrastructure as code (Terraform), Git-based version control, and designing scalable data architectures. The ideal candidate has solid data engineering knowledge, a passion for automation, experience working with large volumes of data, and the ability to proactively propose technical and architectural improvements. Responsibilities :
  • Design, develop, and maintain efficient ETL processes using Python, SQL, AWS Glue, and Redshift.
  • Automate data flows and integrations using AWS Lambda and other serverless services. Propose improvements and optimizations to existing pipelines, prioritizing performance, scalability, and maintainability.
  • Collaborate on the design of scalable and resilient data architectures in AWS.
  • Develop and manage infrastructure as code using Terraform.
  • Actively participate in code reviews and collaborative version control workflows using Git.
  • Document technical solutions and promote best practices in data engineering.
  • Ensure that data processing pipelines can handle large-scale datasets (Big Data). Who we’re looking for : Technical Requirements :
  • Programming Languages : Python – 3+ years of experience (Intermediate to advanced level) o SQL – 3+ years of experience, capable of working with complex data models
  • Large-scale data processing :
  • Experience with PySpark or Big Data environments – 1–2+ years (preferred)
  • Familiarity with distributed processing and performance optimization for high-volume data pipelines
  • AWS Technologies : Lambda, Glue, Redshift, S3 – 2–3 years of hands-on experience
  • Experience designing ETL workflows using native AWS services
  • Proactive mindset with a drive to propose and implement improvements
  • Analytical thinker with the ability to identify bottlenecks and performance issues.
  • Effective collaborator with both technical teams and non-technical stakeholders
  • Strong documentation and technical communication skills Nice to have (not mandatory) :
  • Experience with monitoring and observability tools for data pipelines (CloudWatch, logging, alerting), Knowledge of event-driven architecture design
  • Familiarity with orchestration tools like Apache
  • Experience with automated testing for data pipelines
  • Background in Fintech or experience handling financial datasets
    • Create a job alert for this search

    Lead Data Engineer • navi mumbai, maharashtra, in

    Related jobs
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    DeltacubesMumbai, IN
    Build and maintain scalable ETL / ELT pipelines.Work with Snowflake and BigQuery for data storage.Implement orchestration with Airflow or Prefect. Integrate data workflows with Python.Optimize data pi...Show moreLast updated: 20 days ago
    • Promoted
    Data Engineer Team Lead

    Data Engineer Team Lead

    SGIdombivli, maharashtra, in
    To be discussed based on your skills and experience.Strong hands-on data engineering experience with a proven ability to design, build, and optimize scalable data pipelines in .Deep technical exper...Show moreLast updated: 11 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Kanerika Incdombivli, maharashtra, in
    Databricks, Microsoft Fabric, or Snowflake.You will also play a key role in enabling effective data visualization and reporting for business stakeholders. Databricks, Fabric, or Snowflake.Power BI d...Show moreLast updated: 24 days ago
    • Promoted
    Data Engineer

    Data Engineer

    INFEC Servicesmumbai city, maharashtra, in
    Design, develop, and optimize data pipelines and ETL processes on GCP or Azure.Work with structured and unstructured data, integrating sources such as databases, APIs, and streaming platforms.Imple...Show moreLast updated: 9 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    InfogainKalyan-Dombivli, IN
    Big Data Engineer (Lead) : As a Big Data Engineer (Lead), you will be responsible for leading a team of big data engineers. You will work closely with clients and team members to understand their req...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Eucloid Data SolutionsThane, IN
    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 13 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    eClerxMumbai, Maharashtra, India
    Job Title : Senior Data Engineering Lead (Databricks).If this role excites you and matches your expertise, kindly fill out the Google Form with the required details so we can reach out to you and ma...Show moreLast updated: 22 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Insight GlobalMumbai, IN
    Notice Period : This is a ASAP hire - only apply if you can start 2 weeks after offer is extended!.Priority scheduling for candidates who message on with resume. Design, develop, and maintain robust...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    CareerXperts ConsultingMumbai, IN
    We are looking for a highly skilled.The ideal candidate will have strong expertise in modern data engineering tools and frameworks, along with the ability to collaborate closely with data scientist...Show moreLast updated: 20 hours ago
    • Promoted
    • New!
    Lead Data Engineer

    Lead Data Engineer

    ITQube LTDmumbai, maharashtra, in
    Looking for a Data Engineer to join our engineering will contribute directly to the design, automation, and optimization of our data processes, primarily developing solutions in Python within the A...Show moreLast updated: 18 hours ago
    • Promoted
    • New!
    Lead Data Engineer

    Lead Data Engineer

    Searce IncKalyan-Dombivli, IN
    Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’.It signifies our way of working : To improve to the finest degree of excellence, ‘solving for better’ every time.Searcians...Show moreLast updated: 14 hours ago
    • Promoted
    GenAI Lead Engineer (Investment Data Platforms)

    GenAI Lead Engineer (Investment Data Platforms)

    Vichara Technologiesthane, maharashtra, in
    We are seeking a highly skilled.This role will also involve leading a cross-functional team of.Machine Learning Engineers and UI Developers. Develop custom frameworks using.Optimize LLM usage for in...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Media.netMumbai, Maharashtra, India
    Our proprietary contextual technology is at the forefront of enhancing Programmatic buying, the latest industry standard in ad buying for digital platforms. HQ is based in New York, and the Global H...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Senior / Lead Data Engineer

    Senior / Lead Data Engineer

    Eucloid Data SolutionsThane, IN
    Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which ma...Show moreLast updated: 20 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    Kline + CompanyKalyan-Dombivli, IN
    Here at Kline our data capabilities have grown exponentially over the last four years.Having gone through a rapid digitization process and becoming a cloud-native corporation, we are looking for to...Show moreLast updated: 5 days ago
    • Promoted
    Data Engineer

    Data Engineer

    EveriseMumbai, IN
    Join us on our mission to elevate customer experiences for people around the world.As a member of the Everise family, you will be part of a global experience company that believes in being people-f...Show moreLast updated: 11 days ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    Confidential JobsThane, IN
    This role involves collaborating with cross-functional teams to ensure data reliability, scalability, and performance.The candidate will work closely with data scientists, analysts and software eng...Show moreLast updated: 20 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    ACL Digitaldombivli, maharashtra, in
    Design, develop, and optimize Spark-based data pipelines on Databricks for large-scale data processing.Design, develop, and optimize AWS pipeline as applicable. Implement and manage GitHub asset bun...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Kumaran Systemsdombivli, maharashtra, in
    Strong hands-on experience in Databricks.Proven expertise in building and managing data ingestion pipelines.Exposure to Databricks data ingestion jobs along with incident management frameworks.Expe...Show moreLast updated: 12 days ago
    • Promoted
    Data Engineer

    Data Engineer

    VAANTECHthane, maharashtra, in
    Immediate Joiner (or within 15 days).Includes Night Shifts (US Shift).Preferred Candidates : From Chennai.Data Pipeline Optimization & Tuning. Hadoop Infra / Cloud Platforms.Lead and mentor a team of...Show moreLast updated: 30+ days ago