Talent.com
This job offer is not available in your country.
Lead Data Engineer

Lead Data Engineer

Targetbangalore, India
20 hours ago
Job description

Job Id : R

About us :

Working at Target means helping all families discover the joy of everyday life. We bring that vision to life through our values and culture.Learn more about Target here.

About the Role :

As a Lead Data Engineer , you will serve as the technical anchor for the engineering team, responsible for designing and developing scalable, high-performance data solutions . You will own and drive data architecture that supports both functional and non-functional business needs, ensuring reliability, efficiency, and scalability .

Your expertise in big data technologies, distributed systems, and cloud platforms will help shape the engineering roadmap and best practices for data processing, analytics, and real-time data serving . You will play a key role in architecting and optimizing data pipelines using Hadoop, Spark, Scala / Java, and cloud technologies to support enterprise-wide data initiatives.

Additionally, experience with API development for serving low-latency data and Customer Data Platforms (CDP) will be a strong plus.

Key Responsibilities :

  • Architect and build scalable, high-performance data pipelines and distributed data processing solutions using Hadoop, Spark, Scala / Java, and cloud platforms (AWS / GCP / Azure) .
  • Design and implement real-time and batch data processing solutions , ensuring data is efficiently processed and made available for analytical and operational use.
  • Develop APIs and data services to expose low-latency, high-throughput data for downstream applications, enabling real-time decision-making.
  • Optimize and enhance data models, workflows, and processing frameworks to improve performance, scalability, and cost-efficiency.
  • Drive data governance, security, and compliance best practices.
  • Collaborate with data scientists, product teams, and business stakeholders to understand requirements and deliver data-driven solutions .
  • Lead the design, implementation, and lifecycle management of data services and solutions.
  • Stay up to date with emerging technologies and drive adoption of best practices in big data engineering, cloud computing, and API development .
  • Provide technical leadership and mentorship to engineering teams, promoting best practices in data engineering and API design .

About You :

  • 7+ years of experience in data engineering, software development, or distributed systems.
  • Expertise in big data technologies such as Hadoop, Spark, and distributed processing frameworks.
  • Strong programming skills in Scala and / or Java (Python is a plus).
  • Experience with cloud platforms (AWS, GCP, or Azure) and their data ecosystem (e.g., S3, BigQuery, Databricks, EMR, Snowflake, etc.).
  • Proficiency in API development using REST, GraphQL, or gRPC to serve real-time and batch data.
  • Experience with real-time and streaming data architectures (Kafka, Flink, Kinesis, etc.).
  • Strong knowledge of data modeling, ETL pipeline design, and performance optimization .
  • Understanding of data governance, security, and compliance in large-scale data environments.
  • Experience with Customer Data Platforms (CDP) or customer-centric data processing is a strong plus.
  • Strong problem-solving skills and ability to work in complex, unstructured environments .
  • Excellent communication and collaboration skills, with experience working in cross-functional teams .
  • Why Join Us?

  • Work with cutting-edge big data, API, and cloud technologies in a fast-paced, collaborative environment.
  • Influence and shape the future of data architecture and real-time data services at Target.
  • Solve high-impact business problems using scalable, low-latency data solutions .
  • Be part of a culture that values innovation, learning, and growth .
  • Create a job alert for this search

    Lead Data Engineer • bangalore, India

    Related jobs
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    IGT Solutionshosur, tamil nadu, in
    Primary Skills : Advanced SQL Server, ETL development using SSIS, Azure Data Factory, and Databricks, Power BI, Data warehousing, Data quality and validation, General Microsoft technology stack.We a...Show moreLast updated: 26 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Aceolutionhosur, tamil nadu, in
    We are looking for a freelancer to engage with us for 20-40 hours per week.Kindly find the JD below for your reference.Design, develop, and maintain scalable data pipelines and workflows.Work exten...Show moreLast updated: 9 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    CoffeeBeansBengaluru, Karnataka, India
    Founded in the year 2017, CoffeeBeans specialises in offering high end consulting services in technology, product, and processes. We help our clients attain significant improvement in quality of del...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer [T500-20510]

    Lead Data Engineer [T500-20510]

    ANSRBengaluru, Karnataka, India
    ANSR is hiring for one of its clients.Martens is an iconic British brand founded in 1960 in Northamptonshire.Produced originally for workers looking for tough, durable boots, the brand was quickly ...Show moreLast updated: 9 days ago
    • Promoted
    Azure Data Engineer Lead

    Azure Data Engineer Lead

    Creative Synergies GroupBengaluru, Karnataka, India
    Creative Synergies Group Overview.Creative is a leading Global Technology Services firm delivering innovative solutions that build upon synergies between our Deep Engineering Domain Expertise and D...Show moreLast updated: 1 day ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    MakeMyTripBangalore Urban, Karnataka, India
    We at MakeMyTrip understand that every traveller is unique and being the leading OTA in India we have the leverage to redefine the travel booking experience to meet their need.If you love to travel...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Otomeyt AIhosur, tamil nadu, in
    We are seeking a highly skilled 7+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 19 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Kline + Companyhosur, tamil nadu, in
    Here at Kline our data capabilities have grown exponentially over the last four years.Having gone through a rapid digitization process and becoming a cloud-native corporation, we are looking for to...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    RevXhosur, tamil nadu, in
    RevX helps app businesses acquire and reengage users via programmatic to retain, monetize, and accelerate revenue.We're all about taking your app businesses to a new growth level.We rely on data sc...Show moreLast updated: 9 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Genisys GroupBengaluru, Karnataka, India
    Take ownership of pipeline stability and performance across our GCP-based stack (BigQuery, GCS, Dataprep / Dataflow).Lead the enhancement of our existing ETL workflows to support better modularity, r...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    ThinkWise Consulting LLPBengaluru, Karnataka, India
    We are seeking a Lead Data Engineer to serve as the technical lead for the team responsible for managing and engineering customer data. The ideal candidate will have a strong background in data engi...Show moreLast updated: 1 day ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Eucloid Data SolutionsBengaluru, IN
    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 9 days ago
    • Promoted
    Technical Lead - Data Engineer

    Technical Lead - Data Engineer

    Visara PartnersBengaluru, Karnataka, India
    Location : Bengaluru / Hyderabad.Databricks workflow & Unity catalog.Python programming & package builds.Hands-on experience in designing and building scalable data pipelines using Databricks with ...Show moreLast updated: 6 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Insight Globalhosur, tamil nadu, in
    Notice Period : This is a ASAP hire - only apply if you can start 2 weeks after offer is extended!.Priority scheduling for candidates who message on LinkedIn with resume. Design, develop, and maintai...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    VAANTECHhosur, tamil nadu, in
    Immediate Joiner (or within 15 days).Includes Night Shifts (US Shift).Preferred Candidates : From Chennai.Data Pipeline Optimization & Tuning. Hadoop Infra / Cloud Platforms.Lead and mentor a team of...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Azure Data Engineer

    Lead Azure Data Engineer

    RandomTreesBangalore, IN
    We’re a leading software company specializing in Artificial Intelligence, Machine Learning, Data Analytics, Innovative data solutions, Cloud-based technologies. If you're passionate about building r...Show moreLast updated: 27 days ago
    • Promoted
    Lead Generation Team Lead

    Lead Generation Team Lead

    MphasisBangalore Rural, Karnataka, India
    Job Title : Lead Generation Team Lead.We are seeking a dynamic and experienced.With 10 years of experience in the ITES sector, the ideal candidate will lead a team of analysts and specialists to dri...Show moreLast updated: 21 days ago
    • Promoted
    Data Engineer

    Data Engineer

    ACL Digitalhosur, tamil nadu, in
    Design, develop, and optimize Spark-based data pipelines on Databricks for large-scale data processing.Design, develop, and optimize AWS pipeline as applicable. Implement and manage GitHub asset bun...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Kumaran Systemshosur, tamil nadu, in
    Strong hands-on experience in Databricks.Proven expertise in building and managing data ingestion pipelines.Exposure to Databricks data ingestion jobs along with incident management frameworks.Expe...Show moreLast updated: 9 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Innodata Inc.hosur, tamil nadu, in
    CI / CD practices, Databricks (Spark), Python, Github and SQL.The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and...Show moreLast updated: 27 days ago