Talent.com
This job offer is not available in your country.
Data Engineer Supervisor / Manager

Data Engineer Supervisor / Manager

ConfidentialChennai
7 days ago
Job description

We are seeking an experienced Manager to lead a team responsible for the development and maintenance of our Connected Vehicle enterprise data and data products. The ideal candidate will have a strong technical background in data and / or software engineering, along with proven leadership and management skills. This role requires the ability to design and code streaming solutions, prioritize team tasks, make timely decisions, run results-focused meetings, and guide the team to deliver high-quality results. The leader must be knowledgeable in data governance, customer consent, and security standards.

Responsibilities :

  • Lead and mentor a high-performing team of local and remote engineers.
  • Prioritize team workload, allocate tasks effectively, and ensure team members have the resources to succeed.
  • Provide technical expertise and guidance to the team.
  • Evaluate and mentor adherence to coding standards, best practices, and architectural guidelines.
  • Oversee the design, development, maintenance, scalability, reliability, and performance of the connected vehicle data platform pipelines and architecture. Contribute to the long-term strategic direction of the Connected Vehicle Data Platform with a focus on enterprise use.
  • Communicate decisions effectively and transparently to internal and external customers.
  • Accurately and routinely track all prioritized work in JIRA to support both financial delivery tracking
  • Enforce and ensure data quality, data governance, and security standards.
  • Lead implementation and delivery of various business customers requests and logic into the data assets with optimized design and code development.
  • Identify and consolidate common tasks across teams to improve efficiency and reduce redundancy.
  • Stay updated on industry trends and emerging technologies to inform technical decisions.

Qualifications Required :

  • Bachelor's degree in computer science, Information Technology, Information Systems, or Data Analytics.
  • 5 years of progressive responsibilities in a complex streaming data environment.
  • 5+ years' experience leading a software / data engineering team.
  • 5+ years of experience in Big Data Environments or expertise with Big Data tools.
  • Expertise in Google Cloud Platform and Services for End-to-End Data Engineering
  • Expert knowledge and hands on experience in DevOps and SDLC.
  • Monitor and optimize cost and compute for processes in GCP technologies (e.g., BigQuery, Dataflow, Cloud Run, DataProc).
  • Manage and scale serverless applications and clusters, optimizing resource utilization, and implementing monitoring and logging strategies.
  • Expertise in streaming technologies (Kafka, Pub / Sub) and OpenShift, managing high-throughput topics, message ordering, and ensuring data consistency and durability.
  • Even better you may have :

  • Expertise in other public cloud environments : Amazon Web Services, Microsoft Azure, etc.
  • Hands on experience on AI Engineering
  • Skills Required

    Devops, data engineering , Gcp, Kafka, DataFlow, Aws

    Create a job alert for this search

    Data Engineer • Chennai

    Related jobs
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Eucloid Data SolutionsChennai, Tamil Nadu, India
    Eucloid is looking for a skilled Data Engineer to join our team and contribute to the design, development, and optimization of data frameworks pipelines using Python, Elasticsearch, SQL DB and Queu...Show moreLast updated: 7 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    DeltacubesChennai, IN
    Build and maintain scalable ETL / ELT pipelines.Work with Snowflake and BigQuery for data storage.Implement orchestration with Airflow or Prefect. Integrate data workflows with Python.Optimize data pi...Show moreLast updated: 15 days ago
    • Promoted
    Data Engineer

    Data Engineer

    ImpetusChennai, Tamil Nadu, India
    Bigdata, Pyspark, Python ,Hadoop / HDFS; Spark;.Develops and maintains scalable data pipelines to support continuing increases in data volume and complexity. Collaborates with analytics and business...Show moreLast updated: 23 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Eucloid Data SolutionsChennai, IN
    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 7 days ago
    • Promoted
    Data Engineer

    Data Engineer

    EXLChennai, Tamil Nadu, India
    Collaborate with project stakeholders (client) to identify product and technical requirements.Develop, implement, and tune large-scale distributed systems and pipelines that process large volume of...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    InfogainChennai, IN
    Big Data Engineer (Lead) : As a Big Data Engineer (Lead), you will be responsible for leading a team of big data engineers. You will work closely with clients and team members to understand their req...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Cynosure Corporate SolutionsChennai
    Key Responsibilities : - Design, develop, and maintain robust data pipelines to enable seamless data flow into Snowflake and other storage ...Show moreLast updated: 24 days ago
    • Promoted
    Data Engineer Lead

    Data Engineer Lead

    Ashley Global Capability CenterChennai, Tamil Nadu, India
    Bachelor's or master’s degree in Computer Science, Mathematics, or related field.Years of experience in developing technology solutions, integrating, or creating AI and machine learning models.Know...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Big Data Engineer

    Senior Big Data Engineer

    VeltrisChennai, IN
    Veltris is a Digital Product Engineering Services partner committed to driving technology-enabled transformation across enterprises, businesses, and industries. We specialize in delivering next-gene...Show moreLast updated: 14 days ago
    • Promoted
    Data Engineer

    Data Engineer

    ACL Digitalchennai, tamil nadu, in
    Design, develop, and optimize Spark-based data pipelines on Databricks for large-scale data processing.Design, develop, and optimize AWS pipeline as applicable. Implement and manage GitHub asset bun...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Insight GlobalChennai, IN
    Notice Period : This is a ASAP hire - only apply if you can start 2 weeks after offer is extended!.Priority scheduling for candidates who message on with resume. Design, develop, and maintain robust...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Tata Consultancy ServicesChennai, Tamil Nadu, India
    Greetings from TCS Human Resources Team!!!.Skill : Snowflake Data Engineer.Required Technical Skill Set : Snowflake, dbt, FiveTran, Snowpipe, AWS services : Managed Airflow (MWAA), S3, Lambda.Minimum ...Show moreLast updated: 26 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Kumaran SystemsChennai, IN
    Strong hands-on experience in Databricks.Proven expertise in building and managing data ingestion pipelines.Exposure to Databricks data ingestion jobs along with incident management frameworks.Expe...Show moreLast updated: 7 days ago
    • Promoted
    Data Engineer

    Data Engineer

    INFEC Serviceschennai, tamil nadu, in
    Design, develop, and optimize data pipelines and ETL processes on GCP or Azure.Work with structured and unstructured data, integrating sources such as databases, APIs, and streaming platforms.Imple...Show moreLast updated: 4 days ago
    • Promoted
    Data Engineer

    Data Engineer

    VAANTECHChennai, Tamil Nadu, India
    Immediate Joiner (or within 15 days).Includes Night Shifts (US Shift).Preferred Candidates : From Chennai.Data Pipeline Optimization & Tuning. Hadoop Infra / Cloud Platforms.Lead and mentor a team of...Show moreLast updated: 28 days ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgeChennai, IN
    Snowflake, AWS (Lambda, Glue), DBT, and SQL.The ideal candidate will be responsible for enabling seamless data integration, transformation, and analytics to support business intelligence and advanc...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Bahwan CyberTekChennai, IN
    Job Title : Data Engineer – Google Cloud Platform (GCP).We are seeking a skilled and motivated Data Engineer with hands-on experience in building scalable data pipelines and cloud-native data soluti...Show moreLast updated: 17 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Kanerika Incchennai, tamil nadu, in
    Databricks, Microsoft Fabric, or Snowflake.You will also play a key role in enabling effective data visualization and reporting for business stakeholders. Databricks, Fabric, or Snowflake.Power BI d...Show moreLast updated: 19 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    CYGNVSChennai, Tamil Nadu, India
    We’re looking for Data Engineers on our Analytics Engineering team - you’ll collaborate with teams across the globe to build pipelines and systems to deliver data insights critical to our customers...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Tata Consultancy ServicesChennai, India
    Thanks for Applying with TCS for skill GCP Data Engineering.Experience on Tableau, Power BI, ETL processes and data engineering. SQL and experience with Looker / Look ML.Python or scripting for automa...Show moreLast updated: 30+ days ago