Talent.com
This job offer is not available in your country.
Data Engineer Supervisor

Data Engineer Supervisor

ConfidentialChennai
7 days ago
Job description

We are seeking an experienced Manager to lead a team responsible for the development and maintenance of our Connected Vehicle enterprise data and data products . The ideal candidate will possess a strong technical background in data and / or software engineering, coupled with proven leadership and management skills.

This role requires the ability to design and code streaming solutions, prioritize team tasks, make timely decisions, run results-focused meetings, and guide the team to deliver high-quality results. The successful leader must be knowledgeable in data governance, customer consent, and security standards.

Qualifications Required :

  • Bachelor's degree in Computer Science, Information Technology, Information Systems, or Data Analytics.
  • 5 years of progressive responsibilities in a complex streaming data environment.
  • 5+ years experience leading a software / data engineering team.
  • 5+ years of experience in Big Data Environments or expertise with Big Data tools.
  • Expertise in Google Cloud Platform and Services for End-to-End Data Engineering.
  • Expert knowledge and hands-on experience in DevOps and SDLC.
  • Ability to monitor and optimize cost and compute for processes in GCP technologies (e.g., BigQuery, Dataflow, Cloud Run, DataProc).
  • Experience managing and scaling serverless applications and clusters , optimizing resource utilization, and implementing monitoring and logging strategies.
  • Expertise in streaming technologies (Kafka, Pub / Sub) and OpenShift, managing high-throughput topics, message ordering, and ensuring data consistency and durability.

Even better you may have :

  • Expertise in other public cloud environments : Amazon Web Services, Microsoft Azure, etc.
  • Hands-on experience in AI Engineering.
  • Responsibilities :

  • Lead and mentor a high-performing team of local and remote engineers.
  • Prioritize team workload , effectively allocate tasks, and ensure team members have the necessary resources to succeed.
  • Provide technical expertise and guidance to the team; evaluate and mentor adherence to coding standards, best practices, and architectural guidelines.
  • Oversee the design, development, maintenance, scalability, reliability, and performance of the connected vehicle data platform pipelines and architecture.
  • Contribute to the long-term strategic direction of the Connected Vehicle Data Platform with a focus on enterprise use.
  • Communicate decisions effectively and transparently to internal and external customers.
  • Accurately and routinely track all prioritized work in JIRA to support financial delivery tracking.
  • Enforce and ensure data quality, data governance, and security standards.
  • Lead implementation and delivery of various business customer requests and logic into the data assets with optimized design and code development.
  • Identify and consolidate common tasks across teams to improve efficiency and reduce redundancy.
  • Stay updated on industry trends and emerging technologies to inform technical decisions.
  • Skills Required

    Architecture, Gcp, Cloud, Data Governance, Jira, Sdlc, data engineering

    Create a job alert for this search

    Data Engineer • Chennai

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    Otomeyt AIchennai, tamil nadu, in
    We are seeking a highly skilled 5+.The ideal candidate will have strong technical expertise in Azure, Data Engineering tools, and advanced ETL design along with excellent communication and problem-...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    DeltacubesChennai, IN
    Build and maintain scalable ETL / ELT pipelines.Work with Snowflake and BigQuery for data storage.Implement orchestration with Airflow or Prefect. Integrate data workflows with Python.Optimize data pi...Show moreLast updated: 15 days ago
    • Promoted
    Data Engineer

    Data Engineer

    MovateChennai, Tamil Nadu, India
    Location : Chennai / Bangalore / .Develop data mapping specifications and transformation rules.Perform data cleansing, validation, and reconciliation activities. Create and execute data conversion scr...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    EXLChennai, Tamil Nadu, India
    Collaborate with project stakeholders (client) to identify product and technical requirements.Develop, implement, and tune large-scale distributed systems and pipelines that process large volume of...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    InfogainChennai, IN
    Big Data Engineer (Lead) : As a Big Data Engineer (Lead), you will be responsible for leading a team of big data engineers. You will work closely with clients and team members to understand their req...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Talent Corner HR Services Pvt LtdChennai, India
    We are seeking a dynamic professional to fill in our Data Engineering role who will be responsible for designing, developing, and maintaining the data architecture, infrastructure, and pipelines th...Show moreLast updated: 5 days ago
    • Promoted
    Data Engineer Lead

    Data Engineer Lead

    Ashley Global Capability CenterChennai, Tamil Nadu, India
    Bachelor's or master’s degree in Computer Science, Mathematics, or related field.Years of experience in developing technology solutions, integrating, or creating AI and machine learning models.Know...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Innodata Inc.Chennai, IN
    CI / CD practices, Databricks (Spark), Python, Github and SQL.The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and...Show moreLast updated: 25 days ago
    • Promoted
    Data Engineer

    Data Engineer

    HISH IT SERVICESChennai, IN
    Location : Remote(Banglore,Chennai,Pune).Pay : 14LPA - 18 LPA(Based on Experience).Timings : A couple of hours overlap with EST, as the client is Canada-based (till 12AM IST).Start Date : 20th Octob...Show moreLast updated: 6 days ago
    • Promoted
    Data Engineer

    Data Engineer

    ACL Digitalchennai, tamil nadu, in
    Design, develop, and optimize Spark-based data pipelines on Databricks for large-scale data processing.Design, develop, and optimize AWS pipeline as applicable. Implement and manage GitHub asset bun...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Insight GlobalChennai, IN
    Notice Period : This is a ASAP hire - only apply if you can start 2 weeks after offer is extended!.Priority scheduling for candidates who message on with resume. Design, develop, and maintain robust...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Tata Consultancy ServicesChennai, Tamil Nadu, India
    Greetings from TCS Human Resources Team!!!.Skill : Snowflake Data Engineer.Required Technical Skill Set : Snowflake, dbt, FiveTran, Snowpipe, AWS services : Managed Airflow (MWAA), S3, Lambda.Minimum ...Show moreLast updated: 26 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Kumaran SystemsChennai, IN
    Strong hands-on experience in Databricks.Proven expertise in building and managing data ingestion pipelines.Exposure to Databricks data ingestion jobs along with incident management frameworks.Expe...Show moreLast updated: 7 days ago
    • Promoted
    Data Engineer

    Data Engineer

    ImpetusChennai, Tamil Nadu, India
    Bigdata, Pyspark, Python ,Hadoop / HDFS; Spark;.Develops and maintains scalable data pipelines to support continuing increases in data volume and complexity. Collaborates with analytics and business...Show moreLast updated: 23 days ago
    • Promoted
    Data Engineer

    Data Engineer

    INFEC Serviceschennai, tamil nadu, in
    Design, develop, and optimize data pipelines and ETL processes on GCP or Azure.Work with structured and unstructured data, integrating sources such as databases, APIs, and streaming platforms.Imple...Show moreLast updated: 4 days ago
    • Promoted
    Data Engineer

    Data Engineer

    VAANTECHChennai, Tamil Nadu, India
    Immediate Joiner (or within 15 days).Includes Night Shifts (US Shift).Preferred Candidates : From Chennai.Data Pipeline Optimization & Tuning. Hadoop Infra / Cloud Platforms.Lead and mentor a team of...Show moreLast updated: 28 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Bahwan CyberTekChennai, IN
    Job Title : Data Engineer – Google Cloud Platform (GCP).We are seeking a skilled and motivated Data Engineer with hands-on experience in building scalable data pipelines and cloud-native data soluti...Show moreLast updated: 17 days ago
    • Promoted
    Data Engineer

    Data Engineer

    EveriseChennai, IN
    Join us on our mission to elevate customer experiences for people around the world.As a member of the Everise family, you will be part of a global experience company that believes in being people-f...Show moreLast updated: 6 days ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgeChennai, IN
    Snowflake, AWS (Lambda, Glue), DBT, and SQL.The ideal candidate will be responsible for enabling seamless data integration, transformation, and analytics to support business intelligence and advanc...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Kanerika Incchennai, tamil nadu, in
    Following are high level responsibilities that you will play but not limited to : .Analyze the Data Model and do GAP analysis with Business Requirements and Power BI. Design and Model Power BI schema....Show moreLast updated: 19 days ago