Talent.com
Data Engineer Lead

Data Engineer Lead

ConfidentialChennai
30+ days ago
Job description

Join us as a Data Engineering Lead

  • This is an exciting opportunity to use your technical expertise to collaborate with colleagues and build effortless, digital first customer experiences
  • You'll be simplifying the bank through developing innovative data driven solutions, inspiring to be commercially successful through insight, and keeping our customers' and the bank's data safe and secure
  • Participating actively in the data engineering community, you'll deliver opportunities to support our strategic direction while building your network across the bank
  • We're recruiting for multiple roles across a range to levels, up to and including experienced managers

What you'll do

We'll look to you to demonstrate technical and people leadership to drive value for the customer through modelling, sourcing and data transformation. You'll be working closely with core technology and architecture teams to deliver strategic data solutions, while driving Agile and DevOps adoption in the delivery of data engineering, leading a team of data engineers.

We'll Also Expect You To Be

  • Working with Data Scientists and Analytics Labs to translate analytical model code to well tested production ready code
  • Helping to define common coding standards and model monitoring performance best practices
  • Owning and delivering the automation of data engineering pipelines through the removal of manual stages
  • Developing comprehensive knowledge of the bank's data structures and metrics, advocating change where needed for product development
  • Educating and embedding new data techniques into the business through role modelling, training and experiment design oversight
  • Leading and delivering data engineering strategies to build a scalable data architecture and customer feature rich dataset for data scientists
  • Leading and developing solutions for streaming data ingestion and transformations in line with streaming strategy
  • The skills you'll need

    To be successful in this role, you'll need to be an expert level programmer and data engineer with a qualification in Computer Science or Software Engineering. You'll also need a strong understanding of data usage and dependencies with wider teams and the end customer, as well as extensive experience in extracting value and features from large scale data.

    We'll also expect you to have knowledge of of big data platforms like Snowflake, AWS Redshift, Postgres, MongoDB, Neo4J and Hadoop, along with good knowledge of cloud technologies such as Amazon Web Services, Google Cloud Platform and Microsoft Azure

    You'll Also Demonstrate

  • Knowledge of core computer science concepts such as common data structures and algorithms, profiling or optimisation
  • An understanding of machine-learning, information retrieval or recommendation systems
  • Good working knowledge of CICD tools
  • Knowledge of programming languages in data engineering such as Python or PySpark, SQL, Java, and Scala
  • An understanding of Apache Spark and ETL tools like Informatica PowerCenter, Informatica BDM or DEI, Stream Sets and Apache Airflow
  • Knowledge of messaging, event or streaming technology such as Apache Kafka
  • Experience of ETL technical design, automated data quality testing, QA and documentation, data warehousing, data modelling and data wrangling
  • Extensive experience using RDMS, ETL pipelines, Python, Hadoop and SQL
  • Skills Required

    Java, Data Modelling, Pyspark, Data Warehousing, Data Structures, Python, Sql

    Create a job alert for this search

    Lead Data Engineer • Chennai

    Related jobs
    • Promoted
    Data Engineer

    Data Engineer

    Response Informaticschennai, India
    AWS services : Must be proficient in building scalable data pipelines and managing cloud-native ETL workflows.Snowflake : Moderate understanding of Snowflake architecture. CICD - Terraform or CloudFo...Show moreLast updated: 5 days ago
    • Promoted
    Data Engineer

    Data Engineer

    TalogyChennai, IN
    This opportunity is ideal for a determined and proactive individual who has a wide range of skills in a variety of database administration, reporting and dashboarding disciplines.This role requires...Show moreLast updated: 30+ days ago
    • Promoted
    Lead / Senior Data Engineer - ETL / AWS

    Lead / Senior Data Engineer - ETL / AWS

    ResourcetreeChennai
    We are seeking a highly skilled and motivated Lead / Senior Data Engineer to join our Data Integration and Analytics team. The ideal candidate will bring deep expertise in AWS Redshift, with strong kn...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    ConfidentialChennai
    We are seeking a highly skilled and experienced Senior / Lead Data Engineer to design, develop, and maintain scalable, reliable, and efficient data pipelines and ETL solutions.The role requires str...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    VeraxionChennai, IN
    Python, Spark, DBT, and AWS-native services.Agile environment to deliver scalable, secure, and high-performance data solutions. Python, DBT, and AWS services (Data Ops Live).Deliver end-to-end data ...Show moreLast updated: 1 day ago
    • Promoted
    GenAI Lead Engineer (Investment Data Platforms)

    GenAI Lead Engineer (Investment Data Platforms)

    Vichara Technologieschennai, tamil nadu, in
    We are seeking a highly skilled.This role will also involve leading a cross-functional team of.Machine Learning Engineers and UI Developers. Develop custom frameworks using.Optimize LLM usage for in...Show moreLast updated: 30+ days ago
    • Promoted
    Lead Data Engineer - AWS RedShift

    Lead Data Engineer - AWS RedShift

    ResourcetreeChennai
    Job Description : We are seeking a highly skilled and motivated Lead / Senior Data Engineer to join our.Data Integration a...Show moreLast updated: 27 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    ITQube LTDchennai, tamil nadu, in
    Looking for a Data Engineer to join our engineering will contribute directly to the design, automation, and optimization of our data processes, primarily developing solutions in Python within the A...Show moreLast updated: 22 days ago
    • Promoted
    Azure Data Engineer

    Azure Data Engineer

    9NEXUSChennai, IN
    Job Title : Azure Data Engineer.We are seeking an experienced Azure Data Engineer to design, develop, and optimize scalable data solutions in a cloud environment. The role involves building high-perf...Show moreLast updated: 1 day ago
    • Promoted
    lead Data Engineer

    lead Data Engineer

    CozzeraChennai, IN
    Location : Remote ( 1 week from noida office then remote).We are looking for an accomplished Lead Data Engineer with 8–10 years of experience in. Delta Lake, Spark, MLflow), and modern orchestration ...Show moreLast updated: 1 day ago
    • Promoted
    Lead AWS Data Engineer (12+ Years)

    Lead AWS Data Engineer (12+ Years)

    TVS NextChennai, Tamil Nadu, India
    You will model and mine the data to describe the system behavior and to predict future actions.Build and deploy the infrastructure for ingesting high-volume support data from consumer interactions,...Show moreLast updated: 11 days ago
    • Promoted
    Data Engineer

    Data Engineer

    thinkbridgechennai, tamil nadu, in
    We are a global digital product development firm that helps growth-stage companies gain the technology sophistication and maturity of leading modern digital businesses. We differentiate ourselves by...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    AIQUChennai, IN
    We are hiring for Senior Data Engineer to join one of our major clients based out of KSA.Employment Type : Contract – 12 months & extendable. The Senior Data Engineer plays a lead role in designing, ...Show moreLast updated: 1 day ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Resourcetree Global ServicesChennai
    Job Description : We are seeking a highly skilled and motivated Lead Data Engineer to join our Data Integration and Anal...Show moreLast updated: 18 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Searce IncChennai, IN
    Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’.It signifies our way of working : To improve to the finest degree of excellence, ‘solving for better’ every time.Searcians...Show moreLast updated: 22 days ago
    • Promoted
    Data Engineer

    Data Engineer

    VAANTECHChennai, Tamil Nadu, India
    Immediate Joiner (or within 15 days).Includes Night Shifts (US Shift).Preferred Candidates : From Chennai.Data Pipeline Optimization & Tuning. Hadoop Infra / Cloud Platforms.Lead and mentor a team of...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Manuh TechnologiesChennai, IN
    S3, Glue, Redshift, EMR, Lambda).Develop automation scripts and tools using.Collaborate with data analysts, data scientists, and business stakeholders to ensure data availability and reliability.Tr...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Kline + CompanyChennai, IN
    Here at Kline our data capabilities have grown exponentially over the last four years.Having gone through a rapid digitization process and becoming a cloud-native corporation, we are looking for to...Show moreLast updated: 27 days ago