Talent.com
Lead ETL Engineer
Lead ETL EngineerKOGTA FINANCIAL (INDIA) LIMITED • Haryāna, Republic Of India, IN
Lead ETL Engineer

Lead ETL Engineer

KOGTA FINANCIAL (INDIA) LIMITED • Haryāna, Republic Of India, IN
2 days ago
Job description

Job Summary

Kogta Financial Ltd. is seeking an experienced and highly skilled ETL & Data Warehouse Developer with strong expertise in AWS data services . As a key member of our data engineering team, you will be responsible for designing, developing, and optimizing ETL pipelines and scalable data warehouse solutions on the AWS platform. The ideal candidate will have a solid background in data modeling, SQL performance tuning, and AWS-based data architectures .

Key Responsibilities

1. ETL Development

  • Design, develop, and implement robust ETL processes using AWS EMR, AWS Data Pipeline, or custom scripts .
  • Ensure efficient extraction, transformation, and loading of data from multiple sources into the data warehouse.

2. Data Warehousing

  • Design and maintain scalable, high-performance data warehouse solutions on AWS.
  • Implement optimized data models and structures for AWS Redshift or equivalent environments.
  • 3. AWS Service Utilization

  • Leverage AWS services such as S3, Lambda, Redshift , EMR , Step Functions and others to build end-to-end data solutions.
  • Stay updated with AWS advancements and recommend new tools or services to enhance data infrastructure.
  • 4. SQL Expertise

  • Develop and optimize complex SQL queries, stored procedures, and views for analytics and reporting.
  • Troubleshoot and fine-tune SQL performance to ensure efficient data retrieval.
  • 5. Pyspark Expertise

  • Design, Develop and optimize ETL pipelines using Pyspark .
  • Leverage optimization and data modelling capabilities to design data pipelines.
  • 6. Performance Optimization

  • Continuously monitor and enhance ETL and query performance.
  • Identify and resolve processing bottlenecks across data pipelines and warehouse layers.
  • 7. Data Integration & Collaboration

  • Collaborate with cross-functional teams to integrate data from multiple systems.
  • Partner with business stakeholders to understand and deliver on data requirements.
  • 8. Security & Compliance

  • Implement strong data security and governance measures.
  • Ensure compliance with relevant industry standards and organizational policies.
  • 9. Documentation

  • Maintain detailed documentation for ETL processes, data models, and configurations .
  • Ensure proper handover and knowledge transfer within the team.
  • Qualifications & Skills

  • Bachelor’s degree in Computer Science, Information Technology , or a related field.
  • Experience with Spark Streaming will be an advantage.
  • Proven experience as an ETL / Data Warehouse Developer with expertise in AWS and SQL.
  • Strong proficiency in SQL , including complex queries and performance tuning.
  • Hands on experience with developing and maintaining ETL pipeline using Pyspark .
  • Excellent understanding of Spark architecture.
  • Hands-on experience with AWS services such as S3, EMR, Redshift, Lambda, and Step Functions.
  • Solid understanding of data modeling , data integration, and warehousing principles.
  • Familiarity with data security, compliance, and governance best practices.
  • Strong analytical, problem-solving, and communication skills.
  • AWS Certification or equivalent credentials preferred.
  • Create a job alert for this search

    Engineer Etl • Haryāna, Republic Of India, IN

    Related jobs
    Lead Engineer

    Lead Engineer

    dunnhumby • haryana, haryana, in
    Customer Data Science, empowering businesses everywhere to compete and thrive in the modern data-driven economy.We always put the Customer First. With deep heritage and expertise in retail – one of ...Show more
    Last updated: 2 days ago • Promoted
    Data Engineer – AWS

    Data Engineer – AWS

    Recruin • haryana, haryana, in
    Design, develop, and maintain data pipelines using AWS services such as Glue, Lambda, Step Functions, EMR, Kinesis, and S3. Build and optimize data warehouses and data lakes on AWS (Redshift, Lake F...Show more
    Last updated: 2 hours ago • Promoted • New!
    Lead Engineer Data [T500-20747]

    Lead Engineer Data [T500-20747]

    REA Cyber City • haryana, haryana, in
    In 1995, in a garage in Melbourne, Australia, REA Group was born from a simple question : “Can we change the way the world experiences property?”. Fast forward 30 years, REA Group is a market leader ...Show more
    Last updated: 2 days ago • Promoted
    Etl Developer

    Etl Developer

    Terra Technology Circle Consulting Private Limited • Haryāna, Republic Of India, IN
    We are seeking an experienced ETL Developer with strong hands on expertise in Spark,SQL,Databricks and snowflake and prior experience in pharmaceutical / life sciences domain.The ideal candidate will...Show more
    Last updated: 2 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    KOGTA FINANCIAL (INDIA) LIMITED • haryana, haryana, in
    ETL & Data Warehouse Developer.As a key member of our data engineering team, you will be responsible for designing, developing, and optimizing ETL pipelines and scalable data warehouse solutions on...Show more
    Last updated: 2 days ago • Promoted
    Lead Support Engineer

    Lead Support Engineer

    Graviton Research Capital LLP • haryana, haryana, in
    About Graviton Research Capital.Graviton Research Capital is a cutting-edge high-frequency trading (HFT) firm that merges technology, quantitative research, and advanced algorithms to trade across ...Show more
    Last updated: 2 days ago • Promoted
    Lead Data Engineer

    Lead Data Engineer

    MakeMyTrip • haryana, haryana, in
    At MakeMyTrip (MMT), technology is at the heart of everything we do.As a leading player in the travel industry, we leverage cutting-edge solutions like AI, machine learning, and cloud infrastructur...Show more
    Last updated: 2 days ago • Promoted
    Lead Analyst

    Lead Analyst

    Evalueserve • haryana, haryana, in
    Elevate Your Impact Through Innovation and Learning.Evalueserve is a global leader in delivering innovative and sustainable solutions to a diverse range of clients, including over 30% of Fortune 50...Show more
    Last updated: 2 days ago • Promoted
    Etl Testing

    Etl Testing

    Tata Consultancy Services • Haryāna, Republic Of India, IN
    Required Skills and Experience : .IT experience with 3 years of ETL test experience.Strong testing background (leading, planning & execution of testing activities). Design, develop, maintain, execute ...Show more
    Last updated: 30+ days ago • Promoted
    Lead Engineer- Azure Iaas / Paas

    Lead Engineer- Azure Iaas / Paas

    Acuity Knowledge Partners • haryana, haryana, in
    Acuity Knowledge Partners (Acuity) is a leading provider of bespoke research, analytics and technology solutions to the financial services sector, including asset managers, corporate and investment...Show more
    Last updated: 2 days ago • Promoted
    Senior Data Engineer

    Senior Data Engineer

    ManpowerGroup India • haryana, haryana, in
    ADF, ETL and SSIS, Python and SQL including data warehousing concepts and data warehousing principles.Proficiency in ETL tools and SQL for data extraction, transformation, and loading.Experience pe...Show more
    Last updated: 2 days ago • Promoted
    Technical Lead

    Technical Lead

    Sodexo • haryana, haryana, in
    As the Technical Lead for mobile and digital applications, you will play a crucial role in leading the design, development, and deployment of cutting-edge digital solutions.You will collaborate clo...Show more
    Last updated: 2 days ago • Promoted
    Data Engineer

    Data Engineer

    IGT Solutions • haryana, haryana, in
    We are seeking a highly skilled.Databricks, PySpark, ETL development, and SQL.The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines and analytics...Show more
    Last updated: 2 days ago • Promoted
    Support Engineer (L1 / L2)

    Support Engineer (L1 / L2)

    Graviton Research Capital LLP • haryana, haryana, in
    HFT) firm that blends technology, quantitative research, and advanced algorithms to trade global financial markets.Our team of world-class technologists, researchers, and traders collaborates to pu...Show more
    Last updated: 2 days ago • Promoted
    Senior Lead Engineer - Platform [T500-19638]

    Senior Lead Engineer - Platform [T500-19638]

    REA Cyber City • haryana, haryana, in
    In 1995, in a garage in Melbourne, Australia, REA Group was born from a simple question : “Can we change the way the world experiences property?”. Fast forward 30 years, REA Group is a market leader ...Show more
    Last updated: 2 days ago • Promoted
    Data Engineer

    Data Engineer

    Terra Technology Circle Consulting Private Limited • haryana, haryana, in
    We are seeking a highly skilled and motivated.In this role, you will design, build, and optimize scalable data pipelines and architectures to support analytics, machine learning, and business intel...Show more
    Last updated: 2 days ago • Promoted
    ETL Tester

    ETL Tester

    Tata Consultancy Services • haryana, haryana, in
    Greetings from TATA CONSULTANCY SERVICES!.Years of Experience : 5 - 10 years.Required Skills and Experience : .IT experience with 3 years of ETL test experience. Strong testing background (leading, pla...Show more
    Last updated: 2 days ago • Promoted
    Senior Firmware Engineer

    Senior Firmware Engineer

    Elecbits • haryana, haryana, in
    Elecbits is India’s leading full-stack, vertically integrated Electronics engineering.Maruti Suzuki, OLA, Valeo, and 200 others to go from idea to mass production in. We are on a mission to build th...Show more
    Last updated: 2 days ago • Promoted