Talent.com
This job offer is not available in your country.
Lead Data Engineer

Lead Data Engineer

ITQube LTDernakulam, kerala, in
10 days ago
Job description
  • Looking for a Data Engineer to join our engineering will contribute directly to the design, automation, and optimization of our data processes, primarily developing solutions in Python within the AWS cloud ecosystem, including Lambda, Glue, Redshift, and other key services.
  • The role also involves working with infrastructure as code (Terraform), Git-based version control, and designing scalable data architectures. The ideal candidate has solid data engineering knowledge, a passion for automation, experience working with large volumes of data, and the ability to proactively propose technical and architectural improvements. Responsibilities :
  • Design, develop, and maintain efficient ETL processes using Python, SQL, AWS Glue, and Redshift.
  • Automate data flows and integrations using AWS Lambda and other serverless services. Propose improvements and optimizations to existing pipelines, prioritizing performance, scalability, and maintainability.
  • Collaborate on the design of scalable and resilient data architectures in AWS.
  • Develop and manage infrastructure as code using Terraform.
  • Actively participate in code reviews and collaborative version control workflows using Git.
  • Document technical solutions and promote best practices in data engineering.
  • Ensure that data processing pipelines can handle large-scale datasets (Big Data). Who we’re looking for : Technical Requirements :
  • Programming Languages : Python – 3+ years of experience (Intermediate to advanced level) o SQL – 3+ years of experience, capable of working with complex data models
  • Large-scale data processing :
  • Experience with PySpark or Big Data environments – 1–2+ years (preferred)
  • Familiarity with distributed processing and performance optimization for high-volume data pipelines
  • AWS Technologies : Lambda, Glue, Redshift, S3 – 2–3 years of hands-on experience
  • Experience designing ETL workflows using native AWS services
  • Proactive mindset with a drive to propose and implement improvements
  • Analytical thinker with the ability to identify bottlenecks and performance issues.
  • Effective collaborator with both technical teams and non-technical stakeholders
  • Strong documentation and technical communication skills Nice to have (not mandatory) :
  • Experience with monitoring and observability tools for data pipelines (CloudWatch, logging, alerting), Knowledge of event-driven architecture design
  • Familiarity with orchestration tools like Apache
  • Experience with automated testing for data pipelines
  • Background in Fintech or experience handling financial datasets
  • Create a job alert for this search

    Lead Data Engineer • ernakulam, kerala, in

    Related jobs
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    The Mastermind GroupKochi, IN
    Remote (India) – Occasional travel to Riyadh, KSA.Sunday–Thursday preferred (9 AM – 5 PM IST).About The Mastermind Group (TMG). Software Asset Management (SAM).Hardware Asset Management (HAM).We're ...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    NOQKottayam, IN
    Senior Data & Reporting Developer (Remote | India | Contract Role).NOQ Group is a technology-driven organization dedicated to delivering innovative data solutions for businesses in the food and bev...Show moreLast updated: 8 hours ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Eucloid Data SolutionsKochi, IN
    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 22 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Searce IncKochi, IN
    Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’.It signifies our way of working : To improve to the finest degree of excellence, ‘solving for better’ every time.Searcians...Show moreLast updated: 10 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    HealthyMe AIKochi, IN
    We are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data.You will report to the Head of AI and Engineering and be responsible for designi...Show moreLast updated: 8 days ago
    • Promoted
    GCP Big Data Engineer

    GCP Big Data Engineer

    Talentmaticskottayam, kerala, in
    The ideal candidate will bring strong leadership capabilities, technical depth, and a proven track record of delivering end-to-end big data solutions in cloud environments.Lead and mentor teams in ...Show moreLast updated: 20 days ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    Saransh Inckottayam, kerala, in
    Data Engineer (Contract-to-Hire | Remote).Full-Time / Fixed-Term Contract (12 months, extendable based on performance).We are seeking a highly skilled. The ideal candidate will be hands-on, detail-o...Show moreLast updated: 6 hours ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    PASO CoKochi, IN
    We’re Hiring : Senior Data Engineer | Remote (Pan India) | Full-Time.One of our client l is looking for a.If you love building data systems from the ground up and have hands-on Big Data experience, ...Show moreLast updated: 8 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    InfogainKochi, IN
    Big Data Engineer (Lead) : As a Big Data Engineer (Lead), you will be responsible for leading a team of big data engineers. You will work closely with clients and team members to understand their req...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Incept Labsmount, kerala, in
    Incept Labs is an AI research lab based in San Francisco, California.Our small team of scientists, engineers, and builders is passionate about developing domain-specific, next-generation AI solutio...Show moreLast updated: 10 days ago
    • Promoted
    • New!
    Lead Data Engineer

    Lead Data Engineer

    ATOM Systems Private LimitedKottayam, IN
    We are seeking a highly skilled and driven Data Engineering Lead to lead our data engineering team.The ideal candidate combines strong leadership and technical expertise with the ability to deliver...Show moreLast updated: 8 hours ago
    • Promoted
    • New!
    GCP Data Engineer

    GCP Data Engineer

    EXLKottayam, IN
    Must Have- GCP Data Engineer with Banking / Finance Institutions Experience.Google Cloud Platform (GCP) Engineers.This solution will integrate data from diverse sources including.SAS systems, Excel ...Show moreLast updated: 8 hours ago
    • Promoted
    Data Architect

    Data Architect

    Mindfire SolutionsKottayam, IN
    We are seeking a highly skilled and strategic Data Architect to design, develop, and manage the organisation’s data architecture. The ideal candidate will ensure that data assets are structured, int...Show moreLast updated: 10 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    USEReadyKottayam, IN
    Designation : Senior Data Engineer.As a part of the Data Warehouse Team, implement technology improvements to Enterprise Data Warehouse environment. In this role, you will be a key contributor to the...Show moreLast updated: 30+ days ago
    • Promoted
    GCP Data Engineer

    GCP Data Engineer

    TEKsystemsKottayam, IN
    We are actively hiring for Skilled GCP Data Engineers for a global banking client.Years of experience : 4+ years (relevant). Looking for immediate joiners • •.Onboard new data sources - negotiate, agre...Show moreLast updated: 23 days ago
    • Promoted
    • New!
    Senior Data Engineer

    Senior Data Engineer

    RiDiK (a Subsidiary of CLPS. Nasdaq : CLPS)kottayam, kerala, in
    This role offers the opportunity to work on meaningful projects, collaborate with talented colleagues, and contribute to the success of a growing company. If you’re someone who takes initiative, val...Show moreLast updated: 6 hours ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    SAIVA AIKochi, IN
    We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 22 days ago
    • Promoted
    Data Engineering Role

    Data Engineering Role

    100x.incKottayam, IN
    At least 3 years of professional experience in Data Engineering.Demonstrated end-to-end ownership of ETL pipelines.Deep, hands-on experience with AWS services : EC2, Athena, Lambda, and Step Functio...Show moreLast updated: 10 days ago
    • Promoted
    • New!
    Principal Data Engineer

    Principal Data Engineer

    K&K Talents - IndiaKochi, IN
    This position is with one of our.Title : Principal Data Engineer.Location : Bangalore, Bhopal, Chennai, Gurugram, Hyderabad, Jaipur, Pune. Employment Type : Full-time Permanent.GCP or AWS, Spark, Pyspa...Show moreLast updated: 8 hours ago
    • Promoted
    Technical Project Manager-Data Engineering

    Technical Project Manager-Data Engineering

    Reflections Info SystemsKerala, India, India
    We are looking for 13+years experienced candidates for this role.Preferred Location : Cochin / Trivandrum / Chennai.Overall 13+ Years of Experience in IT with 6+ years of experience as a Technical Produ...Show moreLast updated: 19 days ago