Talent.com
This job offer is not available in your country.
Lead Data Engineer

Lead Data Engineer

ITQube LTDkochi, kerala, in
2 days ago
Job description
  • Looking for a Data Engineer to join our engineering will contribute directly to the design, automation, and optimization of our data processes, primarily developing solutions in Python within the AWS cloud ecosystem, including Lambda, Glue, Redshift, and other key services.
  • The role also involves working with infrastructure as code (Terraform), Git-based version control, and designing scalable data architectures. The ideal candidate has solid data engineering knowledge, a passion for automation, experience working with large volumes of data, and the ability to proactively propose technical and architectural improvements. Responsibilities :
  • Design, develop, and maintain efficient ETL processes using Python, SQL, AWS Glue, and Redshift.
  • Automate data flows and integrations using AWS Lambda and other serverless services. Propose improvements and optimizations to existing pipelines, prioritizing performance, scalability, and maintainability.
  • Collaborate on the design of scalable and resilient data architectures in AWS.
  • Develop and manage infrastructure as code using Terraform.
  • Actively participate in code reviews and collaborative version control workflows using Git.
  • Document technical solutions and promote best practices in data engineering.
  • Ensure that data processing pipelines can handle large-scale datasets (Big Data). Who we’re looking for : Technical Requirements :
  • Programming Languages : Python – 3+ years of experience (Intermediate to advanced level) o SQL – 3+ years of experience, capable of working with complex data models
  • Large-scale data processing :
  • Experience with PySpark or Big Data environments – 1–2+ years (preferred)
  • Familiarity with distributed processing and performance optimization for high-volume data pipelines
  • AWS Technologies : Lambda, Glue, Redshift, S3 – 2–3 years of hands-on experience
  • Experience designing ETL workflows using native AWS services
  • Proactive mindset with a drive to propose and implement improvements
  • Analytical thinker with the ability to identify bottlenecks and performance issues.
  • Effective collaborator with both technical teams and non-technical stakeholders
  • Strong documentation and technical communication skills Nice to have (not mandatory) :
  • Experience with monitoring and observability tools for data pipelines (CloudWatch, logging, alerting), Knowledge of event-driven architecture design
  • Familiarity with orchestration tools like Apache
  • Experience with automated testing for data pipelines
  • Background in Fintech or experience handling financial datasets
    • Create a job alert for this search

    Lead Data Engineer • kochi, kerala, in

    Related jobs
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    CareerXperts ConsultingKottayam, IN
    We are looking for a highly skilled.The ideal candidate will have strong expertise in modern data engineering tools and frameworks, along with the ability to collaborate closely with data scientist...Show moreLast updated: 2 days ago
    • Promoted
    Data Engineer

    Data Engineer

    RevXKochi, IN
    RevX helps app businesses acquire and reengage users via programmatic to retain, monetize, and accelerate revenue.We're all about taking your app businesses to a new growth level.We rely on data sc...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    IntraEdgeKottayam, IN
    The Senior Data Engineer will design, develop, monitor and maintain a robust and scalable data platform used by other data analyst and engineering teams to deliver powerful insights to both interna...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    People Tech Group IncKottayam, IN
    We are Hiring - Data Engineer Bengaluru!.We are looking for a skilled and experienced Data Engineer with over 5 years of experience in data engineering and data migration projects.The ideal candida...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Mitra AIKochi, IN
    We are seeking a candidate who is comfortable working on B shift (3PM - 11PM IST).JOB SPECIFIC DUTIES AND RESPONSIBILITIES. Develop and maintain ETL pipelines using FiveTran, DBT Cloud, and custom f...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Data Engineer

    Data Engineer

    TekIT Software Solutions Pvt. Ltd. (India & USA)Kottayam, IN
    Python, PySpark, and Databricks.The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines, ensuring the quality and reliability of data across vario...Show moreLast updated: 7 hours ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Searce IncKottayam, IN
    Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’.It signifies our way of working : To improve to the finest degree of excellence, ‘solving for better’ every time.Searcians...Show moreLast updated: 1 day ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    InfogainKottayam, IN
    Big Data Engineer (Lead) : As a Big Data Engineer (Lead), you will be responsible for leading a team of big data engineers. You will work closely with clients and team members to understand their req...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    Kline + CompanyKochi, IN
    Here at Kline our data capabilities have grown exponentially over the last four years.Having gone through a rapid digitization process and becoming a cloud-native corporation, we are looking for to...Show moreLast updated: 6 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Vriba SolutionsKottayam, IN
    Design, develop & maintain ETL / ELT pipelines.Ingest & transform data from APIs, DBs, files, streams.Build real-time & batch processing solutions. Data validation, quality & cleansing.Translate busin...Show moreLast updated: 2 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    CESKottayam, IN
    As part of our data engineering team, you’ll build and maintain.This is a hands-on role where you’ll design and optimize modern data infrastructure, ensuring reliability, scalability, and performan...Show moreLast updated: 12 days ago
    • Promoted
    • New!
    Data Engineer Lead

    Data Engineer Lead

    CoffeeBeansKochi, IN
    Hybrid (3 days WFO, 2 days WFH).Tech-lead in one of the feature teams, candidate need to be work along with team lead in handling the team without much guidance. Good communication and leadership sk...Show moreLast updated: 7 hours ago
    • Promoted
    Data Engineer

    Data Engineer

    People Prime WorldwideKottayam, IN
    Our Client is a global IT services company headquartered in Southborough, Massachusetts, USA.Founded in 1996, with a revenue of $1. B, with 35,000+ associates worldwide, specializes in digital engin...Show moreLast updated: 30+ days ago
    • Promoted
    Data Engineer

    Data Engineer

    EveriseKottayam, IN
    Join us on our mission to elevate customer experiences for people around the world.As a member of the Everise family, you will be part of a global experience company that believes in being people-f...Show moreLast updated: 13 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Bahwan CyberTekKottayam, IN
    Job Title : Data Engineer – Google Cloud Platform (GCP).We are seeking a skilled and motivated Data Engineer with hands-on experience in building scalable data pipelines and cloud-native data soluti...Show moreLast updated: 24 days ago
    • Promoted
    Lead Data Engineer

    Lead Data Engineer

    Eucloid Data SolutionsKottayam, IN
    Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 14 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Kumaran SystemsKottayam, IN
    Strong hands-on experience in Databricks.Proven expertise in building and managing data ingestion pipelines.Exposure to Databricks data ingestion jobs along with incident management frameworks.Expe...Show moreLast updated: 14 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Data-Hat AIKottayam, IN
    Data Engineering & AI Solutions .Lead Data Solutions Architect .International travel required (up to 30–40%) .We are hiring a senior-level Data Engineer to lead the design, development, and optimiz...Show moreLast updated: 1 day ago
    • Promoted
    Data Engineer

    Data Engineer

    Exult GlobalKochi, Kerala, India
    Proficient in Python (Including popular python packages e.Strong background in distributed data processing and storage (e. Large scale (TBs of data) data engineering skills - Model data, create prod...Show moreLast updated: 27 days ago
    • Promoted
    Senior Data Engineer

    Senior Data Engineer

    Confidential JobsKottayam, IN
    This role involves collaborating with cross-functional teams to ensure data reliability, scalability, and performance.The candidate will work closely with data scientists, analysts and software eng...Show moreLast updated: 2 days ago