No longer accepting applications

Lead Data Engineer

ITQube LTDvapi, India

8 days ago

Job description

Looking for a Data Engineer to join our engineering will contribute directly to the design, automation, and optimization of our data processes, primarily developing solutions in Python within the AWS cloud ecosystem, including Lambda, Glue, Redshift, and other key services.

The role also involves working with infrastructure as code (Terraform), Git-based version control, and designing scalable data architectures. The ideal candidate has solid data engineering knowledge, a passion for automation, experience working with large volumes of data, and the ability to proactively propose technical and architectural improvements. Responsibilities :

Design, develop, and maintain efficient ETL processes using Python, SQL, AWS Glue, and Redshift.

Automate data flows and integrations using AWS Lambda and other serverless services. Propose improvements and optimizations to existing pipelines, prioritizing performance, scalability, and maintainability.

Collaborate on the design of scalable and resilient data architectures in AWS.

Develop and manage infrastructure as code using Terraform.

Actively participate in code reviews and collaborative version control workflows using Git.

Document technical solutions and promote best practices in data engineering.

Ensure that data processing pipelines can handle large-scale datasets (Big Data). Who we’re looking for : Technical Requirements :

Programming Languages : Python – 3+ years of experience (Intermediate to advanced level) o SQL – 3+ years of experience, capable of working with complex data models

Large-scale data processing :

Experience with PySpark or Big Data environments – 1–2+ years (preferred)

Familiarity with distributed processing and performance optimization for high-volume data pipelines

AWS Technologies : Lambda, Glue, Redshift, S3 – 2–3 years of hands-on experience

Experience designing ETL workflows using native AWS services

Proactive mindset with a drive to propose and implement improvements

Analytical thinker with the ability to identify bottlenecks and performance issues.

Effective collaborator with both technical teams and non-technical stakeholders

Strong documentation and technical communication skills Nice to have (not mandatory) :

Experience with monitoring and observability tools for data pipelines (CloudWatch, logging, alerting), Knowledge of event-driven architecture design

Familiarity with orchestration tools like Apache

Experience with automated testing for data pipelines

Background in Fintech or experience handling financial datasets

Create a job alert for this search

Lead Data Engineer • vapi, India

Related jobs

Promoted

Data Engineer

Veraxionvapi, India

Python, Spark, DBT, and AWS-native services.Agile environment to deliver scalable, secure, and high-performance data solutions. Python, DBT, and AWS services (Data Ops Live).Deliver end-to-end data ...Show moreLast updated: 4 days ago

Promoted

Senior Data Engineer

Saransh Incvapi, India

Data Engineer (Contract-to-Hire | Remote).Full-Time / Fixed-Term Contract (12 months, extendable based on performance).We are seeking a highly skilled. The ideal candidate will be hands-on, detail-o...Show moreLast updated: 8 days ago

Promoted

AI / ML & Data Engineer

Mindfire Solutionsvapi, India

We are looking for an experienced AI / ML & Data Engineer to design, develop, and deploy scalable machine learning models and data infrastructure on AWS. You will work closely with cross-functional te...Show moreLast updated: 6 days ago

Promoted

Data Engineer

Randstad Enterprisevapi, India

Shift Timing : 2 : 00 Pm - 11 : 00 Pm.Experience : 2- 4 years relevant Experience only ( this is a Junior position with us ). GCP - 2 years minimum working Experience.Worked with global stakeholders.Ran...Show moreLast updated: 6 days ago

Promoted

Staff / Senior Data Engineer

HG Insightsvapi, India

At HG Insights we provides AI-powered revenue growth intelligence and technology intelligence data to help B2B companies refine their go-to-market (GTM) strategies by analyzing market size, identif...Show moreLast updated: 8 days ago

Promoted

AWS Data Engineer

Tata Consultancy Servicesvapi, gujarat, in

Aws data engineer having strong experience of Python.Technical / Behavioral Competency.Proficient in Python, with experience in deploying Python packages and OOP, Experience in ingesting data from di...Show moreLast updated: 2 days ago

Promoted

GenAI Lead Engineer (Investment Data Platforms)

Vichara Technologiesvapi, India

We are seeking a highly skilled.This role will also involve leading a cross-functional team of.Machine Learning Engineers and UI Developers. Develop custom frameworks using.Optimize LLM usage for in...Show moreLast updated: 8 days ago

Promoted

Data Engineer

thinkbridgevapi, India

We are a global digital product development firm that helps growth-stage companies gain the technology sophistication and maturity of leading modern digital businesses. We differentiate ourselves by...Show moreLast updated: 6 days ago

Promoted

Senior Data Engineer

Straivevapi, India

The ideal candidate is a strong software engineer with hands-on experience in Spark (3.You'll be responsible for designing and implementing ETL / ELT solutions, collaborating with teams to deliver da...Show moreLast updated: 8 days ago

Promoted

Freelance Data Engineer

upGradvapi, India

We are seeking a highly skilled and motivated.The ideal candidate will be responsible for designing, developing, and optimizing large-scale data pipelines and data warehouse solutions, utilizing a ...Show moreLast updated: 8 days ago

Promoted

Data Engineer

RevXvapi, India

RevX helps app businesses acquire and reengage users via programmatic to retain, monetize, and accelerate revenue.We're all about taking your app businesses to a new growth level.We rely on data sc...Show moreLast updated: 8 days ago

Promoted

Azure-ETL Engineer

Coforgevapi, India

The ideal candidate will be responsible for designing, implementing, and maintaining scalable data solutions that support business intelligence and analytics needs. Design, implement, and maintain d...Show moreLast updated: 4 days ago

Promoted

Data Engineer

Trantorvapi, India

We are seeking a data engineer to design, implement, and optimize cloud-based data pipelines using Microsoft Azure services, including ADF, Synapse, and ADLS. Develop and maintain ETL / ELT pipelines ...Show moreLast updated: 8 days ago

Promoted

Data Engineer

VAANTECHvapi, India

Immediate Joiner (or within 15 days).Includes Night Shifts (US Shift).Preferred Candidates : From Chennai.Data Pipeline Optimization & Tuning. Hadoop Infra / Cloud Platforms.Lead and mentor a team of...Show moreLast updated: 8 days ago

Promoted

Data Engineer

Sikich Indiavapi, gujarat, in

Sikich India is seeking an experienced Data Engineer to join our Data & AI practice.You will design, build, and optimize end-to-end data solutions using Microsoft’s data platforms, including Micros...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

Kline + Companyvapi, India

Here at Kline our data capabilities have grown exponentially over the last four years.Having gone through a rapid digitization process and becoming a cloud-native corporation, we are looking for to...Show moreLast updated: 6 days ago

Promoted

Senior Data Engineer

USEReadyvapi, gujarat, in

Job Title : Senior Databricks Engineer.As a Senior Databricks Engineer, you will be responsible for designing, developing, and optimizing our data architecture and pipelines on the Databricks Lakeho...Show moreLast updated: 25 days ago

Promoted

Data Engineer

Response Informaticsvapi, gujarat, in

AWS services : Must be proficient in building scalable data pipelines and managing cloud-native ETL workflows.Snowflake : Moderate understanding of Snowflake architecture. CICD - Terraform or CloudFo...Show moreLast updated: 25 days ago