Lead Data Engineer

ITQube LTDindore, India

6 days ago

Job description

Looking for a Data Engineer to join our engineering will contribute directly to the design, automation, and optimization of our data processes, primarily developing solutions in Python within the AWS cloud ecosystem, including Lambda, Glue, Redshift, and other key services.

The role also involves working with infrastructure as code (Terraform), Git-based version control, and designing scalable data architectures. The ideal candidate has solid data engineering knowledge, a passion for automation, experience working with large volumes of data, and the ability to proactively propose technical and architectural improvements. Responsibilities :

Design, develop, and maintain efficient ETL processes using Python, SQL, AWS Glue, and Redshift.

Automate data flows and integrations using AWS Lambda and other serverless services. Propose improvements and optimizations to existing pipelines, prioritizing performance, scalability, and maintainability.

Collaborate on the design of scalable and resilient data architectures in AWS.

Develop and manage infrastructure as code using Terraform.

Actively participate in code reviews and collaborative version control workflows using Git.

Document technical solutions and promote best practices in data engineering.

Ensure that data processing pipelines can handle large-scale datasets (Big Data). Who we’re looking for : Technical Requirements :

Programming Languages : Python – 3+ years of experience (Intermediate to advanced level) o SQL – 3+ years of experience, capable of working with complex data models

Large-scale data processing :

Experience with PySpark or Big Data environments – 1–2+ years (preferred)

Familiarity with distributed processing and performance optimization for high-volume data pipelines

AWS Technologies : Lambda, Glue, Redshift, S3 – 2–3 years of hands-on experience

Experience designing ETL workflows using native AWS services

Proactive mindset with a drive to propose and implement improvements

Analytical thinker with the ability to identify bottlenecks and performance issues.

Effective collaborator with both technical teams and non-technical stakeholders

Strong documentation and technical communication skills Nice to have (not mandatory) :

Experience with monitoring and observability tools for data pipelines (CloudWatch, logging, alerting), Knowledge of event-driven architecture design

Familiarity with orchestration tools like Apache

Experience with automated testing for data pipelines

Background in Fintech or experience handling financial datasets

Create a job alert for this search

Lead Data Engineer • indore, India

Related jobs

Promoted

Data Engineer

People Prime Worldwideindore, madhya pradesh, in

Job Title : Senior Data Engineer.Skills : Data Engineering, AgenticAI, Python, SQL, Api’s, Azure cloud services, SQL and NoSQL ,Docker, Kubernetes. We are seeking a highly skilled and experienced Seni...Show moreLast updated: 30+ days ago

Data Engineer Lead

DigiValetIndore, Madhya Pradesh, India, India, India

Quick Apply

In this role, you will be responsible for turning data into actionable insights that drive strategic decisions.You will collaborate with cross-functional teams to deliver impactful dashboards, cond...Show moreLast updated: 30+ days ago

Promoted

Data Engineer - ETL / Data Warehousing

HiringeyeIndore

Modern, we're looking for a driven and detail-oriented Data Engineer with a strong consulting background to join our Client Technology Team. In this role, you will serve as a subject matter exp...Show moreLast updated: 4 days ago

Promoted

Data Engineer

ConfidentialIndore

Enhance and maintain the MDM platform.Monitor and optimize system performance.Troubleshoot and resolve technical issues.Support production incident resolution. Develop and refactor Python and SQL co...Show moreLast updated: 30+ days ago

Promoted

Data Platform Engineer

ConfidentialIndore

Assists with the data platform blueprint and design, encompassing the relevant data platform components.Collaborates with Integration Architects and Data Architects to ensure cohesive integration b...Show moreLast updated: 30+ days ago

Promoted

Big data Lead

ImpetusIndore, Madhya Pradesh, India

About Impetus Impetus Technologies is a digital engineering company focused on delivering expert services and products to help enterprises achieve their transformation goals.We solve the analytics...Show moreLast updated: 30+ days ago

Promoted
New!

AWS Data Engineer

Tata Consultancy Servicesindore, madhya pradesh, in

Aws data engineer having strong experience of Python.Technical / Behavioral Competency.Proficient in Python, with experience in deploying Python packages and OOP, Experience in ingesting data from di...Show moreLast updated: 6 hours ago

Promoted

Data Engineer

Response Informaticsindore, madhya pradesh, in

AWS services : Must be proficient in building scalable data pipelines and managing cloud-native ETL workflows.Snowflake : Moderate understanding of Snowflake architecture. CICD - Terraform or CloudFo...Show moreLast updated: 23 days ago

Promoted

NucleusTeq - Data Engineer - BigQuery

NucleusTeq Consulting Pvt. Ltd.Indore

Job Description : As a Data Engineer, you will work under the guidance of senior Data Engineers to design, develop, and maintain applications and data pipelines.You w...Show moreLast updated: 27 days ago

Promoted

Noww - Senior Data Engineer - ETL

Nowwin International Pvt LtdIndore

Description : Job Title : Senior Data Engineer Location : Indore / Ahmedabad (India) Experience : 7+ years Show moreLast updated: 4 days ago

Promoted

Lead Data Engineer - Python / ETL / SQL

HiringeyeHyderabad,Indore

Description : We are looking for a highly skilled Lead Data Engineer with strong expertise in data architecture, modeling, and scalable...Show moreLast updated: 4 days ago

Promoted

Data Analyst - ETL

ARMPLIndore

Job Description This individual contributor role is responsible for managing the Operations for several Business Critical Analytics applications, including Snowflake, SAP BW, a...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

USEReadyindore, madhya pradesh, in

Job Title : Senior Databricks Engineer.As a Senior Databricks Engineer, you will be responsible for designing, developing, and optimizing our data architecture and pipelines on the Databricks Lakeho...Show moreLast updated: 23 days ago

Promoted
New!

▷ (Only 24h Left) LSE / Associate Architect - Big Data

ImpetusIndore, Madhya Pradesh, India

Qualification Lead Software Engineer / Associate Architect with proficiency in design and implmentation of scalable and robust data engineering solutions Role In-depth understanding of Big data ...Show moreLast updated: 6 hours ago

Promoted

LSE / Associate Architect - Big Data

ImpetusIndore, Madhya Pradesh, India

Promoted

Azure Data Engineer - ETL / PySpark

Tekfortune IT India Pvt LtdIndore

Job Description : Data Engineer Position : Data Engineer Experience : 8+ Years Show moreLast updated: 30+ days ago

Promoted

Big Data Engineer - SQL / Python

ANB IT Solutions Pvt LtdIndore

Job Description : - Minimum of 7+ years of progressive experience in Data Engineering, with a proven track record in pi...Show moreLast updated: 30+ days ago

Data Engineer (Middle / Senior) ID42376

AgileEngineIndore, MP, in

Quick Apply

Fortune 500 brands and trailblazing startups across 17+ industries.We rank among the leaders in areas like application development and AI / ML, and our people-first culture has earned us multiple Bes...Show moreLast updated: 13 days ago

Promoted

Data Engineer - Python

Resources valleyIndore

Data Engineer Location : Jaipur / Indore Notice : Immediate joiners Responsibilities (Must-Haves) : ...Show moreLast updated: 30+ days ago

Promoted

Senior Azure Data Engineer

ConfidentialMumbai, Indore, Pune

Job Location : Hyderabad / Bangalore / Chennai / Kolkata / Noida / Gurgaon / Pune / Indore / Mumbai.At least 5+ years of relevant hands on development experience as Azure Data Engineering role.Profi...Show moreLast updated: 30+ days ago