Lead Data Engineer

ITQube LTDnavi mumbai, India

8 days ago

Job description

Looking for a Data Engineer to join our engineering will contribute directly to the design, automation, and optimization of our data processes, primarily developing solutions in Python within the AWS cloud ecosystem, including Lambda, Glue, Redshift, and other key services.

The role also involves working with infrastructure as code (Terraform), Git-based version control, and designing scalable data architectures. The ideal candidate has solid data engineering knowledge, a passion for automation, experience working with large volumes of data, and the ability to proactively propose technical and architectural improvements. Responsibilities :

Design, develop, and maintain efficient ETL processes using Python, SQL, AWS Glue, and Redshift.

Automate data flows and integrations using AWS Lambda and other serverless services. Propose improvements and optimizations to existing pipelines, prioritizing performance, scalability, and maintainability.

Collaborate on the design of scalable and resilient data architectures in AWS.

Develop and manage infrastructure as code using Terraform.

Actively participate in code reviews and collaborative version control workflows using Git.

Document technical solutions and promote best practices in data engineering.

Ensure that data processing pipelines can handle large-scale datasets (Big Data). Who we’re looking for : Technical Requirements :

Programming Languages : Python – 3+ years of experience (Intermediate to advanced level) o SQL – 3+ years of experience, capable of working with complex data models

Large-scale data processing :

Experience with PySpark or Big Data environments – 1–2+ years (preferred)

Familiarity with distributed processing and performance optimization for high-volume data pipelines

AWS Technologies : Lambda, Glue, Redshift, S3 – 2–3 years of hands-on experience

Experience designing ETL workflows using native AWS services

Proactive mindset with a drive to propose and implement improvements

Analytical thinker with the ability to identify bottlenecks and performance issues.

Effective collaborator with both technical teams and non-technical stakeholders

Strong documentation and technical communication skills Nice to have (not mandatory) :

Experience with monitoring and observability tools for data pipelines (CloudWatch, logging, alerting), Knowledge of event-driven architecture design

Familiarity with orchestration tools like Apache

Experience with automated testing for data pipelines

Background in Fintech or experience handling financial datasets

Create a job alert for this search

Lead Data Engineer • navi mumbai, India

Related jobs

Promoted

Data Engineer

DeloitteMumbai, India

India’s impact on the global economy has increased at an exponential rate and Deloitte presents an opportunity to unleash and realise your potential amongst cutting edge leaders, and organisations ...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

StraiveMumbai, Maharashtra, India

Analyse relevant internally and externally sourced data (raw data) to generate BI and Advanced.Analytics datasets based on your stakeholders’ requirements. Design data pipelines to curate sourced da...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

USEReadythane, maharashtra, in

Designation : Senior Data Engineer.As a part of the Data Warehouse Team, implement technology improvements to Enterprise Data Warehouse environment. In this role, you will be a key contributor to the...Show moreLast updated: 25 days ago

Promoted

Reveille Technologies - Big Data Engineer

Reveille TechnologiesMumbai

Description : We are looking for highly skilled and motivated Big Data Engineers / Leads to join our team and drive the development of our next-generation data plat...Show moreLast updated: 23 days ago

Promoted

Senior Data Engineer

Fluent HealthMumbai, Maharashtra, India

Fluent Health is a dynamic healthcare startup revolutionizing how you manage your healthcare and that of your family.The company will provide customers with high-quality, personalized options, cred...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

VeraxionThane, IN

Python, Spark, DBT, and AWS-native services.Agile environment to deliver scalable, secure, and high-performance data solutions. Python, DBT, and AWS services (Data Ops Live).Deliver end-to-end data ...Show moreLast updated: 5 days ago

Promoted

Data Engineer

IntraEdgeThane, IN

The Senior Data Engineer will design, develop, monitor and maintain a robust and scalable data platform used by other data analyst and engineering teams to deliver powerful insights to both interna...Show moreLast updated: 30+ days ago

Promoted
New!

Technical Lead

PunctuationsVirar, Maharashtra, India

Punctuations is a fast-growing AI-focused technology company that specializes in chatbot development, AI vision, and content generation using large language models (LLMs).Our mission is to empower ...Show moreLast updated: 10 hours ago

Promoted

Senior Data Engineer

SAIVA AIKalyan-Dombivli, IN

We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

EnvuThane, Maharashtra, India

At Envu, we partner with our customers to design world-class, forward-thinking innovations that protect and enhance the health of environments around the world. We offer dedicated services in : Profe...Show moreLast updated: 30+ days ago

Promoted

Lead Data Engineer

ConfidentialMumbai

This role is perfect for a professional with.You'll play a critical role in strengthening our data infrastructure, mentoring junior engineers, and ensuring our data solutions are reliable, high-qua...Show moreLast updated: 30+ days ago

Promoted

Lead Data Engineer

Searce IncMumbai, IN

Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’.It signifies our way of working : To improve to the finest degree of excellence, ‘solving for better’ every time.Searcians...Show moreLast updated: 25 days ago

Promoted

Data Engineer

RevXKalyan-Dombivli, IN

RevX helps app businesses acquire and reengage users via programmatic to retain, monetize, and accelerate revenue.We're all about taking your app businesses to a new growth level.We rely on data sc...Show moreLast updated: 30+ days ago

Promoted

Azure Data Engineer

C5iMumbai, Maharashtra, India

We are seeking a highly skilled and experienced Data Engineering Lead to join our team.The ideal candidate will have a strong background in data engineering, data architecture, and team leadership....Show moreLast updated: 6 days ago

Promoted

Data Engineer

StraiveMumbai, Maharashtra, India

Data Engineer will be responsible for designing, developing, and maintaining data pipelines and architectures that support the organization's analytics and reporting needs.The ideal candidate will ...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

Response Informaticsdombivli, maharashtra, in

AWS services : Must be proficient in building scalable data pipelines and managing cloud-native ETL workflows.Snowflake : Moderate understanding of Snowflake architecture. CICD - Terraform or CloudFo...Show moreLast updated: 25 days ago

Promoted

AWS Data Engineer

Tata Consultancy Servicesthane, maharashtra, in

Aws data engineer having strong experience of Python.Technical / Behavioral Competency.Proficient in Python, with experience in deploying Python packages and OOP, Experience in ingesting data from di...Show moreLast updated: 2 days ago

Promoted

Data Engineer

Kline + CompanyKalyan-Dombivli, IN

Here at Kline our data capabilities have grown exponentially over the last four years.Having gone through a rapid digitization process and becoming a cloud-native corporation, we are looking for to...Show moreLast updated: 30+ days ago