This job offer is not available in your country.

Lead Data Engineer

ITQube LTDgandhinagar, gujarat, in

15 days ago

Job description

Looking for a Data Engineer to join our engineering will contribute directly to the design, automation, and optimization of our data processes, primarily developing solutions in Python within the AWS cloud ecosystem, including Lambda, Glue, Redshift, and other key services.

The role also involves working with infrastructure as code (Terraform), Git-based version control, and designing scalable data architectures. The ideal candidate has solid data engineering knowledge, a passion for automation, experience working with large volumes of data, and the ability to proactively propose technical and architectural improvements. Responsibilities :

Design, develop, and maintain efficient ETL processes using Python, SQL, AWS Glue, and Redshift.

Automate data flows and integrations using AWS Lambda and other serverless services. Propose improvements and optimizations to existing pipelines, prioritizing performance, scalability, and maintainability.

Collaborate on the design of scalable and resilient data architectures in AWS.

Develop and manage infrastructure as code using Terraform.

Actively participate in code reviews and collaborative version control workflows using Git.

Document technical solutions and promote best practices in data engineering.

Ensure that data processing pipelines can handle large-scale datasets (Big Data). Who we’re looking for : Technical Requirements :

Programming Languages : Python – 3+ years of experience (Intermediate to advanced level) o SQL – 3+ years of experience, capable of working with complex data models

Large-scale data processing :

Experience with PySpark or Big Data environments – 1–2+ years (preferred)

Familiarity with distributed processing and performance optimization for high-volume data pipelines

AWS Technologies : Lambda, Glue, Redshift, S3 – 2–3 years of hands-on experience

Experience designing ETL workflows using native AWS services

Proactive mindset with a drive to propose and implement improvements

Analytical thinker with the ability to identify bottlenecks and performance issues.

Effective collaborator with both technical teams and non-technical stakeholders

Strong documentation and technical communication skills Nice to have (not mandatory) :

Experience with monitoring and observability tools for data pipelines (CloudWatch, logging, alerting), Knowledge of event-driven architecture design

Familiarity with orchestration tools like Apache

Experience with automated testing for data pipelines

Background in Fintech or experience handling financial datasets

Create a job alert for this search

Lead Data Engineer • gandhinagar, gujarat, in

Related jobs

Promoted

Data Engineer

TalogyAhmedabad, IN

This opportunity is ideal for a determined and proactive individual who has a wide range of skills in a variety of database administration, reporting and dashboarding disciplines.This role requires...Show moreLast updated: 30+ days ago

Promoted

SAP Data Engineer (DataSphere / BW / HANA / Data Modeling)

KPG99 INCGandhinagar, IN

Role : SAP Data Engineer (DataSphere / BW / HANA / Data Modeling).Duration : 12-month contract with extensions.Provide state-of-the-art technical support for the SAP Datasphere, BW4 Systems maintenance and...Show moreLast updated: 3 days ago

Promoted

Data Engineer

AAA GlobalGandhinagar, IN

Proprietary Trading / Financial Markets.We are seeking an experienced Data Engineer to strengthen our core Data Engineering team. In this key role, you will ensure the secure, scalable, and efficien...Show moreLast updated: 5 days ago

Promoted

Data Engineer

Azilen TechnologiesAhmedabad, Gujarat, India

Manage and create design schema, SQL query tuning, and code review.Min 3+ years of professional experience in the field of data engineering with knowledge of the data platform and DWH development.D...Show moreLast updated: 5 days ago

Promoted

Data Engineer

IntraEdgeAhmedabad, IN

The Senior Data Engineer will design, develop, monitor and maintain a robust and scalable data platform used by other data analyst and engineering teams to deliver powerful insights to both interna...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

Kanerika IncAhmedabad, Gujarat, India

Our focus is to empower businesses to achieve their digital transformation goals and maximize their business impact through the effective use of data and AI. We leverage cutting-edge technologies in...Show moreLast updated: 5 days ago

Promoted

Data Engineer

Digivance SolutionsGandhinagar, IN

Chennai, Bengaluru, Pune, Hyderabad, Mumbai, Delhi NCR.Collaborate with business and technology stakeholders to understand current and future data requirements. Design, build, and maintain reliable,...Show moreLast updated: 25 days ago

Promoted

Data Engineer - Scala

Idyllic ServicesGandhinagar, IN

Code Optimization , Shell Scripting, Data Engineering & Scala.Big Data tools like Spark, Hadoop & Hive.The Senior Data Engineer will be responsible for designing, developing, and maintaining scalab...Show moreLast updated: 4 days ago

Promoted

Senior Data Engineer

HealthyMe AIGandhinagar, IN

We are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data.You will report to the Head of AI and Engineering and be responsible for designi...Show moreLast updated: 14 days ago

Promoted

Lead Data Engineer

Searce IncAhmedabad, IN

Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’.It signifies our way of working : To improve to the finest degree of excellence, ‘solving for better’ every time.Searcians...Show moreLast updated: 15 days ago

Promoted

Lead Architect Engineer (Data)

ConfidentialGandhinagar, IN

Lead Architect Engineer (Data).We are seeking a highly skilled and experienced Lead Architect Engineer (Data) to play a pivotal leadership role in the development, architecture, and engineering of ...Show moreLast updated: 2 days ago

Promoted

SAP Data Engineer (Datasphere)

KPG99 INCGandhinagar, IN

Duration : 12-month contract with extensions.Candidates' Core Skillset Must Be : .SAP ABAP, HANA / AMDP / CDS, SOAP / OData / Rest API’s etc.Show moreLast updated: 3 days ago

Promoted

Data Engineer

OWOWAhmedabad, IN

Data Architecture & Infrastructure (40%) .Design and implement a multi-database architecture (MongoDB, Redis, Milvus, Neo4j, BigQuery) . Build scalable data pipelines for real-time conversation proc...Show moreLast updated: 1 day ago

Promoted

Data Engineer

EveriseAhmedabad, IN

Join us on our mission to elevate customer experiences for people around the world.As a member of the Everise family, you will be part of a global experience company that believes in being people-f...Show moreLast updated: 27 days ago

Promoted

Data Engineer

KeasisAhmedabad, IN

We are seeking a Data Engineer with strong Apache NiFi expertise to design and implement pipelines that move and transform data from Cloudera (HDFS / Hive / Impala) into Apache Iceberg tables, with dow...Show moreLast updated: 5 days ago

Promoted

Data Engineer

AptologicsAhmedabad, Gujarat, India

Aptologics is a global Data & AI company that simplifies complex data, builds scalable analytics platforms, and operationalizes AI to drive measurable outcomes. We deliver tailored solutions that he...Show moreLast updated: 3 days ago

Promoted

Freelance Data Engineer

upGradAhmedabad, IN

We are seeking a highly skilled and motivated.The ideal candidate will be responsible for designing, developing, and optimizing large-scale data pipelines and data warehouse solutions, utilizing a ...Show moreLast updated: 4 days ago

Promoted

Senior Data Engineer

RK HR Management Private LimitedAhmedabad, Gujarat, India

Design and build scalable data pipeline architecture that can handle large volumes of data.Develop ELT / ETL pipelines to extract, load and transform data from various sources into our data warehouse...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer

SAIVA AIAhmedabad, IN

We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 28 days ago

Promoted

Data Engineer

Manuh TechnologiesGandhinagar, IN

S3, Glue, Redshift, EMR, Lambda).Develop automation scripts and tools using.Collaborate with data analysts, data scientists, and business stakeholders to ensure data availability and reliability.Tr...Show moreLast updated: 30+ days ago