Lead Data Engineer
ITQube LTDtirunelveli, tamil nadu, in19 days ago
Job descriptionLooking for a Data Engineer to join our engineering will contribute directly to the design, automation, and optimization of our data processes, primarily developing solutions in Python within the AWS cloud ecosystem, including Lambda, Glue, Redshift, and other key services. The role also involves working with infrastructure as code (Terraform), Git-based version control, and designing scalable data architectures. The ideal candidate has solid data engineering knowledge, a passion for automation, experience working with large volumes of data, and the ability to proactively propose technical and architectural improvements. Responsibilities : Design, develop, and maintain efficient ETL processes using Python, SQL, AWS Glue, and Redshift. Automate data flows and integrations using AWS Lambda and other serverless services. Propose improvements and optimizations to existing pipelines, prioritizing performance, scalability, and maintainability. Collaborate on the design of scalable and resilient data architectures in AWS. Develop and manage infrastructure as code using Terraform. Actively participate in code reviews and collaborative version control workflows using Git. Document technical solutions and promote best practices in data engineering. Ensure that data processing pipelines can handle large-scale datasets (Big Data). Who we’re looking for : Technical Requirements : Programming Languages : Python – 3+ years of experience (Intermediate to advanced level) o SQL – 3+ years of experience, capable of working with complex data models Large-scale data processing : Experience with PySpark or Big Data environments – 1–2+ years (preferred) Familiarity with distributed processing and performance optimization for high-volume data pipelines AWS Technologies : Lambda, Glue, Redshift, S3 – 2–3 years of hands-on experience Experience designing ETL workflows using native AWS services Proactive mindset with a drive to propose and implement improvements Analytical thinker with the ability to identify bottlenecks and performance issues. Effective collaborator with both technical teams and non-technical stakeholders Strong documentation and technical communication skills Nice to have (not mandatory) : Experience with monitoring and observability tools for data pipelines (CloudWatch, logging, alerting), Knowledge of event-driven architecture design Familiarity with orchestration tools like Apache Experience with automated testing for data pipelines Background in Fintech or experience handling financial datasets
Create a job alert for this search
Lead Data Engineer • tirunelveli, tamil nadu, in
Related jobs
- Promoted
Lead Data Engineer
Searce IncThoothukudi, IN Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’.It signifies our way of working : To improve to the finest degree of excellence, ‘solving for better’ every time.Searcians...Show moreLast updated: 19 days ago
- Promoted
Data Engineer
Manuh TechnologiesThoothukudi, IN S3, Glue, Redshift, EMR, Lambda).Develop automation scripts and tools using.Collaborate with data analysts, data scientists, and business stakeholders to ensure data availability and reliability.Tr...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
thinkbridgetirunelveli, tamil nadu, in We are a global digital product development firm that helps growth-stage companies gain the technology sophistication and maturity of leading modern digital businesses.
We differentiate ourselves by...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
Mastektirunelveli, tamil nadu, in Job Title : Databricks SQL Engineer (with Pharma / Life Sciences background).We are seeking a highly skilled Databricks SQL Engineer with Pharma background to join our Data Engineering team.The ideal ...Show moreLast updated: 9 days ago
- Promoted
Data Engineer
RevXThoothukudi, IN RevX helps app businesses acquire and reengage users via programmatic to retain, monetize, and accelerate revenue.We're all about taking your app businesses to a new growth level.We rely on data sc...Show moreLast updated: 30+ days ago
- Promoted
- New!
AI / ML & Data Engineer
Mindfire SolutionsThoothukudi, IN We are looking for an experienced AI / ML & Data Engineer to design, develop, and deploy scalable machine learning models and data infrastructure on AWS.
You will work closely with cross-functional te...Show moreLast updated: 19 hours ago
- Promoted
Data Engineer
GEMRAJ TECHNOLOGIES LIMITEDThoothukudi, IN We are currently seeking a Data Engineer to join our technology team.In this role, you will work on building data-driven products that sit atop cloud-based data infrastructure.The ideal candidate i...Show moreLast updated: 1 day ago
- Promoted
GenAI Lead Engineer (Investment Data Platforms)
Vichara Technologiesthoothukudi, tamil nadu, in We are seeking a highly skilled.This role will also involve leading a cross-functional team of.Machine Learning Engineers and UI Developers.
Develop custom frameworks using.Optimize LLM usage for in...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
INFEC Servicestirunelveli, tamil nadu, in Design, develop, and optimize data pipelines and ETL processes on GCP or Azure.Work with structured and unstructured data, integrating sources such as databases, APIs, and streaming platforms.Imple...Show moreLast updated: 28 days ago
- Promoted
Data Engineer
V2Softtirunelveli, tamil nadu, in Experience to deal with large stream volumes.Implementation experience ( atleast couple of projects ) in MSK / Flink / Spark / Scala.
Very good knowledge on atleast 3 out of the 4 technologies.Desirable e...Show moreLast updated: 9 days ago
- Promoted
Senior Data Engineer
Saransh Inctirunelveli, tamil nadu, in Data Engineer (Contract-to-Hire | Remote).Full-Time / Fixed-Term Contract (12 months, extendable based on performance).We are seeking a highly skilled.
The ideal candidate will be hands-on, detail-o...Show moreLast updated: 9 days ago
- Promoted
Data Engineer
Impetusthoothukudi, tamil nadu, in Strong ability to write clean and efficient code.Good understanding of Spark SQL for distributed data processing.Experience with large datasets and structured data manipulation.Ability to write que...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
Kline + CompanyThoothukudi, IN Here at Kline our data capabilities have grown exponentially over the last four years.Having gone through a rapid digitization process and becoming a cloud-native corporation, we are looking for to...Show moreLast updated: 24 days ago
- Promoted
Data Engineer
IntraEdgeThoothukudi, IN The Senior Data Engineer will design, develop, monitor and maintain a robust and scalable data platform used by other data analyst and engineering teams to deliver powerful insights to both interna...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
VAANTECHtirunelveli, tamil nadu, in Immediate Joiner (or within 15 days).Includes Night Shifts (US Shift).Preferred Candidates : From Chennai.Data Pipeline Optimization & Tuning.
Hadoop Infra / Cloud Platforms.Lead and mentor a team of...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
TalogyThoothukudi, IN This opportunity is ideal for a determined and proactive individual who has a wide range of skills in a variety of database administration, reporting and dashboarding disciplines.This role requires...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer
SAIVA AIThoothukudi, IN We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 30+ days ago
- Promoted
Freelance Data Engineer
upGradThoothukudi, IN We are seeking a highly skilled and motivated.The ideal candidate will be responsible for designing, developing, and optimizing large-scale data pipelines and data warehouse solutions, utilizing a ...Show moreLast updated: 7 days ago
- Promoted
Lead Data Engineer
ITQube LTDthoothukudi, tamil nadu, in Looking for a Data Engineer to join our engineering will contribute directly to the design, automation, and optimization of our data processes, primarily developing solutions in Python within the A...Show moreLast updated: 19 days ago
- Promoted
Data Engineer
Response Informaticsthoothukudi, tamil nadu, in AWS services : Must be proficient in building scalable data pipelines and managing cloud-native ETL workflows.Snowflake : Moderate understanding of Snowflake architecture.
CICD - Terraform or CloudFo...Show moreLast updated: 19 days ago