This job offer is not available in your country.
Lead Data Engineer
ITQube LTDjunagadh, gujarat, in7 days ago
Job descriptionLooking for a Data Engineer to join our engineering will contribute directly to the design, automation, and optimization of our data processes, primarily developing solutions in Python within the AWS cloud ecosystem, including Lambda, Glue, Redshift, and other key services. The role also involves working with infrastructure as code (Terraform), Git-based version control, and designing scalable data architectures. The ideal candidate has solid data engineering knowledge, a passion for automation, experience working with large volumes of data, and the ability to proactively propose technical and architectural improvements. Responsibilities : Design, develop, and maintain efficient ETL processes using Python, SQL, AWS Glue, and Redshift. Automate data flows and integrations using AWS Lambda and other serverless services. Propose improvements and optimizations to existing pipelines, prioritizing performance, scalability, and maintainability. Collaborate on the design of scalable and resilient data architectures in AWS. Develop and manage infrastructure as code using Terraform. Actively participate in code reviews and collaborative version control workflows using Git. Document technical solutions and promote best practices in data engineering. Ensure that data processing pipelines can handle large-scale datasets (Big Data). Who we’re looking for : Technical Requirements : Programming Languages : Python – 3+ years of experience (Intermediate to advanced level) o SQL – 3+ years of experience, capable of working with complex data models Large-scale data processing : Experience with PySpark or Big Data environments – 1–2+ years (preferred) Familiarity with distributed processing and performance optimization for high-volume data pipelines AWS Technologies : Lambda, Glue, Redshift, S3 – 2–3 years of hands-on experience Experience designing ETL workflows using native AWS services Proactive mindset with a drive to propose and implement improvements Analytical thinker with the ability to identify bottlenecks and performance issues. Effective collaborator with both technical teams and non-technical stakeholders Strong documentation and technical communication skills Nice to have (not mandatory) : Experience with monitoring and observability tools for data pipelines (CloudWatch, logging, alerting), Knowledge of event-driven architecture design Familiarity with orchestration tools like Apache Experience with automated testing for data pipelines Background in Fintech or experience handling financial datasets
Create a job alert for this search
Lead Data Engineer • junagadh, gujarat, in
Related jobs
- Promoted
Lead Data Engineer
Searce IncJunagadh, IN Searce means ‘a fine sieve’ & indicates ‘to refine, to analyze, to improve’.It signifies our way of working : To improve to the finest degree of excellence, ‘solving for better’ every time.Searcians...Show moreLast updated: 7 days ago
- Promoted
Data Engineer
Kumaran SystemsJunagadh, IN Strong hands-on experience in Databricks.Proven expertise in building and managing data ingestion pipelines.Exposure to Databricks data ingestion jobs along with incident management frameworks.Expe...Show moreLast updated: 19 days ago
- Promoted
Senior Data Engineer
InfogainJunagadh, IN Big Data Engineer (Lead) : As a Big Data Engineer (Lead), you will be responsible for leading a team of big data engineers.
You will work closely with clients and team members to understand their req...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
IntraEdgeJunagadh, IN The Senior Data Engineer will design, develop, monitor and maintain a robust and scalable data platform used by other data analyst and engineering teams to deliver powerful insights to both interna...Show moreLast updated: 30+ days ago
- Promoted
Principal Data Engineer
XebiaJunagadh, IN We’re Hiring : Principal Data Engineer | Any Xebia Location (Hybrid, 3 days in office per week).Any Xebia Location (Hybrid – 3 days in office per week).
Data Engineering with 4+ years team leadership...Show moreLast updated: 30+ days ago
- Promoted
Data Platform Engineer
Intuitive.CloudJunagadh, IN With the reputation of being a.Digital Transformation challenges across following Intuitive Superpowers : .Application & Database Modernization.
Platform Engineering (IaC / EaC, DevSecOps & SRE).Cloud N...Show moreLast updated: 17 days ago
- Promoted
Data Engineer
RevXJunagadh, IN RevX helps app businesses acquire and reengage users via programmatic to retain, monetize, and accelerate revenue.We're all about taking your app businesses to a new growth level.We rely on data sc...Show moreLast updated: 30+ days ago
- Promoted
Senior Lead Data Engineer
TerraFinn TechnologiesJunagadh, IN TerraFinn Technologies outsources scholars from various top business schools in India and experienced employees to Fintech companies globally.
The company focuses on providing expert employees to he...Show moreLast updated: 5 days ago
- Promoted
Data Engineer
XebiaJunagadh, IN We’re Hiring : Data Engineer | Xebia.Any Xebia location (Hybrid, 3 days office per week).Immediate to 2 weeks – only apply if you can join early.
Databricks, Python, SQL, and Postgres.The ideal candi...Show moreLast updated: 17 days ago
- Promoted
Data Engineer
EveriseJunagadh, IN Join us on our mission to elevate customer experiences for people around the world.As a member of the Everise family, you will be part of a global experience company that believes in being people-f...Show moreLast updated: 18 days ago
- Promoted
Data / ML Engineer
GleantapJunagadh, IN Gleantap is a customer engagement platform powering fitness, wellness, and service businesses.Python (scikit-learn, LightGBM, XGBoost).
Set up retraining and monitoring pipelines (Airflow, MLflow, o...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer
SAIVA AIJunagadh, IN We are building the future of healthcare analytics.Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems.Our goal : pipel...Show moreLast updated: 19 days ago
- Promoted
Senior Data Engineer
HealthyMe AIJunagadh, IN We are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data.You will report to the Head of AI and Engineering and be responsible for designi...Show moreLast updated: 5 days ago
- Promoted
Data Engineer Team Lead
SGIjunagadh, gujarat, in To be discussed based on your skills and experience.Strong hands-on data engineering experience with a proven ability to design, build, and optimize scalable data pipelines in .Deep technical exper...Show moreLast updated: 17 days ago
- Promoted
Senior Big Data Engineer
VeltrisJunagadh, IN Veltris is a Digital Product Engineering Services partner committed to driving technology-enabled transformation across enterprises, businesses, and industries.
We specialize in delivering next-gene...Show moreLast updated: 26 days ago
- Promoted
Lead Data Engineer
Eucloid Data SolutionsJunagadh, IN Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 19 days ago
- Promoted
Data Engineer
Bahwan CyberTekJunagadh, IN Job Title : Data Engineer – Google Cloud Platform (GCP).We are seeking a skilled and motivated Data Engineer with hands-on experience in building scalable data pipelines and cloud-native data soluti...Show moreLast updated: 29 days ago
- Promoted
Data Engineer
Vriba SolutionsJunagadh, IN Design, develop & maintain ETL / ELT pipelines.Ingest & transform data from APIs, DBs, files, streams.Build real-time & batch processing solutions.
Data validation, quality & cleansing.Translate busin...Show moreLast updated: 7 days ago