This job offer is not available in your country.
Data Engineer
ACL Digitalsangli, maharashtra, in30+ days ago
Job descriptionDesign, develop, and optimize Spark-based data pipelines on Databricks for large-scale data processing. Design, develop, and optimize AWS pipeline as applicable. Implement and manage GitHub asset bundles for version control, CI / CD workflows, and collaborative development. Leverage Databricks capabilities including Delta Lake, MLflow, and notebooks to build robust data solutions. Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality, production-ready datasets. Ensure data quality, integrity, and security across all stages of the pipeline. Monitor and troubleshoot performance issues in Spark jobs and Databricks clusters. Document technical designs, workflows, and best practices.
Required Qualifications
- Minimum 5+ years of hands-on experience with Spark in a production environment.
- Strong proficiency in Databricks platform and ecosystem.
- Solid understanding of GitHub asset bundle management, including branching strategies, pull requests, and release workflows.
- Proficient in Python, Scala, or SQL for data engineering tasks.
- Experience with Delta Lake, Structured Streaming, and Databricks Workflows.
- Familiarity with cloud platform (AWS) and AWS data services.
- Excellent problem-solving and communication skills.
Create a job alert for this search
Data Engineer • sangli, maharashtra, in
Related jobs
- Promoted
Data Engineer
Innodata Inc.Kolhapur, IN CI / CD practices, Databricks (Spark), Python, Github and SQL.The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and...Show moreLast updated: 28 days ago
- Promoted
Senior Data Engineer
EXLKolhapur, IN We are seeking a highly skilled.You will work closely with cross-functional teams to provide thought leadership deliver robust, secure, and high-performance data solutions that empower analytics an...Show moreLast updated: 28 days ago
- Promoted
Senior Data Engineer
DexianKolhapur, IN We seek a Senior Data Engineer colleague to join our world-class client, one of the.Employment / Contract Type : Contract.
Duration : 1 year (with potential to be extended).Hours per Week : 40 (Full-time...Show moreLast updated: 29 days ago
- Promoted
Senior Data Engineer
InfogainKolhapur, IN Big Data Engineer (Lead) : As a Big Data Engineer (Lead), you will be responsible for leading a team of big data engineers.
You will work closely with clients and team members to understand their req...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
XebiaKolhapur, IN We’re Hiring : Data Engineer | Xebia.Any Xebia location (Hybrid, 3 days office per week).Immediate to 2 weeks – only apply if you can join early.
Databricks, Python, SQL, and Postgres.The ideal candi...Show moreLast updated: 8 days ago
- Promoted
Data Engineer
Randstad EnterpriseKolhapur, IN Shift Timing : 2 : 00 Pm - 11 : 00 Pm.Experience : 2- 4 years relevant only ( this is a Junior position with us ).GCP - 2 years minimum working Experience.
Worked with global stakeholders.Randstad Sourc...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer
BrightEdgeKolhapur, IN BrightEdge About Us BrightEdge is a leading SEO and content performance marketing platform that transforms online content into tangible business results.
Our platform processes massive amounts of da...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer
CESKolhapur, IN As part of our data engineering team, you’ll build and maintain.This is a hands-on role where you’ll design and optimize modern data infrastructure, ensuring reliability, scalability, and performan...Show moreLast updated: 8 days ago
- Promoted
Data Engineer
Kline + CompanyKolhapur, IN Here at Kline our data capabilities have grown exponentially over the last four years.Having gone through a rapid digitization process and becoming a cloud-native corporation, we are looking for to...Show moreLast updated: 3 days ago
- Promoted
Data Engineer
IntraEdgeKolhapur, IN Snowflake, AWS (Lambda, Glue), DBT, and SQL.The ideal candidate will be responsible for enabling seamless data integration, transformation, and analytics to support business intelligence and advanc...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
Bahwan CyberTekKolhapur, IN Job Title : Data Engineer – Google Cloud Platform (GCP).We are seeking a skilled and motivated Data Engineer with hands-on experience in building scalable data pipelines and cloud-native data soluti...Show moreLast updated: 20 days ago
- Promoted
Data Engineer
EveriseKolhapur, IN Join us on our mission to elevate customer experiences for people around the world.As a member of the Everise family, you will be part of a global experience company that believes in being people-f...Show moreLast updated: 9 days ago
- Promoted
Data Engineer
Kumaran SystemsKolhapur, IN Strong hands-on experience in Databricks.Proven expertise in building and managing data ingestion pipelines.Exposure to Databricks data ingestion jobs along with incident management frameworks.Expe...Show moreLast updated: 10 days ago
- Promoted
Data Engineer
Manuh TechnologiesKolhapur, IN Strong proficiency in Python programming (Pandas, NumPy, PySpark, or similar).Hands-on experience with Dask for large-scale distributed data processing.
Proven expertise as a Data Modeler (conceptua...Show moreLast updated: 30+ days ago
- Promoted
Senior Data Engineer
DeltacubesKolhapur, IN Build and maintain scalable ETL / ELT pipelines.Work with Snowflake and BigQuery for data storage.Implement orchestration with Airflow or Prefect.
Integrate data workflows with Python.Optimize data pi...Show moreLast updated: 18 days ago
- Promoted
Senior Data Engineer
EvolentKolhapur, IN Lead the design, development, and deployment of complex data solutions, ensuring scalability and maintainability.Architect and implement high-performance data pipelines and data warehousing solutio...Show moreLast updated: 26 days ago
- Promoted
Data Engineer
RevXKolhapur, IN RevX helps app businesses acquire and reengage users via programmatic to retain, monetize, and accelerate revenue.We're all about taking your app businesses to a new growth level.We rely on data sc...Show moreLast updated: 30+ days ago
- Promoted
Lead Data Engineer
Eucloid Data SolutionsKolhapur, IN Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 10 days ago
- Promoted
Data Engineer
Insight GlobalKolhapur, IN Notice Period : This is a ASAP hire - only apply if you can start 2 weeks after offer is extended!.Priority scheduling for candidates who message on with resume.
Design, develop, and maintain robust...Show moreLast updated: 30+ days ago
- Promoted
Data Platform Engineer
Intuitive.CloudKolhapur, IN With the reputation of being a.Digital Transformation challenges across following Intuitive Superpowers : .Application & Database Modernization.
Platform Engineering (IaC / EaC, DevSecOps & SRE).Cloud N...Show moreLast updated: 8 days ago