This job offer is not available in your country.
Data Engineer
ACL Digitalpanchkula, haryana, in30+ days ago
Job descriptionDesign, develop, and optimize Spark-based data pipelines on Databricks for large-scale data processing. Design, develop, and optimize AWS pipeline as applicable. Implement and manage GitHub asset bundles for version control, CI / CD workflows, and collaborative development. Leverage Databricks capabilities including Delta Lake, MLflow, and notebooks to build robust data solutions. Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality, production-ready datasets. Ensure data quality, integrity, and security across all stages of the pipeline. Monitor and troubleshoot performance issues in Spark jobs and Databricks clusters. Document technical designs, workflows, and best practices.
Required Qualifications
- Minimum 5+ years of hands-on experience with Spark in a production environment.
- Strong proficiency in Databricks platform and ecosystem.
- Solid understanding of GitHub asset bundle management, including branching strategies, pull requests, and release workflows.
- Proficient in Python, Scala, or SQL for data engineering tasks.
- Experience with Delta Lake, Structured Streaming, and Databricks Workflows.
- Familiarity with cloud platform (AWS) and AWS data services.
- Excellent problem-solving and communication skills.
Create a job alert for this search
Data Engineer • panchkula, haryana, in
Related jobs
- Promoted
- New!
Data Engineer
Kline + Companybaddi, himachal pradesh, in Here at Kline our data capabilities have grown exponentially over the last four years.Having gone through a rapid digitization process and becoming a cloud-native corporation, we are looking for to...Show moreLast updated: 5 hours ago
- Promoted
Senior Data Engineer
Deltacubesbaddi, himachal pradesh, in Build and maintain scalable ETL / ELT pipelines.Work with Snowflake and BigQuery for data storage.Implement orchestration with Airflow or Prefect.
Integrate data workflows with Python.Optimize data pi...Show moreLast updated: 15 days ago
- Promoted
Data Engineer
Innodata Inc.panchkula, haryana, in CI / CD practices, Databricks (Spark), Python, Github and SQL.The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and...Show moreLast updated: 25 days ago
- Promoted
Data Engineer
Kumaran Systemspanchkula, haryana, in Strong hands-on experience in Databricks.Proven expertise in building and managing data ingestion pipelines.Exposure to Databricks data ingestion jobs along with incident management frameworks.Expe...Show moreLast updated: 7 days ago
- Promoted
Data Engineer
RevXpanchkula, haryana, in RevX helps app businesses acquire and reengage users via programmatic to retain, monetize, and accelerate revenue.We're all about taking your app businesses to a new growth level.We rely on data sc...Show moreLast updated: 7 days ago
- Promoted
Lead Data Engineer
Eucloid Data Solutionsbaddi, himachal pradesh, in Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.The ideal candidate will support development of data infrastructure on Databricks...Show moreLast updated: 7 days ago
- Promoted
Rocket UniData Engineer
Mitra AIpanchkula, haryana, in The ideal candidate will have a deep understanding of UniData and UniVerse environments, with a proven track record in developing, maintaining, and optimizing complex legacy systems.Design, develop...Show moreLast updated: 18 days ago
- Promoted
Data Engineer Team Lead
SGIChandigarh, India, India To be discussed based on your skills and experience.Strong hands-on data engineering experience with a proven ability to design, build, and optimize scalable data pipelines in .Deep technical exper...Show moreLast updated: 6 days ago
- Promoted
Data Engineer
Everisepanchkula, haryana, in Join us on our mission to elevate customer experiences for people around the world.As a member of the Everise family, you will be part of a global experience company that believes in being people-f...Show moreLast updated: 6 days ago
- Promoted
Data Engineer
IntraEdgepanchkula, haryana, in Snowflake, AWS (Lambda, Glue), DBT, and SQL.The ideal candidate will be responsible for enabling seamless data integration, transformation, and analytics to support business intelligence and advanc...Show moreLast updated: 26 days ago
- Promoted
Data Engineer
VAANTECHpanchkula, haryana, in Immediate Joiner (or within 15 days).Includes Night Shifts (US Shift).Preferred Candidates : From Chennai.Data Pipeline Optimization & Tuning.
Hadoop Infra / Cloud Platforms.Lead and mentor a team of...Show moreLast updated: 28 days ago
- Promoted
Data Engineer
Aceolutionpanchkula, haryana, in We are looking for a freelancer to engage with us for 20-40 hours per week.Kindly find the JD below for your reference.Design, develop, and maintain scalable data pipelines and workflows.Work exten...Show moreLast updated: 7 days ago
- Promoted
- New!
Data Engineer
TechVeritobaddi, himachal pradesh, in You will play a critical role in designing, building, and optimizing data workflows that enable scalable analytics and real-time insights.
The ideal candidate is hands-on, detail-oriented, and passi...Show moreLast updated: 5 hours ago
- Promoted
Data Engineer
Insight Globalbaddi, himachal pradesh, in Notice Period : This is a ASAP hire - only apply if you can start 2 weeks after offer is extended!.Priority scheduling for candidates who message on LinkedIn with resume.
Design, develop, and maintai...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer
INFEC Servicesbaddi, himachal pradesh, in Design, develop, and optimize data pipelines and ETL processes on GCP or Azure.Work with structured and unstructured data, integrating sources such as databases, APIs, and streaming platforms.Imple...Show moreLast updated: 4 days ago
- Promoted
Senior Data Engineer
BrightEdgepanchkula, haryana, in BrightEdge About Us BrightEdge is a leading SEO and content performance marketing platform that transforms online content into tangible business results.
Our platform processes massive amounts of da...Show moreLast updated: 26 days ago
- Promoted
Data Engineer
Kanerika Incpanchkula, haryana, in Databricks, Microsoft Fabric, or Snowflake.You will also play a key role in enabling effective data visualization and reporting for business stakeholders.
Databricks, Fabric, or Snowflake.Power BI d...Show moreLast updated: 19 days ago
- Promoted
Engineer
Alp Consulting Ltd.baddi, himachal pradesh, in As a GCP Data Engineer, you will be responsible for designing, building, and maintaining scalable data processing systems on.
You will collaborate with cross-functional teams to ensure data is acces...Show moreLast updated: 19 days ago