Data Engineer - Databricks Expert

Data Engineer – Databricks Expert

Remote (India-based) | Full-time | Immediate Joiners Preferred

Are you passionate about building scalable data pipelines and optimizing performance with cutting-edge tools like Databricks and Apache Spark? We're looking for a seasoned Data Engineer to join our team and work on high-impact data products for a leading global client.

Tech Stack & Skills

5+ years in Python (incl. Pytest for testing)

7+ years of SQL & Query Optimization

3+ years of API development

Hands-on with Databricks CLI , DLT Pipelines , Unity Catalog , and Delta Lake

Strong grasp of Apache Spark , Structured Streaming , Medallion Architecture

Familiarity with Databricks Workflows , Asset Bundles , and REST APIs

Solid understanding of CDC (Debezium preferred)

Exposure to AWS , DevOps , CI / CD , and Git

Experience with SQL Server , Data Warehousing , Semi-Structured Data , and MS SSIS

Key Responsibilities

Develop and deploy robust DLT pipelines , workflows, and ingestion tasks

Maintain production streaming and batch jobs with tight SLAs

Monitor pipelines daily, troubleshoot failures, and document resolutions

Analyze data lineage using codebase and Databricks tools

Collaborate to automate data quality checks

Write clean code, conduct PRs, testing, and deployments

Communicate clearly on incidents, blockers, and task progress

What You Bring

Strong problem-solving mindset

Passion for clean, scalable, and well-documented code

Ability to work independently and in a fast-paced environment

Comfortable collaborating across time zones