Data Engineer โ Databricks Expert
๐ Remote (India-based) | ๐ Full-time | ๐ฏ Immediate Joiners Preferred
Are you passionate about building scalable data pipelines and optimizing performance with cutting-edge tools like Databricks and Apache Spark? We're looking for a seasoned Data Engineer to join our team and work on high-impact data products for a leading global client.
๐ง Tech Stack & Skills
- 5+ years in Python (incl. Pytest for testing)
- 7+ years of SQL & Query Optimization
- 3+ years of API development
- Hands-on with Databricks CLI , DLT Pipelines , Unity Catalog , and Delta Lake
- Strong grasp of Apache Spark , Structured Streaming , Medallion Architecture
- Familiarity with Databricks Workflows , Asset Bundles , and REST APIs
- Solid understanding of CDC (Debezium preferred)
- Exposure to AWS , DevOps , CI / CD , and Git
- Experience with SQL Server , Data Warehousing , Semi-Structured Data , and MS SSIS
๐ Key Responsibilities
Develop and deploy robust DLT pipelines , workflows, and ingestion tasksMaintain production streaming and batch jobs with tight SLAsMonitor pipelines daily, troubleshoot failures, and document resolutionsAnalyze data lineage using codebase and Databricks toolsCollaborate to automate data quality checksWrite clean code, conduct PRs, testing, and deploymentsCommunicate clearly on incidents, blockers, and task progress๐ผ What You Bring
Strong problem-solving mindsetPassion for clean, scalable, and well-documented codeAbility to work independently and in a fast-paced environmentComfortable collaborating across time zones