Data Pipeline Architect

Job Summary

We are seeking an experienced Databricks Developer with strong SQL skills and hands-on experience using Microsoft Copilot (or equivalent AI-assisted development tools). The ideal candidate will be responsible for designing, developing, and optimizing data pipelines, supporting analytics workloads, and improving overall data engineering efficiency through automation and AI-driven solutions.

Key Responsibilities

• Design and implement scalable data pipelines and ETL workflows using Azure Databricks or similar platforms.
• Develop and optimize complex SQL queries , procedures, and performance tuning for large datasets.
• Leverage Copilot or similar AI-based coding assistants to accelerate code generation, debugging, and documentation.
• Integrate Databricks with Azure Data Lake, Synapse, and other cloud data services .
• Collaborate with data scientists, analysts, and business stakeholders to deliver reliable data solutions.
• Ensure data quality, governance, and security best practices.
• Participate in code reviews and continuous improvement initiatives.

Required Skills and Experience

Preferred Qualifications