Data Developer - Azure Databricks + Cosmos DB + SQL + ETL

We are seeking an experienced Senior Data Developer to join our data engineering team responsible for building and maintaining complex data solutions using  Azure Data Factory  (ADF),  Azure Databricks , and  Cosmos DB . The role involves designing and developing scalable data pipelines, implementing data transformations, and ensuring high data quality and performance. The Senior Data Developer will work closely with data architects, testers, and analysts to deliver robust data solutions that support strategic business initiatives.

The ideal candidate should possess deep expertise in big data technologies, data integration, and cloud-native data engineering solutions on Microsoft Azure. This role also involves coaching junior developers, conducting code reviews, and driving strategic improvements in data architecture and design patterns.

Key Responsibilities

• Data Solution Design and Development :
• Design and develop scalable and high-performance data pipelines using Azure Data Factory (ADF).
• Implement data transformations and processing using Azure Databricks.
• Develop and maintain NoSQL data models and queries in Cosmos DB.
• Optimize data pipelines for performance, scalability, and cost efficiency.
• Data Integration and Architecture :
• Integrate structured and unstructured data from diverse data sources.
• Collaborate with data architects to design end-to-end data flows and system integrations.
• Implement data security, governance, and compliance standards.
• Performance Tuning and Optimization :
• Monitor and tune data pipelines and processing jobs for performance and cost efficiency.
• Optimize data storage and retrieval strategies for Azure SQL and Cosmos DB.
• Collaboration and Mentoring :
• Collaborate with cross-functional teams including data testers, architects, and business analysts.
• Conduct code reviews and provide constructive feedback to improve code quality.
• Mentor junior developers, fostering best practices in data engineering and cloud development.

Primary Skills

Secondary Skills

Soft Skills

Educational Qualifications

Skills Required

Azure Data Factory, Pyspark, Cosmos DB, Data Integration, Python, Performance Tuning