Azure Data Pipeline Engineer

K&K Talents is an international recruiting agency that has been providing technical resources globally since 1993. This position is with one of our clients in India , who is actively hiring candidates to expand their teams.

Title : Azure Data Engineer

Location : Bangalore, Bhopal, Chennai, Gurugram, Hyderabad, Jaipur, Pune

Mode of Operation : Hybrid

Employment Type : Full-time Permanent

Experience : 5-10 years

Role :

We are seeking an experienced Data Engineer with strong skills in Databricks, Python, SQL, and Postgres , along with exposure to Vector Databases and Generative AI use cases such as RAG pipelines and embedding-based search .

Responsibilities :

• Design, develop, and maintain data pipelines and ETL workflows using Databricks and Azure Data Factory .
• Build efficient and scalable data models and Delta Lake architectures for analytics and AI applications.
• Develop and optimize Python-based data processing scripts (PySpark, pandas, APIs).
• Manage and tune SQL and Postgres databases for schema design, indexing, and query performance.
• Integrate and experiment with Vector Databases (pgvector, Qdrant, Pinecone) for advanced AI search solutions.
• Collaborate with data scientists and architects on Generative AI applications leveraging Azure OpenAI or similar platforms.
• Implement CI / CD pipelines and Git-based workflows for continuous data deployment and version control.

Required Skills :