Azure Data Engineer

K&K Talents is an international recruiting agency that has been providing technical resources globally since 1993. This position is with one of our clients in India , who is actively hiring candidates to expand their teams.

Title : Azure Data Engineer

Location : Bangalore, Bhopal, Chennai, Gurugram, Hyderabad, Jaipur, Pune

Mode of Operation : Hybrid

Employment Type : Full-time Permanent

Experience : 5-10 years

Role :

We are seeking an experienced Data Engineer with strong skills in Databricks, Python, SQL, and Postgres , along with exposure to Vector Databases and Generative AI use cases such as RAG pipelines and embedding-based search .

Responsibilities :

Design, develop, and maintain data pipelines and ETL workflows using Databricks and Azure Data Factory .

Build efficient and scalable data models and Delta Lake architectures for analytics and AI applications.

Develop and optimize Python-based data processing scripts (PySpark, pandas, APIs).

Manage and tune SQL and Postgres databases for schema design, indexing, and query performance.

Integrate and experiment with Vector Databases (pgvector, Qdrant, Pinecone) for advanced AI search solutions.

Collaborate with data scientists and architects on Generative AI applications leveraging Azure OpenAI or similar platforms.

Implement CI / CD pipelines and Git-based workflows for continuous data deployment and version control.

Required Skills :

Strong programming skills in Python (PySpark, pandas, REST APIs) .

Proven expertise in Databricks (workflows, notebooks, Delta Lake) .

Advanced SQL knowledge for data modeling and optimization.

Experience with Azure Data Factory, Azure Data Lake Gen2, and Azure Synapse Analytics .

Proficiency in Postgres (schema design, indexing, tuning) .

Exposure to Vector Databases (pgvector, Qdrant, Pinecone, etc.) and Generative AI concepts.

Familiarity with CI / CD pipelines and Git -based version control.