Azure Data Engineer

K&K Talents

is an international recruiting agency that has been providing technical resources globally

since 1993.

This position is with one of our

clients in India , who is actively hiring candidates to expand their teams.

Title : Azure Data Engineer

Location : Bangalore, Bhopal, Chennai, Gurugram, Hyderabad, Jaipur, Pune

Mode of Operation : Hybrid

Employment Type : Full-time Permanent

Experience : 5-10 years

Role :

We are seeking an experienced Data Engineer with strong skills in

Databricks, Python, SQL, and Postgres , along with exposure to

Vector Databases

and

Generative AI

use cases such as

RAG pipelines

and

embedding-based search .

Responsibilities :

Design, develop, and maintain

data pipelines and ETL workflows

using

Databricks

and

Azure Data Factory .

Build efficient and scalable

data models and Delta Lake architectures

for analytics and AI applications.

Develop and optimize

Python-based data processing scripts

(PySpark, pandas, APIs).

Manage and tune

SQL and Postgres databases

for schema design, indexing, and query performance.

Integrate and experiment with

Vector Databases

(pgvector, Qdrant, Pinecone) for advanced AI search solutions.

Collaborate with data scientists and architects on

Generative AI

applications leveraging

Azure OpenAI

or similar platforms.

Implement

CI / CD pipelines and Git-based workflows

for continuous data deployment and version control.

Required Skills :

Strong programming skills in

Python (PySpark, pandas, REST APIs) .

Proven expertise in

Databricks (workflows, notebooks, Delta Lake) .

Advanced

SQL

knowledge for data modeling and optimization.

Experience with

Azure Data Factory, Azure Data Lake Gen2, and Azure Synapse Analytics .

Proficiency in

Postgres (schema design, indexing, tuning) .

Exposure to

Vector Databases (pgvector, Qdrant, Pinecone, etc.)

and

Generative AI

concepts.

Familiarity with

CI / CD pipelines

and

Git -based version control.