Key Responsibilities include :
- Data Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake.
- AI Data Enablement : Collaborate with AI Consultants to prepare and manage datasets for supervised, unsupervised, and synthetic learning workflows.
- POC Support : Implement optimized data pipelines for Agentic AI POCs using realistic or synthetic data sources.
- API & Microservices Development : Build RESTful APIs and Fast API-based microservices for data access and model interaction within Azure-hosted environments.
- Model Deployment Support : Enable end-to-end deployment of AI models using
- Azure Machine Learning, Azure Kubernetes Service (AKS), and Azure DevOps.
- Data Governance & Compliance : Ensure data quality, lineage, and compliance with responsible AI and enterprise data standards.
Skills & Experience Required :
Minimum YoE : 5 Years
Data Engineering & Azure Ecosystem : Strong hands-on experience withAzure Data Factory, Azure Synapse Analytics, Azure Data Lake, Azure BlobStorageAzure Machine Learning, Azure DevOps, Azure Kubernetes Service (AKS) Agentic AI Enablement : Experience supportingGPT model fine-tuning, data preparation for LLMs, synthetic data generationVector / Graph DBs (neo4j), Azure AI Search, LangChain data loadersContext engineering for agent memory and tool chainingResponsible AI principles, model explainability, data privacy controlsProgramming & Micro Services Architecture : Strong skills in
Python, PySpark, SQL, Fast API (Pydantic, REST APIs)ETL / ELT workflows, data modeling, schema design, feature engineeringContainerization using Docker / Kubernetes, and CI / CD automationSoft Skills
Ability to collaborate effectively with AI Consultants, Architects, and Business Analysts
Strong communication skills to explain data engineering concepts to non- technical stakeholders & ability to transfer industry knowledge to peers
Preferred Certifications
Microsoft Certified : Azure Data Engineer Associate (DP-203)Microsoft Certified : Azure AI Engineer Associate (AI-102)SnowPro Data Engineer or other relevant specialization in Data Engineering, Generative AI, or Agentic AI frameworksData Pipeline Engineering : Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake.AI Data Enablement : Collaborate with AI Consultants to prepare and managedatasets for supervised, unsupervised, and synthetic learning workflows.POC Support : Implement optimized data pipelines for Agentic AI POCs using realistic or synthetic data sources.API & Microservices Development : Build RESTful APIs and Fast API-based microservices for data access and model interaction within Azure-hosted environments.Model Deployment Support : Enable end-to-end deployment of AI models using Azure Machine Learning, Azure Kubernetes Service (AKS), and Azure DevOps.Data Governance & Compliance : Ensure data quality, lineage, and compliance with responsible AI and enterprise data standards.Skills & Experience Required :
Minimum YoE : 5 Years
Data Engineering & Azure Ecosystem :
Strong hands-on experience with Azure Data Factory, Azure Synapse Analytics, Azure Data Lake, Azure Blob StorageAzure Machine Learning, Azure DevOps, Azure Kubernetes Service (AKS) Agentic AI Enablement : Experience supportingGPT model fine-tuning, data preparation for LLMs, synthetic data generationVector / Graph DBs (neo4j), Azure AI Search, LangChain data loadersContext engineering for agent memory and tool chainingResponsible AI principles, model explainability, data privacy controlsProgramming & Micro Services Architecture : Strong skills inPython, PySpark, SQL, Fast API (Pydantic, REST APIs)ETL / ELT workflows, data modeling, schema design, feature engineeringContainerization using Docker / Kubernetes, and CI / CD automationSoft Skills
Ability to collaborate effectively with AI Consultants, Architects, and Business AnalystsStrong communication skills to explain data engineering concepts to non-technical stakeholders & ability to transfer industry knowledge to peersPreferred Certifications
Microsoft Certified : Azure Data Engineer Associate (DP-203)Microsoft Certified : Azure AI Engineer Associate (AI-102)SnowPro Data Engineer or other relevant specialization in Data Engineering, Generative AI, or Agentic AI frameworks