Manager EXL / M / 1461817

Job Description

: Data Engineer (Manager Level – Individual Contributor)

Experience : 5–8 years

Location : Noida, UP

Role Type : Individual Contributor (IC)

About the Role

We are seeking a highly skilled Data Engineer with strong Python development expertise and proven experience in building and scaling cloud-based data management platforms . This role requires hands-on expertise in data pipelines, data lakehouse architectures, and Apache Spark , with a strong foundation in metadata and master data management . The ideal candidate will also bring experience in AI-driven analytics and demonstrate the ability to design, optimize, and manage data solutions with a focus on cost efficiency .

Key Responsibilities

• Design, build, and maintain scalable data pipelines and ETL / ELT processes across Azure-based ecosystems.
• Develop and optimize data lakehouse solutions leveraging Azure Synapse Analytics, Microsoft Fabric, and Databricks .
• Estimate and manage cloud resource utilization and costs for data pipelines, ensuring efficiency and cost-effectiveness.
• Monitor and fine-tune pipelines to balance performance and cost optimization across compute, storage, and data movement.
• Collaborate with analytics teams to deliver business-ready datasets for reporting and AI-driven use cases.
• Implement best practices for metadata and master data management , ensuring data lineage, quality, and governance.
• Develop and support real-time and batch processing frameworks using Apache Spark .
• Integrate and support visualization solutions using Power BI for business stakeholders.
• Partner with data science and AI teams to enable AI / ML-powered analytics solutions .
• Ensure adherence to data security, compliance, and governance standards .

Required Qualifications

Preferred Skills