Job Description :
- Design, develop, and maintain scalable data pipelines using Azure Databricks.
- Integrate and manage data across Microsoft Fabric, including OneLake, Lakehouse, and Real-Time Analytics.
- Good to have hands on experience dashboards and reports development using Power BI.
- Collaborate with cross-functional teams to gather requirements and deliver data-driven solutions.
- Optimize Spark jobs and data workflows for performance and cost-efficiency.
- Ensure data quality, governance, and security across all platforms.
- Implement CI / CD pipelines and version control for data engineering projects.
- Provide technical documentation and support for deployed for Sr. Technical Consultant :
We are looking for a candidate with 3+ years of relevant experience in a Data Engineer role, who has attained a Graduate Engineering degree in Computer Science, Information Systems or another quantitative field.
They should also have experience using the following software / tools :
Azure Databricks Certification (e.g., Databricks Certified Data Engineer Associate or Professional).3+ years of experience in big data engineering or analytics.Proficiency in PySpark, SQL, and Python.Experience with Azure ecosystem (Data Lake, ADF, Synapse, etc.)Strong understanding of data modelling, ETL / ELT processes, and distributed computing.Familiarity with CI / CD practices and version control (e.g., Git).Good to Have Experience in Big Data tools : Hadoop, Spark, Background :B.Tech (CS / IT), M.Tech(ref : hirist.tech)