Key Responsibilities :
- Solution Design & Architecture : Design and implement end-to-end data architectures and pipelines on IICS and Databricks.
- Data Engineering & Development :
- Develop ETL / ELT processes for ingesting, transforming, and loading data from diverse sources.
- Platform Management : Configure, monitor, and manage Databricks clusters. Ensure compliance with data governance, security, and privacy regulations.
- Best Practices & Innovation : Stay updated with the latest features of IICS and Databricks, adopting industry best practices and innovative solutions.
- Collaboration & Leadership : Work closely with business stakeholders and cross-functional teams. Provide guidance, resolve technical challenges, and lead initiatives for data optimization.
Required Skills & Qualifications :
Technical Skills : Proficiency in IICS, Databricks, Python, Scala, SQL, cloud platforms (Azure, AWS, GCP), data warehousing, ETL / ELT pipelines, and big data processing.Soft Skills : Strong analytical and problem-solving abilities, excellent communication, stakeholder management, and ability to work independently and lead teams.Skills Required
Databricks, Python, Scala, Sql, Azure, Aws