Essential Responsibilities :
- Hands-on engineering expert and leader to design, build and monitor AI-empowered applications, partner with sister teams like AI Platforms, Data Sourcing and Delivery etc.
- Understand current and future data and AI downstream consumer needs to ensure application design that is scalable, economical and frontloaded with end-user value.
- Being accountable for successful execution of difficult data and AI projects. Take proactive approach to stakeholder collaboration, requirement refining and planning, focus on end outcomes that answer IDA objectives.
- Leading and hands-on execution of research / POCs into new technologies such as AI tooling, storage and query solutions, specialist frameworks, governance and other tooling.
- Engage, lead and offer guidance to the wider development team like contractors, empower them to make good technical and product decisions during implementation.
- Provide support to data science and data engineering community in scaling value of their work through automation, tooling, and engineering. Advise on engineering best practice and skill gaps where necessary.
- You will report to Division Lead, Data Science and AI Excellence.
Required Skills and Abilities :
Senior engineering professional with hands-on skills in designing, building, and optimizing scalable cost-efficient data and AI systems and applications in a cloud-first environment.Skilled in engineering ways of working such as CI / CD, release lifecycle, observability, testing, continuous model validation with tangible track record of instituting change.Relevant years of experience as a Data Engineer / Software Engineer / ML Engineer / AI Apps on an opensource tech stack with Python, Java / Scala, Spark, cloud platforms, MPP database technology.Desired Skills and Abilities :
Ideally in Python or open to using Python. Familiarity with all, and expert in some of the belowSQL, Databricks or Spark, MPP databases, data warehouse design, feature store design, Kubernetes, orchestration tools, monitoring tools, Docker, streaming technologies.Skills Required
Java, Python, Scala, Spark, Mpp