Apache Spark

In the role of Responsible Technology Lead, a typical day involves overseeing the development and implementation of solutions that prioritize ethical considerations and responsible use. The role includes fostering collaboration across various departments to ensure alignment with organizational values and advocating for the adoption of responsible practices throughout the project lifecycle. The individual will also engage in strategic planning and decision-making to promote transparency and accountability.

Roles & Responsibilities:

- Expected to be an SME, collaborate and manage the team to perform.

- Responsible for team decisions.- Engage with multiple teams and contribute on key decisions.

- Provide solutions to problems for their immediate team and across multiple teams.

- Facilitate cross-functional communication to with responsible use principles and promote shared understanding among stakeholders.- Mentor junior team members by providing guidance on ethical practices and supporting their professional growth.

Professional & Technical Skills:

- Must To Have Skills: Proficiency in Apache Spark.

- Strong knowledge of distributed computing concepts and experience in processing large-scale data using Apache Spark.

- Experience in designing and optimizing data pipelines

- Familiarity with data governance and security practices relevant to systems.

- Ability to troubleshoot and resolve performance issues in Spark applications.

- Experience with integrating Apache Spark with other big data technologies and cloud platforms.

Additional Information:

- The candidate should have minimum 5 years of experience in Apache Spark.

- This position is based at our Gurugram office.

- A 15 years full time education is required.

Skills Required
Apache Spark