Principal Data Engineer

Key Responsibilities :

• Develop high quality, secure and scalable data pipelines using spark, Scala / Python / Java on Hadoop or object storage like MinIO.
• Leverage technologies and solutions to innovate with increasingly large data sets.
• Drive automation and efficiency in Data ingestion, data movement and data access workflows by innovation and collaboration.
• Understand, implement and enforce Software development standards and engineering principles in the Big Data space.
• Contribute ideas to help ensure that required standards and processes are in place and actively look for opportunities to enhance standards and improve process efficiency.
• Perform assigned tasks and production incident independently.

Must Have :

Experience of building Nifi pipelines.

Preferred

Skills & Qualifications : Bachelor’s degree in information systems, Information Technology, Computer Science or Engineering or equivalent work experience.