Talent.com
No longer accepting applications
▷ Immediate Start : Lead Data Engineer

▷ Immediate Start : Lead Data Engineer

Pyramid It ConsultingPune, Maharashtra, India
14 days ago
Job description

Role & responsibilities :

  • Collaborate with BU stakeholders and TPOs to gather and clarify requirements.
  • Translate requirements into technical stories with a clear Definition of Ready and expected outcomes in Jira boards.
  • Ensure delivery of stories with adherence to Definition of Done in each sprint.
  • Provide technical direction and mentorship to junior engineers (23 team members).
  • Develop data pipelines (batch and near real-time) using Spark (Scala / Python) and structured streaming APIs.
  • Work with unstructured and encrypted IoT / engine-generated data, converting it into structured, human-readable formats.
  • Create Proof of Concepts (POCs) for new use cases, evaluate feasibility, and drive solutions to production pipelines.
  • Ensure high standards of software engineering practices (coding, testing, code reviews, performance optimization).
  • Handle multiple tracks across projects simultaneously (2–3 at a time).
  • Collaborate with cross-functional teams to ensure successful delivery.
Create a job alert for this search

Lead Data Engineer • Pune, Maharashtra, India