Talent.com
This job offer is not available in your country.
Principal Engineer (Data Platform)

Principal Engineer (Data Platform)

Weekday AIBengaluru, KA, IN
28 days ago
Job type
  • Quick Apply
Job description

This role is for one of Weekday’s clients

Min Experience : 12 years

Location : Bengaluru

JobType : full-time

Requirements

We are looking for a seasoned Principal Engineer to lead the design and development of next-generation data pipelines that enable near real-time ingestion and processing of massive datasets using cloud-native and open-source technologies.

Why Join

  • Work on cutting-edge challenges at the intersection of big data, security, and cloud computing.
  • Shape the direction of high-impact, global-scale data products.
  • Collaborate with top industry experts while strengthening your technical and architectural depth.

Key Responsibilities

  • Architect and build scalable, fault-tolerant, low-latency data pipelines for real-time / near real-time processing.
  • Partner with cross-functional teams to design innovative solutions for complex data and security problems.
  • Evaluate, adopt, and contribute to open-source technologies that enhance the data platform ecosystem.
  • Influence product and engineering teams by providing guidance on architecture and platform best practices.
  • Act as a thought leader, driving technical direction and innovation within the data engineering domain.

    • Required Skills & Experience

  • Experience range more than 12+ years.
  • Extensive experience architecting and scaling real-time / near real-time data systems.
  • Strong analytical and problem-solving skills, with ability to simplify complex technical challenges.
  • Deep expertise in distributed systems, concurrency, and performance optimization.
  • Proficiency in Golang, Java, or similar languages.
  • Solid understanding of gRPC streaming, serialization formats (Protobuf, Avro), and distributed security models (TLS, authentication, authorization).
  • Hands-on experience with distributed object storage (S3, GCS) and data formats (Parquet, Iceberg), including optimization for scale and performance.
  • Strong background in cloud-native data infrastructure (AWS, GCP, etc.).
  • Excellent communication skills and proven ability to influence and align teams globally.
    • Create a job alert for this search

    Principal Data Engineer • Bengaluru, KA, IN