Talent.com
Senior Distributed Systems Engineer
Senior Distributed Systems EngineerINDI Staffing Services • Pune, Maharashtra, India
Senior Distributed Systems Engineer

Senior Distributed Systems Engineer

INDI Staffing Services • Pune, Maharashtra, India
22 days ago
Job description

At INDI, we're passionate about empowering individuals and businesses worldwide. Our cutting-edge recruiters connect leading companies with top talent, fostering a dynamic environment where innovation thrives. Join us in shaping the future of work.

Overview of the role :

The Senior Distributed Systems Engineer position focuses on working with distributed systems technologies including Apache Ozone, Apache Spark, and Apache Kafka to build enterprise-grade platforms designed for massive scale. This role involves architecting and implementing resilient solutions for distributed data processing, storage, and messaging systems that handle petabytes of data across thousands of nodes while contributing to open-source communities.

Key responsibilities :

  • Designing and implementing core features for distributed systems including Apache Ozone, Apache Spark, and Apache Kafka.
  • Contributing code and design documentation to Apache open-source communities.
  • Supporting enterprise customers running large-scale big data analytics and ML / AI pipelines.
  • Partnering with engineering leadership, product managers, and cross-functional groups to understand requirements and turning them into solid design and implementation.
  • Architecting resilient and scalable solutions for distributed data processing at massive scale.
  • Developing advanced monitoring, debugging, and performance analysis tools for large-scale distributed systems.
  • Providing technical leadership for development of streaming messaging products and related technologies.
  • Leading and mentoring talented groups of engineers working on distributed systems features.

Requirements :

  • Education : Bachelor's degree in Computer Science or equivalent with 5+ years of experience; OR Master's degree with 4+ years of experience.
  • Programming Expertise : Strong backend engineering skills with expertise in Java, and / or strong proficiency in Scala across modern ecosystems.
  • Systems Design : Proven experience with large-scale distributed systems design and development.
  • Technical Foundation : Strong understanding of scaling, replication, consistency, high availability, and system software design.
  • Architecture Knowledge : Deep understanding of computer architecture, storage, network, and IO subsystems.
  • Development Skills : Hands-on programming abilities with strong data structures and algorithms expertise.
  • Code Quality : Passionate about programming with clean coding habits, attention to detail, and focus on quality.
  • Communication : Strong oral and written communication abilities.
  • Language Proficiency : Advanced level of English.
  • Additional skills preferred :

  • Distributed Storage : Background in distributed storage systems (file systems, database storage internals, NoSQL storage, or distributed hash tables).
  • Performance Optimization : Experience in performance tuning and identifying performance bottlenecks.
  • Open Source : Recognized contributions to open-source projects.
  • Apache Ecosystem : Experience with Apache Big Data ecosystem projects (Hive, Pig, MapReduce, HBase, Spark, Kafka).
  • Specialized Knowledge : Understanding of storage development, RAFT replication frameworks, distributed query processing, and consensus algorithms.
  • Cloud Platforms : Experience with cloud services (AWS, Azure, GCP, OpenShift).
  • DevOps : Experience with delivery pipeline tools, CI / CD solutions, and automated testing.
  • Containerization : Experience with Kubernetes and Docker technologies.
  • Additional Languages : Proficiency in Python, JavaScript, or C++.
  • What to expect from us :

  • Competitive Compensation : Excellent payment in USD or your preferred local currency.
  • Paid Leave : Parental leave, vacation, and national holidays.
  • Dynamic Work Culture : Innovative and multicultural environment.
  • Elite Collaboration : Work with the global top 1% of talent.
  • Growth and Support : Mentorship and career development opportunities.
  • If you are interested in being part of a team composed of the best professionals and working 100% goal-oriented in an innovative environment, do not hesitate to apply!

    Create a job alert for this search

    Senior System Engineer • Pune, Maharashtra, India

    Related jobs
    Senior Engineer, Systems Engineering

    Senior Engineer, Systems Engineering

    ICE • Pune, Maharashtra, India
    Job Purpose We are seeking an experienced and motivated Systems Engineer to join our team.In this role, you will work alongside other engineers on multiple items – projects, operations, and on-cal...Show more
    Last updated: 22 days ago • Promoted
    Senior Systems Engineer

    Senior Systems Engineer

    Confidential • Pune, India
    Active Directory, Exchange and M365 administrator.The Senior Systems Engineer is primarily responsible for the administration and operation of the firm's complex Microsoft 365 services with primary...Show more
    Last updated: 30+ days ago • Promoted
    Distributed Systems Engineer – Vector Database(Prototype)

    Distributed Systems Engineer – Vector Database(Prototype)

    HI Technology & Innovation • Pune, India
    HI Technology & Innovation is collaborating with a pioneering database company to evolve a single-threaded, command-line vector database proof-of-concept, originally written in C#, into a demonstra...Show more
    Last updated: 30+ days ago • Promoted
    Advanced Systems Engr

    Advanced Systems Engr

    Confidential • Pune
    Tech in Instrumentation, Electronics, Chemical, or Petrochemical Engineering.Experience : 12+ years of industry experience, with at least 10 years of hands-on experience in site commissioning and tr...Show more
    Last updated: 30+ days ago • Promoted
    Senior System Software Engineer

    Senior System Software Engineer

    Confidential • Pune, India
    We are now looking for an experienced software engineer with strong system software and image / video / graphics / multimedia fundamentals with robust C++ skills. Join us in development of NVIDIA AI for M...Show more
    Last updated: 30+ days ago • Promoted
    Distributed Systems Engineer – Vector Database (Prototype)

    Distributed Systems Engineer – Vector Database (Prototype)

    HI Technology & Innovation • Pune, India
    HI Technology & Innovation is collaborating with a pioneering database company to evolve a single-threaded, command-line vector database proof-of-concept, originally written in C#, into a demonstra...Show more
    Last updated: 30+ days ago • Promoted
    Applications and Systems Engineer 2

    Applications and Systems Engineer 2

    Confidential • Pune, India
    If you are an Application Engineering professional looking for an opportunity to grow, Emerson has an exciting opportunity for you! The Application Engineer takes an active role in bid management, ...Show more
    Last updated: 18 days ago • Promoted
    Senior Engineer, Systems Engineering

    Senior Engineer, Systems Engineering

    Confidential • Pune, India
    We are seeking an experienced and motivated Systems Engineer to join our team.In this role, you will work alongside other engineers on multiple items – projects, operations, and on-call duties.You ...Show more
    Last updated: 26 days ago • Promoted
    Applications and Systems Engineer 3

    Applications and Systems Engineer 3

    Confidential • Pune, India
    If you are an Application Engineering professional looking for an opportunity to grow, Emerson has an exciting opportunity for you! The Application Engineer takes an active role in bid management, ...Show more
    Last updated: 15 days ago • Promoted
    System Engineer DeltaV Upgrade

    System Engineer DeltaV Upgrade

    Confidential • Pune, India
    If you are Automation engineering professional, Emerson has an exciting role for you! We are looking for a DCS System Engineer to work with our Lifecycle Services Group. The System engineer is an in...Show more
    Last updated: 14 days ago • Promoted
    Distributed System Engineer - Backend Infrastructure

    Distributed System Engineer - Backend Infrastructure

    Avensys Consulting • Pune, IN
    Avensys is a reputed global IT professional services company headquartered in Singapore.Our service spectrum includes enterprise solution consulting, business intelligence, business process automat...Show more
    Last updated: 3 days ago • Promoted
    Systems Engineer I

    Systems Engineer I

    Confidential • Pune, India
    GPP Database Link (https : / / cummins365.Responsible for defining, building and communicating a shared technical and architectural vision for a Product Team to help ensure the system or solution is fi...Show more
    Last updated: 26 days ago • Promoted
    Senior Engineer RTOS

    Senior Engineer RTOS

    VOLANSYS (An ACL Digital Company) • Pune, Maharashtra, India
    Job Title : Senior Engineer - RTOS.RTOS : Free RTOS, or VxWorks, or QNX.Expert in C, focusing on embedded systems, developing C / C++ libraries designing algorithms. Expert in bootloader (U-Boot) devel...Show more
    Last updated: 21 days ago • Promoted
    Senior Engineer

    Senior Engineer

    Rolls-Royce • Pune, Maharashtra, India
    This job is with Rolls-Royce, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly.Job Descript...Show more
    Last updated: 8 days ago • Promoted
    Senior Distributed Systems Engineer

    Senior Distributed Systems Engineer

    INDI Staffing Services • Pune, IN
    At INDI, we're passionate about empowering individuals and businesses worldwide.Our cutting-edge recruiters connect leading companies with top talent, fostering a dynamic environment where innovati...Show more
    Last updated: 22 days ago • Promoted
    Senior System Engineer

    Senior System Engineer

    Confidential • Pune, India
    Ensono is an expert technology adviser and managed service provider.As a relentless ally, we accelerate clients' digital transformation to achieve business outcomes that stand to last.Our dedicated...Show more
    Last updated: 26 days ago • Promoted
    System Engineer Cloud & Datacenter Services

    System Engineer Cloud & Datacenter Services

    Confidential • Pune, India
    You will play an active role in shaping our business process automation and support the global consolidation and harmonization of the IT infrastructure as a technical driver.We plan to align and co...Show more
    Last updated: 21 days ago • Promoted
    Systems Engineer

    Systems Engineer

    Confidential • Pune, India
    The Systems Engineer plays a key role in designing and implementing robust system solutions that align with current and future product requirements. Working under general supervision, this role focu...Show more
    Last updated: 30+ days ago • Promoted