Talent.com
Senior Distributed Systems Engineer

Senior Distributed Systems Engineer

INDI Staffing Serviceslucknow, uttar pradesh, in
1 day ago
Job description

At INDI, we're passionate about empowering individuals and businesses worldwide. Our cutting-edge recruiters connect leading companies with top talent, fostering a dynamic environment where innovation thrives. Join us in shaping the future of work.

Overview of the role :

The Senior Distributed Systems Engineer position focuses on working with distributed systems technologies including Apache Ozone, Apache Spark, and Apache Kafka to build enterprise-grade platforms designed for massive scale. This role involves architecting and implementing resilient solutions for distributed data processing, storage, and messaging systems that handle petabytes of data across thousands of nodes while contributing to open-source communities.

Key responsibilities :

  • Designing and implementing core features for distributed systems including Apache Ozone, Apache Spark, and Apache Kafka.
  • Contributing code and design documentation to Apache open-source communities.
  • Supporting enterprise customers running large-scale big data analytics and ML / AI pipelines.
  • Partnering with engineering leadership, product managers, and cross-functional groups to understand requirements and turning them into solid design and implementation.
  • Architecting resilient and scalable solutions for distributed data processing at massive scale.
  • Developing advanced monitoring, debugging, and performance analysis tools for large-scale distributed systems.
  • Providing technical leadership for development of streaming messaging products and related technologies.
  • Leading and mentoring talented groups of engineers working on distributed systems features.

Requirements :

  • Education : Bachelor's degree in Computer Science or equivalent with 5+ years of experience; OR Master's degree with 4+ years of experience.
  • Programming Expertise : Strong backend engineering skills with expertise in Java, and / or strong proficiency in Scala across modern ecosystems.
  • Systems Design : Proven experience with large-scale distributed systems design and development.
  • Technical Foundation : Strong understanding of scaling, replication, consistency, high availability, and system software design.
  • Architecture Knowledge : Deep understanding of computer architecture, storage, network, and IO subsystems.
  • Development Skills : Hands-on programming abilities with strong data structures and algorithms expertise.
  • Code Quality : Passionate about programming with clean coding habits, attention to detail, and focus on quality.
  • Communication : Strong oral and written communication abilities.
  • Language Proficiency : Advanced level of English.
  • Additional skills preferred :

  • Distributed Storage : Background in distributed storage systems (file systems, database storage internals, NoSQL storage, or distributed hash tables).
  • Performance Optimization : Experience in performance tuning and identifying performance bottlenecks.
  • Open Source : Recognized contributions to open-source projects.
  • Apache Ecosystem : Experience with Apache Big Data ecosystem projects (Hive, Pig, MapReduce, HBase, Spark, Kafka).
  • Specialized Knowledge : Understanding of storage development, RAFT replication frameworks, distributed query processing, and consensus algorithms.
  • Cloud Platforms : Experience with cloud services (AWS, Azure, GCP, OpenShift).
  • DevOps : Experience with delivery pipeline tools, CI / CD solutions, and automated testing.
  • Containerization : Experience with Kubernetes and Docker technologies.
  • Additional Languages : Proficiency in Python, JavaScript, or C++.
  • What to expect from us :

  • Competitive Compensation : Excellent payment in USD or your preferred local currency.
  • Paid Leave : Parental leave, vacation, and national holidays.
  • Dynamic Work Culture : Innovative and multicultural environment.
  • Elite Collaboration : Work with the global top 1% of talent.
  • Growth and Support : Mentorship and career development opportunities.
  • If you are interested in being part of a team composed of the best professionals and working 100% goal-oriented in an innovative environment, do not hesitate to apply!

    Create a job alert for this search

    Senior System Engineer • lucknow, uttar pradesh, in

    Related jobs
    • Promoted
    • New!
    System Engineer

    System Engineer

    Indevia Accounting, Inc.lucknow, India
    Indevia is looking for a detail-oriented and technically capable Senior Systems Engineer to support and maintain core IT operations. The role will focus on maintaining the cloud infrastructure, mana...Show moreLast updated: 19 hours ago
    • Promoted
    Senior System Engineer - SASE

    Senior System Engineer - SASE

    Versa Networkslucknow, India
    JOB TITLE : SENIOR SYSTEMS ENGINEER - SASE.Software Defined solutions and architectures, called Unified-SASE (Secure Access Service Edge). Versa is providing an end-to-end solution that both simplifi...Show moreLast updated: 1 day ago
    • Promoted
    Systems Engineer – Enterprise Vault Specialist

    Systems Engineer – Enterprise Vault Specialist

    CMK Resources, Inc.Lucknow, IN
    CMK Resources is looking for an Enterprise Vault Specialist for our partner in India.This is a 12-month contract supporting archiving and data migration activities within the Enterprise Vault envir...Show moreLast updated: 1 day ago
    • Promoted
    Kubernetes Network Engineer - 8+ years - Remote

    Kubernetes Network Engineer - 8+ years - Remote

    Tekgence IncLucknow, IN
    Remote
    We need someone who has experience with.K8S networking / Kubernetes Networking.Not just Kubernetes experience).Buzz words may include bare metal Kubernetes or Container Network Interface (CNI) for Ku...Show moreLast updated: 1 day ago
    • Promoted
    Senior System Engineer / Solution Architect

    Senior System Engineer / Solution Architect

    Rexus GroupLucknow, IN
    Position : Senior System Engineer / Solution Architect.As a Senior System Engineer \ Solutions Architect, you will serve as the focused services solution and technical lead engineer supporting the r...Show moreLast updated: 1 day ago
    • Promoted
    Senior Kepware Engineer

    Senior Kepware Engineer

    9NEXUSLucknow, IN
    Job Title : Senior Kepware Engineer.IT–OT integration initiatives and manage connectivity across industrial automation systems. The role involves working with diverse PLC environments, enabling seaml...Show moreLast updated: 1 day ago
    • Promoted
    Senior Engineer - Protocols

    Senior Engineer - Protocols

    RecroLucknow, Uttar Pradesh, India
    As a Software Engineer, you will play a key role in enhancing our cloud-scale NAS platform.Your responsibilities will include : Collaborating on requirements analysis, design reviews to evolve Nasun...Show moreLast updated: 22 days ago
    • Promoted
    Senior Kubernetes Network Engineer

    Senior Kubernetes Network Engineer

    World Wide TechnologyLucknow, IN
    World Wide Technology Holding Co, LLC (WWT).Through our culture of innovation, we inspire, build and deliver business results, from idea to outcome. Louis, WWT works closely with industry leaders su...Show moreLast updated: 1 day ago
    • Promoted
    Senior Firmware Engineer

    Senior Firmware Engineer

    Talentojlucknow, India
    Strong proficiency in Embedded C.Hands-on experience with bare-metal firmware development.Proficiency with communication protocols : I2C, UART, RS485. Experience with ARM Cortex controllers (STM32, N...Show moreLast updated: 1 day ago
    • Promoted
    IT Senior Engineer

    IT Senior Engineer

    KPG99 INCLucknow, IN
    Support the migration of applications to AWS (cloud migration currently underway).Must have strong hands-on experience with AWS,. NET, and cloud-based architectures.Full stack capability required, i...Show moreLast updated: 14 days ago
    • Promoted
    Sr Systems Engineer Linux – AI Infrastructure

    Sr Systems Engineer Linux – AI Infrastructure

    DC Tech ConsultingLucknow, IN
    Position : Senior Linux Administrator – AI / ML Infrastructure.We are seeking a highly skilled Senior Linux Administrator to join our team, focusing on the implementation and management of on-premises...Show moreLast updated: 30+ days ago
    • Promoted
    Software Engineer (C#, Distributed systems)

    Software Engineer (C#, Distributed systems)

    Omnissalucknow, India
    The world is evolving fast, and organizations everywhere—from corporations to schools—are under immense pressure to provide flexible, work-from-anywhere solutions. They need IT infrastructure that e...Show moreLast updated: 1 day ago
    • Promoted
    Enterprise Engineer

    Enterprise Engineer

    Estarta SolutionsLucknow, IN
    The role focuses on designing, implementing, and optimizing large-scale enterprise network infrastructures that enable secure, high-performing, and resilient business operations.As a key technical ...Show moreLast updated: 1 day ago
    • Promoted
    Senior Solutions Engineer

    Senior Solutions Engineer

    Zeotaplucknow, uttar pradesh, in
    Founded in Berlin in 2014, Zeotap started with a mission to provide high-quality data to marketers.As we evolved, we recognized a greater challenge : helping brands create personalized, multi-channe...Show moreLast updated: 30+ days ago
    • Promoted
    Senior DevOps Engineer

    Senior DevOps Engineer

    ElestioLucknow, IN
    Elestio is growing, and we’re looking for a DevOps Expert to join our team!.To support our fast growth, we’re looking for someone passionate about DevOps, open-source technologies, and customer suc...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Senior Engineer

    Senior Engineer

    Ignitariumlucknow, uttar pradesh, in
    Experienced with Sequans LTE-M / NB-IoT modems,.Show moreLast updated: 13 hours ago
    • Promoted
    System integration testing engineer (Cisco's DNAC or Nexus)

    System integration testing engineer (Cisco's DNAC or Nexus)

    Philodesign Technologies IncLucknow, IN
    System Integration Testing (SIT) Engineer – Cisco DNAC / Nexus.System Integration Testing (SIT) Engineer.Cisco’s DNAC or Nexus platforms. The ideal candidate will be responsible for validating the s...Show moreLast updated: 1 day ago
    • Promoted
    TDM Senior Engineer

    TDM Senior Engineer

    QualiZealLucknow, IN
    Responsible for delivering test data management solutions focusing on enhanced data provisioning capabilities, data integration and devising efficient TDM processes. Work with other stakeholders lik...Show moreLast updated: 23 days ago