Talent.com
This job offer is not available in your country.
Distributed Systems Engineer – Vector Database(Prototype)

Distributed Systems Engineer – Vector Database(Prototype)

HI Technology & InnovationPune, India
30+ days ago
Job description

About the Role

HI Technology & Innovation is collaborating with a pioneering database company to evolve a single-threaded, command-line vector database proof-of-concept, originally written in C#, into a demonstrable, parallelized prototype. We’re looking for an experienced Distributed or Parallel Processing Engineer to lead the development of a lightweight “controller + wrapper” layer that adds multi-instance orchestration, parallelism, and query merging capabilities to the current system.

This is a high-impact, fast-paced role ideal for someone with strong distributed systems thinking and a pragmatic, get-it-done engineering mindset.

What You’ll Tackle

  • Design and implement a wrapper / controller layer around the existing single-threaded vector DB POC.
  • Enable sharding and parallel loading of large vector datasets across multiple instances.
  • Implement logic to dispatch and coordinate parallel queries , aggregate candidate vectors, apply a pluggable distance metric (e.g., Euclidean, cosine similarity, SAD / Manhattan), and merge and sort results before returning to the caller.
  • Expose both command-line and REST interfaces to interact with the system.
  • Output clear timing metrics to demonstrate speed-ups from parallel execution.
  • Deliver a working, testable prototype —production-ready polish is not required.

What We’re Looking For

  • Deep expertise in distributed computing and parallel processing , including MapReduce-style design patterns, data sharding, and inter-process communication (IPC).
  • Proven track record as a senior engineer who can work independently, move quickly, and deliver results with minimal oversight.
  • Strong problem-solving skills and practical experience building distributed systems and prototypes.
  • Comfort working across multiple languages and runtimes. Choose whatever tech stack gets the job done fastest (Python, C#, C, etc.).
  • Ability to clearly demonstrate and benchmark performance improvements.
  • Engagement Snapshot

  • Timeline : Short-term, estimated 5–10 days of focused work.
  • Start Date : ASAP
  • Location : Remote
  • Deliverables : Fully functional parallel prototype with CLI + REST interfaces, benchmark metrics, and sharded query support.
  • Ready to build something fast and clever? Apply now and help bring this proof-of-concept to life.

    Create a job alert for this search

    System Engineer • Pune, India

    Related jobs
    • Promoted
    eBPF Systems Engineer (Core Agent Team)

    eBPF Systems Engineer (Core Agent Team)

    Alma SecurityPune, IN
    The ideal candidate will help build, maintain, and troubleshoot, the company's rapidly expanding infrastructure.They will work alongside other engineers to ensure highest levels of performance and ...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Design Verification Engineer

    Senior Design Verification Engineer

    Nurotech circuits private limitedPune, Maharashtra, India
    Tips : UVM, Design Verification.Senior DV engineer to develop UVM / SV-based testbench.Good knowledge of SV / UVM is a must. Should have developed UVM / SV components like driver / monitor / scoreboard,.Exposu...Show moreLast updated: 30+ days ago
    C,C++,RTOS - Embedded Systems Engineer

    C,C++,RTOS - Embedded Systems Engineer

    Epergne SolutionsPune, Maharashtra, India
    Quick Apply
    Job Title : C,C++,RTOS -Embedded Systems Engineer.We are seeking a highly skilled.The ideal candidate should have hands-on expertise in. Agile tools and industrial control systems.Design, develop, a...Show moreLast updated: 30+ days ago
    • Promoted
    Associate Systems Engineer

    Associate Systems Engineer

    SapaadPune, IN
    Sapaad, has seen tremendous success in the last decade, with thousands of customers.Driven by a team of passionate developers and designers, Sapaad is constantly. Singapore, with offices across five...Show moreLast updated: 30+ days ago
    • Promoted
    System Engineer

    System Engineer

    CUS TechPune, IN
    We are looking for a detail-oriented and proactive.The role involves ensuring the reliability, security, and performance of servers, networks, and applications while providing technical support and...Show moreLast updated: 2 days ago
    • Promoted
    Resident Engineer – Kubernetes & Portworx

    Resident Engineer – Kubernetes & Portworx

    CMK Resources, Inc.pune, maharashtra, in
    CMK Resources Resident Engineer – Kubernetes & Portworx (3 openings).Help Shape the Future of Kubernetes Storage.Our client's largest and most strategic customer is moving VMware-based workloads to...Show moreLast updated: 9 days ago
    • Promoted
    System Engineer - Telecom Domain

    System Engineer - Telecom Domain

    TalproPune
    Role Overview : We are seeking skilled System Engineers with strong expertise in telecom systems, network implementation, and software / hardware integrations.The idea...Show moreLast updated: 30+ days ago
    • Promoted
    Solution Engineer

    Solution Engineer

    AdeccoPune, Maharashtra, India
    Greetings from Adecco!!!! We are in the screening process for “Solution Engineers” for a Leading Market Research Company Company : IT Services and IT Consulting, Market Research Location : Remote ...Show moreLast updated: 16 days ago
    MS Senior Systems Engineer

    MS Senior Systems Engineer

    Mindpool TechnologiesPune, Maharashtra, India
    Quick Apply
    Mindpool is hiring for Avamar in Pune.Establish, manage and maintain the Allscripts Global Managed Services Storage and Backup infrastructure that meets agreed functional requirements and customer ...Show moreLast updated: 30+ days ago
    • Promoted
    System Engineer

    System Engineer

    founditPune, Maharashtra, India
    Manage and maintain system-level requirements using systems engineering principles and requirements management tools.Understand and decompose technical system requirements into detailed subsystem / u...Show moreLast updated: 5 days ago
    Systems Support Engineer

    Systems Support Engineer

    Mindpool TechnologiesPune, Maharashtra, India
    Quick Apply
    Mindpool is hiring for App support, windows, SQL and monitoring tool.Experience / Knowledge on Application / Infrastructure Monitoring tools / solutions : DynaTrace / AppDynamics / NewRelic or other Applicati...Show moreLast updated: 30+ days ago
    • Promoted
    System Engineer

    System Engineer

    HyqooPune, IN
    Job Title : Systems Engineer L3.Duration : 12 months with high possible extension.Working time zone : Night Shifts (EST, CST, PST). Working hours 40 hours per week (8 hours per day).We are seeking a hi...Show moreLast updated: 22 days ago
    • Promoted
    Bio Process Design (Technical Sales Support) #Eng-Bio-2025-05-07-44

    Bio Process Design (Technical Sales Support) #Eng-Bio-2025-05-07-44

    DDE Bioengineering Pvt. Ltd.Pimpri Chinchwad, Maharashtra, India
    Should be on top of his / her Professional knowledge base and Flexible and Adaptable to new Technologies / Processes / Operating Systems. Passion for meeting the pre-determined Key Performance Indicat...Show moreLast updated: 30+ days ago
    • Promoted
    Linux Engineer

    Linux Engineer

    Accolade Electronics Private LimitedPune, Maharashtra, India
    Job Description : Embedded Linux Developer.Linux kernel, and driver / application development.The ideal candidate should have strong expertise in low-level programming, board bring-up, and system inte...Show moreLast updated: 1 day ago
    Expert Systems Engineer

    Expert Systems Engineer

    Mindpool TechnologiesPune, Maharashtra, India
    Quick Apply
    Allscripts is hiring for Expert Systems Engineer- Linux / Unix, Azure, Kubernetes.Expert Systems Engineer, Pune .Provide production support for the Linux / Unix infrastructure.X7 Operational support Li...Show moreLast updated: 30+ days ago
    • Promoted
    Embedded System Engineer - C / C++ Programming

    Embedded System Engineer - C / C++ Programming

    Connect2TalentPune
    Job Title : Embedded Systems Engineer Location : Indore / Pune Employment Type : Full-time <...Show moreLast updated: 8 days ago
    • Promoted
    Platform Engineer(AWS, Devops, System Administration, linux) with New Zealand based product company, Koregaon Park, Pune.

    Platform Engineer(AWS, Devops, System Administration, linux) with New Zealand based product company, Koregaon Park, Pune.

    Seventh Contact Hiring SolutionsPune, Maharashtra, India
    Position – Platform Engineer-Senior.Working Model : 3 days Work from Office (WFO) –.Must be available for a 24 / 7 rotational shift for one week (on-call support). Minimum of 6+ years of experience in ...Show moreLast updated: 8 days ago
    • Promoted
    Avantor - Senior Systems Engineer - IAM Services

    Avantor - Senior Systems Engineer - IAM Services

    AvantorPune
    The Opportunity : - Under limited supervision, responsible for the operations of secure and highly available computing platforms, servers,...Show moreLast updated: 18 days ago
    • Promoted
    Platform Engineer(AWS, Devops, System Administration, linux) with New Zealand based product company,

    Platform Engineer(AWS, Devops, System Administration, linux) with New Zealand based product company,

    Seventh Contact Hiring SolutionsPune, India
    Position – Platform Engineer-Senior.Working Model : 3 days Work from Office (WFO) – UK shift timings.Must be available for a 24 / 7 rotational shift for one week (on-call support).Minimum of 6+ years ...Show moreLast updated: 4 days ago
    DevOps Engineer (System Engineer)

    DevOps Engineer (System Engineer)

    KNOREXPune, MH, IN
    Quick Apply
    Founded in 2009, Knorex (https : / / knorex.Through its flagship universal marketing platform, Knorex XPO unifies the connectivity to each of the major marketing channels including social media, search...Show moreLast updated: 30+ days ago