Talent.com
Trigent Software Private Limited
Senior Data Scientist (L2-Systems Software Engineer)Trigent Software Private Limited • Chennai, Tamil Nadu, India
Senior Data Scientist (L2-Systems Software Engineer)

Senior Data Scientist (L2-Systems Software Engineer)

Trigent Software Private Limited • Chennai, Tamil Nadu, India
21 days ago
Job description
  • Specific contributions expected from the role:Infrastructure as Code (IaC); Inference Optimization: Develop and optimize high-throughput low-latency inference engines for LLMs (e.g. Llama 3 Mistral) using C and CUDA.
  • Performance Engineering: Profile and eliminate bottlenecks in the software stack-from Python-level orchestration down to GPU kernel execution.
  • Memory Management: Implement advanced memory techniques like KV Cache optimization PagedAttention and model quantization (INT8/FP8/AWQ) to maximize hardware utilization.
  • Distributed Systems: Architect and maintain distributed serving systems capable of handling multi-node multi-GPU inference using technologies like Ray vLLM or TGI.
  • Framework Integration: Build and maintain high-performance Python bindings (Pybind11) for C backends to expose system-level optimizations to the AI research team.
  • Tooling & Observability: Build custom profiling tools and dashboards to monitor TTFT (Time to First Token) throughput and hardware telemetry (SMI)
  • Proficiency in Large Models & Deep Neural Networks. Hands-on experience in working with large models & deep neural networks.
  • Expertise in LLMs with working knowledge of large language models (LLMs).
  • Extensive experience in System platform Architecture.
  • Experience in Development Preferable for memory/storage/ any embedded system.
  • In depth knowledge and extensive experience in dealing with Standardizations/Technical Papers/Patents.
  • Extensive experience with C/C and Python programming.

Employment Type : Full Time
Experience: years
Vacancy: 1
Create a job alert for this search

Senior Data Scientist (L2-Systems Software Engineer) • Chennai, Tamil Nadu, India

Similar jobs

Data Engineer-Senior II-6

FedExChennai, Tamil Nādu, IN

Responsible for designing and implementing data pipelines, ensuring data quality and accessibility, creating data models, managing ETL processes, optimizing databases, collaborating with stakeholde... Show more

Data Engineer-Senior II-14

FedExChennai, Tamil Nādu, IN

Responsible for designing and implementing data pipelines, ensuring data quality and accessibility, creating data models, managing ETL processes, optimizing databases, collaborating with stakeholde... Show more

Data Engineer-Senior II-7

FedExChennai, Tamil Nādu, IN

Responsible for designing and implementing data pipelines, ensuring data quality and accessibility, creating data models, managing ETL processes, optimizing databases, collaborating with stakeholde... Show more

Data Engineer-Senior II-11

FedExChennai, Tamil Nādu, IN

Responsible for designing and implementing data pipelines, ensuring data quality and accessibility, creating data models, managing ETL processes, optimizing databases, collaborating with stakeholde... Show more

Sr AI Solutions Engineer

Centific Global Solutions, Inc.India Office - Chennai

In this role, you will provide regular updates on solutions and benefits/feature scope to Leadership and stakeholders.You'll apply NVIDIA processing and interconnect products such as NeMo, Riva, RA... Show more

Data Scientist-Senior I

FedExChennai, Tamil Nādu, IN

Primary Location - Chennai </p><p><strong>Job Summary:</strong></p><p>Takes ownership over select data science initiatives.Advances ACCs’ broad capabilities to u... Show more

Data Engineer-Senior II-10

FedExChennai, Tamil Nādu, IN

Responsible for designing and implementing data pipelines, ensuring data quality and accessibility, creating data models, managing ETL processes, optimizing databases, collaborating with stakeholde... Show more

Data Engineer-Senior II-9

FedExChennai, Tamil Nādu, IN

Responsible for designing and implementing data pipelines, ensuring data quality and accessibility, creating data models, managing ETL processes, optimizing databases, collaborating with stakeholde... Show more

Software Engineer-Senior II-2

FedExChennai, Tamil Nādu, IN

Responsible for analyzing requirements, collaborating on system design, developing efficient algorithms, ensuring scalability, integrating with external services, optimizing performance, adhering t... Show more

Data Engineer-Senior II-13

FedExChennai, Tamil Nādu, IN

Responsible for designing and implementing data pipelines, ensuring data quality and accessibility, creating data models, managing ETL processes, optimizing databases, collaborating with stakeholde... Show more

Data Engineer-Senior II-3

FedExChennai, Tamil Nādu, IN

Responsible for developing, optimize, and maintaining business intelligence and data warehouse systems, ensuring secure, efficient data storage and retrieval, enabling self-service data exploration... Show more

Senior Lead Clinical Data Science Programmer

ICONChennai, India

Senior Lead Clinical Data Science Programmer.ICON plc is a world-leading healthcare intelligence and clinical research organization.We’re proud to foster an inclusive environment driving innovation... Show more

Data Engineer-Senior II-12

FedExChennai, Tamil Nādu, IN

Responsible for designing and implementing data pipelines, ensuring data quality and accessibility, creating data models, managing ETL processes, optimizing databases, collaborating with stakeholde... Show more

Data Scientist-Senior II

FedExChennai, Tamil Nādu, IN

Job Profile Summary:</strong></p><p class="ql-align-justify">Takes ownership and responsibility over major data science initiatives.Advances ACCs’ broad capabilities to use and de... Show more

Data Scientist II

FedExChennai, Tamil Nādu, IN

Primary Work Location - Chennai </strong></p><p><br></p><p><strong>Job Summary</strong></p><p>Under general supervision, advances ACCs’ b... Show more

Data Engineer-Senior II-8

FedExChennai, Tamil Nādu, IN

Responsible for designing and implementing data pipelines, ensuring data quality and accessibility, creating data models, managing ETL processes, optimizing databases, collaborating with stakeholde... Show more