AI Model Evaluation Specialist
People Prime WorldwideRepublic Of India, IN17 hours ago
Job descriptionModel Quality Assessment : Evaluate the quality of AI model responses that include code, machine learning, AI, identifying errors, inefficiencies, and non-compliance with established standards. Code Annotation and Labeling : Accurately generate, annotate and label code snippets, algorithms, and technical documentation according to project-specific guidelines. Review and Feedback : Provide detailed, constructive feedback on model and other outputs Comparative Analysis : Compare multiple outputs and rank them based on criteria such as correctness, efficiency, readability, and adherence to programming best practices. Data Validation : Validate and correct datasets to ensure high-quality data for model training and evaluation. Collaboration : Work closely with data scientists and engineers to identify new annotation guidelines, resolve ambiguities, and contribute to the overall project strategy. Strong background in software engineering / development, computer science, ML / AI, or related technical field, with a keen eye for detail and a passion for data accuracy Programming Proficiency : Demonstrated expertise in : Python (must-have) and at least one or more common programming languages such as : JavaScript, Rust, Node.Js, Typescript, C, C++, Shell (Bonus points) At least 1 or more less common programming languages such as : Rust, Shell, Go, Ruby, Swift, PHP, Kotlin Knowledge of web technologies & frameworks Web Scraping, API integration, HTML / CSS / JavaScript Web application development (e.G. Flask) Frontend (e.G. React) and backend (e.G. Node.Js) development Machine Learning & Artificial Intelligence Machine Learning (General concepts, model development, experimentation, training, evaluation) Deep Learning (General, frameworks like TensorFlow, PyTorch, JAX, Keras, neural networks, CNNs, RNNs, transformer architecture, LSTM) Natural Language Processing (NLP) Reinforcement Learning (e.G., PPO, Q-learning, policy gradients, A2C, DQN, AlphaZero) Computer Vision (e.G., image processing, analysis, instance segmentation, OCR, deepfake detection) Game AI (Specific AI for intelligent opponents, understanding game states, actions, rewards) Data Science & Engineering Data Analysis & Manipulation (including Pandas, Matplotlib, Seaborn, NumPy, statistical analysis, general data processing, visualization libraries) Database Management (SQL, NoSQL, SQLite, data storage Algorithms & Mathematics Algorithms (General and specific like Monte Carlo Tree Search (MCTS), A pathfinding, Sudoku solving, Collatz sequence, optimization, combinatorial problems) Software Engineering Practices & Tools Version Control (Git / GitHub) Coding Best Practices : A solid understanding of clean code principles, software design patterns, and debugging techniques. Attention to Detail : Meticulous attention to detail and the ability to follow complex, multi-step instructions precisely. Problem-Solving : Strong analytical and problem-solving skills to evaluate and troubleshoot complex coding solutions. Communication : Excellent written communication skills to provide clear, concise, and actionable feedback Proactiveness : Willingness to challenge the status quo to conduct a given task and achieve the end goal Experience with AI / ML concepts, particularly with large language models (LLMs) and code generation. Familiarity with various programming paradigms (e.G., object-oriented, functional). Experience with code review in a professional or academic setting. Experience in data annotation or similar quality assurance roles Writing clean, high-quality, high-performance, maintainable code Develop and support software including applications, database integration, interfaces, and new functionality enhancements Coordinate cross-functionally to insure project meets business objectives and compliance standards Support test and deployment of new products and features Participate in code reviews. Bachelor's degree in Computer Science (or related field)
About Company
Our client is a trusted global innovator of IT and business services. We help clients transform through consulting, industry solutions, business process services, digital & IT modernization and managed services. Our client enables them, as well as society, to move confidently into the digital future. We are committed to our clients’ long-term success and combine .
Job Title : AI / ML Engineer
Location : Chennai
Experience : 8+ yrs
Job Type : Contract to hire
Notice Period : - Immediate joiner
Mandatory Skills
- Hands-on experience with AI / ML Engineer.
Responsibilities :
Qualifications :
Preferred Qualifications :
Responsibilities
Qualifications
Create a job alert for this search
Evaluation Specialist • Republic Of India, IN
Related jobs
- Promoted
AI / ML Engineer – Technical Interview Panel Expert
Tek Supportnagpur, maharashtra, in AI / ML Engineer – Technical Interview Panel Expert.Technical Interview Panel Expert.The expert will participate in designing, structuring, and executing high-quality technical interviews for AI and ...Show moreLast updated: 1 day ago
- Promoted
AI Model Evaluation Specialist
TuringRepublic Of India, IN Remote contract for PhDs in Mathematics, Statistics, or related fields.Work on cutting-edge projects with top AI labs while.
Help fine-tune large language models (like ChatGPT) using your math and a...Show moreLast updated: 30+ days ago
- Promoted
AI Model Development Specialist
Tata Consultancy ServicesPune, Republic Of India, IN A fundamental understanding of ML and DL principles, algorithms, and neural network architectures is critical.Proficient in Python and experienced with AI development tools like TensorFlow and PyTo...Show moreLast updated: 30+ days ago
- Promoted
Applied AI Specialist
AscendionChennai, Republic Of India, IN OCR Tools (Azure Doc Intelligence / Tesseract / John Snow Labs).Image Pre-processing (denoising / enrichment) in OCR pipeline.
Frameworks / Platforms - Langchain / LlamaIndex / CrewAI / Semantic Ker...Show moreLast updated: 1 day ago
- Promoted
AI Model Evaluation Engineer
TuringRepublic Of India, IN We’re looking for experienced Python developers to collaborate with one of the world’s top Large Language Model (LLM) companies.
Your work will directly help improve how AI models think, reason, and...Show moreLast updated: 30+ days ago
- Promoted
AI Research Engineer (Model Evaluation)
ConfidentialIndia Join Tether and Shape the Future of Digital Finance.At Tether, we're not just building products, we're pioneering a global financial revolution.
Our cutting-edge solutions empower businesses—from ex...Show moreLast updated: 7 days ago
- Promoted
Language Model Evaluation Analyst
TuringPune, Republic Of India, IN Join us as an Research Analyst and help shape the future of large language models (like GPT).You’ll work on fascinating analytical questions, research real-world scenarios, and create structured co...Show moreLast updated: 1 day ago
- Promoted
AI Exploration Engineer
Mitchell Martin Inc.Nagpur, IN Design and execute machine learning experiments to evaluate emerging AI technologies and frameworks.Prototype and assess end-to-end AI solutions to inform product and platform strategy.Formulate hy...Show moreLast updated: 30+ days ago
- Promoted
- New!
AI Model Evaluation and Training Engineer
People Prime WorldwideRepublic Of India, IN Our client is a Palo Alto–based AI infrastructure and talent platform founded in 2018.It helps companies connect with remote software developers using AI-powered vetting and matching technology.Ori...Show moreLast updated: 17 hours ago
- Promoted
Principal Software Engineer - AI Model Evaluation
TuringRepublic Of India, IN Turing is seeking experienced software engineers to help design and validate real-world coding tasks that push the limits of today’s large language models.
You’ll work hands-on with public GitHub re...Show moreLast updated: 30+ days ago
- Promoted
- New!
AI Model Deployment Specialist
Tata Consultancy ServicesChennai, Republic Of India, IN Experience in deploying complex, multi-component systems, preferably in cloud environments (AWS).Deep understanding of AI models, especially LLMs, and the infrastructure required to support them.Fa...Show moreLast updated: 10 hours ago
- Promoted
AI Model Evaluation Expert (Physics)
TuringRepublic Of India, IN Remote contract for PhDs in Physics, Applied Physics, or related fields.Work on cutting-edge projects with top AI labs while earning $50+ / hour, fully remote, with flexible weekly hours.Help fine-tu...Show moreLast updated: 1 day ago
- Promoted
Responsible Ai
EXLRepublic Of India, IN We are seeking a highly skilled and principled Responsible AI Evaluator to assess, audit, and ensure the ethical development and deployment of AI models across the enterprise.This role spans tradit...Show moreLast updated: 30+ days ago
- Promoted
AI Evaluation Expert (Mathematics)
TuringRepublic Of India, IN Remote contract for PhDs in Mathematics, Statistics, or related fields.Work on cutting-edge projects with top AI labs while.
Help fine-tune large language models (like ChatGPT) using your math and a...Show moreLast updated: 1 day ago
- Promoted
Evaluation Specialist
LawSikhoNagpur, IN Description : Evaluation Associate SkillArbitrage.As an Evaluations Associate, you will : .Review student submissions in real-world skills : .
ChatGPT, Canva, Wix, Jasper, Midjourney, Notion AI, etc.Twit...Show moreLast updated: 4 days ago
- Promoted
AI Developer - Transformers - 3 to 6 Years
AIMLEAPNagpur, IN AI Developer - Transformers (2 – 6 Years).Tech in Computer Science, AI / ML, or related field.AI / ML with hands-on exposure to LLMs and agentic AI development.
Strong Python programming background for ...Show moreLast updated: 4 days ago
- Promoted
STEM Content Evaluation Specialist (GenAI)
Synstack TechnologiesRepublic Of India, IN As a STEM Rater for [Maths / Physics / Chemistry / Biology / Coding / Finance], you will be a crucial contributor to shaping the "brain" of our AI.
Working closely with the STEM Lead and your team, your prima...Show moreLast updated: 2 days ago
- Promoted
AI Biology Evaluation Expert
TuringRepublic Of India, IN Remote contract for PhDs in Biology, Biotechnology, Biochemistry, or related fields.Work on cutting-edge projects with top AI labs while earning up to $50+ / hour, fully remote, with flexible weekly ...Show moreLast updated: 30+ days ago