Talent.com
This job offer is not available in your country.
Senior AI QA Test Analyst

Senior AI QA Test Analyst

Nasdaqbangalore, India
21 hours ago
Job description

Your role

and responsibilities :

We are seeking a highly skilled Test Automation Specialist to join our AI product development team. The ideal candidate will have expertise in designing and implementing automated testing frameworks for sophisticated AI and machine learning systems.

Furthermore, you will :

  • Develop and maintain comprehensive automated test suites for generative AI models, including language models,and multimodal systems
  • Create innovative testing strategies to validate the quality, coherence, and safety of AI-generated content
  • Design and implement automation frameworks to test generative AI products across multiple platforms and use cases
  • Collaborate closely with AI researchers, data scientists, and product developers to understand product requirements and unique testing challenges of generative systems
  • Develop tools and scripts to generate diverse test data sets and simulate real-world generative AI scenarios
  • Implement automated tests for prompt engineering, fine-tuning processes, and model versioning
  • Continuously improve testing methodologies to keep pace with constantly evolving generative AI technologies
  • Analyze test results and provide detailed reports on model performance, potential biases, and areas for improvement

We expect you to have

  • Bachelor's or Master's degree in Computer Science, AI / ML, or related technical field
  • 2-4 years of experience in software test automation, with at least 2 years focused on AI / ML systems, preferably generative AI
  • Strong programming skills in Python.
  • Solid understanding of AI / ML algorithms and ability to validate their accuracy, bias, and performance.
  • Expertise in test automation tools and frameworks suitable for AI testing tools / frameworks like RAGAS, Deep eval, TrueLens, AWS Bedrock Evaluator, pytest, Robot Framework.
  • Experience in testing AI-driven applications , including data validation, model performance validation, and AI explainability.
  • Strong analytical and problem-solving skills, with a deep understanding of AI risks and mitigation strategies.
  • Solid experience in reviewing architectures, test strategies, and automation frameworks .
  • Knowledge of statistical analysis, probability, and mathematical modeling to validate AI systems.
  • Experience with AWS Bedrock, vectorized databases, and Sonnet / LLM algorithms .
  • Experience in performance testing of AI models and large-scale distributed systems.
  • It would be great if you

  • Experience with cloud platforms (AWS) for AI deployment and testing at scale
  • Familiarity with containerization and orchestration tools (Docker, Kubernetes)
  • Knowledge of vector databases.
  • Does it sound like you? What happens now?

    As the selection process is ongoing, please submit your application in English as soon as possible. We will get back to you in 2-3 weeks.

    What will it be like working here?

    Nasdaq is a vibrant and entrepreneurial company where everyone is encouraged to take initiative, challenge status quo, and take intelligent risks. We want everyone to feel welcome and bring their authentic self to work. Every day, we are building a culture where we all feel connected, supported and empowered. We are a Hybrid-first environment that accepts work-life balance and fdevelopwell-being.

    Come as you are

    Nasdaq is an equal opportunity employer. We positively encourage applications from suitably qualified and eligible candidates regardless of age, color, disability, national origin, ancestry, race, religion, gender, sexual orientation, gender identity and / or expression, veteran status, genetic information or any other status protected by applicable law.

    Nasdaq is a leading global provider of trading, clearing, exchange technology, listing, information, and public company services. As the creator of the world's first electronic stock market, its technology powers more than 100 marketplaces in 50 countries. Nasdaq is home to over 4,000 total listings with a market value of approximately $12 trillion.

    To learn more, about our business visit business.nasdaq.com. Check out more about our Life at Nasdaq.

    Come as You Are

    Nasdaq is an equal opportunity employer. We positively encourage applications from suitably qualified and eligible candidates regardless of age, color, disability, national origin, ancestry, race, religion, gender, sexual orientation, gender identity and / or expression, veteran status, genetic information, or any other status protected by applicable law.

    We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request an accommodation.

    Create a job alert for this search

    Senior Test Analyst • bangalore, India

    Related jobs
    • Promoted
    Senior Test Engineer

    Senior Test Engineer

    HCLTechBengaluru, Karnataka, India
    Design, develop, and execute comprehensive test plans, strategies, and.Conduct hands-on backend testing, including.REST API testing and AWS environment testing. Years of experience in software quali...Show moreLast updated: 9 days ago
    • Promoted
    Senior Quality Assurance Automation Engineer

    Senior Quality Assurance Automation Engineer

    Andor TechBangalore Rural, Karnataka, India
    Location : Work From Office (5 Days).We are seeking a skilled QA / Automation Engineer with hands-on experience in API, Web, Desktop, and Mobile application testing. The candidate should have strong au...Show moreLast updated: 9 days ago
    • Promoted
    Senior Data Analyst

    Senior Data Analyst

    Elife Transferhosur, tamil nadu, in
    At Hoppa & Elife, we’re unifying all ground transportation into one powerful marketplace, giving travellers the freedom to book airport transfers, ride-hailing, shared shuttles, private cars, and t...Show moreLast updated: 9 days ago
    • Promoted
    TEST LEAD SWIFT

    TEST LEAD SWIFT

    OnPoint Insightshosur, tamil nadu, in
    The test lead develops test strategies, creates test plans, and takes responsibility for building and managing the test team, executing manual and automated tests, identifying and reporting bugs, a...Show moreLast updated: 6 days ago
    • Promoted
    Quality Assurance Analyst (Level 1)

    Quality Assurance Analyst (Level 1)

    Blutichosur, tamil nadu, in
    This entry-level role is ideal for candidates who are eager to grow their skills in data quality assurance within an Agile offshore environment. This is a 100% long term remote opportunity.The candi...Show moreLast updated: 7 days ago
    • Promoted
    Senior Test Engineer

    Senior Test Engineer

    Lucidityhosur, tamil nadu, in
    Lucidity is a rapidly growing company with a first of its kind and impactful product in the cloud storage.Joining Lucidity offers the opportunity to work on cutting-edge technology, solve real-worl...Show moreLast updated: 30+ days ago
    • Promoted
    Automation Engineer(Testim / CPQ)

    Automation Engineer(Testim / CPQ)

    Gokool Digitalhosur, tamil nadu, in
    Quality Assurance / Engineering.You will contribute to building stable, maintainable test suites that ensure high-quality business operations across CRM and ERP systems. Salesforce CPQ and NetSuite ...Show moreLast updated: 22 days ago
    • Promoted
    Quality Analyst - API Testing

    Quality Analyst - API Testing

    MyBlue.aiBangalore
    We are looking for a QA Engineer to ensure that BLUE delivers flawless performance across video ingestion, compression, AI analytics, and reporting layers. The QA Engineer will design and execute te...Show moreLast updated: 30+ days ago
    • Promoted
    Senior QA Engineer (Database Testing)

    Senior QA Engineer (Database Testing)

    CESbangalore, karnataka, in
    If you have hands-on expertise in SQL query validation, are proficient in Excel, and enjoy working independently in.SQL query validation, to ensure. Collaborate with cross-functional teams to.Proven...Show moreLast updated: 6 days ago
    • Promoted
    Senior Test Engineer

    Senior Test Engineer

    Trantorhosur, tamil nadu, in
    We are building a modern, scalable web platform using a headless CMS architecture powered by Drupal (backend) and Next.The application prioritizes high performance, accessibility, and seamless inte...Show moreLast updated: 1 day ago
    • Promoted
    Senior AI Engineer

    Senior AI Engineer

    Milestone Technologies, Inc.hosur, tamil nadu, in
    AI-first, data-centric platform.You will implement agentic capabilities (intent, planner, router / composer), integrate knowledge-graph reasoning alongside a strong RAG baseline, and instrument robus...Show moreLast updated: 9 days ago
    • Promoted
    1-Oct-25_Virtual Drive_ETL Test Engineer

    1-Oct-25_Virtual Drive_ETL Test Engineer

    Tata Consultancy Servicesshosur, tamil nadu, in
    Lead and mentor a team of ETL testers, providing technical guidance, training, and support in ETL tools, SQL, and test automation frameworks. Create and review complex test cases, test scripts, and ...Show moreLast updated: 1 day ago
    • Promoted
    Senior Test Analyst

    Senior Test Analyst

    FimeBengaluru, Karnataka, India
    Fime enables its clients to create and launch trusted and secure solutions with consulting and testing services in payments, smart mobility, biometrics, and authentication.With 800+ experts around ...Show moreLast updated: 30+ days ago
    • Promoted
    Senior Test Lead

    Senior Test Lead

    BirlasoftBengaluru, Karnataka, India
    Birlasoft, a global leader at the forefront of Cloud, AI, and Digital technologies, seamlessly blends domain expertise with enterprise solutions. The company’s consultative and design-thinking appro...Show moreLast updated: 21 days ago
    • Promoted
    Senior QA Analyst [T500-20402]

    Senior QA Analyst [T500-20402]

    Talent500Bengaluru, Karnataka, India
    Talent500 is hiring for one of its client's.Founded in 1999 and headquartered in New York City, Huge is a global design and technology company that creates digital experiences for the world’s most ...Show moreLast updated: 9 days ago
    • Promoted
    Experienced Test Analyst

    Experienced Test Analyst

    FimeBengaluru, Karnataka, India
    Fime enables its clients to create and launch trusted and secure solutions with consulting and testing services in payments, smart mobility, biometrics, and authentication.With 800+ experts around ...Show moreLast updated: 30+ days ago
    • Promoted
    Lead QA Test Automation Engineer SDET

    Lead QA Test Automation Engineer SDET

    Omni Reachhosur, tamil nadu, in
    We are looking for 8+ years experience Lead QA Automation Engineers (Engineering background mandatory.Ability to interact with Customer. This is a full-time remote role for a Lead QA Test Automatio...Show moreLast updated: 15 days ago
    • Promoted
    Senior Test Lead -Sales

    Senior Test Lead -Sales

    BirlasoftBengaluru, Karnataka, India
    Job Title : Senior Test Lead – Sales - CRM Platform - Microsoft D365.Experience Level : 10 + years in QA / UAT, with 3+ years in Sales - CRM and - Sales platform testing. We are seeking a Senior Test Le...Show moreLast updated: 21 days ago
    • Promoted
    Product Analyst

    Product Analyst

    MSE Technologybangalore, karnataka, in
    We are looking for a Product Analyst.Data Centre of Excellence and support the delivery of high-quality analytics for our digital products. This role is suited for someone with.Senior Product Analys...Show moreLast updated: 1 day ago
    • Promoted
    • New!
    SITA - Senior Test Analyst - Automation Testing

    SITA - Senior Test Analyst - Automation Testing

    SITA INFORMATION NETWORKING COMPUTING INDIABangalore
    WELCOME TO SITA : At SITA, we keep airports moving, airlines flying smoothly, and borders open.Our technology and communication innovations power the success of the g...Show moreLast updated: 12 hours ago