Talent.com
This job offer is not available in your country.
Senior AI QA Test Analyst

Senior AI QA Test Analyst

NasdaqBengaluru, Karnataka, India
3 hours ago
Job description

Your role

and responsibilities :

We are seeking a highly skilled Test Automation Specialist to join our AI product development team. The ideal candidate will have expertise in designing and implementing automated testing frameworks for sophisticated AI and machine learning systems.

Furthermore, you will :

  • Develop and maintain comprehensive automated test suites for generative AI models, including language models,and multimodal systems
  • Create innovative testing strategies to validate the quality, coherence, and safety of AI-generated content
  • Design and implement automation frameworks to test generative AI products across multiple platforms and use cases
  • Collaborate closely with AI researchers, data scientists, and product developers to understand product requirements and unique testing challenges of generative systems
  • Develop tools and scripts to generate diverse test data sets and simulate real-world generative AI scenarios
  • Implement automated tests for prompt engineering, fine-tuning processes, and model versioning
  • Continuously improve testing methodologies to keep pace with constantly evolving generative AI technologies
  • Analyze test results and provide detailed reports on model performance, potential biases, and areas for improvement

We expect you to have

  • Bachelor's or Master's degree in Computer Science, AI / ML, or related technical field
  • 2-4 years of experience in software test automation, with at least 2 years focused on AI / ML systems, preferably generative AI
  • Strong programming skills in Python.
  • Solid understanding of AI / ML algorithms and ability to validate their accuracy, bias, and performance.
  • Expertise in test automation tools and frameworks suitable for AI testing tools / frameworks like RAGAS, Deep eval, TrueLens, AWS Bedrock Evaluator, pytest, Robot Framework.
  • Experience in testing AI-driven applications , including data validation, model performance validation, and AI explainability.
  • Strong analytical and problem-solving skills, with a deep understanding of AI risks and mitigation strategies.
  • Solid experience in reviewing architectures, test strategies, and automation frameworks .
  • Knowledge of statistical analysis, probability, and mathematical modeling to validate AI systems.
  • Experience with AWS Bedrock, vectorized databases, and Sonnet / LLM algorithms .
  • Experience in performance testing of AI models and large-scale distributed systems.
  • It would be great if you

  • Experience with cloud platforms (AWS) for AI deployment and testing at scale
  • Familiarity with containerization and orchestration tools (Docker, Kubernetes)
  • Knowledge of vector databases.
  • Does it sound like you? What happens now?

    As the selection process is ongoing, please submit your application in English as soon as possible. We will get back to you in 2-3 weeks.

    What will it be like working here?

    Nasdaq is a vibrant and entrepreneurial company where everyone is encouraged to take initiative, challenge status quo, and take intelligent risks. We want everyone to feel welcome and bring their authentic self to work. Every day, we are building a culture where we all feel connected, supported and empowered. We are a Hybrid-first environment that accepts work-life balance and fdevelopwell-being.

    Come as you are

    Nasdaq is an equal opportunity employer. We positively encourage applications from suitably qualified and eligible candidates regardless of age, color, disability, national origin, ancestry, race, religion, gender, sexual orientation, gender identity and / or expression, veteran status, genetic information or any other status protected by applicable law.

    Nasdaq is a leading global provider of trading, clearing, exchange technology, listing, information, and public company services. As the creator of the world's first electronic stock market, its technology powers more than 100 marketplaces in 50 countries. Nasdaq is home to over 4,000 total listings with a market value of approximately $12 trillion.

    To learn more, about our business visit business.nasdaq.com. Check out more about our Life at Nasdaq.

    Come as You Are

    Nasdaq is an equal opportunity employer. We positively encourage applications from suitably qualified and eligible candidates regardless of age, color, disability, national origin, ancestry, race, religion, gender, sexual orientation, gender identity and / or expression, veteran status, genetic information, or any other status protected by applicable law.

    We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request an accommodation.

    Create a job alert for this search

    Senior Test Analyst • Bengaluru, Karnataka, India

    Related jobs
    • Promoted
    • New!
    QA & Testing Lead Analyst

    QA & Testing Lead Analyst

    The Cigna GroupBengaluru, Karnataka, India
    Together, with our 74, 000 employees worldwide that service Cigna, Express Scripts and other affiliate customers, we aspire to transform health services, making them more affordable and accessible ...Show moreLast updated: 3 hours ago
    • Promoted
    • New!
    Senior Tester

    Senior Tester

    Version 1Bengaluru, Karnataka, India
    You may have been working as a Senior Software Engineer in Test, Senior Test Engineer or Test Analyst who is confident in their ability performing automation testing. You will be responsible for des...Show moreLast updated: 3 hours ago
    • Promoted
    • New!
    Senior QA Analyst

    Senior QA Analyst

    The Cigna GroupBengaluru, Karnataka, India
    Write test strategy and test case documents that are derived from user stories for one or more features.Test cases should include positive and negative scenarios as well as test data setup / config...Show moreLast updated: 3 hours ago
    • Promoted
    • New!
    Senior QA Analyst- software testing

    Senior QA Analyst- software testing

    dentsuBengaluru, Karnataka, India
    We are seeking an experienced QA Tester with expertise in manual testing and a basic understanding of automation to help ensure our software products meet the highest standards of quality.The ideal...Show moreLast updated: 3 hours ago
    • Promoted
    Senior Test Analyst

    Senior Test Analyst

    FimeBengaluru, Karnataka, India
    Fime enables its clients to create and launch trusted and secure solutions with consulting and testing services in payments, smart mobility, biometrics, and authentication.With 800+ experts around ...Show moreLast updated: 30+ days ago
    • Promoted
    • New!
    Senior QA Test Engineer

    Senior QA Test Engineer

    EurofinsBengaluru, Karnataka, India
    POSITION TITLE (ENGLISH) : Senior QA Test Engineer- Automation.WORKING LOCATION : Bengaluru (B4).SUMMARY OF POSITION AND OBJECTIVES : . Eurofins is developing an eLIMS-NG product (Eurofins Laboratory I...Show moreLast updated: 3 hours ago
    • Promoted
    • New!
    Senior QA Test Lead

    Senior QA Test Lead

    EurofinsBengaluru, Karnataka, India
    SUMMARY OF POSITION AND OBJECTIVES : .Eurofins is seeking to hire a Test Automation Consultant to join our team.Someone who is experienced and passionate about test automation, and who understands wh...Show moreLast updated: 3 hours ago
    • Promoted
    • New!
    Senior QA – Automation

    Senior QA – Automation

    Intertec Softwares Pvt LtdBengaluru, Karnataka, India
    To lead and execute test automation strategy across projects, ensuring the delivery of high-quality software products through scalable and maintainable automated solutions.The role requires strong ...Show moreLast updated: 3 hours ago
    • Promoted
    • New!
    Senior Analyst, OMS-QA

    Senior Analyst, OMS-QA

    Hudson's Bay CompanyBengaluru, Karnataka, India
    SCS A technology company for all of Hudson’s Bay, delivers efficient, high-value solutions and services to customers by leveraging industry knowledge and deep technical expertise in order to reduce...Show moreLast updated: 3 hours ago
    • Promoted
    • New!
    Senior QA Test Engineer

    Senior QA Test Engineer

    Eurofins GSC IT DCBengaluru, Karnataka, India
    Required Experience and Skills.This role is for an experienced Manual Web Application Tester who will be responsible for overseeing the quality assurance of our web applications.You will play a cri...Show moreLast updated: 3 hours ago
    • Promoted
    • New!
    QA & Testing Senior Analyst (Oracle Finance - Functional Tester)

    QA & Testing Senior Analyst (Oracle Finance - Functional Tester)

    The Cigna GroupBengaluru, Karnataka, India
    QA & Testing Senior Analyst (Oracle Finance - Functional Tester).Together, with our 74, 000 employees worldwide that service Cigna, Express Scripts and other affiliate customers, we aspire to trans...Show moreLast updated: 3 hours ago
    • Promoted
    Senior QA Analyst [T500-20402]

    Senior QA Analyst [T500-20402]

    Talent500Bengaluru, Karnataka, India
    Talent500 is hiring for one of its client's.Founded in 1999 and headquartered in New York City, Huge is a global design and technology company that creates digital experiences for the world’s most ...Show moreLast updated: 10 days ago
    • Promoted
    • New!
    Test Analyst - U

    Test Analyst - U

    Delta CapitaBengaluru, Karnataka, India
    We are seeking a highly motivated and detail-oriented .This role is integral to ensuring the quality, stability, and compliance of software solutions supporting critical business functions.The succ...Show moreLast updated: 3 hours ago
    • Promoted
    • New!
    Sr. QA Analyst

    Sr. QA Analyst

    EcolabBengaluru, Karnataka, India
    Job Characteristics : Defines, implements and continually improving policies, processes and procedures that deliver consistent and reliable products and services to businesses and customers.Prepares...Show moreLast updated: 3 hours ago
    • Promoted
    • New!
    QA & Testing Senior Analyst

    QA & Testing Senior Analyst

    The Cigna GroupBengaluru, Karnataka, India
    Together, with our 74, 000 employees worldwide that service Cigna, Express Scripts and other affiliate customers, we aspire to transform health services, making them more affordable and accessible ...Show moreLast updated: 3 hours ago
    • Promoted
    • New!
    Test Analyst

    Test Analyst

    Aditi ConsultingBengaluru, Karnataka, India
    Able to perform Testing related work which may not be straight forward and repetitive.Should have the knowledge and work experience on the Retail On-boarding end to end journey of CCPL & CASA & TD ...Show moreLast updated: 3 hours ago
    • Promoted
    • New!
    Senior Test Architect

    Senior Test Architect

    McFadyen DigitalBengaluru, Karnataka, India
    We are seeking an experienced and dynamic.This person is expected to work hand in hand with the CoE Lead and drive Quality Assurance (QA) transformation initiatives and drive excellence in testing ...Show moreLast updated: 3 hours ago
    • Promoted
    • New!
    QA & Testing Analyst

    QA & Testing Analyst

    The Cigna GroupBengaluru, Karnataka, India
    QA & Testing Analyst (Functional Tester).Together, with our 74, 000 employees worldwide that service Cigna, Express Scripts and other affiliate customers, we aspire to transform health services, ma...Show moreLast updated: 3 hours ago