Architect

AI Test Engineer (QA)
Role Summary
The AI Test Engineer ensures quality, reliability, safety, and correctness of AI enabled systems across the SDLC.
Key Responsibilities
•    Design and execute test strategies for GenAI and Agentic AI apps
•    Validate LLM outputs for:
o    Accuracy
o    Bias
o    Hallucinations
o    Safety
•    Test prompt versions and AI behavior changes
•    Automate functional and non functional tests
•    Test AI integrations, APIs, and workflows
•    Perform regression testing for AI model/version changes
•    Collaborate with developers on quality gates
Required Skills
•    Application testing (manual + automation)
•    Test automation frameworks (Selenium, Playwright)
•    API testing
•    CI/CD quality gates
AI Specific Skills
•    Testing LLM outputs and prompt behavior
•    Understanding of model variability and non determinism
•    Test data management for AI
•    Knowledge of responsible AI testing concepts
Experience
•    5–8 years in software testing
•    Hands on GenAI / AI testing experience required