Senior QA Engineer

Summary

We are seeking a detail-oriented Senior QA Engineer to keep the quality assurance efforts across our complex data flows and AI-driven products, specifically focusing on conversational agents. This role requires a blend of automation expertise and strong analytical skills to define quality standards, validate complex data outputs, and ensure the reliable and responsible behavior of our generative AI systems.

Key Responsibilities

• Expertise in quality assurance efforts for data pipelines, APIs, and conversational agents.
• Design and execute generative AI testing scenarios, including exploratory testing for chatbot interactions, intent recognition, tone, and edge-case behavior.
• Experience in LLM test designs, including prompt and grounding validation, golden sets, and non-deterministic assertions.
• Perform crucial safety and quality checks, such as testing for hallucination, bias, toxic...