AI Functional Tester - Flexon Technologies Inc.
Job Description:As a Functional Tester specializing in AI Agents, you will be responsible for designing, executing, and maintaining test cases that validate the functionality, reliability, and performance of AI-driven agent systems. You will work closely with development teams, AI specialists, and product owners to ensure that AI agents perform accurately and efficiently in real-world scenarios.Key ResponsibilitiesAILLM-Specific QA Designing test frameworks for LLM outputs (hallucination checks, factuality tests, toxicitybias detection).Automation Frameworks PyTest, Robot Framework, Playwright, Cypress, or custom LLM test harnesses. Evaluation Metrics BLEU, ROUGE, BERTScore, GPT-based evaluators, human-in-the-loop validation. Data QA Ensuring high-quality trainingevaluation datasets, data validation (Great Expectations, Deequ). Python Automation Scripting test cases, API test automation. CICD Integration Automated test pipelines in JenkinsGitHub ActionsGitLab CI.Performance Testing Latency, throughput, stress testing of LLM-powered services. Leadership (Manager level) Define QA strategies for AI systems, lead test automation teams, enforce quality gates.Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.
Apply Now
Apply Now