Product Validation Engineer II: AI Agent Quality Assurance (QA)
Cadence · Belo Horizonte
At Cadence, we hire and develop leaders and innovators who want to make an impact on the world of technology.
Cadence Design Systems Inc. is looking for a motivated Product Validation Engineer II: AI Agent Quality Assurance (QA) to work with us in Belo Horizonte, Brazil.
At Cadence, we hire and develop leaders and innovators who want to impact the world of technology. Cadence has been nominated as a Great Place to Work globally is also a Fortune 100 Best Companies to Work For.
As a Product Validation Engineer II: AI Agent Quality Assurance (QA), you will be part of the Hardware System Verification Software team in Belo Horizonte, Brazil. To understand more about what we do Click Here. Working at Cadence is very dynamic, fast-paced, and integrated with other teams all around the world.
Job Description:
- Validate AI Agent products and customer workflows through structured test planning and execution.
- Test agent behavior across prompts, tool usage, retrieval quality, workflow execution, error handling, and response consistency.
- Evaluate agent outputs using quality rubrics, benchmarks, regression checks, and metrics such as accuracy, relevance, safety, latency, and task success.
- Create and expand testcase suites and evaluation datasets that reflect real customer scenarios, edge cases, and domain-specific workflows.
- Document defects, analyze failures, support root-cause triage, and verify fixes through repeatable regression testing.
- Collaborate with product and engineering teams to improve AI Agent quality, release readiness, and customer experience.
Requirements:
- Complete bachelor’s degree in Computer Science, Computer Engineering, Electrical Engineering, or equivalent experience.
- 2+ years of experience in product validation, software QA, test engineering, software development, or engineering productivity tools.
- Hands-on experience writing test plans and testcases, executing validation cycles, reporting defects, and verifying fixes.
- Familiarity with AI/LLM concepts, AI agents, prompt behavior, RAG workflows, and common AI system failure modes.
- Ability to evaluate AI Agent outputs using clear quality criteria and communicate findings to technical and product stakeholders.
- Experience with Python, scripting, or automation for testing, data preparation, log analysis, or reporting.
- Good spoken and written English and Portuguese with strong attention to detail and a collaborative mindset.
Nice to have:
- Experience validating AI agents, copilots, conversational products, or workflow automation tools.
- Familiarity with AI evaluation frameworks, benchmarking, red-team testing, or metrics-driven product improvement.
- Experience creating evaluation datasets, golden answers, customer workflow test suites, or regression packs.
- Knowledge of vector databases, embeddings, retrieval evaluation, or agent orchestration frameworks.
- Knowledge of EDA, VLSI design, design verification, emulation, Palladium, or Protium workflows.
Additional Job Details:
- Employment category: CLT
- Employment term: 40 hours/week.
- Competitive benefits.
- Location: Av Contorno 5800, Belo Horizonte, Minas Gerais Brazil.
About Cadence Design Systems:
Cadence is the only company that provides the expertise and tools, IP, and hardware required for the entire electronics design chain, from chip design to chip packaging to boards and to systems. We enable electronic systems and semiconductor companies to create innovative products that transform the way people live, work, and play. Our products are used in mobile, consumer, cloud datacenter, automotive, aerospace, IoT, industrial and other market segments. For more information, access www.cadence.com
We’re doing work that matters. Help us solve what others can’t.
More jobs at Cadence · Software Engineering jobs in Belo Horizonte