Automation Test Engineer
Metova · Remote
Senior Automation Test Engineer
We are looking for a Senior Automation Test Engineer with strong experience in test automation, API and web testing, and modern quality engineering practices. This role will be responsible for designing and implementing robust automated testing strategies across web applications, APIs, and AI-powered solutions.
The ideal candidate combines a strong foundation in QA Automation and Software Engineering with practical knowledge of Large Language Models (LLMs), AI Agents, and AI-assisted development workflows.
Key Responsibilities
- Design, develop, and maintain scalable test automation architectures and frameworks.
- Define and execute automated testing strategies for web applications and REST APIs.
- Develop and maintain effective automated regression testing strategies.
- Implement BDD (Behavior-Driven Development) practices.
- Design and execute performance testing.
- Integrate automated testing into CI/CD pipelines, particularly within Azure DevOps environments.
- Develop automated tests using Playwright, Selenium, Karate, Gatling, or similar technologies.
- Collaborate with development and engineering teams to establish quality standards throughout the software development lifecycle.
- Apply quality engineering practices to solutions incorporating Large Language Models, AI Agents, and Agentic Workflows.
- Contribute to the evaluation and validation of AI-generated outputs and AI-assisted development processes.
- Continuously improve testing processes, automation coverage, and quality practices.
Required Qualifications
- 4+ years of experience in QA Automation, Software Testing, or a similar Quality Engineering role.
- Strong experience in test automation architecture and automation strategies.
- Solid experience with API and Web Testing.
- Experience with BDD and regression testing strategies.
- Experience with Performance Testing.
- Hands-on experience with CI/CD and Azure DevOps.
- Solid experience with one or more automation technologies such as Playwright, Selenium, Karate, Gatling, or similar tools.
- Programming experience with Java, JavaScript/TypeScript, Python, or similar languages.
- Strong understanding of REST APIs.
- Experience with Git and version-control workflows.
- English proficiency: B2 level or higher.
AI & Emerging Technology Experience
Practical experience or working knowledge in one or more of the following areas is highly valuable:
- Large Language Models (LLMs)
- AI Agents and Agentic Workflows
- Prompt Engineering and Context Engineering
- Tool Calling and AI Orchestration
- Specification-Driven Development
- AI-assisted code generation
- Evaluation and validation of AI-generated outputs
Experience in these areas may come from professional environments, hands-on projects, or practical implementation within software development and QA workflows.