Senior QA Engineer

About the role

We are looking for a Senior QA Engineer to perform manual and automation testing of web applications, with a strong manual background and a clear growth path into automation within a supported team structure. You will validate AI-generated test cases and LLM outputs, conduct API and cross-browser UI testing, manage test plans in TestRail, and document defects in Jira across Agile sprint cycles. The role includes contributing automation scripts to a stable existing framework with guidance from a dedicated Automation Lead.

What you will do

• Perform manual and automation testing of web applications to identify bugs, glitches, and inconsistencies;
• Take ownership of automation tasks within the team and proactively develop automation skills;
• Develop, maintain, and execute detailed manual test cases based on product requirements and specifications;
• Perform thorough cross-browser UI testing to ensure consistent behavior across different browsers;
• Validate AI-generated test cases, summaries, and recommendations produced by integrated LLMs;
• Design and execute test scenarios to verify AI behavior, including prompt-response consistency, contextual relevance, and deterministic versus non-deterministic outputs;
• Evaluate AI model quality using defined acceptance metrics such as precision, recall, hallucination rate, and duplication rate;
• Conduct manual API testing to validate request and response accuracy, error handling, and integration;
• Use TestRail to create, manage, and track test plans, test cases, and test execution results;
• Use Jenkins CI/CD pipelines;
• Report and document defects using JIRA;
• Participate in daily stand-ups, sprint planning, and other Agile team meetings;
• Review user stories and acceptance criteria to understand the scope of testing;
• Estimate own tasks and report risks to the team lead;
• Collaborate with developers and QA team members to reproduce issues and verify fixes;
• Maintain and update test documentation as needed.

Must haves

• 4+ years of experience in software testing;
• Strong manual testing background;
• Basic automation knowledge with a strong willingness to learn automation;
• Basic understanding of SDLC and STLC models;
• Knowledge of testing and quality assurance processes;
• Strong experience with test design activities to cover product requirements;
• Knowledge of test design techniques;
• Knowledge of testing methodologies;
• Defect analysis skills and the ability to write detailed and useful defect reports with expected defect-fixing outcomes;
• Experience with Postman for API testing and browser developer tools;
• Experience with UI testing;
• Experience with TestRail as a test management system;
• Basic understanding of CI/CD processes;
• Upper-intermediate English level.

Nice to haves

• Understanding of LLM evaluation principles, including prompt engineering, output validation, and model fine-tuning cycles;
• Familiarity with AI/ML concepts, APIs, and frameworks such as OpenAI API, Azure OpenAI, and LangChain;
• Knowledge of data protection and compliance standards for AI systems, including GDPR, zero-data retention, and PII anonymization;
• Experience with SSO testing;
• Experience in performance or load testing.