Senior Automation Test Engineer/SDET (Playwright + AI)

N-iX is looking for Senior Automation Test Engineer/SDET (Playwright + AI) to join the team

About the client:

Our client is a cutting-edge, technology focused company that provides a better way of detecting and managing risks that may impact the outcome of clinical trials. Their solutions, all of which are cloud-based, are driven by a unique set of algorithms that interrogate clinical and operational data in real-time centrally to conveniently illuminate outliers and anomalies in data.

The Role:

We are looking for a highly skilled AI Tester with strong Playwright expertise who embraces an AI-First approach to quality engineering. In this role, your primary focus will be testing AI-powered features implemented within the application — ensuring their reliability, accuracy, robustness, explainability, and compliance with product expectations.

While automation remains a critical capability, this role requires a strong understanding of how AI-driven functionality behaves in real-world scenarios, including edge cases, model variability, and prompt-driven outputs.

You will play a key role in validating AI features end-to-end — from requirement analysis and test design to automated validation, exploratory testing, and model behavior analysis — while continuing to leverage AI tools like GitHub Copilot/Codex to accelerate test development.

Responsibilities:

• Designing and executing comprehensive test strategies specifically for AI-powered features within the application

• Validating AI outputs for accuracy, consistency, edge-case handling, and alignment with business requirements

• Designing prompt-based and scenario-driven tests to evaluate model behavior under varied inputs

• Defining measurable validation criteria for non-deterministic systems( confidence ranges, tolerance thresholds, expected behavior patterns)

• Collaborating with engineering and product teams to improve explainability, observability, and traceability of AI decisions

• Ensuring AI features meet quality, compliance, and audit requirements where applicable

• Leveraging AI coding assistants (e.g., GitHub Copilot, Codex, or similar tools) to accelerate test development and framework enhancement

• Using AI tools to generate high-quality test scenarios from requirements and user stories

• Reviewing, validating, and refining AI-generated test code to ensure accuracy, scalability, and maintainability

• Contributing to AI-driven test design patterns and reusable automation strategies

• Promoting AI-augmented productivity practices within the QA team

• Designing, developing, and maintaining scalable Playwright-based automation frameworks for UI, API, and end-to-end testing

• Integrating automated test suites into CI/CD pipelines (GitHub Actions, Azure DevOps, Jenkins, etc.)

• Performing exploratory testing to uncover edge cases, usability gaps, and unexpected system behavior

Required Qualifications:

• 5+ years of commercial experience in tests automation

• Experience testing AI-driven or data-driven systems (LLMs, ML models,rule engines, recommendation systems, NLP-based features, etc.)

• Understanding of AI/ML behavior concepts such as prompt variability, non-deterministic outputs, confidence thresholds, bias, hallucinations, and edge-case handling.

• Ability to design validation strategies for probabilistic systems where results may not always be binary (pass/fail)

• Strong hands-on experience with Playwright automation framework

• Proficiency in JavaScript or TypeScript

• Demonstrated expertise using GitHub Copilot, Codex, or AI coding assistants as part of daily development workflow

• Solid understanding of automation framework architecture and design patterns

• Experience integrating automated tests into CI/CD pipelines

• Experience with test management tools such as Zephyr, Xray, or similar

• Strong understanding of software testing fundamentals (test design techniques, defect lifecycle, risk analysis)

• Proven experience in manual and exploratory testing of web applications

• Excellent analytical, debugging, and communication skills

• Upper-Intermediate/Advanced English level

Nice to have

• Experience validating AI systems in regulated environments (auditability, traceability, explainability requirements)

We offer*:

• Flexible working format - remote, office-based or flexible

• A competitive salary and good compensation package

• Personalized career growth

• Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more)

• Active tech communities with regular knowledge sharing

• Education reimbursement

• Memorable anniversary presents

• Corporate events and team buildings

• Other location-specific benefits

*not applicable for freelancers