Quality Engineer- AI Platform Testing

Job Title: Quality Engineer- AI Platform Testing

Location: Bangalore


Experience: 5-7 years


Education: Bachelor’s or Associate’s Degree in Computer Science, Engineering, or a related field

Job Summary:

We are looking for an experienced Quality Engineer with a strong background in software testing processes, automation, test framework development and application testing. The ideal candidate will have expertise in AI based application/platform testing, Model [LLM’s] evaluation testing, RESTful API testing and technical proficiency in python, JavaScript, TypeScript, and related tools.

Key Responsibilities:

• Create and maintain comprehensive test cases for web applications.

• Develop and execute smoke, functional, regression, and integration testing processes for software applications.

• Design, create, and maintain automated test frameworks using tools like RAGA’S/ DeepEval/Lang chain, Postman, VS Code, Cucumber and node.js.

• Collaborate closely with development and product teams to ensure testing coverage across all stages of development.

• Identify, record, document thoroughly and track bugs.

• Perform load and performance testing using tools like JMeter.

• Manage testing processes using GitHub, JIRA, and other DevOps tools.

• Contribute to continuous integration/continuous deployment (CI/CD) practices to enhance test automation pipelines.

• Work with cloud technologies, particularly AWS, to manage testing environments.

Required Skills & Qualifications:

• 6+ years of relevant work experience in software testing, particularly in automation and test framework development.

• Proficiency in python, JavaScript, TypeScript, Postman, VS Code, Cucumber, and Node.js.

• Must have experience in Model [LLM’s] evaluation testing, analysing model performance

• Strong experience in backend testing with exposure to LLM’s using Swagger, postman tools.

• Must have experience in tools like Kubernetes to check the logs.

• Must have experience in model evaluation frameworks [for ex: RAGA’S, DeepEval, Lang chain]

• Familiarity with various testing techniques. Knowledge of quality standards and regulations.

• Strong understanding of version control systems (GitHub) and project management tools (JIRA).

• Experience in Agile/Scrum development environments.

• A detail-oriented approach with excellent problem-solving skills.

Preferred Qualifications:

• Familiarity with continuous integration and delivery (CI/CD) pipelines using Github actions.

• Experience or knowledge of machine learning and open-source AI models, Test automation using pytest.

• Experience testing applications hosted in multiple geographical locations.

• Familiarity with cloud technologies, especially AWS.