Software Development Engineer in Test III - AI

About HighLevel:
HighLevel is an AI powered, all-in-one white-label sales & marketing platform that empowers agencies, entrepreneurs, and businesses to elevate their digital presence and drive growth. We are proud to support a global and growing community of over 2 million businesses, comprised of agencies, consultants, and businesses of all sizes and industries. HighLevel empowers users with all the tools needed to capture, nurture, and close new leads into repeat customers. As of mid 2025, HighLevel processes over 4 billion API hits and handles more than 2.5 billion message events every day. Our platform manages over 470 terabytes of data distributed across five databases, operates with a network of over 250 microservices, and supports over 1 million hostnames.

Our People
With over 1,500 team members across 15+ countries, we operate in a global, remote-first environment. We are building more than software; we are building a global community rooted in creativity, collaboration, and impact. We take pride in cultivating a culture where innovation thrives, ideas are celebrated, and people come first, no matter where they call home.

Our Impact
As of mid 2025, our platform powers over 1.5 billion messages, helps generate over 200 million leads, and facilitates over 20 million conversations for the more than 2 million businesses we serve each month. Behind those numbers are real people growing their companies, connecting with customers, and making their mark - and we get to help make that happen.

About the Role:
We are looking for a Senior Software Development Engineer in Test (SDET 3) with strong expertise in AI tools and testing AI-driven products. This role requires a hands-on individual who can design and execute test strategies for AI systems, automate intelligently, and mentor junior team members. You will work independently, drive tasks to closure, and play a key role in ensuring the quality of our AI initiatives.

Requirements::
• 5+ years of overall experience in QA/SDET roles
• Proven experience working with AI tools (e.g., OpenAI, Claude, or similar LLM platforms)
• Strong understanding of testing AI/ML products and their unique challenges
• Hands-on knowledge of RAG pipelines and their testing methodologies
• Proficiency in automation frameworks (e.g., Playwright, Cypress, Selenium, or similar)
• Experience with API testing (Postman, REST, GraphQL, gRPC)
• Strong problem-solving skills with the ability to work independently
• Mentorship and leadership skills in guiding peers or junior engineers

Responsibilities::
• Design, develop, and maintain automation frameworks and test strategies for AI products
• Test and validate AI-powered features (including OpenAI, Claude, and other AI integrations)
• Evaluate and improve RAG (Retrieval-Augmented Generation) flows, ensuring accuracy and performance
• Leverage AI automation tools to optimize test coverage and efficiency
• Collaborate closely with developers, product managers, and AI researchers to ensure high-quality releases
• Own tasks end-to-end, working independently to deliver on commitments.
• Mentor and guide junior SDETs, fostering a culture of quality and continuous learning

Nice to have:
• Experience with CI/CD pipelines and cloud platforms (AWS/GCP/Azure)
• Familiarity with MLOps pipelines and monitoring AI systems
• Exposure to performance and scalability testing of AI workloads

EEO Statement:
The company is an Equal Opportunity Employer. As an employer subject to affirmative action regulations, we invite you to voluntarily provide the following demographic information. This information is used solely for compliance with government record-keeping, reporting, and other legal requirements. Providing this information is voluntary and refusal to do so will not affect your application status. This data will be kept separate from your application and will not be used in the hiring decision.

#LI-Remote #LI-JM1