Senior QA Analyst

About Tubi:

Boldly built for every fandom, Tubi is a free streaming service that entertains over 100 million monthly active users. Tubi offers the world's largest collection of Hollywood movies and TV shows, thousands of creator-led stories and hundreds of Tubi Originals made for the most passionate fans. Headquartered in San Francisco and founded in 2014, Tubi is part of Tubi Media Group, a division of Fox Corporation.

About the Role:

Tubi is seeking a highly skilled and experienced Senior QA Analyst to lead quality assurance initiatives for our cutting-edge streaming and AI-driven product features. This pivotal role involves ensuring exceptional end-to-end user experiences, robust streaming playback, and the accuracy and integrity of our AI/ML features across web, mobile, and OTT platforms.

We're looking for a candidate with a strong background in streaming QA and deep technical knowledge of media workflows. You'll be instrumental in collaborating with engineering, product, and data science teams to define comprehensive QA strategies that guarantee both functional excellence and data-level quality.

This is a hybrid role based out of our Toronto office. You must be willing to travel to our Toronto office three days/week.

What You'll Do:

• Design and lead test strategies for streaming workflows, playback systems, and AI-powered features.

• Test across platforms (web, mobile, and connected TV) to ensure functional parity and playback stability.

• Validate streaming performance—including ABR logic, encoding pipelines, and DRM integrations—under diverse real-world conditions.

• Debug with precision using tools like Charles Proxy, Chrome DevTools, ADB, and Xcode. Collaborate with data and ML teams to validate AI model updates, recommendations, and personalization accuracy.

• Leverage AI-assisted QA tools to enhance regression coverage, UI validation, and anomaly detection.

• Contribute to automation and CI/CD frameworks, driving faster, more reliable releases.

• Oversee QA deliverables for multiple concurrent releases and ensure seamless sign-off for production launches.

• Monitor live environments for playback or recommendation anomalies post-release and escalate issues promptly.

• Continuously improve QA processes, metrics, and reporting for streaming and AI validation.

Your Background:

• Bachelor’s degree in Computer Science, Software Engineering, or related field, or equivalent hands-on experience

• 4+ years of QA experience, preferably in streaming media or VOD/OTT platforms

• Strong technical knowledge of video streaming protocols (HLS, DASH, MPEG-TS), DRM systems, and CDN architectures

• Experience validating AI/ML systems in production — e.g., testing model output accuracy, user personalization logic, and algorithm stability

• Hands-on experience with test automation tools (Selenium, Appium, Playwright, Puppeteer) and AI-based visual testing

• Proficiency in debugging tools and network analysis utilities (Charles Proxy, Chrome DevTools)

• Experience managing regression suites and release validation cycles across web, mobile, and connected TV platforms

• Familiarity with Python, Typescript or JavaScript for scripting and test automation

• Understanding of data validation, logging pipelines, and A/B testing frameworks

• Strong analytical and documentation skills, with a proactive approach to cross-team collaboration

Nice to have:

• Experience testing machine learning-driven streaming features such as recommendation systems, ad targeting, or automated metadata tagging

• Exposure to model evaluation techniques (precision/recall, bias testing, data drift analysis)

• Familiarity with continuous testing and CI/CD environments (Jenkins, GitHub Actions, CircleCI)

• Understanding of observability tools (Grafana, Kibana, Datadog) for post-deployment validation

• Strong ability to triage issues in large distributed systems and collaborate with engineering to resolve root causes

#LI-CL1

#LI-Hybrid

Tubi is a division of Fox Corporation, and the FOX Employee Benefits summarized here, covers the majority of all US employee benefits. The following distinctions below outline the differences between the Tubi and FOX benefits:

• For US-based non-exempt Tubi employees, the FOX Employee Benefits summary accurately captures the Vacation and Sick Time.

• For all salaried/exempt employees, in lieu of the FOX Vacation policy, Tubi offers a Flexible Time off Policy to manage all personal matters.

• For all full-time, regular employees, in lieu of FOX Paid Parental Leave, Tubi offers a generous Parental Leave Program, which allows parents twelve (12) weeks of paid bonding leave within the first year of birth, adoption, surrogacy, or foster placement of a child in addition to applicable government leave program(s) and FOX’s short-term disability policy. This time is 100% paid through a combination of any applicable state, city, and federal leaves and wage-replacement programs in addition to contributions made by Tubi.

• For all full-time, regular employees, Tubi offers a monthly wellness reimbursement.

We are an equal opportunity employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, gender identity, disability, protected veteran status, or any other characteristic protected by law. We will consider for employment qualified applicants with criminal histories consistent with applicable law.