Product Experimentation Lead

The Wow

Betsson Group is looking for a Product Experimentation Lead to operationalize, scale, and champion our experimentation program across our global portfolio of digital products. This role is central to ensuring that every customer-facing decision is backed by evidence, rigor, and user insight. 

Sitting at the intersection of product, analytics, UX, and engineering, you will drive evidence-based decision-making through robust A/B testing and live validation frameworks. You’ll execute and interpret high-quality experiments to evangelize a test-and-learn culture and scale the infrastructure that supports it. This includes instilling best practices, improving tools, and ensuring we learn the right things—not just run the right tests.

A taster of what you will be involved with:

Experimentation Platform & Governance:

• Own and optimize the use of experimentation tools (e.g., Optimizely), ensuring robust configuration, scalability, and cost efficiency 

• Develop best practices, playbooks, and governance models to ensure statistical rigor and test hygiene across all markets and brands

• Establish guardrails to prevent test collisions and misleading results 

• Ensure test documentation is consistently captured, tagged, and archived for future reference. Help build and maintain a repository that connects experiments to broader user insights, product decisions, and research learnings

• Support the development of a cross-functional knowledge system to prevent redundant testing, track learnings over time, and accelerate future decision-making

Strategy & Roadmap:

• Develop and maintain a strategic experimentation roadmap aligned with product priorities and market goals 

• Partner closely with Analytics and UX Research (UXR) teams to track research insights and ensure continuity from discovery to validation

• Prioritize initiatives based on user needs, business impact, and technical feasibility

• Account for seasonality, test interdependence, and long-term effects on user behavior in planning

Test Design & Execution:

• Collaborate with PMs, researchers, and analysts to define hypotheses, test structure, and success metrics

• Guide test design including traffic allocation, sample sizing, segmentation, and statistical methods

• Manage test execution end-to-end and ensure robust post-test analysis

• Ensure tests are designed to capture both short-term effects and longitudinal impacts (e.g., retention, engagement)

• Pre-test analysis using GA or similar tools, to identify experiment parameters

• Manage or preferably execute robust post-test analysis ensuring all relevant data sources are used to ‘paint the full picture’ and insights/recommendations are clear

• Proactively develops the applicable experiments to run during low-request periods. Identify opportunities for improvements 

What we are looking for:

• 5+ years of relevant experience in product experimentation, CRO, product analytics, or related role

• Hands-on experience running and scaling A/B and multivariate tests across high-traffic digital products

• Expertise with testing platforms (e.g., Optimizely, AB Tasty, VWO) and analytics tools (GA, Amplitude, Adobe Analytics, ContentSquare)

• Strong statistical acumen: understanding of test design, power analysis, segmentation, and validity 

• Experience working cross-functionally with product, analytics, research, design, and engineering teams 

• Clear communicator able to translate test results into actionable insights and strategic recommendations 

• Experience in Data Visualization (through Google Looker Studio, Power BI, Tableau or similar)

• Experience using Business Intelligence and Operational Intelligence tools

What we offer

Much like a rollercoaster, life at Betsson Group is fast-paced, full of twists and turns, and always exciting. With more than 2,800 colleagues representing over 75 nationalities across a global network of offices - including 1,500 at our operational headquarters in Malta - every day brings new challenges and opportunities to grow. It may not be for the faint-hearted, but if you thrive on innovation, enjoy pushing boundaries and want to be part of a diverse, international team, then you’ll fit right in at Betsson.

Challenge accepted?

By submitting your application, you understand that your personal data will be processed as set out in our Privacy Policy