Technology & AI · Data Analytics & BI

The A/B Test Lab — Experimentation at Scale

Triage four concurrent experiments at CoEditor.io, redesign the ones that are not decision-grade, and write the Friday memo to the CEO.

5 rounds Executive English, Español

Preview

About this simulation

Triage four concurrent experiments at CoEditor.io, redesign the ones that are not decision-grade, and write the Friday memo to the CEO. Practice the Kohavi-Tang-Xu discipline: separate decision-grade results from not-yet-decision-grade results, refuse to flatten honest uncertainty into political certainty, and frame the experimentation programme to Series-C investors with calibrated peer-benchmarked metrics.

Who it is for

An advanced simulation for participants used to working with the main frameworks and trade-offs of the subject, designed for executive education and experienced professionals.

How a session runs

  1. The instructor creates a session from the Eureka dashboard and invites the participants.
  2. Participants play 5 rounds. In each one they submit their decisions and the simulation calculates the results.
  3. The simulation can be run in English, Español.
  4. The instructor follows each participant's progress and results from the dashboard, and uses the class results for the debrief.

Decisions participants make

The decisions participants make during the simulation:

  • Triage verdict
  • Statistical / metric choice
  • Programme-level move

What participants track

What participants follow on screen as the rounds go by:

  • Pricing-page Architecture
  • Round-by-round decision quality

Subjects covered

Designed for courses in Data Analytics & BI.

Ready to use The A/B Test Lab — Experimentation at Scale with your students?

Contact us and we'll set you up with a free trial session.

Contact us