Technology & AI · Data Analytics & BI

The A/B Test Lab

Run a real A/B test on a landing-page redesign for a small e-commerce brand. Frame the hypothesis, size the sample, resist a peeking PM, read segments without over-claiming, and ship a defensible memo.

4 rounds MBA & Masters English, Español

Preview

About this simulation

Run a real A/B test on a landing-page redesign for a small e-commerce brand. Frame the hypothesis, size the sample, resist a peeking PM, read segments without over-claiming, and ship a defensible memo. Practices CRO statistics: MDE, power, peeking and alpha inflation, statistical vs. practical significance, segmentation, and multiple-comparisons correction.

Who it is for

An intermediate simulation for participants who already know the core concepts of the subject, designed for master's and MBA programmes.

How a session runs

  1. The instructor creates a session from the Eureka dashboard and invites the participants.
  2. Participants play 4 rounds. In each one they submit their decisions and the simulation calculates the results.
  3. The simulation can be run in English, Español.
  4. The instructor follows each participant's progress and results from the dashboard, and uses the class results for the debrief.

Decisions participants make

The decisions participants make during the simulation:

  • Test Direction
  • Minimum Detectable Effect (relative)
  • Planned Test Duration
  • Response to Devon
  • Day-6 Decision
  • Slack Reply to Devon
  • Run Segment Cuts?
  • Apply Multiple-Comparisons Correction?
  • Which Segment Wins?
  • Memo Recommendation

What participants track

What participants follow on screen as the rounds go by:

  • DECISION CONSOLE
  • RIGOR SCORE BY ROUND

Subjects covered

Designed for courses in Data Analytics & BI.

Ready to use The A/B Test Lab with your students?

Contact us and we'll set you up with a free trial session.

Contact us