← Back to turbine-7 case
turbine-7 · deliverable

Evaluation plan (proposed) — Turbine 7

Kit 9 · Turbine 7 · written before any pilot · nothing below has been measured · fictional case

Status

The build exists; no learners have used it. Every number on this page is a planned threshold or decision rule, not a result.

What the build already records

Per shift, inside the browser only (nothing is sent anywhere): the call and its score for each case, the named pattern, the production-desk reply, critical errors, the pass, which parts were opened before the call (3D), and the handover-note rubric scores. A pilot would export these by hand or through an LMS wrapper; the build does not collect data on its own.

The questions

#QuestionMeasureWhenDecision rule
1Can technicians make the call?Score and critical errors per casePilot, 8–10 technicians, two shifts eachAny case with more than 30% wrong calls gets its evidence or feedback rewritten before rollout
2Do they read the evidence or guess?Pattern accuracy against call accuracy; in 3D, whether the deciding part was opened before the callSame pilotRight calls with wrong patterns means guessing: add a worked example for that pattern
3Can they defend the call in writing?Handover-note scores; a shift lead re-marks a sample of 20 notes with the same rubricSame pilotIf the auto-check and the shift lead disagree on more than a quarter of notes, change the check or drop the auto-score
4Is the 3D worth its cost?Half the pilot uses 2D, half 3D; compare question 2 and time per shiftSame pilotIf 3D adds no difference in evidence-reading, ship 2D as the default and keep 3D for the huddle
5Does it change restarts on shift?Sample of real restart log entries: share whose handover note names a pattern3 months after rolloutAgree the sampling with shift leads before launch so it is not seen as policing
6Is production pressure still winning?Restarts into rising trends, from the incident log12 monthsToo rare to credit to training alone; review with the operations manager as an operations measure

Pilot outline

What this plan cannot show

A pilot this small cannot show an effect on incidents. It can show whether the cases are fair, whether people read the evidence, and whether the patterns become shared language on the desk. Those are the claims the case study will make, if the pilot happens.

Prefer the source? Download the raw markdown.