QA
If you can't say in one sentence what a pass means, the test isn't verification yet.
An empty slot. What’s written here is only what has to exist before this slot counts as filled.
What travels 1 — zero must not mean two things
From the wuxia game’s QA, and the one thing from this studio that actually crossed into the pipelines at work.
When “found nothing” and “had nothing to look at” come out as the same zero, the test passes a broken build. Emit the counted value and the population size separately, and make a population of zero raise a configuration error rather than a pass.
What travels 2 — a static pass is not proof it runs
Reading a file and reporting “fixed” doesn’t count. Picture defects get judged by capturing the screen; behaviour defects by actually running it. There was a case where the harness passed while the scene wiring was empty and the real thing never ran.
What has to be re-decided — what counts as a defect
In the wuxia game, “there’s no time to read the telegraph” is a defect. In another game that could be the intent. The definition of a defect changes per game, so the pass criterion gets written in one sentence before anything else.