EVALUATION PARTIAL -- shortcut does NOT generalise svd see artifact
Paired Wilcoxon over 10 repeats gives a minimum attainable p of 0.001953 = 2/210, against a Holm-tightest threshold of 0.008333 = 0.05/6 for the pre-registered family. Feasible. This is arithmetic on the design, computed before the data: it says what the run could have shown, not what it did.
| corpus | features | recordings | speakers | AUC | 95% CI | AUC directionless | status |
|---|---|---|---|---|---|---|---|
| svd | silence_only | 28,509 | 1,679 | 0.5136 | [0.5104, 0.5174] | 0.5136 | RUN |
| svd | duration_intensity_only | 28,509 | 1,679 | 0.5048 | [0.5020, 0.5077] | 0.5048 | RUN |
| coswara | silence_only | 610 | 72 | 0.4854 | [0.4668, 0.5037] | 0.5146 | RUN |
| coswara | duration_intensity_only | not yet measured | not yet measured | not yet measured | not yet measured | not yet measured | NOT RUN -- no data |
| coughvid | silence_only | 13,535 | 13,535 | 0.5264 | [0.5251, 0.5277] | 0.5264 | RUN |
| coughvid | duration_intensity_only | not yet measured | not yet measured | not yet measured | not yet measured | not yet measured | NOT RUN -- no data |
4 of 6 pre-registered cells ran, and the artifact reports its own limitation in a field: falsifier_fully_evaluable = False. all_below_0.60 = True. The corpora measured here are sustained vowels and coughs; Pitt, where the audited shortcut was found, is spontaneous speech in which pause structure carries cognitive load. So this is not evidence that the Pitt effect was spurious — it is evidence that the shortcut does not transfer to these acoustic conditions.
| artifact | autoresearch_results/V7_silence_shortcut.json · view raw · last written 2026-07-28 12:56 UTC |
| objective | ROC-AUC (JUDGE-FREE) |
| audited | arXiv:2406.07410 |
| wall clock | 78.3 s (0.02 h) |
| written up as | F6 in FINDINGS.md |
No 7-step reasoning entry exists for this run. The sibling convention renders Diagnosis · Citations · Hypothesis · Prediction · Verdict · Learning on every per-experiment page, sourced from a reasoning_annotations.json. This program never wrote one, and neither does it keep an append-only experiment_log.jsonl; the run history is the set of artifact files listed on the run ledger, ordered only by their write time. The pre-registered prediction for this run does exist — it is on the V7 hypothesis page, recorded before the run. Everything else on that convention’s checklist is absent here and is shown as absent rather than quietly dropped.