EVALUATION PARTIAL -- near-null reproduced; falsifier NOT evaluable SCOPE-LIMITED svd see artifact
Scope caveat. This run is a pilot slice -- 1,679 of the 13,535 speakers measured elsewhere on svd. It may satisfy the repeat contract and still be a narrower measurement than a later run on the same corpus; both facts are shown because either alone would mislead.
Paired Wilcoxon over 10 repeats gives a minimum attainable p of 0.001953 = 2/210, against a Holm-tightest threshold of 0.008333 = 0.05/6 for the pre-registered family. Feasible. This is arithmetic on the design, computed before the data: it says what the run could have shown, not what it did.
| corpus | backbone | recordings | speakers | AUC, scaler fit on ALL | AUC, scaler fit per fold | delta (leak - honest) | 95% CI on delta | status |
|---|---|---|---|---|---|---|---|---|
| svd | wavlm | 28,509 | 1,679 | 0.7382 | 0.7382 | 0.00004 | [0.0000, 0.0001] | RUN |
| svd | egemaps | 667 | 49 | 0.5315 | 0.5357 | -0.00418 | [-0.0063, -0.0022] | RUN |
| coswara | wavlm | 610 | 72 | 0.4929 | 0.4906 | 0.00236 | [0.0004, 0.0048] | RUN |
| coswara | egemaps | not yet measured | not yet measured | not yet measured | not yet measured | not yet measured | not yet measured | NOT RUN -- no cached embeddings |
| coughvid | wavlm | not yet measured | not yet measured | not yet measured | not yet measured | not yet measured | not yet measured | NOT RUN -- no cached embeddings |
| coughvid | egemaps | not yet measured | not yet measured | not yet measured | not yet measured | not yet measured | not yet measured | NOT RUN -- no cached embeddings |
3 of 6 pre-registered cells ran. The unrun cells are the corpus-specificity arm — the part of this hypothesis that is actually novel. The near-null reproduced on SVD is a reproduction of the audited paper's point, not the new claim, so the falsifier is not evaluable and the finding is PARTIAL. Artifact self-report: all_within_pm_0.01 = True.
| artifact | autoresearch_results/V6_preprocessing_leakage.json · view raw · last written 2026-07-28 14:03 UTC |
| objective | ROC-AUC vs clinical labels (JUDGE-FREE) |
| audited | Applied Soft Computing S1568494626007970 |
| wall clock | 2,486.5 s (0.69 h) |
| written up as | F5 in FINDINGS.md |
No 7-step reasoning entry exists for this run. The sibling convention renders Diagnosis · Citations · Hypothesis · Prediction · Verdict · Learning on every per-experiment page, sourced from a reasoning_annotations.json. This program never wrote one, and neither does it keep an append-only experiment_log.jsonl; the run history is the set of artifact files listed on the run ledger, ordered only by their write time. The pre-registered prediction for this run does exist — it is on the V6 hypothesis page, recorded before the run. Everything else on that convention’s checklist is absent here and is shown as absent rather than quietly dropped.