Skip to content
CHINZYSUPER INTELLIGENCE INFRASTRUCTURE
Console ↗

CHINZY / FDE and robotics acceptance fieldbook / 05

Holdout set isolation

Lock the holdout IDs and hashes before tuning. Group duplicates by source and check that versions of one ticket do not cross the split.

Test setup

Freeze samples, versions and ownership before the rehearsal. Keep before/after evidence for an independent reviewer. Budget caps and thresholds in examples are fixtures; agree actual gates with the project owner.

Contrasting examples

Figures and IDs are illustrative fixtures, not product results or contract terms. Save inputs, versions and conditions before repeating an unexpected result.

Example inputExpected observation
train=[T1.v1,T2]; holdout=[T1.v2]leakage:T1
train=[T1,T2]; holdout=[T7]disjoint_ids

Recording the result

Keep a separate row for each example; one pass cannot stand in for the other. Enter the actual output, evidence location, environment version and review decision. Leave unresolved results open.

Download test worksheet (CSV) ↓

Related project guide ↗

Download an RFQ template →