CHINZY / FDE and robotics acceptance fieldbook / 01
Abstention without evidence
Remove the only source for lead time. Do not borrow the figure for a similar product; restore the source and retest.
Test setup
Freeze the corpus and mark the expected passages. Ask a reviewer to trace each answer to the original, recording missing evidence, wrong citations and correct abstentions separately.
Contrasting examples
Figures and IDs are illustrative fixtures, not product results or contract terms. Save inputs, versions and conditions before repeating an unexpected result.
| Example input | Expected observation |
|---|---|
A.lead_time=null; B=7d; query=A | unknown |
A.lead_time=12d; query=A | 12d@A |
Recording the result
Keep a separate row for each example; one pass cannot stand in for the other. Enter the actual output, evidence location, environment version and review decision. Leave unresolved results open.
Download test worksheet (CSV) ↓