CHINZY / FDE and robotics acceptance fieldbook / 01
Partially answerable requests
Ask for weight and delivery but supply only a weight sheet. Mark unknown and supported fields separately, without guessing or refusing both.
Test setup
Freeze the corpus and mark the expected passages. Ask a reviewer to trace each answer to the original, recording missing evidence, wrong citations and correct abstentions separately.
Contrasting examples
Figures and IDs are illustrative fixtures, not product results or contract terms. Save inputs, versions and conditions before repeating an unexpected result.
| Example input | Expected observation |
|---|---|
weight=8kg; ETA=null | weight:8kg; ETA:unknown |
weight=null; ETA=null | weight:unknown; ETA:unknown |
Recording the result
Keep a separate row for each example; one pass cannot stand in for the other. Enter the actual output, evidence location, environment version and review decision. Leave unresolved results open.
Download test worksheet (CSV) ↓