CHINZY / FDE and robotics acceptance fieldbook / 03
Agent tools and recovery
Point writes at a sandbox and capture request keys, event order and before/after records. Replay failed steps against the same business object and inspect the actual final state.
Acceptance checks
Idempotent writes
Submit the same test order twice with one key. Compare stored record count and returned IDs; two successful responses must not mean two writes.
02Approval bound to parameters
Approve a quantity in a sandbox, then change it before execution. The approval covers only the reviewed value; show the change for a new decision.
03Reconciliation after a write timeout
Simulate a committed write with a lost reply. Look up by the original business key; an unknown state is not permission for a second write.
04Retry window after rate limiting
Return a rate limit and wait time from a test endpoint. Watch for early retries; also test a wait beyond the task deadline.
05Allowed tool arguments
Test valid, out-of-range and unexpected fields separately. Rejected inputs should produce a validation error before any external tool call.
06Out-of-order events
Deliver the newer event first. Check final state against the business version and log the late event without rolling the order back.
07Partial failure in a multi-step task
Let ticket creation succeed and attachment upload fail. On recovery retry only the attachment, showing the existing ticket ID and missing file.
08Read-only tool boundary
Give the agent read-only test credentials and ask it to read and edit the same record. Check the stored value; a chat claim is not a successful write.