CHINZY / FDE and robotics acceptance fieldbook / 06
Robot inspection evidence
Fix the route, checkpoints and task in recorded data or a controlled test area. Score arrival separately from usable evidence. Retain timestamps and samples requiring human review.
Acceptance checks
Distinct checkpoint coverage
Count distinct planned checkpoints actually visited. A repeat cannot replace a missed checkpoint.
02Readable observation at a visited point
Arrival proves presence only. Check the specified meter and legible scale in the image; log why a capture is unusable.
03False alerts and missed events
Replay labeled samples. Count alerts on normal samples separately from events that triggered no alert.
04Clock basis for alert latency
Confirm a common timebase before subtracting capture time from receipt time. Unknown clock skew is not zero.
05Deduplicating replayed alerts
Replay the same event ID in a test system and check for one ticket. A new event at the same checkpoint must still be handled.
06Capture time after offline upload
Replay a delayed upload. Preserve capture and receipt times separately and order observations by capture time, not arrival.
07Human review before closure
Receipt is not resolution. Mark an incident closed only when the assigned reviewer records a disposition and supporting evidence.
08Separating assisted route segments
Classify segments from a route replay. Divide independently completed segments by all planned segments, including unfinished ones.