UC-005_road_classification_sample_audit_2026Q2.pdf
EV-2026-0138 · Test Results · linked to Asset image classification — road defects
Artefact ID
EV-2026-0138
Type
Test Results
Linked use case
Uploaded by
Roads & Transport
Uploaded at
2026-05-19 15:00
Size
344 KB
SHA-256
8ee0…7651 (truncated for display)
Hash chain
Verified · chained to previous entry
Summary
Quarterly sample audit of road defect classifications produced by the RoadAI vendor model. 200-image random sample, manually reviewed by maintenance officer.
Chain of custody
Sample drawn randomly via vendor API. Manual classifications by senior maintenance officer. Hash chained at upload.
Key facts
- Overall agreement
- 193 / 200 = 96.5%
- False positive rate (Q2)
- 5.0% (target < 8%)
- AIRC condition status
- On track
- Drift flag (mid-cycle)
- FP trending up — see Re-attestation page for monitoring
Sample audit results (Q2 2026, n=200 classifications)
| Defect class | Model classified | Officer confirmed | Disagreement |
|---|---|---|---|
| Pothole — major | 24 | 23 | 1 (false positive) |
| Pothole — minor | 38 | 36 | 2 (downgraded by officer) |
| Cracking — alligator | 17 | 17 | 0 |
| Cracking — longitudinal | 41 | 39 | 2 (1 FP, 1 underclassified) |
| Line marking — degraded | 28 | 27 | 1 (FP) |
| Line marking — missing | 12 | 12 | 0 |
| Surface — wear | 22 | 21 | 1 (officer reclassified) |
| No defect (true negatives) | 18 | 18 | 0 |