| Calibration credentials and measurement control |
| Calibration provider accreditation | Confirm that the calibration laboratory is accredited to ISO/IEC 17025 by a recognized accreditation body, and that the accreditation is valid on the certificate date. | Current accreditation certificate; accreditation-body directory listing; certificate number and issue date. | Check the accreditation body's public directory and confirm the laboratory's legal name, status, and validity dates. |
| Accredited scope | Check that the laboratory's published scope covers the relevant measurand, range, and calibration method. Accreditation alone does not establish that every service offered by a laboratory is accredited. | Current scope of accreditation; calibration certificate identifying the applicable method and measurement range. | Match each critical measurement—such as length, force, pressure, or alignment—to the scope and range stated in the documents. |
| Calibration certificate contents | Look for the calibrated item or reference standard identification, results, measurement uncertainty, calibration date, method, and any relevant environmental conditions. | Certificate with unique instrument or reference-standard IDs, reported values, units, uncertainty, and traceability statement. | Confirm that serial numbers match the equipment used for the proposed system and that the certificate is current under the buyer's maintenance policy. |
| Metrological traceability | Verify a documented, unbroken calibration chain to appropriate measurement references, with uncertainty stated for the relevant results. | Certificate traceability statement and, where needed, supporting calibration records for reference standards. | Ask the supplier to explain how the stated uncertainty affects the inspection decision limits; do not treat traceability as proof that a system is fit for every use. |
| System-level calibration and maintenance | Determine which sensors, targets, cameras, and mechanical components require calibration or verification, and how drift or repairs are handled. | Calibration and verification schedule; service procedure; adjustment history; post-repair verification records. | Require a documented check after component replacement, relocation, or repair, and define who may approve a return to service. |
| Pilot design and operational performance |
| Representative pilot conditions | Run the pilot on the intended vehicle types, inspection tasks, operators, and site conditions rather than relying only on a controlled demonstration. | Written pilot protocol; vehicle and test-case list; site conditions; operator training records. | Include the range of vehicle sizes and inspection conditions expected in routine use, and record exclusions and failed runs. |
| Measurement agreement | Compare system readings with an appropriate reference method, using matched vehicles and documented measurement conditions. | Paired results, reference-method details, equipment calibration records, and a documented analysis of differences. | Set an acceptance tolerance before testing. The tolerance should be based on the intended inspection decision and applicable requirements, not assumed to come from ISO/IEC 17025. |
| Repeatability | Repeat measurements under unchanged conditions to assess variation in the system's results. | Repeated readings for each selected test case; operator, vehicle, and environmental-condition logs. | Predefine the number of repeats and the maximum acceptable spread for each measurement. Report all valid readings, not only averages. |
| False acceptance and false rejection | Assess whether the system incorrectly passes or flags vehicles relative to the agreed reference decision. | Confusion matrix with counts of true positives, true negatives, false positives, and false negatives; adjudication records. | Agree on minimum sample sizes and allowable error rates before the pilot. Include borderline cases and report the denominator for each rate. |
| Throughput and availability | Measure completed inspections per hour and record downtime, retries, and interruptions during representative operation. | Time-stamped inspection logs; downtime log; calculation method and observation period. | Set site-specific targets before testing—for example, a target number of completed inspections per hour and a defined availability period—then report actual results separately. |
| Data integrity and reporting | Check that results are linked to the correct vehicle and inspection event, and that changes are traceable. | Sample reports; audit trail; user-access controls; export and backup procedure. | Verify that the report includes measurement units, time stamp, system or sensor ID, status, and any manual edits or overrides. |
| Acceptance decision | Evaluate the pilot against criteria agreed before testing; distinguish calibration evidence from operational performance evidence. | Signed pilot report listing protocol, results, deviations, unresolved issues, and pass/fail decisions for each criterion. | Do not accept a system solely because a calibration certificate is present. Confirm that both the relevant calibration scope and the site's pilot criteria are satisfied. |