Governing office and purpose
- The Memorandum Circular recognizes that the Optical Mark Reader software and hardware is a vital part of the Driver’s License System Core Application Module and the Automated Driver’s License Examination System (ADLES).
- The Memorandum Circular provides the guidelines to ensure proper utilization of the facility and to monitor performance of the OMR software and hardware.
- The Memorandum Circular requires observance of OMR validation standards aligned with the Quality Management System of the Office.
- The Memorandum Circular establishes rules for quarterly validation, including both software validation and hardware testing.
Coverage: validation teams, sites, and materials
- The Memorandum Circular requires the ITPEMC Technical Team and the ITPEMC-DLS Team to conduct the validation test.
- Validation must be conducted on site every quarter of the year.
- At least two (2) sites for every quarter must be subjected for testing, or as the need arises.
- The Memorandum Circular requires that test sites be identified by the teams.
Software validation: required transactions and pass/fail
- The Memorandum Circular requires the validation test to use transactions that test the accuracy and effectiveness of the OMR randomly.
- The transactions used for random testing are exactly:
- 2 New Non Pro
- 2 New Pro
- 2 Non Pro Dormant
- 2 Pro Dormant
- 2 Non Pro to Pro
- 2 ARC
- 2 New Conductors License
- The Memorandum Circular requires that the answer sheet be shaded and checked in accordance with the Automated Exam Guidelines.
- The Memorandum Circular declares the validation passed if all results obtained from the script and manual checking tally with the results given by the OMR software.
- The Memorandum Circular declares the validation failed if there is any discrepancy between results.
Investigation, corrective action, and reporting
- When testing is declared failed due to discrepancy, an investigation relative to the problem encountered must be conducted by STRADCOM.
- Corrective action must be approved by the ITPEMC.
Resolution preparation after validation
- The team that conducted the validation test must prepare a resolution based on the results of the test.
Hardware test procedure: stress test
- The Memorandum Circular requires hardware testing to follow a defined procedure.
- For the stress test, the OMR must be plugged and kept running continuously for 24 hours.
Hardware test procedure: efficiency and margin of error
- For the efficiency test, the OMR must be fed answer sheets, and the testing must count how many answer sheets can be scanned per minute.
- The efficiency test requires getting the average based on a five (5) set one minute interval.
- The efficiency test requires scanning 150 answer sheets and tabulating the scores on each sheet.
- The efficiency test requires manual checking of the answer sheets and comparison of tabulated automatic scores with manual checking scores.
- The efficiency test requires computing the percentage of error and comparing it to the hardware specifications for margin of error.