N.Y. Comp. Codes R. & Regs. tit. 15 § 141.14

Current through Register Vol. 46, No. 36, September 4, 2024
Section 141.14 - Appendix A

IPIRP Specification Document

Introduction

Background

New York State (NYS) Vehicle & Traffic Law (V&T) was amended to allow the Department of Motor Vehicles (DMV) to conduct a 5-year pilot program to assess the delivery of the Motor Vehicle Accident Prevention Course, commonly referred to as Point and Insurance Reduction Program (PIRP) via Alternate Delivery Methods (ADMs). Approved NYS classroom PIRP Sponsors may participate in the IPIRP pilot by meeting state requirements, included herein, and adhering to regulations set forth in Part 141 of the Commissioner's regulations.

To distinguish the current classroom based program from the Alternate Delivery Method (ADM) Program, NYS is naming this pilot program "IPIRP", to specifically reference the internet as described in the enabling legislation. NYS is not limiting the pilot methods to the internet, in the Commissioner's discretion, so long as providers can ensure that all the pilot program requirements are met. NYS has 13 approved public sponsors delivering classroom training. Only approved providers can participate in the IPIRP; although new sponsors wishing to participate can apply to be a IPIRP provider at any time. Application processing preference may be given to existing, approved classroom sponsors.

Requirement Overview

The enabling legislation, Chapter 751 of the Laws of 2005, charged DMV with developing a pilot program that ensures:

* Student identity is validated at registration.

* Student participation is validated throughout the course.

* The 320 minute time requirement for the course is met.

* Students successfully complete the course.

The DMV has established the following general requirements:

* Only approved, existing classroom sponsors will be eligible to participate in the pilot program.

* Approved sponsors want to participate in the pilot must follow the proposed application process.

* Sponsors shall have the responsibility of identity validation, as well as validating course participation.

* Sponsors shall be required to meet information security guidelines.

* IPIRP course delivery shall have specific requirements.

* IPIRP pilot review and study evaluation shall be required.

Goals of the Pilot

The success of the pilot will be based on the following three goals of the program; Interactive Interface, Expansion of Traffic Safety Awareness and Use of Identification Technologies. Each of these goals shall have several measures to evaluate the effectiveness of alternate delivery methods, as described below. Sponsors will use a common set of questions developed by DMV to collect this information from students.

Interactive Interface shall assess whether a course delivered in a non-classroom environment can engage the course participant. This goal shall be measured as follows:

* Participant satisfaction with the course. This will be measured using a Likert based scale where success will be determined when a participant rates the course good or excellent. Overall, it is expected that this rating will occur at least 80% of the time.

* Participant believes course was interesting. Without an instructor to engage the student, the course material presentation becomes very important. This shall be measured when the participant rates the course as interesting or very interesting using a Likert based scale. Overall, it is expected that this rating will occur at least 80% of the time.

* Participant believes ADM course was easy to use and instructions understandable. Given the independent nature of the course delivery, overall participant satisfaction will be impacted by how easy and trouble free the learning experience was. This will be measured using a Likert scale and success will be measured when the participant selects easy or very easy to use. Overall, it is expected that this rating will occur at least 80% of the time.

The goal of Expansion of Traffic Safety Awareness recognizes that if a course is made available using alternate technology and it is convenient for the participant, there will be an increase in the number of completers of Accident Prevention Courses. This goal will be measured as follows:

* Number of New Completers. This will be measured based on the number of actual completers of alternate technology. This shall be measured by the number of completers for each sponsor for both ADM and classroom based offerings. A measure of success shall be that the ADMs experience double digit growth (as a % of all offerings) each year they are available.

* Impact of Course. This will be measured by the completer's opinion on whether the course is likely to influence how they will drive in the future. This will be measured using a Likert based scale where success is determined when a participant indicates the course will improve their driving some or very much. Overall, it is expected that this rating will occur at least 80% of the time. DMV shall develop a uniform survey instrument for this purpose that all sponsors shall use.

* Impact/Improvement. This shall be measured by the sponsors when they complete their PIRP effectiveness studies at the end of the 5-year pilot, or when due, depending upon the requirements spelled out in this Part, in Vehicle & Traffic Law, article 12-B and also in Commissioner Regulations, section 138. Each sponsor will be required to demonstrate the effectiveness of its ADM course, as is also required for classroom courses, by measuring a significant impact in accident and conviction reduction in the 18 months after completing the course. Depending upon the number of completers, DMV may accept a smaller population than is required in the regulations if an insufficient number of completers is available.

The goal of Evaluate Identification Technologies is to measure usage with a variety of alternate instructional delivery methods. DMV shall measure this goal as follows:

* Number of alternate techniques employed. This shall be measured based on the number of different types of technologies employed by the various sponsors. Technology usage shall cover both the delivery method (internet, CD, etc.) as well as types of validation techniques used by each sponsor. A measure of success shall be the number of multiple media and validation techniques employed by all sponsors. The more variation employed by sponsors, the more successful the pilot will be deemed in terms of this measure.

* Robustness/reliability of various methods. This shall be measured based on whether the sponsor continues to offer a particular media or technique from the beginning of the pilot, until the end of the pilot and shall be partially based on consumer use and satisfaction. If a technology is robust enough, it is likely to be continued throughout the pilot period and over time, have more and more participants being drawn to the technology. Overall, it is expected that all approved pilot programs continue for the 5 year pilot as initially approved (except for content updates), and that consumer satisfaction with alternate techniques does not decline over the 5-year period.

Both the state and the sponsors will compile these measures during and at the conclusion of the pilot as appropriate. These goals and measures shall be the basis for the DMV's report to the Legislature and Governor at the conclusion of the pilot.

Data/Security Requirements

General Requirements

The data security of the administration of the overall Motor Vehicle Accident Prevention Course program in NYS is guided by a variety of regulations at both the Federal and State level. Generally all of the regulations and standards are consistent with each other. In any instance where they may be disparate, the more stringent standard will preempt the lesser standard. Recognizing that technology and standards evolve over time, NYS shall require sponsors to adhere to promulgated rules and regulations and state standards governing the program and strive to adhere to national standards and guidance documents related to this program. The actual standards that apply shall be based on each individual sponsor's solution. In the event conflicting requirements appear or sponsors require additional guidance as to which standards apply specifically to their solution, contact Driver Program Regulation (see contact information in closing section) for clarification.

Federal Regulations

Federal regulations detailing the Driver's Privacy Protection Act are contained under 18 USC § 2721 et. seq., which are available on DMV's website at www.nysdmv.com. These rules detail permissible uses of personal information that is disclosed for use in motor vehicle accident prevention courses, as well as other uses. All sponsors and their agents participating in the program shall be required to execute a Non-Disclosure Affidavit with DMV as part of the application process.

Federal regulations related to fraud and related activity in connection with computers are contained under Title 18 of the United States Code, Part 1, Chapter 47, section 1030. These rules detail types of computer related offenses that will be punishable if found to occur during the pilot period.

National Standards

National organizations that promulgate standards related to this pilot program, and specific standards, include, but are not limited to:

National Institute of Standards and Technology (NIST) www.nist.org

800-76Biometric Data Specification for Personal Identity Certification

Inter National Committee For Information Technology Standards (INCITS) www.incits.org

377Information Technology-Finger Pattern Based Interchange Format
379Information Technology-Iris Image Interchange Format
385Information Technology-Face Recognition Format for Data Interchange
395Information Technology-Biometric Data Interchange Formats-Signature/Sign Data (Project 1603)
396Information Technology-D Hand Geometry Format for Data Interchange (Project 1643)
398Information Technology-Common Biometric Exchange Formats Framework (Project 1622)
409.1:200xInformation Technology-Biometric Performance Testing and Reporting-Part 1: Principles and Framework (Project 1602)
409.2:200xInformation Technology-Biometric Performance Testing and Reporting-Part 2: Technology Testing and Reporting (Project 1602)
409.3:200xInformation Technology-Biometric Performance Testing and Reporting-Part 3: Scenario Testing and Reporting (Project 1602)

State Laws - DMV

The general legal authority for the Department of Motor Vehicles to require and implement the IPIRP pilot exists under article 12-C (Accident Prevention Course Internet Technology Pilot Program) of the New York State Vehicle and Traffic Law (V&T). Given the use of personal identification information, sponsors shall also be subject to New York State Technology Law § 208, the Information Security Breach and Notification Act, which requires notification when a person without valid authorization has acquired personal information.

State Regulations - DMV

The NYS Department of Motor Vehicles regulations are referred to as 15 NYCRR Part 138, related to the classroom course and 15 NYCRR Part 141, the PIRP Internet/ADM pilot.

State Standards - OFT & CSCIC

The NYS Office for Technology (OFT) and NYS Office of Cyber Security and Critical Infrastructure Coordination have established Information Technology and Security policies and standards as they relate to developed systems in NYS, whether done in-house or by an outside entity.

OFT policies can be found at the following URL: www.oft.state.ny.us and include the following:

G02-001-Guidelines for Internet Privacy

P04-002-Statewide Technology Policy - Accessibility of State Agency Web-based Intranet/Internet Information and Applications

S04-001-NYS Mandatory Technology Standard - Accessibility of State Agency Web-based Intranet/Internet Information and Applications

CSCIC policies can be found at the following URL: http://www.cscic.state.ny.us/lib/policies/ and include the following:

P03-002 v.2.1 "Information Security Policy"

Sponsors participating in the pilot shall comply with the entire Information Security Policy, and the DMV policies listed below, except for those elements that clearly apply to state employees only. DMV will provide copies of the confidential DMV policies to sponsoring agencies upon receipt of a signed Non-Disclosure Affidavit, so as to ensure confidentiality of information contained in these polices.

DMV Policies

The following is a summarized list of confidential DMV policies that shall be adhered to by the sponsors. DMV may, over the course of the pilot, add other DMV or NYS security requirements as new related and applicable policies are issued. These documents are not to be shared outside of the sponsor's organization or to be used for any other purpose than IPIRP.

Modem PolicyConnecting a dial-up modem (a device computers use to transfer data using telephone lines) to a computer system on the DMV network, even when approved, can be a potential security risk. When modem usage is approved certain guidelines must be followed when technically feasible. Exemption from these guidelines may be approved in writing when it is not technically feasible to follow. This will apply to transmission of completer data if File Transfer Protocol (FTP) is utilized during phase 2 (see later section on data transmission).
Equipment Disposal PolicyThere is a risk of disclosure of sensitive information through careless disposal or re-use of equipment. Storage devices such as tape, diskettes or CDs, containing sensitive information must be physically destroyed or securely overwritten to prevent the unauthorized disclosure of sensitive DMV information, depending on the sensitivity level of the data stored thereon. Storage Devices at the very minimum must be re-formatted before disposal or reuse by another user.
User Password Security PolicyPassword protection ensures the integrity of the files and applications by protecting against unauthorized access to programs and data.
Example:If a PC is left unprotected, unauthorized persons gaining access could read, add, delete, or change data records or make changes to the data files or applications.
It is the responsibility of each sponsor to reasonably protect against unauthorized activities performed by their employees' user IDs. Each user is responsible for the data that resides on his/her computer and for any activities performed through use of that computer or other password protected device.

Guidance Documents

The following organizations have proposed related standards that are included here as recommended best practices.

Top 10Open Web Application Security Project available at: http://www.owasp.org/index.php/OWASP_Top_Ten
17799-2005Information Technology-Code of Practice for Information Security Management (INCITS/ISO/IEC) available at: www.incits.org
800-26NIST: Guide for Information Security Program Assessments and System Reporting Form available at www.nist.org

Data Collection Requirements

ADM Participation Data

NYS is requiring all sponsors to collect and report certain standardized data on each course participant for the duration of the pilot. The data captured must be reported to DMV in an un-altered manner, based on how it was captured from the students. Data found to be altered shall result in sponsors being suspended or revoked. Data will be collected on the following:

* Sponsor & Delivery Agency Code

* Motorist Identification

* Course Start & End Date and Time

* Length of PIRP course

* Number of Sessions

* Validation Method Used

* Participant Questions and Answers

* Type of Alternate Training

* Participant Satisfaction with Training

All data listed under "IPIRP Student Participant Information" shall be required to be retained by the sponsor from the beginning of the pilot program to the end of the 5 year study, except where otherwise specified. DMV may add additional values or elements once sponsors submit applications for their unique course. The initial data dictionary of the required retained elements is below:

"IPIRP Student Participant Information"-Data Dictionary

Data/Column Name

Data Type - Length - Value

Description

Sponsor CodeChar (2)Sponsor Code on License File
Delivery Agency CodeChar (3)Agency Code on License File
Motorist Last NameChar (25)Last Name of motorist as appears on the photo driver license
Motorist First NameChar (25)First Name of motorist as appears on the photo driver license
Motorist Middle InitialChar (1)Middle Initial as appears on photo driver license
Motorist Client IDChar (9)ID From NYS driver's license
Motorist Date of BirthChar (10) (mm/dd/yyyy)Check DOB w/CID to ensure accurate posting of completion information to license file trailer.
Start DateChar (10) (mm/dd/yyyy)Date Motorist Started Course
Start TimeChar (6) (hhmm AM/PM)Start Time of IPIRP Course
End DateChar (10) (mm/dd/yyyy)Date Motorist Ended Course
End TimeChar (6) (hhmm AM/PM)End Time of IPIRP Course
Total TimeNum (4)Total Time in Minutes Start to End
Number of SessionsNum (2)Total number of user sessions from start time to end time
Date Reported to DMVChar (10) (mm/dd/yyyy)Date the completer data was reported to DMV by the sponsor
Completed CourseLogical (1)Y=Yes, N=No
Method of Validation 1Char (2)Initial Acceptable Values:
01=Biometric-face recognition
02=Biometric-key stroke
03=Biometric-fingerprint
04=Biometric-voice print
10=Proctored Test
11=In person
12=Third Party Database questions
13=Phone contact
14=Online/Instant messenger tools
15=Personal questions
16=Content questions
17=Pay per view "remote buttons"
18=Email
Method of Validation 2Char (2)Initial Acceptable Values:
01=Biometric-face recognition
02=Biometric-key stroke
03=Biometric-fingerprint
04=Biometric-voice print
10=Proctored Test
11=In person
12=Third Party Database questions
13=Phone contact
14=Online/Instant messenger tools
15=Personal questions
16=Content questions
17=Pay per view "remote buttons"
18=Email
Method of Validation 3Char (2)Initial Acceptable Values:
01=Biometric-face recognition
02=Biometric-key stroke
03=Biometric-fingerprint
04=Biometric-voice print
10=Proctored Test
11=In person
12=Third Party Database questions
13=Phone contact
14=Online/Instant messenger tools
15=Personal questions
16=Content questions
17=Pay per view "remote buttons"
18=Email
Valid Question 1*Char (3)Unique sponsor question code
Student Answer 1Char (1)Student Answer to unique question
Valid Question 2Char (3)Unique sponsor question code approved by DMV
Student Answer 2Char (1)Student Answer to unique question
Valid Question 3Char (3)Unique sponsor question code approved by DMV
Student Answer 3Char (1)Student Answer to unique question
Valid Question 4Char (3)Unique sponsor question code approved by DMV
Student Answer 4Char (1)Student Answer to unique question
Valid Question 5Char (3)Unique sponsor question code approved by DMV
Student Answer 5Char (1)Student Answer to unique question
Valid Question 6Char (3)Unique sponsor question code approved by DMV
Student Answer 6Char (1)Student Answer to unique question
Valid Question 7Char (3)Unique sponsor question code approved by DMV
Student Answer 7Char (1)Student Answer to unique question
Valid Question 8Char (3)Unique sponsor question code approved by DMV
Student Answer 8Char (1)Student Answer to unique question
Valid Question 9Char (3)Unique sponsor question code approved by DMV
Student Answer 9Char (1)Student Answer to unique question
Valid Question 10Char (3)Unique sponsor question code approved by DMV
Student Answer 10Char (1)Student Answer to unique question
Valid Question 11Char (3)Unique sponsor question code approved by DMV
Student Answer 11Char (1)Student Answer to unique question
Valid Question 12Char (3)Unique sponsor question code approved by DMV
Student Answer 12Char (1)Student Answer to unique question
Valid Question 13Char (3)Unique sponsor question code approved by DMV
Student Answer 13Char (1)Student Answer to unique question
Valid Question 14Char (3)Unique sponsor question code approved by DMV
Student Answer 14Char (1)Student Answer to unique question
Valid Question 15Char (3)Unique sponsor question code approved by DMV
Student Answer 15Char (1)Student Answer to unique question
Valid Question 16Char (3)Unique sponsor question code approved by DMV
Student Answer 16Char (1)Student Answer to unique question
Valid Question 17Char (3)Unique sponsor question code approved by DMV
Student Answer 17Char (1)Student Answer to unique question
Valid Question 18Char (3)Unique sponsor question code approved by DMV
Student Answer 18Char (1)Student Answer to unique question
Valid Question 19Char (3)Unique sponsor question code approved by DMV
Student Answer 19Char (1)Student Answer to unique question
Valid Question 20Char (3)Unique sponsor question code approved by DMV
Student Answer 20Char (1)Student Answer to unique question
Valid Question 21Char (3)Unique sponsor question code approved by DMV
Student Answer 21Char (1)Student Answer to unique question
Valid Question 22Char (3)Unique sponsor question code approved by DMV
Student Answer 22Char (1)Student Answer to unique question
Valid Question 23Char (3)Unique sponsor question code approved by DMV
Student Answer 23Char (1)Student Answer to unique question
Valid Question 24Char (3)Unique sponsor question code approved by DMV
Student Answer 24Char (1)Student Answer to unique question
Valid Question 25Char (3)Unique sponsor question code approved by DMV
Student Answer 25Char (1)Student Answer to unique question
Valid Question 26Char (3)Unique sponsor question code approved by DMV
Student Answer 26Char (1)Student Answer to unique question
Valid Question 27Char (3)Unique sponsor question code approved by DMV
Student Answer 27Char (1)Student Answer to unique question
Valid Question 28Char (3)Unique sponsor question code approved by DMV
Student Answer 28Char (1)Student Answer to unique question
Valid Question 29Char (3)Unique sponsor question code approved by DMV
Student Answer 29Char (1)Student Answer to unique question
Valid Question 30Char (3)Unique sponsor question code approved by DMV
Student Answer 30Char (1)Student Answer to unique question
Valid Question 31Char (3)Unique sponsor question code approved by DMV
Student Answer 31Char (1)Student Answer to unique question
Valid Question 32Char (3)Unique sponsor question code approved by DMV
Student Answer 32Char (1)Student Answer to unique question
Course Reason CodeChar (1)Acceptable Values
I=Insurance Reduction
P=Point Reduction
B=Both Points/Insurance Reduction
T=Traffic Safety Awareness
C=Court Mandated
D=Court Mandated/Point Reduction
R=Court Reduced Infraction
O=Other
ADM Delivery MethodChar (1)Acceptable Values
I=Internet
2=DVD/CD/VHS Sale
3=DVD/CD/VHS Rental
4=Pay Per View
5=PC at Delivery Agent/Equivalent
Previous PIRP ExperienceChar (2) Acceptable Values 0-99Number of Times Student has taken Accident Prevention Course Before
Satisfaction Code -Char (1)Acceptable Values
Method1=Really Like ADM Over Classroom
2=Like ADM Over Classroom
3=No Preference
4=Like Classroom over ADM
5=Really Like Classroom over ADM
6=First time attendee/not applicable
Satisfaction Code -Char (1)Acceptable Values
Course1=Excellent Course
2=Good Course
3=Average Course
4=Poor Course
5=Worst Course Ever
Impact Code -Char (1)Acceptable Values
Course Effectiveness1=Will Improve Driving Very Much
2=Will Improve Driving Some
3=Little Impact on Driving
4=No Impact on Driving
Participant InterestChar (1)Acceptable Values
Code - Course1=Very Interesting Course
2=Interesting Course
3=Average Course
4=Boring Course
5=Very Boring Course
Ease of Use Code - CourseChar (1)Acceptable Values
1=Very Easy to Use
2=Easy to Use
3=Neither easy or difficult
4=Hard to Use
5=Very Hard to Use

*Valid Question X number will be obtained from sponsor provided list of unique questions asked during the course, where required.

As per section 141.5 and 141.8 of this Part, each sponsoring agency application must include a specific plan for how instruction time will be calculated. A record of such calculations, including all instruction time, will be recorded and stored by the sponsor and made available to the third party monitor and the Department for monitoring and quality control purposes. This information, as part of each student's completion record, must clearly differentiate actual interactive instruction time from non-instruction time such as log-in procedures, administrative tasks, help functions, validation processes, and audio/visual media download times. Such record shall be maintained for five years.

Data Submission

In the event a student begins, but does not complete the course, sponsors will complete as much information as possible (for example, start date and start time). DMV strongly recommends that sponsors DO NOT collect social security numbers, as they are not needed to match to the license record. As part of pilot participation, sponsors will be expected to transmit the required data either to DMV and/or a third party under contract to DMV. Data transmission is to be achieved in a manner and frequency to be determined by DMV. A sponsor's ability to properly collect, store and report this data shall be validated during the sponsor IPIRP curriculum review and approval process. Depending upon the format selected by the sponsor (internet, DVD or other), sponsors shall be required to capture, store and report additional information such as student footprint data or monitored exam data. DMV anticipates the process for completer data transmission to be implemented in a phased approach as follows:

Phase 1 - The completer data will be sent in the existing (pre-IPIRP) format either via existing methods or via Secure FTP. The elements submitted to the DMV will be the same elements that are currently submitted to the DMV. However, the entirety of the elements listed above under "IPIRP Student Completer Information" must be retained. Sponsors shall use a unique delivery agent code to delineate the IPIRP completer from the traditional classroom completer. Failure to correctly delineate the IPIRP completer from the traditional classroom completer may result in sponsor suspension.

Phase 2 - The completer data will be submitted to the DMV or a third party approved by DMV. The elements of the data that need to be submitted shall conform to ALL of the elements listed under "IPIRP Student Completer Information". The format and data transmission specifics will be published by DMV under a separate "Technical Interface" document prior to Phase Two to all participating IPIRP sponsors.

Student Footprint Logs (Internet/Phone Based Only)

To facilitate DMV's ability to audit the 320 minute time requirement, sponsors that offer computer based training shall be required to collect and store logs of student activity as they progress through the training. Data stored for each student, during each session must include:

Data/Column Name

Data Type - Length - Value

Description

Motorist Client IDChar (9)ID from NYS driver's license
Start DateChar (10) (mm/dd/yyyy)Date Motorist Started Course
Start TimeChar (6) (hhmm AM/PM)Start Time of IPIRP Course
End DateChar (10) (mm/dd/yyyy)Date Motorist Ended Course
End TimeChar (6) (hhmm AM/PM)End Time of IPIRP Course
Total TimeChar (5)Calculated based on End Date/Time
- Start Date/Time. Captures overall
time from registration through completion, including proctored testing if required.
Last Module CompletedChar (2)?Sponsor designated code for where in application student ended session
Total Instruction Time in MinutesChar (3)Calculated based on sponsor's approved calculation method. Excludes non-instruction time such as log-in procedures, administrative tasks, help functions, validation processes and audio/visual media download times.

Sponsors will not be required to transmit this data, but are expected to store it and make it available to DMV, upon request, as needed. The logs must be stored in the format above and must be human readable.

Proctored Exam Logs

(DVD/VHS/CD Formats

Data/Column Name

Data Type - Length - Value

Description

Motorist Client IDChar (9)ID from NYS driver's license
License Document NumberChar (8)Document number on lower right hand corner of front of license
Date of Exam(10) (mm/dd/yyyy)Date Motorist Started Exam
Start TimeChar (6) (hhmm AM/PM)Start Time of Exam
End TimeChar (6) (hhmm AM/PM)End Time of Exam
Total TimeChar (5)Calculated based on End Date/Time - Start Date/Time
Person Validating IdentityChar (4)Unique code identifying person who validated student identity at time of exam
Testing Facility UsedChar (4)Unique code identifying the testing facility where exam administered
Monitoring Method 1Char (1)Type of monitoring used during proctored exam (1st method) using the following codes:
1=Biometric Sample Collected
2=Student monitored by video
3=Student monitored by person
Monitoring Method 2Char (1)Type of monitoring used during proctored exam (2nd method)
1=Biometric Sample Collected
2=Student monitored by video
3=Student monitored by person

Storage of any biometric samples collected, or video of the exam completion, shall be maintained by the sponsor for a minimum of 5 business days from course completion but no longer than 30 calendar days from course completion. These materials shall be made available to DMV and their representatives upon request.

Data Security Requirements

Personal Identification Information

Information that is considered personal information includes, but is not limited to, participant name, address, date of birth, motorist identification number, client identification number, social security number (if collected), credit card information, answers to personal and content questions and biometric samples. Computer systems storing this information shall be protected against data theft and loss. Financial transactions shall be conducted securely, so that theft of personal identification information is unlikely. In the event this information becomes compromised, sponsors are required to investigate the incident and determine what data has been compromised. Suspected or confirmed inappropriate access to or disclosure of personal identification data collected for IPIRP shall be reported to DMV's Director of Audit Services or designees by phone within 1 hour of detection. This notification shall be followed up in writing by fax or e-mail within 24 hours of detection. The sponsor shall fully investigate the compromise and report the circumstances as well as the steps taken or proposed to be taken to prevent similar instances in the future. Failure by the sponsor to notify DMV of disclosure of participant personal information, as specified, will result in Sponsor suspension or revocation. Notification must be made to the following individuals:

DPR - Director, Driver Program Regulation (518) 486-5572

Field Audit - Director or designee (518) 474-0881

If personal identification information has been compromised, the sponsor must provide assistance and information regarding identity theft, how the student can monitor their credit report and what resources exist for preventing and/or identifying and reporting any potential identity theft. In the event of a security breach, DMV will allow sponsors access to their bond for the purposes of breach notification and necessary follow through.

Security Reviews

Sponsors shall be required to undergo a security review as part of the sponsor approval process. DMV personnel will complete this security review, and it will involve a site visit and a series of interviews via telephone and/or e-mail.

The Division of Field Investigation site visit will focus on a review of physical security and computer system access. The sponsor shall pay all costs for travel and lodging incurred by the Department of Motor Vehicles in connection with all security reviews.

The Information Security Office interviews will, at a minimum, review:

* System Description

Diagrams of the system, including data connections.

Where and how any custom source code is stored and secured.

An inventory of data stores, such as files and databases.

An inventory of sensitive or confidential data that is stored, processed or transmitted by the system.

* Security and Risk

A list of the DMV and vendor contacts in case of a security incident.

An inventory of the system vulnerabilities and what protection will be in place for each of the vulnerabilities.

Review of how DMV private or sensitive data is secured.

Procedures if secured DMV data is compromised or lost.

* Backup and Recovery

Review of the vendor's backup plan.

Procedure for reconstructing data from other sources, if available.

Estimate of the recovery time from a disaster ("how soon do they need to come back up?") and the recovery steps.

The business continuity plan.

The disaster recovery plan for this application.

* Disposal

Procedures for disposing of confidential information, both paper and electronic.

The security review may include the release of sensitive information (e.g., a description and diagram of your system) as applicable.

Sponsors shall be provided with an opportunity to correct significant security vulnerabilities noted during the security review and a follow-up visit and/or type of confirmation will occur to confirm that deficiencies have been remediated.

Sponsors that do not pass a security review shall not be allowed to offer courses via IPIRP/ADM until they do pass a security review. DMV reserves the right, over the course of the pilot, to conduct follow-up reviews to ensure that security standards identified during the original review continue to be maintained.

User Interface Requirements

NYS desires IPIRP courses that engage the user in the learning experience. Courses that are reviewed which do not require the student to "participate" in some fashion will not be approved. The user's graphical interface must be user friendly, which is demonstrated through:

* Ease of use.

* Length of time it takes for pages to load.

* Ability to play multimedia during the course (assuming student has appropriate hardware and software installed).

* Ability to log on and off the course site (or stop and start computer or video based courses), and navigate easily and freely to material previously covered.

* Easily understood policies & procedures regarding course and usage during the signup process.

* Scrolling should be limited to up and down where appropriate, versus also requiring the user to scroll left to right.

* No advertisements (including pop-ups) will be allowed during the entire course (including sign up, login and course completion).

In an effort to encourage innovation and alternative methods, NYS will allow sponsors to choose which mandatory elements they will incorporate in their course delivery, within certain parameters, as defined below:

Audio/Visual Requirements

Participants will have varying internet connection bandwidth rates, which must be taken into account in the overall ratio of multimedia to alternate content delivery (e.g., chart with text), where possible.

Timing requirements, as outlined in the table below, are based on successful completion of the minimum course duration of 320 minutes. DMV anticipates the course to be broken into 6-10 sections that can be completed at a reasonable pace. These sections would be logical groupings of material from the approved classroom curriculum. Minimum content will be determined based on the following methods as described below:

Timing of Content to Determine Minimum Time Requirements Met

Type of Content

Types of Material/ Specifications

Amount of Time Allowed

MultimediaAudio and/or visual clips, where possible. Audio/visual should be in sync. Each clip shall be no more than 6 minutes in duration, except where approved by the department. Material in written text can also be available as audio (verbatim or ad lib), to be played at the students option, which will determine course timing. The total video should not exceed 25% of allowed time for online courses. Audio/visual clip download time shall not be unnecessarily long so as to disrupt the flow of the course or diminish the student's course experience.Actual play time of all audio/visual material.
Simulations & ExercisesThis can be "follow along" video or interactive audio/video that engages the user to evaluate a key learning point from the training (e.g., response time, range of motion, visual acuity, etc.)Actual time of simulation or exercise, allowing sufficient time for user to follow along at required pace.
Charts & GraphsStatistics included must be the most current available, and are expected to be updated annually at a minimum.Allow 1 minute for each chart or graph.
Personal QuestionsCollected from 3rd party database, DMV license file (if approved), or as collected by the sponsor at time of application.Allow 45 seconds to answer each personal question.
Content QuestionsTest bank questions are developed by the sponsor and approved by DMV.Allow 60 seconds to answer each content question.
Written TextIncluding bulleted lists, captions, paragraphs and other written material. Time allowed will be a word count, when audio augmentation is not available, will be based on a physical word count. The word count shall be divided by 100 words per minute.The result of total words divided by 100. This will be the time allowed.

Recognizing that material on the internet can vary widely, and that the emphasis is on student learning, DMV will consider alternate time calculation methods, at their discretion, so long as sponsors can demonstrate that the course meets the 320-minute requirement.

The responsibility for validating student identity, as well as student participation, shall be with the sponsors, and their delivery agents, if applicable. While DMV intends to monitor sponsor compliance through existing resources, and/or through a third party contractor, the sponsor shall be accountable for their compliance. Given that a variety of content delivery/validation methods exist today, and more are expected over the course of the pilot, DMV will set an initial, minimum threshold, which is as secure as the existing classroom course.

Customer Service Requirements

DMV shall require that:

* The cost of all services is spelled out to the motorist at the point of sale (course cost, customer service fees, certificate costs, technology costs, proctored exams, etc. where applicable). There shall be no hidden fees and fees shall not change after the student registers for the course and accepts the terms and conditions required by the regulation.

* The course delivery and participation validation method, and terms and conditions of course and course payment/refund policies shall be described to the participant prior to the sale.

* Customers shall agree to the terms and conditions, including language to be provided by DMV, by typing "I agree" prior to the course commencing (or by signing an agreement in person either at point of sale or during proctored exam after identity validated).

* Sponsors shall provide customer service telephone support, that is at a minimum, Monday through Saturday from 8 am to 4 pm EST. DMV will consider sponsor proposals to utilize an interactive voice message system in place of live contact or in conjunction with live contact. DMV will revisit this requirement after the pilot program has been operational for 6 months.

* Sponsors shall incorporate the contents of the DMV C-32A brochure, described in Part 138.11 of the Commissioner's regulations, into the course material. This can be covered during registration if desired.

* Sponsors shall make available a printable version of key learning points covered during the training to participants so that they may have a ready reference if desired.

Participant Validation

In order to meet the legislative intent, and to assure that rigorous course requirements are met (including identity validation and student participation), while allowing multiple delivery methods to be employed, DMV has assigned "point" values to the following validation techniques:

Participant Validation Technique Options Available to Sponsors in Designing Program

Method of Validation

Examples/Parameters of Validation Method

Points Assigned

Facial Recognition Biometric-Hardware provided by sponsor and included in cost of course6
Fingerprint Biometric-Hardware provided by sponsor and included in cost of course6
Handprint Biometric-Hardware provided by sponsor and included in cost of course6
Retina or Iris Scan Biometric-Hardware provided by sponsor and included in cost of course6
Ear Scan Biometric-Hardware provided by sponsor and included in cost of course6
Keystroke Analysis Biometric-Software provided by sponsor and included in cost of course5
Voice Print Biometric-Software provided by sponsor and included in cost of course6
Other BiometricPrior DMV approval requiredTo be determined
Proctored ExamStudents must pass a multiple choice test with a correct score of 75% or better in order to obtain a certificate. Students will be permitted to bring in sponsor provided material into the exam.5
In Person ContactIdentity validated at time of registration, or if set up as a computer based training at delivery agent site, delivery of training3
Phone ContactPrompting student to dial an 800 number to answer content or identity questions.2
Third Party DatabaseUsing individualized questions based on data stored in a credit bureau or government database (this is unrelated to and separate from a 3rd party monitoring organization)2
Online/Instant MessagePrompting student to answer questions through an online chat discussion group or when online technical assistance requested.1
Personal QuestionsQuestions aimed at authenticating identity.1
Content QuestionsQuestions aimed at determining student participation.1
Pay Per View ButtonsUsing features of cable TV to have user interface for answering personal or content questions.1
E-mailSending technical assistance response or user names and password for site access. If both user name and password are transmitted in the same email, password must be changed when the participant first logs on.1
Other TechniquesPrior DMV approval requiredTo be determined

Sponsors seeking approval for their IPIRP courses must have a minimum of seven or more points, using two or more of these techniques, provided, however, that one point must be for content questions. The content questions may be asked at random points throughout the course or at the end of each chapter or unit. Such questions do not need to be in the form of a final exam. Sponsors are free to suggest alternate techniques, although the actual points assigned will be based on a determination by DMV. Depending upon the robustness of the solution offered by the sponsor, DMV reserves the right to increase or decrease the point values above to reflect the quality of a particular sponsor's solution in meeting or exceeding the validation requirements. Participant private information, as defined in the personal identification section shall be encrypted. All authentication information shall be protected; for example, it should not be stored or transmitted in clear text.

Validation Requirements

This section details requirements not otherwise detailed in the previous sections, and focuses primarily on requirements for participant validation, and also data storage. Participant validation will focus on Biometrics, Proctored Exam, In Person Contact, Telephone Contact, Online Chat/Discussion Group, Personal and Content Questions, Pay Per View and Email Requirements.

Biometrics

DMV shall allow a variety of Biometric Data Formats, so long as initial sample collection and periodic validation of ongoing participation against the original sample occur throughout the course at random intervals. DMV recognizes that many biometric standards are relatively new and that some available technologies in the marketplace may not strictly adhere to the standards. DMV expects the ADM pilot will allow sponsors the opportunity to explore alternate validation techniques, in lieu of requiring a proctored exam.

If a sponsor selects Biometrics as a validation technique, they will be required to capture at least 7 biometric samples over the 320 minutes of instruction. These 7 samples shall be stored for a minimum of 5 business days from course completion, and no longer than 30 calendar days from course completion, and shall be subject to DMV review. In the event DMV elects to review samples, the sponsor must provide the appropriate hardware and software in which to allow DMV to verify that validation was correct. This information shall be considered "personal information" and must be kept securely. For each sample, the sponsor must also associate the client identification number on the motorist's driver's license, date and time the sample was collected and by whom the sample was collected and/or verified by (as appropriate). Sponsors shall ensure that their biometric validation technique(s) is calibrated to be at least 90% accurate. Students who fail to have their identity verified by the biometric technique after five attempts shall be excluded from the course.

Proctored Exam

Unless biometrics are used in the ADM course, or sponsors can prove to DMV's satisfaction that rigorous identity validation and participation techniques are employed, a proctored exam shall be required. Requirements for the proctored exam are as follows:

* Exam locations shall be approved by DMV, and can be provided as part of the sponsor application process. It is preferred that tests be administered at colleges, universities and other testing facilities that routinely offer proctored exams, however delivery agencies may also administer the proctored exam.

* To the degree possible, proctors shall be independent of the sponsor, as well as with those taking the test. Typically, exam proctors are educators, law enforcement personnel, supervisory administrative staff, lawyers, engineers, etc. that have no stake in the outcome of the exam. Delivery agencies may also administer the proctored exam.

* Students taking the proctored exam must present two forms of identity, with one being their NYS driver's license photo identification. These must be validated against the schedule (name, motorist ID) and also visually against the photograph. Students must sign in, indicating agreement with the test requirements. Signatures must be validated against signatures on the student IDs. Students without proper identification, or who appear to be presenting false identification must be refused entrance into the test.

* During the exam, proctors must monitor student exam completion by either being in the room, in a different room separated by a glass window or via video monitoring.

* The exam location must be closed to the public and be free from distractions.

* Students will be given a sponsor developed multiple-choice exam. These exams will be uniquely generated from a random pool of 100 test questions, which are developed by the sponsor and approved by DMV. When submitting test questions for approval, sponsors shall identify where in their course curriculum the answer is contained. Sponsors are required to refresh questions every 6-12 months. Students must receive a passing score of 75% correct to pass the course. Students that fail the exam, will be allowed one additional opportunity to pass the exam, which will be considered a "retest". Students will be allowed up to 60 minutes to take the exam and will be allowed to bring in materials printed from the sponsor's course.

* Students shall complete the proctored exam within 30 calendar days from completing the course, although within 1-14 days is preferable. Retests can be completed within 30 calendar days from the date of initial completion.

In Person Contact

This identity validation method refers to face-to-face contact between the student and either the sponsor staff or the delivery agency staff, identified in the sponsor's application. This can be at the point of sale or course delivery (computer based training). During this contact, sponsor staff is required to:

* Ask students to present two forms of identity, with one being photo identification in the form of a government issued driver's license or non-driver ID.

* The motorist must be validated visually against the photograph.

* Students must sign an agreement, indicating willingness to comply with course guidelines.

* Signatures must be validated against signatures on the student's government issued drivers license or non-driver ID.

* Students without proper identification, or who appear to be presenting false identification must be refused entrance into the course.

Phone Contact

Phone contact, for the purpose of this identity validation method, does NOT include customer service phone support described earlier in this document. This phone contact is selected by the sponsor as an additional validation/participation method. This method can either be the sponsor contacting the student while the course is being delivered, or by prompting the student to contact the sponsor at a toll free number.

Once the student contacts the sponsor, the student's identity is validated using personal questions and/or the student's participation is validated using content questions. These questions would be in addition to the proctored exam. In addition, the questions used for phone validation cannot be the same as those included in a proctored exam. It is preferred that when phone contact is initiated by the student, when prompted, that a live operator be available to answer the phone within a minute. Recognizing that 24/7 service may not be practical, sponsors can elect to utilize an automated service outside of the core customer service hours. See personal and content questions for more guidance on these requirements.

Sponsors shall be expected to capture specific data on each of these contacts, including participant identity information, date/time of contact, operator guiding the call and answers to personal/content questions as part of ADM participant information. This information should be stored electronically and be available for the entire 5 year pilot period. Sponsors shall implement security measures to ensure that personal validation information cannot be retained by operators or by contracted services, such as outsourcers in other countries.

Third Party Database Questions

This method refers to the sponsor's use of data elements from a third party database, primarily that of a credit bureau or a government agency, to develop individualized questions to be used in validating the identity of a student. Data sets may be made available to the sponsor for direct verification but the sponsor assumes the risks and responsibilities associated with securing this data, so it is preferable that the sponsor utilize the services of the data provider where verification can be made without the sponsor accessing the personal data from the third party database. At least one of the national credit bureaus is known to provide an identity verification service where verification is made without personal information being released by the credit bureau. Sponsors are expected to capture each third party validation question and whether the question was answered correctly, including a date and time stamp. Verification transaction information must be stored electronically and available to the department for the five years of the pilot study. Sponsors must implement security measures to ensure that personal validation information is secured.

DMV reserves the right to review and approve the use of a third party database information for the purpose of validating student identity, including any contracts, agreements, security protocols and policies, and may consult the third party credit bureau or government data provider without permission from or knowledge of the sponsor.

Personal/Content Questions

Should sponsors opt to utilize phone contact, online personal or content questions or utilize "pay per view" cable buttons, students will be required to answer authentication questions correctly and within the prescribed timeframes as follows:

Proposed Validation of Student Identity & Participation

Type of Question

Number In Test Bank

Minimum # in Course

Correct Responses Required

Amount of Time to Read & Answer - PC Format

Amount of Time to Ask & Answer - Phone Contact

Personal identity3010745 seconds30 seconds
Content/environment100201460 seconds45 seconds

Personal questions may be asked throughout the course, and at a minimum, at the beginning of each session logon. Students are limited by the number of times they can incorrectly answer personal identity and content/environment questions. Questions will be asked as they relate to material presented in each section, and can either be after video clips or at the end of each sub-section or section. Students that fail to answer the minimum number of content/environment questions correctly can have additional questions asked (adding to the minimum time requirement) so as to proportionally be able to answer a correct number of questions in a subsequent attempt as appropriate. Students will have up to 3 complete opportunities (for a total of 10 personal or 20 content questions each) in order to "prove" participation.

E-mail Contact

Should sponsors opt to use email as a validation method, they will need to confirm that the email was "received", by providing to the student both the hyperlink to "confirm" registration or to link to the course upon acceptance of payment. Email contact can also be used to transmit user sign-ons and passwords in order to access the course. The purpose of email contact is to send information necessary to access the course to a participant provided address. The preferred method is for the user name and password to be transmitted in separate emails, but mailing both in a single email is acceptable if a password change is required upon initial log on to the sponsor site.

Online Contact

In the event sponsors wish to use some form of online contact with participants, the requirements of this option are:

* Participants must identify themselves in a manner that will allow them to be linked to the student participation database.

* Online contact can utilize participatory tools available on the internet including but not limited to instant messaging, online whiteboards and collaboration software.

* During online contact, sponsors can ask personal/content questions or use this to provide online help.

* Sponsors must clearly demonstrate how they plan to implement and use this option, as well as how they plan to protect the information that is transmitted. Sponsors must not transmit private data using clear text; all private data must be encrypted and secured.

Web TV/Pay Per View

Given the advent of interactive TV and the ability to "vote" using digital cable, sponsors who opt to deliver their course as a pay per view option, can use this technology to validate participation. This can be done through the remote control by having students answer multiple choice personal questions or content questions. Participants must be identified in a manner that will allow them to be linked to the student ADM participant database. Sponsors can also consider participants being prompted to call a toll free number to answer personal and content questions at selected intervals during the course.

Other Portable Devices (Cell Phones/PDA)

Although we do not know of an accident prevention course being delivered through a PDA or cell phone, the features and functions of today's devices seem to support the delivery of a course, albeit the screen display is limited. Sponsors that opt to deliver their courses using this methodology can couple the device with interactive use of phone buttons to have students answer both personal and content questions during the course.

Future Technologies

Recognizing the explosion of portable personal devices, DMV remains open to alternate delivery methods over the duration of the pilot. DMV will continue to accept sponsors' applications, including technologies not specified herein, for alternate delivery methods throughout the duration of the 5-year pilot.

Sponsor Application Process

Participation in the IPIRP is voluntary; existing sponsors are not required to participate in the pilot. The two-step application process is designed to minimize development costs and potential delays during the review and approval process, while ensuring that the finished product adheres to the mandated requirements.

Step 1

Approved sponsors that desire to participate in the pilot must:

* Complete an IPIRP application form (to be provided by DMV to all approved classroom sponsors when Part 141 Commissioner's regulations are approved).

* Include a one time, $7,500 non-refundable application fee in the form of a certified check or money order, payable to the Commissioner of Motor Vehicles - IPIRP Fund.

* Mail the application and fee to:

NYS Department of Motor Vehicles Bureau of Driver Program Regulation, Rm. 412 6 Empire State Plaza Albany, NY 12228

The application will be carefully reviewed by DMV associates to ensure completeness and adherence to the IPIRP requirements. It is anticipated that several follow-up discussions with appropriate sponsor staff will occur as a result of the application submitted and that these subsequent discussions will take at least one month. NYS reserves the right to return incomplete applications to sponsors for more information. Sponsors that have their application returned can resubmit their updated application at any time. The $7,500 non-refundable application fee only needs to be paid once during the pilot program.

Step 2

Once DMV associates have reviewed the application, and all necessary questions have been addressed, the DMV will notify sponsors in writing that they have been approved to proceed with development. Once the sponsor has completed their IPIRP development, they must submit the finished product to DMV as follows:

* If internet based, sponsors should submit the URL (web address) of the training, and 10 unique user names and passwords that can be used by DMV staff to review the curriculum.

* If an alternate delivery methodology is used, sponsors should submit 10 copies of the alternate medium that can be used by DMV staff to review the curriculum.

* Regardless of method, DMV will be testing the sponsors proposed validation and participation methodologies, so sponsors must submit appropriate materials (hardware, software, phone numbers, questions and answers, etc.) necessary for validation by up to 10 different associates.

* A bond, or letter of credit, in the amount of $100,000, naming DMV as a beneficiary. Applicants need not provide the bond or letter of credit with their initial application materials, though this requirement must be satisfied before DMV will grant final approval to conduct an ADM course. Sponsors that do not provide the bond or letter of credit with application materials will be advised in writing by DMV when all other application requirements have been satisfied and approval is imminent. The sponsor must then submit the bond or letter of credit in order to be finally approved. DMV will notify the sponsor when course delivery may commence. The sponsors must submit proof of bond renewal on an annual basis.

* The physical location(s) of the data server used to either deliver the course and/or store student participation data (detailed in data collection requirements section) and the responsible person (and their contact information) at this location. If the data server is out of state, NYS reserves the right to require sponsors to reimburse the state for the cost of travel to this site, and to any other site where related data may be stored, to verify security requirements are being met.

DMV anticipates that this review and approval process could take upwards of 60 days to complete. The length of time will be dependent upon the number of curriculums being reviewed at one time; DMV plans to assign the review to multiple individuals, and will assign based on a first in, first reviewed order.

DMV Review & Approval Process

All applications will be logged-in based on when received and tracked during the various reviews completed (curriculum, security, background, etc.). As stated previously, these will be reviewed in a first in, first out order. Cooperation by the sponsor in answering questions, scheduling and hosting the security review, and providing follow up or supplemental materials requested (if necessary) will assist in getting the application processed as quickly as possible. Continuous delays, errors and omissions in the application package will result in the application process slowing down.

Communication about application and programmatic deficiencies will be reported to the application contact person. If the sponsor would like this communication to go to multiple people, this must be noted on the application form. DMV plans to review both steps of the submission completely, and will note all items found non-compliant upon completion of the review, in writing to the contact person. Once a sponsor has successfully met all pilot requirements described herein, DMV will provide written approval allowing the sponsor to start the IPIRP/ADM course.

DMV reserves the right to deny participation in the ADM pilot if adverse material uncovered during the review indicates that sponsors are not of the high moral and financial character required to operate an ADM program. In the event DMV reaches this decision, written notice will be provided to the sponsor explaining or decision. This decision will be subject to appeal.

Existing approved NYS sponsors are allowed to partner or create a co-venture with another company to provide the ADM course, so long as they have exclusive rights to deliver the course in NYS. In the event the partnership is with a non-NYS approved PIRP provider, the non-NYS provider would not be eligible to offer the same PIRP course, in the event they opted at a future date to apply to become a NYS classroom and/or ADM sponsor.

To the degree possible, DMV prefers to have at least two approved ADM sponsors before authorizing the start of the pilot. The start date selected will be provided in writing to all approved ADM sponsors, and will likely indicate a future date (approximately 14 days from the notice). Once the pilot officially starts, all subsequently approved ADM sponsors can start as soon as course approval has been received. The five year pilot will being once the start date selected occurs.

Questions About Appendix A

Appendix A will be updated as needed to address DMV's and the sponsors' concerns. Questions about the specification can be put in writing and mailed to:

DPR - Room 412 6 Empire State Plaza Albany, NY 12208 Fax: (518) 473-0160 Email: IPIRP@dmv.state.ny.us

The sponsor question and DMV response will be mailed to all sponsors with a pending application on file (sponsor is at step 1 or later). In the event the specification document is updated as a result of clarifications (or technology advancements), it will be mailed to all approved public sponsors.

N.Y. Comp. Codes R. & Regs. Tit. 15 § 141.14