2900-0770_Qualitative Feedback_Supporting Statement B_revised 09282020

Supporting Statement B for Paperwork Reduction Act (PRA)

Generic Information Collection Submissions for

“Generic Clearance for the Collection of Qualitative Feedback on Agency Service Delivery”

(NCA, VBA, VHA)

2900-0770

B. COLLECTIONS OF INFORMATION EMPLOYING STATISTICAL METHODS

Data collection methods and procedures will vary; however, the primary purpose of these collections will be for internal management purposes. There are no plans to publish or otherwise release this information.

1. Provide a numerical estimate of the potential respondent universe and describe any sampling or other respondent selection method to be used. Data on the number of entities (e.g., households or persons) in the universe and the corresponding sample are to be provided in tabular format for the universe as a whole and for each strata. Indicate expected response rates. If this has been conducted previously include actual response rates achieved.

The activities under this clearance may involve samples of self-selected customers, as well as convenience samples, and quota samples, with respondents selected either to cover a broad range of customers or to include specific characteristics related to certain products or services. Results will not be used to make statements representative of the universe of study, to produce statistical descriptions (careful, repeatable measurements), or to generalize the data beyond the scope of the sample. The specific sample planned for each individual collection and the method for soliciting participation will be described fully in each collection request.

Qualitative surveys are tools used by program managers to change or improve programs, products, or services. The accuracy, reliability, and applicability of the results of these surveys are adequate for their purpose.

The samples associated with this collection are not subjected to the same scrutiny as scientifically drawn samples where estimates are published or otherwise released to the public.

2. Describe the procedures for the collection of information, including:

• Statistical methodology for stratification and sample selection

• Estimation procedure

• Degree of accuracy needed

• Unusual problems requiring specialized sampling procedures

• Any use of less frequent than annual data collection to reduce burden

Data collection methods and procedures will vary, and the specifics of these will be provided with each collection request. VA expects to use a variety of methodologies for these collections. For example, VA or its contractors may use commercial survey-specific software to automate its collection and analysis of feedback. In addition to physical copies, information collection instruments may be electronically disseminated and/or posted on target pages of VA’s web site. Telephone scripts, personal interviews, and focus groups with professional guidance and moderation also may be used.

2. Describe methods to maximize response rate and to deal with issues of non-response. The accuracy and reliability of information collected must be shown to be adequate for intended uses. For collections based on sampling, a special justification must be provided for any collection that will not yield “reliable” data that can be generalized to the universe studied.

Information collected under this generic clearance will not yield generalizable quantitative findings; it can provide useful customer input, but it does not yield data about customer opinions that can be generalized.

2. Describe any tests of procedures or methods to be undertaken. Testing is encouraged as an effective means of refining collections to minimize burden and improve utility. Tests must be approved if they call for answers to identical questions of 10 or more individuals.

Pretesting may be done with internal staff, a limited number of external colleagues, and/or customers who are familiar with the programs and products. If the number of pretest respondents exceeds nine members of the public, VA will submit the pretest instruments for review under this generic clearance.

2. Provide the name and telephone number of individuals consulted on statistical aspects of the design and the name of the agency unit, contractor(s), grantee(s), or other person(s) who will actually collect and/or analyze the information for the agency.

Each program will obtain information from statisticians in the development, design, conduct, and analysis of customer/partner service surveys, when appropriate. This statistical expertise will be available from agency statisticians or from contractors, and VA will include the names and contact information of persons consulted in the specific information collection requests submitted under this generic clearance.