Office of Population Affairs Grantee Satisfaction Survey 2022

Form Approved

OMB No. 0990-0379

Exp. Date 08/31/2023

Office of Population Affairs (OPA)

2022 Annual Grantee Satisfaction Survey

According to the Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unless it displays a valid OMB control number. The valid OMB control number for this information collection is 0990-0379. The time required to complete this information collection is estimated to average 20 minutes per response, including the time to review instructions, search existing data resources, gather the data needed, to review and complete the information collection. If you have comments concerning the accuracy of the time estimate(s) or suggestions for improving this form, please write to: U.S. Department of Health & Human Services, OS/OCIO/PRA, 200 Independence Ave., S.W., Suite 336-E, Washington D.C. 20201, Attention: PRA Reports Clearance Officer

Office of Population Affairs (OPA)

Embryo Adoption Awareness, Teen Pregnancy Prevention, and

Title X Family Planning Services Grants

2022 Annual Grantee Satisfaction Survey

Introduction:

You have received this survey because your organization has one or more federal awards (grant or cooperative agreement) funded by the Office of Population Affairs (OPA). The purpose of this survey is to assess your satisfaction with OPA grantee support, communications, and other resources. We are also interested in your suggestions for how to improve the services, technical assistance (TA) products, and support from OPA and our contractors. OPA plans to use the results of the survey for continuous quality improvement efforts, including more effective customer service and to identify areas for improvement.

You are free to consult with others within your organization as needed to answer the questions, but you can only submit one survey per grant. If you have more than one federal award from OPA, you will see some questions repeated for each grant project. You may stop and start the survey at any time. Once you click the submit button, you cannot revise any responses.

Your participation is voluntary and confidential. You can skip any item. Please provide honest responses and complete information. Your responses will not affect your current award or your eligibility for, or receipt of, future services or funding.

Do not put your name or organization’s name on the survey. Results will be reported to OPA in a manner that does not identify information about an individual or an organization and to be used only for the purposes of continuous quality improvement. Aggregated results may be used by OPA to share with selected stakeholders (e.g., grantees, federal partners) for the purposes of knowledge-sharing and improving processes.

Please take the time to complete the survey. It should take about 20 minutes to complete. If you have questions about this survey, please email Dr. Tiara N. Jackson at OPASupport@norc.org. Thank you for your participation.

1. Is this the organization’s first OPA grant?

__ Yes

__ No

If no,

How long has your organization been an OPA grantee? __________

OPA GUIDANCE, TRAINING & TECHNICAL ASSISTANCE

Project Officer Monitoring and Support

2. Please rate your satisfaction with your Project Officer in the following areas: Question will repeat for each grant/Project Officer.

	Very satisfied	Satisfied	Neutral	Dissatisfied	Very dissatisfied	Not applicable
Guidance on grant program expectations						
Guidance on programmatic reporting						
Frequency of communication (email, phone calls)						
Promptness in responding to inquiries						
Clarity of communication						
Consistency in messaging						
Oversight and monitoring of your grant project						
Adequacy of TA resource(s) and support(s) to help your grant project succeed (e.g., connecting to other grantees, sharing TA)						
Level of professionalism (e.g., courteousness, responsiveness, respectfulness)						
Overall performance						

3. Would you like more or less communication from your Project Officer(s)?

1. More communication

2. Stay the same

3. Less communication

4. What types of PO communication are most helpful?

1. Emails

2. 1:1 calls

3. Office hours

4. Responses to questions

Programmatic Guidance and Project Officer Feedback

5. Please consider written communications and resources that you have received from OPA and rate your level of agreement with the statements below: Question will repeat for each grant.

OPA Notice of Funding Opportunity (NOFO)*	Strongly agree	Agree	Neutral	Disagree	Strongly disagree	Not applicable
The NOFO was clear and easy to understand.						
The grant expectations included in the NOFO are clear and easy to understand.						
Technical Assistance related to the NOFO was useful.						

*Hover text: Funding Opportunity Announcements (FOA) are now called, “Notice of Funding Opportunities”.

[Note: Removed Planning Period Activities]

Project Officer Feedback on Progress Reports	Strongly agree	Agree	Neutral	Disagree	Strongly disagree	Not applicable
The feedback was clear and easy to understand.						
The feedback was helpful in identifying areas of continuous improvement for our grant.						
The feedback was consistent with the expectations outlined in the NOFO.						
The feedback received was timely.						

OPA Continuation Application Guidance	Strongly agree	Agree	Neutral	Disagree	Strongly disagree	Not applicable
The guidance was clear and easy to understand.						
The guidance was provided within sufficient time.						

Project Officer Feedback on Continuation Applications	Strongly agree	Agree	Neutral	Disagree	Strongly disagree	Not applicable
The feedback was clear and easy to understand.						
The feedback was helpful in identifying areas of continuous quality improvement for our grant.						
The feedback was consistent with the expectations outlined in the NOFO.						

6. Did your organization participate in a OPA site visit within the past grant year?

1. Yes

2. No

Note: For Title X programs, the phrase “OPA Program Review (In-person or Virtual)” will be used instead of OPA site visit for these questions.

If yes, respondents will see these questions:

OPA Site Visit	Strongly agree	Agree	Neutral	Disagree	Strongly disagree	Not applicable
The notice provided for the site visit allowed adequate time to prepare.						
The TA and support provided during the site visit were helpful.						
OPA recommendations were consistent with what was discussed during the site visit.						
OPA recommendations resulting from the site visit were clear and easy to understand.						
OPA recommendations following the site visit were helpful for the continuous quality improvement of our grant.						

7. Other OPA Staff/Contractor Support: Please rate your satisfaction with the guidance and support received from other OPA staff (i.e., Evaluation Team, MAX Core Team). EAA grantees will not see these questions. Qualifying question – pipe responses into matrix question

Satisfaction with support from:	Very satisfied	Satisfied	Not Sure	Dissatisfied	Very dissatisfied	Not applicable
OPA Evaluation Technical Assistance (Mathematica) (TPP only)						
OPA MAX Core Team						
Reproductive Health National Training Center (RHTNC) TA Liaison (1:1)						
RHTNC Support						
National Clinical Training Center for Family Planning (NCTCFP) Team (Title X only)						
OPA Performance Measures Contractor (OPA Performance Measures Support team) (Title X will not see the question)						
OPA FPAR 2.0 Contractor (Title X only)						
GAM (Grants and Acquisitions Management Office and Specialist)						

8. Overall, how satisfied are you with the support you’ve received from OPA (inclusive of OPA TA contractors/training centers) for your project?

1. Very satisfied

2. Satisfied

3. Not Sure

4. Dissatisfied

5. Very Dissatisfied

9. Please indicate how often you participated during this past grant year; and overall, how satisfied you were with the support: Question will repeat for each grant.

OPA Webinars
	Always	Very often	Often	Sometimes	Never	Not applicable
a. How often did you participate?						
	Very satisfied	Satisfied	Not Sure	Dissatisfied	Very dissatisfied	Not applicable
b. How satisfied were you?						
OPA Technical Assistance Opportunities
	Always	Very often	Often	Sometimes	Never	Not applicable
a. How often did you participate?						
	Very satisfied	Satisfied	Not Sure	Dissatisfied	Very dissatisfied	Not applicable
b. How satisfied were you?						
OPA Virtual Conference and/or Trainings
	Always	Very often	Often	Sometimes	Never	Not applicable
a. How often did you participate?						
	Very satisfied	Satisfied	Not Sure	Dissatisfied	Very dissatisfied	Not applicable
b. How satisfied were you?						
RHTNC webinars
	Always	Very often	Often	Sometimes	Never	Not applicable
a. How often did you participate?						
	Very satisfied	Satisfied	Not Sure	Dissatisfied	Very dissatisfied	Not applicable
b. How satisfied were you?						
NCTCFP webinars (Title X only)
	Always	Very often	Often	Sometimes	Never	Not applicable
a. How often did you participate?						
	Very satisfied	Satisfied	Not Sure	Dissatisfied	Very dissatisfied	Not applicable
b. How satisfied were you?						
RHTNC customized (individual) TA
	Always	Very often	Often	Sometimes	Never	Not applicable
a. How often did you participate?						
	Very satisfied	Satisfied	Not Sure	Dissatisfied	Very dissatisfied	Not applicable
b. How satisfied were you?						
NCTCFP on-site (in-person) training (Title X only)
	Always	Very often	Often	Sometimes	Never	Not applicable
a. How often did you participate?						
	Very satisfied	Satisfied	Not Sure	Dissatisfied	Very dissatisfied	Not applicable
b. How satisfied were you?						

OPA Training and TA Products

10. Have you used any OPA and/or OPA-Funded National Training Centers TA products (e.g., tip sheets, tool kits, online learning modules, TA briefs) in the current budget period? (Will not be asked of EAA grantees)

	Yes	No	Not applicable
Grant #1			
Grant #2			
Grant #3			
….			

If participant answers all “No” values, the survey will automatically skip to Q13

11. How do you hear about OPA and OPA-funded National Training Centers training & TA product(s)? Check all that apply.

__ MAX.gov

__ Max Cohort listservs (TPP only)

__ Searching the OPA website (opa.hhs.gov)

__ OPA Grantee Digest

__ OPA Bulletin

__ OPA Twitter (@HHSPopAffairs)

__ RHNTC Newsletter

__ NCTCFP Newsletter

__ Project Officer

__ Other (please specify)

12. How often would you say you use OPA and/or OPA-funded National Training Center training and TA products (click here to view)?

__ Never

__ Frequently (1-2 times a month)

__ Seldom (1-2 times a quarter)

__ Rarely (1-2 times a year)

13. What type of the OPA and/or OPA-Funded National Training Centers here (RHNTC, NCTCFP, Mathematica etc.) training and TA products have you used? (Check all that apply)

__ Printable pdfs

__ Text from the OPA website

__ Tip sheets

__ e-Learning modules

__ Checklists

__ Toolkits

__ Webinars

__ Videos

__ Peer Learning Group

__ Individual TA

__ Other (please specify)

__ Templates

For Title X, the following items will be added to the list:

_ Drop-in Active Learning Sessions

_ Clinician Cafe

_ Interactive Case Studies

_ Job aids

_ Factsheets

_ Virtual coffee breaks

_ Podcasts

_ Articles of interest

_ LARC link

1. Based on choices selected (Qualtrics will show only the products selected in the previous section), which TA products were most helpful?

2. Based on choices selected (Qualtrics will show only the products selected in the previous section), which TA products were least helpful?

Overall Guidance and Training and Technical Assistance Feedback

14. Please describe how the support, training, and technical assistance you received from OPA, OPA-Funded Contractors (Mathematica, ICF, etc.) and OPA-Funded National Training Centers here (RHNTC, NCTCFP, etc.) has affected your project. [Text Box] Question will repeat for each grant.

15. Use this space to provide any suggestions for improving support from OPA Project Officers, staff and/or contractors. [Text Box]

16. Use this space to provide any suggestions for improving OPA programs. [Text Box]

17. Use this space to provide any suggestions for improving OPA programmatic guidance and/or technical assistance. [Text Box]

18. Overall, how satisfied are you with the guidance provided by OPA for your project?

1. Very satisfied

2. Satisfied

3. Not Sure

4. Dissatisfied

5. Very Dissatisfied

Web-Based Communications/Resources

MAX.gov – This section will be skipped for EAA recipients in the online survey.

19. Please indicate the extent to which you agree with these statements about the components of MAX.gov (click here to view): Question will repeat for each grant.

MAX.gov:	Strongly agree	Agree	Not Sure	Disagree	Strongly disagree	Have not used/done yet
Log-in procedures are clear.						
Navigation and finding information are easy.						
Visual design/user experience is pleasing.						
Files upload smoothly.						
MAX.gov provides useful information.						
MAX.gov listservs provide valuable information (Not shown to Title X grantees)						
The site is easy to use.						
I understand when to use this system						

How satisfied are you with MAX.gov?

Satisfaction with MAX.gov	Very satisfied	Satisfied	Not Sure	Dissatisfied	Very dissatisfied	Not applicable
						

TPP Performance Measures /Title X Family Planning Annual Report (FPAR)/Title X Clinic Locator Database

The next set of items is about your project’s perceptions of the Performance Measures (PMs).

20. Please indicate the extent to which you agree with these statements about the TPP performance measures (PMs), PM submission process, and support you receive to submit the PMs:

TPP Performance Measures (PM) Attributes:	Strongly agree	Agree	Not Sure	Disagree	Strongly Disagree	Have not used/done yet
The PM submission process is easy.						
Sufficient support is provided to submit the PMs.						
PM reports are useful for our project’s Continuous Quality Improvement (CQI) process.						

For Title X:

The next set of items is about your project’s perceptions of the Family Annual Reporting (FPAR) 1.0.

Please indicate the extent to which you agree with these statements about the Family Planning Annual Report (FPAR):

Family Planning Annual Report (FPAR) 1.0 Attributes:	Strongly agree	Agree	Not Sure	Disagree	Strongly Disagree	Have not used/done yet
The FPAR 1.0 submission process is easy.						
Sufficient support is provided to submit and/or update information for FPAR 1.0						
FPARs are useful for our project’s Continuous Quality Improvement (CQI) process.						

How satisfied are you with the FPAR Data System and support?

Satisfaction with FPAR Data System	Very satisfied	Satisfied	Not Sure	Dissatisfied	Very dissatisfied	Not applicable
Satisfaction with FPAR 1.0 Data System						
Satisfaction with FPAR 1.0 Data System Help Desk						
Satisfaction with FPAR 2.0 Roll-out						

For Title X:

The next set of items is about your project’s experience with the Title X Clinic Locator Database.

Please indicate the extent to which you agree with these statements about the Clinic Locator Database (https://opa-fpclinicdb.hhs.gov/):

Clinic Locator Database Attributes:	Strongly agree	Agree	Not Sure	Disagree	Strongly Disagree	Have not used/done yet
The Clinic Locator Database submission process (adding, removing, updating entries) is clear.						
Sufficient support is provided by OPA for the Clinic Locator Database.						
I am able to obtain accurate information from the Clinic Locator Database for reporting purposes.						

How satisfied are you with Title X Clinic Locator Database and the technical assistance provided?

	Very satisfied	Satisfied	Not Sure	Dissatisfied	Very dissatisfied	Not applicable
Satisfaction with Clinic Locator Database as a resource to promote awareness of grantee Title X services?						
Satisfaction with Clinic Locator Database technical assistance provided via the OPA support mailbox (OPAsupport@icf.com)						
Overall satisfaction with the Clinic Locator Database						

OPA Website

This next set of questions is about the OPA website: opa.hhs.gov.

21. How often have you used the OPA website in this past grant year?

__ Frequently/Often

__ Sometimes

__ Occasionally

__ Almost never

__ Never (SKIP to Q22)

22. Please indicate how useful resources in the following sections of the OPA website have been for your project in the past grant year. (Check “not used” if you have not used the resource).

Usefulness of the OPA Website Resources	Very useful	Useful	Somewhat useful	Not at all useful	Not used
Adolescent Development: Information on adolescent health topics					
Reproductive Health: Information on reproductive health topics					
Evaluation & Research: Information on expanding evidence and advancing best practices					
Grant Programs: Information on OPA grant programs					

Grantee Digest (weekly)

23. How often do you read the OPA Grantee Digest email?

__ Frequently/Often

__ Sometimes

__ Occasionally

__ Almost never

__ Never (SKIP to Q24)

24. Please rate your satisfaction with the information and resources provided in the Grantee Digest:

Satisfaction with Grantee Digest	Very satisfied	Satisfied	Not Sure	Dissatisfied	Very Dissatisfied	Not applicable
Organization of information						
Sufficiency of detail to meet your program needs						
Relevance to your areas of need						
Timeliness of information (e.g., “Enough notice of events and activities to participate in items of interest)						
Comprehensiveness in addressing the scope of issues that you face						

OPA Bulletin

25. How often do you read the OPA Bulletin (the OPA e-newsletter that comes out every other month)?

__ Frequently/Often

__ Sometimes

__ Occasionally

__ Almost never

__ Never (SKIP to Q26)

26. Please rate your satisfaction with the information and resources provided in the OPA Bulletin:

Satisfaction with OPA Bulletin	Very satisfied	Satisfied	Not Sure	Dissatisfied	Very Dissatisfied	Not applicable
a. Organization of information						
b. Sufficiency of detail to meet your program needs						
c. Relevance to your areas of need						
d. Comprehensiveness in addressing the scope of issues that you face						

OPA Twitter (@HHSPopAffairs)

27. How often do you read the tweets from OPA’s Twitter account @HHSPopAffairs?

__ Frequently/Often

__ Sometimes

__ Occasionally

__ Almost never

__ Never (SKIP to Q28)

28. Does your organization use social media to stay informed about Title X, teen pregnancy prevention, reproductive health, or related information?

__ Yes

__ No

__ Unsure

29. How useful do you find the information and resources shared on OPA’s Twitter account @HHSPopAffairs?

Usefulness of OPA Twitter Feed	Very useful	Useful	Not Sure	Somewhat useful	Not at all useful	Not used
						

Satisfaction with OPA Twitter Feed	Very satisfied	Satisfied	Not Sure	Dissatisfied	Very Dissatisfied	Not applicable
a. Timeliness of the information shared						
b. Usefulness of the OPA Twitter posts						
c. Relevance to your areas of need						

OPA YouTube Channel

30. How often do you watch the videos posted on OPA’s YouTube channel?

__ Frequently/Often

__ Sometimes

__ Occasionally

__ Almost never

__ Never (SKIP to Q32)

31. How useful do you find the information and resources shared on OPA’s YouTube channel?

Usefulness of OPA YouTube Channel	Very useful	Useful	Not Sure	Somewhat useful	Not at all useful	Not used
						

Satisfaction with OPA’s YouTube Channel	Very satisfied	Satisfied	Not Sure	Dissatisfied	Very Dissatisfied	Not applicable
a. Timeliness of the information shared						
b. Usefulness of the OPA Twitter posts						
c. Relevance to your areas of need						

Overall Digital Communications/Resources (i.e., web, e-newsletters, and social media) Feedback

32. Would you like to receive OPA information or materials in a language other than English?   Yes/No

If yes, which of the following languages?

1. Amharic

2. Cantonese Chinese

3. French

4. Haitian Creole

5. Korean

6. Mandarin Chinese

7. Russian

8. Spanish

9. Tagalog

10. Vietnamese

11. Other languages?  (write in)_____________________

33. Use this space to provide any other suggestions for improving OPA web-based and digital communications/resources (e.g., content, frequency, relevance, etc.).

[Text Box]

34. Overall, how satisfied are you with the resources provided by OPA for your project?

1. Very satisfied

2. Satisfied

3. Not Sure

4. Dissatisfied

5. Very Dissatisfied

OVERALL SATISFACTION WITH OPA’S RESOURCES AND SUPPORT

35. Overall, how satisfied are you with OPA for your grant project?

1. Very satisfied

2. Satisfied

3. Not Sure

4. Dissatisfied

5. Very Dissatisfied

Thank you for your cooperation.

[End of Survey]

27