Improving Fetal Alcohol Spectrum Disorders Prevention and Practice through Practice and Implementation Centers and National Partnerships
OMB # 0920-xxxx
Supporting Statement Part B
New Request
Nancy Cheal, Ph.D., R.N.
Health Scientist
Centers for Disease Control and Prevention
Email: ncheal@cdc.gov
Phone: 404-498-6764
Fax: 404-498-3070
B. Collections of Information Employing Statistical Methods
Each FASD DSW and NOFAS has defined a target percentage of members of their disciplines/audiences that they will attempt to reach through the trainings developed for this project. These estimates represent the respondent universe for each DSW in this project. For the cross-site evaluation, the respondent universe for the DSW Report will include all staff working on this project for each DSW, while the universe for the high impact studies will include all staff of health systems where promising practices/interventions are being implemented.
Each DSW and NOFAS will attempt to reach their target percentage of their respectively-defined target audiences. Although the survey data collection is voluntary, surveying the defined target audiences will provide the most complete picture of the impact of the project on knowledge and practice behavior, as well as the most complete picture of respondent satisfaction with trainings. The DSW Report will be sent to the entire respondent universe. Its intent is to assess collaboration within the project’s DSWs, and the best way to assess that is to survey all collaborators. Through the high impact studies, however, we will not attempt to collect data from all staff in a health system. Rather, we will target a small number of staff who are in decision-making roles regarding the practice/intervention, those responsible for implementing the practice/intervention, or those otherwise familiar with it.
Participants who complete project core trainings and DSW-specific trainings will complete an online survey prior to and at the end of each training session. Participants who voluntarily provide their email contact information will also receive a link for a 6-month follow-up survey to assess retention of knowledge over time as well as changes in practice behaviors and changes in confidence and self-efficacy to perform certain skills related to the prevention, identification, and treatment of FASDs. To link the pre-test, post-test, and follow-up surveys, participants will create a unique number that links the forms, but that is otherwise not linked with any information about the participant.
Qualitative data collection for this project consists of key informant interviews. The majority of these interviews will be conducted via telephone, but a small number may be conducted in-person or online. In all telephone or in-person data collections, respondents will have advance notice, with appointment times set prior to the interview. Interviews will be conducted by trained staff from each DSW, NOFAS, or the cross-site evaluator, depending on the interview. Notes will be taken, either by the interviewer or a dedicated note-taker, to document the interview session. When permission is provided by the interviewee, interviews may also be audio-recorded. When audio-recordings are made, they will be stored on password-protected computers and will be accessible only to grantee staff working on data analysis.
Surveys will include a statement of the purpose of the evaluation survey and the need for collecting this information to improve programs and assess training effectiveness. We anticipate that response rates will be high for surveys completed immediately before and after each training, as well as for those completed at in-person events. Still, since all surveys are completed anonymously, it is not feasible to deal with non-response.
For qualitative data collections, when possible, selected respondents who do not complete the data collection will be replaced with another, similar respondent.
The FASD Core Training Survey will be given to participants of core project trainings at pre-training, immediate post-training, and post-training follow-up. The pre-test instrument (Attachment D1) was cognitively tested to ensure that participants will understand the questions and response options as written. This cognitive testing was conducted with nine participants representing the disciplines targeted by this project. The instrument included in Attachment D1 was updated after cognitive testing to edit the wording and response options for several questions; where applicable (i.e., when identical questions appeared in the post-test or six-month follow-up instruments) the post-test instrument (Attachment D2) and follow-up instrument (Attachment D3) were also revised based on the cognitive testing results.
For the purpose of the evaluation, no individually identifiable information is being collected. Survey data collection, including for 6-month follow up, will be anonymous; the evaluation forms themselves will have no identifying information or any link to names or contact information. All qualitative data collected through key informant interviews will be kept secure.
Paper and pencil surveys will be entered into electronic databases by staff from each DSW, NOFAS, or the cross-site evaluator, with quality assurance methods such as double-pass entry in place. Surveys conducted electronically will be transferred to retention databases. All data will be checked for out-of-range values, and missing value codes will be inserted as part of the QA process. Otherwise, data will be preserved as originally provided by participants.
Descriptive participant information is mostly categorical in nature and will be reported via frequency counts/percents within categories, with chi-square methods used to test differences among categories where appropriate.
Quantitative analyses of other survey data will vary by organization (DSWs/NOFAS/cross-site evaluator), depending on their specific programmatic needs. Surveys may be analyzed individually, summarizing the data for all respondents for a given instrument, or may (when applicable) be combined with other data sources to contribute to broader analyses across trainings or across all activities of a DSW. Quantitative analyses planned by grantees and the cross-site evaluator include cross-tabulations, t-tests, bivariate regression analysis, chi-square and McNemar’s tests, repeated measures ANCOVA, and MANOVA/MANCOVA. Analyses will be conducted using SPSS.
Qualitative data, resulting primarily from key informant interviews and the DSW Report, will be analyzed for common themes and important divergences among respondents. The software packages used to conduct these analyses will vary by organization, but will include NVivo, Dedoose, Atlas.ti, and Microsoft Word, Excel, and Access.
Questionnaires and protocols were developed in collaboration with and are reviewed by staff of the National Center on Birth Defects and Developmental Disabilities, and by members of the FASD PICs and Partners Evaluation Working Group:
FASD Evaluation Working Group Members
Rich Ann Baetz, MSCRP. Senior Study Director. Westat, 1450 Research Blvd TC 3070, Rockville, MD 20850. RichAnnBaetz@westat.com
Jennifer Berktold, PhD. Senior Study Director. Westat, 1700 Research Blvd, Rockville, MD 20850. JenniferBerktold@westat.com
Shelia L. Broyles, PhD, MPH. University of California San Diego. Project Scientist, Lecturer. UCSD School of Medicine, 9500 Gilman Drive, MC 0602, La Jolla, CA 92093. slbroyles@ucsd.edu
Mary Butler, PhD. Senior Study Director. Westat, 1450 Research Blvd TC 3030, Rockville, MD, 20850. maryobutler@verizon.net
Michelle Clark, MSW. American College of Obstetricians and Gynecologists. Project Manager
409 12th St SW, Washington DC 20024. mclark@acog.org
Josh Benke. American Academy of Pediatrics. Program Manager. 141 Northwest Point Blvd, Elk Grove Village, IL 60007. jbenke@aap.org
Melanie Chansky, MAA. Senior Study Director. Westat, 1450 Research Blvd TC 3068, Rockville, MD 20850. MelanieChansky@westat.com
Rachel Daskalov. American Academy of Pediatrics. Manager, Screening and Public Health Programs. 141 Northwest Point Blvd, Elk Grove, IL 60007. rdaskalov@aap.org
Brittney Francis, MPH. Research Assistant. Westat, 1450 Research Blvd TC 3033, Rockville, MD 20850.
Bridget Hanson, PhD. University of Alaska, Research Assistant Professor, UAA Center for Behavioral Health Research and Sciences, 3211 Providence Drive, Anchorage, AK 99508. blhanson4@uaa.alaska.edu
Joyce A. Hartje, PhD. University of Nevada, 1664 N Virginia Street, Mailstop 279, Reno, NV 89557. jhartje@casat.org
Ellen Hutchins, ScD, MPH, MSW. Public Health Consultant. 66 Florence Street, Melrose, MA 02176. Ellen66@verizon.net
Leigh Tenkku Lepper, PhD, MPH. Associate Research Professor, Director for Research. School of Social Work and Public Health Program, University of Missouri, 707 Clark Hall, Columbia, MO 65211. tenkkul@missouri.edu
Dawn Lindsay, PhD. University of Pittsburgh. Director of Evaluation Services. 425 Sixth Avenue, Suite 1710, Pittsburgh, PA 15219. dawn@ireta.org
Kathleen Mitchell, MHS, LCADC. National Organization on Fetal Alcohol Syndrome. Vice President and national spokesperson. 1200 Eton Court NW, 3rd Floor, Washington DC 20007. Mitchell@nofas.org
Susan Nash, PhD, Instructor. Baylor College of Medicine, Department of Family and Community Medicine, 3701 Kirby Dr., Suite 600, Houston, TX 77098.sgnash@bcm.edu
Anita Prewett, M.S., C.R.A. UT Austin - Health Behavior Research & Training Institute. anitaprewett@austin.utexas.edu
Anne Ray, PhD. Research Associate. Center of Alcohol Studies, Rutgers, The State University of New Jersey. anne.e.ray@rutgers.edu
Laura Fenster Rothschild, PsyD. Assistant Research Professor, Director of Education and Training. Center for Alcohol Studies, Rutgers University, 607 Allison Road, Piscataway, NJ, 08854. lfenster@rci.rutgers.edu
Melanie Ruhe. National Organization on Fetal Alcohol Syndrome. Program Coordinator. 1200 Eton Court NW, 3rd Floor, Washington DC 20007. ruhe@nofas.org
Luis Rustveld, PhD. Assistant Professor. Baylor College of Medicine, Department of Family and Community Medicine, 3701 Kirby Dr., Suite 600, Houston, TX 77098. rustveld@bcm.edu
Saloni Sapru, PhD. Senior Study Director. Westat, 1450 Research Blvd TC 3056, Rockville, MD 20850. SaloniSapru@westat.com
Diana R. Simmes, MPH. University of California San Diego, Department of Pediatrics, Division of Dysmorphology and Teratology, 9500 Gilman Drive, Mail Code 0828, La Jolla, CA 92093. dsimmes@ucsd.edu
Debra Sprague, MA. Project Director & Evaluator. Missouri Institute of Mental Health, MIMH, DC067.0 – MUPC 3201, University of Missouri 65212, Columbia, MO. spraguedj@health.missouri.edu
Kirk von Sternberg, PhD. University of Texas at Austin. Associate Professor. The University of Texas
School of Social Work, 1925 San Jacinto Blvd R5100, Austin, TX 78712-0358. vonsternberg@mail.utexas.edu
Georgiana Wilton, PhD. Senior Scientist. University of Wisconsin-Madison, Department of Family Medicine, 1100 Delaplaine Ct., Madison, WI 53715-1896. georgiana.wilton@fammed.wisc.edu
CDC Collaborators
Nancy Cheal, Ph.D., R.N. Team Lead, Fetal Alcohol Syndrome Prevention Team, Prevention Research Branch, Division of Birth Defects and Developmental Disabilities, National Center on Birth Defects and Developmental Disabilities, CDC. Centers for Disease Control and Prevention, 1600 Clifton Road, Mailstop E-86, Atlanta, GA 30333. ncheal@cdc.gov.
Patricia P. Green, MSPH. Epidemiologist. Fetal Alcohol Syndrome Prevention Team, Prevention Research Branch, National Center on Birth Defects and Developmental Disabilities. Centers for Disease Control and Prevention, 1600 Clifton Road, Mailstop E-86, Atlanta, GA 30333. pap5@cdc.gov
| File Type | application/vnd.openxmlformats-officedocument.wordprocessingml.document |
| Author | fvs1 |
| File Modified | 0000-00-00 |
| File Created | 2021-01-22 |