OMBSupportingStatementNovember2011_with pilot study B

TDV OMB Clearance

Supporting Statement

Information Collection Request

Supporting Statement for the

Teen Dating Relationships: Opportunities for Youth to Define what’s Healthy and Unhealthy

also known as the

Understanding Abuse in Teen Dating Relationships Through Concept Mapping Project

Project Officer:

Carrie F. Mulford, PhD

Violence and Victimization Research Division

Office of Research and Evaluation

National Institute of Justice

Office of Justice Programs

Department of Justice

810 7th Street NW
Washington, DC 20531
Phone: (202) 307-2959
Fax: (202) 616-0275
E-mail: carrie.mulford@usdoj.gov

Table of Contents

Section B: Collections of Information Employing Statistical Methods

B.1. Respondent Universe and Sampling Methods………………………………………………………..23

B.2. Procedures for the Collection of Information………………………………………………………...24

B.3. Methods to Maximize Response Rates and Deal with Nonresponse………………………………...26

B.4. Test of Procedures or Methods to be Undertaken……………………………………………………27

B.5. Individuals Consulted on Statistical Aspects and Individuals Collection and/or Analyzing Data…..27

References………………………………………………………………………………………………...27

B. Collections of Information Employing Statistical Methods

B.1. Respondent Universe and Sampling Methods

For the pilot study fifty teens, ages 14-18, will participate in the brainstorming, sorting and rating tasks. A minimum of twenty five completed sorts is typically needed to produce a reliable concept map; however, given the foundational, exploratory nature of this information collection and the variation in experience that teens are likely to have in relation to dating and relationships, we believe that fifty sorts will be sufficient to produce a concept map that will give us meaningful insight into the conceptualization of the teen respondents, as well as how the collection procedures need to be refined to involve a greater range of youth and adults in the future information collection. Twenty teens, ages 14-18, will participate in each of the two facilitated discussions (a total of forty teens).

The following table displays the number of individuals that will be invited to participate in the different information collection tasks for the full study:

Concept Mapping Participation Targets
Task	Preteens (11-13)	Teens (14-18)	Young Adults (19-22)	Adults	Total task target
Brainstorming	50 100		100	150	400
Sorting	0 25		25	50	100
Rating	0 125		125	150	400
Total group target					400
Facilitated Discussion Participation Targets
Suggested location	Preteens (11-13)	Teens (14-18)	Young Adults (19-22)	Adults	Total regional target
Washington, DC	0 10		10	20	40
Atlanta	0 10		10	20	40
Chicago or Kansas City	0 10		10	20	40
San Francisco	0 10		10	20	40
Total group target	0 40		40	80	160

This information collection will not require purposefully sampling on the basis of any specific social demographics other than age.

B.2. Procedures for the Collection of Information

The information collection approach for this project will be to purposefully sample on the basis of heterogeneity, which is to non-randomly select a broad range of persons who are likely to reflect the full range of ideas as possible that are relevant to the topic under investigation. However, the adequacy of ideas that are captured is dependent upon there is a match between the focus and the participants selected to participate. We are not expecting that the results will be generalizable to the youth and adult populations at large; however we will be looking for saturation of the topic, as bounded by the participants group. Thus, we anticipate that in the brainstorming task, we will reach a point where there will be a fair amount of redundancy and some homeostasis in the topic. The goal is to achieve a broad sampling of ideas rather than a representative sample of individuals. Youth respondents will be recruited through youth serving organizations with collective access to a diverse group of youth recommended by members of the project Planning and Advisory Groups. These groups will be selected in part through a nomination process that solicited recommendations for organizations from the project’s Planning and Advisory Groups. Within this group of youth serving organizations, we are also looking to purposefully stratify our sample by age across three age groups: 11-13 (preteens), 14-18 (teens) and19-22 (young adult), in order to capture the variation of perspectives as they may be influenced by age. The organizations that will be used for recruitment purposes will be instructed by the research team to recruit a specific number of youth within the specific age ranges for participation in each activity (See Appendices B1-B3). Inclusion of youth participants will be based on a first-come-first-serve criterion; those youth who are the first to respond to the organizational representatives’ advertisements will have the opportunity to participate. In addition, adult participants will be purposefully selected from Planning and Advisory Group nominations, based on the relevance of their professional roles to the youth population and their relationships (i.e. practitioners, teachers, advocates, researchers, etc.). The proposed recruitment strategies for 14-18 year olds will be tested in the pilot study and revised, as necessary, for the full study.

In terms of quality control, the sorting, rating and demographic/background data will be gathered directly over the web, thus eliminating any concerns about mis-entering or mis-reading handwritten data. The software has some constraints built in that prevent errors in the data entry. For example, since this is an unstructured forced-choice sort method (Weller & Romney, 1988), the software does not allow a statement to be placed in more than one group simultaneously. For the ratings, the software only allows legitimate entries (e.g., the integers 1-to-5). Before any participant data can be used in data analysis, the software requires that the concept map analyst visually inspect the data and indicate by checking a setting that the data are complete and useable. Without this check, the participant’s data will not show up in any subsequent screen that calls for data analysis. Because the Concept System® software was expressly designed to accomplish the concept mapping process and analysis, there is also no danger that the statistical analysis procedure might be mis-specified by the analyst.

B.3. Methods to Maximize Response Rates and Deal With Nonresponse

The brainstorming task will be conducted completely anonymously for all respondents. The number of statements elicited in response to the focus prompt will be measureable, but there will no way to determine the actual response rate, as respondents will be able to provide as many statements as they choose without any way to identify which respondents provided which statements.

The response rate for sorting and rating will be calculated over the course of the information collection, as the project website administrators will be able to monitor the progress of each participant according to their username. In order to maximize response rates for brainstorming, sorting and rating, a reminder notice will be sent to all invited respondents at multiple points during the period for each task. Response rates for youth invited to participate in the sorting and rating will also be maximized by offering the incentives described in section A9 of this supporting statement. In addition, because the use of incentives to maximize completion of the sorting and rating tasks, we anticipate that our response rates will be higher than the estimates outlined in section B1 above.

The facilitated discussion response rate will be calculated based on how many invitees (20 per discussion) actually attend. Attendance rate will be maximized by sending invitees reminders of the discussions in advance of the sessions.

B.4. Test of Procedures or Methods to be Undertaken

Not applicable. No tests of procedures or methods will be undertaken.

B.5. Individuals Consulted on Statistical Aspects and Individuals Collection and/or Analyzing Data

Concept Systems, Inc. (CSI) is the contractor that will be consulted on statistical aspects of the design, and that will actually collect and analyze the information for the agency. Individuals from CSI who will be contributing to the statistical design and analysis are as follows:

1. Mary Kane, Principal Consultant

2. Scott Rosas, Senior Consultant

3. Alyssa Goldman, Junior Consultant

These individuals can be reached by telephone at (607) 272-1206.

References

Anderberg, M. R. (1973). Cluster analysis for applications. New York, NY: Academic Press, Inc.

Arriaga XB, Foshee VA. Adolescent dating violence. Do adolescents follow in their friends’ or their parents’ footsteps? Journal of Interpersonal Violence 2004;19(2):162–84.

Barnett, O., Miller-Perrin, C. L., & Perrin, R. D. (2005). Family violence across the lifespan 2^nd Ed. Thousand Oaks, CS: Sage Publications.

Bergman, L. Dating violence among high school students. Social Work 1992;37:21–7.

Brown, J. (2006). Rethinking concept mapping for youth participatory evaluation in the context of youth development programs. Journal of Youth Development,) 1(2).

Cook, C., Heath, F., & Thompson, R. L. (2000). A meta-analysis of response rates in web- or internet-based surveys. Educational and Psychological Measurement, 60(6), 821-836.

Coxon, A. P. M. (1999). Sorting data: Collection and analysis. Thousand Oaks, CA: Sage.

Everitt, B. (1980). Cluster analysis. 2nd edition. New York, NY: Halsted Press, A Division of John Wiley and Sons.

Galliher, R. V., Enno, A. M., & Wright, R. (2008). Convergence and divergence across multiple methods for assessing adolescent romantic relationships. Journal of Adolescence, 31, 747-769. .

Hays, S., & Scholla, K. (2003). Engaging Youth In Tobacco Policy Change: Results from a Concept Mapping Project in Madison County, Illinois. Paper presented at the 2003 Annual Meeting of Midwest Political Science Association, Chicago, Illinois, April 4, 2003.

Kane, M., & Trochim, W. (2007). Concept mapping for planning and evaluation. Thousand Oaks, CA: Sage Publications.

Kaplowitz, M. D., Hadlock, T. D., & Levine, R. (2004). A comparison of web and mail survey response rates.  Public Opinion Quarterly, 68(1), 94-101.

Krippendorf, K. (2004). Content analysis: An introduction to its methodology (2nd ed.). Newbury Park, CA: Sage Publications.

Kruskal, J. B., & Wish, M. (1978). Multidimensional scaling. Beverly Hills, CA: Sage Publications.

Levy B. Dating violence: Women in danger. Seal, Seattle, WA: 1991.

Levy, B. (1990). Abusive teen dating relationships: An emerging issue for the 90s. Response to the Victimization of Women and Children.) 13(1).

Mulford, C., & Giordano, P. C. (2008) Teen dating violence: A closer look at adolescent romantic relationships. NIJ Journal, 261, 34-40.

Murphy, K. & Smith, D. (2010). Adolescent girls’ responses to warning signs of abuse in romantic relationships. Journal of Interpersonal Violence, 25(4),626-647.

O’Keefe, M. (2005). Teen Dating Violence: A Review of Risk Factors and Prevention Efforts. VAWnet: The National Online Resource Center on Violence Against Women (www.vawnet.org: Applied Research Forum). .

Osborn, A. F. (1957). Applied imagination. New York: Scribner.

Patton, M. Q. (1990). Qualitative evaluation and research methods 2^nd Ed. Thousand Oaks, CA: Sage Publications.

Ries, A., Voorhees, C., Gittelsohn, J., Roche, K. & Astone, N. (2008). Adolescents’ perceptions of environmental influences on physical activity. American Journal of Health Behavior, 32(1), 26-39. American Academy of Health Behavior.

Rosas, S. R. (November, 2009). Establishing standards in concept mapping: A meta-review and analysis. Paper presented at the 22nd Annual Conference of the American Evaluation Association, Orlando, FL.

Rosenberg, S., & Kim, M. P. (1975). The method of sorting as a data gathering procedure in multivariate research. Multivariate Behavioral Research, 10, 489-502.

Schwartz, R. M. (1994). The skilled facilitator: Practical wisdom for developing effective groups. San Francisco: Jossey-Bass.

Shulman, S. & Kipnis, O. (2001). Adolescent romantic relationships: A look from the future. Journal of Adolescence, 24,337-351.

Silverman J, Raj A, Mucci L, Hathaway J. Dating violence against adolescent girls and associated substance use, unhealthy weight control, sexual risk behavior, pregnancy, and suicidality. Journal of the American Medical Association 2001; 286(5):572-9.

Snider, C., Kirst, M. Abubakar, S. Ahmad, F. & Nathens, A. (2010). Community-based articipatory research: Development of an emergency department-based youth violence intervention using concept mapping. Academy of Emergency Medicine, 17,877-885.

Tuval-Mashiach, R. & Shulman, S. (2006). Resolution of disagreements between romantic partners, among adolescents, and young adults: Qualitative analysis of interaction discourse. Journal of Research on Adolescence, 16(4)), 561-588.

Weller, S. C., & Romney, A. K. (1988). Systematic data collection. Newbury Park, CA: Sage Publications.

8