0704-0604_ssb_adss_8.4.2021

SUPPORTING STATEMENT – PART B
B. COLLECTIONS OF INFORMATION EMPLOYING STATISTICAL METHODS
If the collection of information employs statistical methods, it should be indicated in
Item 17 of OMB Form 83-I, and the following information should be provided in this Supporting
Statement:
1. Description of the Activity
Describe the potential respondent universe and any sampling or other method used
to select respondents. Data on the number of entities covered in the collection should be
provided in tabular form for the universe as a whole and for each of the strata in the proposed
sample. Indicate the expected response rates for the collection as a whole, as well as the actual
response rates achieved during the last collection, if previously conducted.
The population of interest for the 2021 ADSS consists of spouses of active duty
members from the Army, Navy, Marine Corps, and Air Force who are below flag rank. In
addition, for the spouse to remain eligible for the survey, they must indicate they are currently
married to an active duty member at the time of the survey. OPA uses a sampling tool developed
by the Research Triangle Institute (RTI) to determine the sample size needed to achieve 95%
confidence and an associated precision of 5% or less on each reporting domain. We select a
single-stage, non-proportional stratified random sample to ensure statistically adequate expected
number of responses for the reporting categories (i.e., domains). For the active duty spouse
survey, OPA uses Service, paygrade, gender, and family status to define the initial strata. We
collapse these strata when there are fewer than 200 individuals in the stratum and there are 80
final strata. Attachment A contains a table with the number of individuals in the population and
sample by strata. The expected weighted response rate for this survey is 20%; the weighted
response rate for this survey in 2019 was 16.3%.
2. Procedures for the Collection of Information
Describe any of the following if they are used in the collection of information:
a. Statistical methodologies for stratification and sample selection;
As described above, OPA uses a sampling tool developed by the Research Triangle
Institute (RTI) to determine the sample size needed to achieve 95% confidence and an associated
precision of 5% or less on each reporting category domain. We select a single-stage, nonproportional stratified random sample to ensure statistically adequate expected number of
responses for the reporting domains. For the active duty spouse survey, OPA uses Service,
paygrade, gender, and family status to define the initial strata. We collapse these strata when
there are fewer than 200 individuals in the stratum. Once OPA determines the stratum-level
sample sizes, a random number is assigned to every member of the population and the population
is sorted by stratum and random number prior to sampling, which results in a randomly-ordered
1

population within each stratum. We then select the appropriate number of spouses from each
stratum.
b. Estimation procedures;
OPA weights the eligible respondents in order to make inferences about the entire
population of active duty spouses. The weighting methodology utilizes standard weighting
processes. First, we assign a base weight to the sampled member based on the reciprocal of the
selection probability. Second, OPA uses 20-30 administrative variables in the XGBoost
application of Generalized Boosted Model (GBM) to predict survey eligibility and completion.
OPA’s accurate and detailed administrative data on both survey respondents and nonrespondents
provides confidence in our survey estimates. We adjust the sampling weights and then all priorstage weights by the inverse of these model-predicted probabilities to adjust for nonresponse.
Finally, we rake these adjusted weights to known population totals to further reduce the variance
and bias of the estimates.
c. Degree of accuracy needed for the Purpose discussed in the justification;
OPA creates variance strata so precision measures can be associated with each
estimate. We produce precision measures for reporting categories using 95% confidence
intervals with the goal of achieving a precision of 5% or less (e.g, 80% (+/- 5%) of spouses of
Army E1-E4 are satisfied with their job).
d. Unusual problems requiring specialized sampling procedures; and
OPA recognizes the response rates vary for certain domains of interest such as
Service and paygrade. To account for this, we average the response rates for the previous three
surveys at the stratum level and these response rates are utilized by the sampling tool to adjust
the sample and compute expected sample sizes.
e. Use of periodic or cyclical data collections to reduce respondent burden.
OPA conducts the ADSS survey every other yea to reduce respondent burden. The
last ADSS was administered in 2019 so the current one is scheduled for 2021.
3. Maximization of Response Rates, Non-response, and Reliability
Discuss methods used to maximize response rates and to deal with instances of nonresponse. Describe any techniques used to ensure the accuracy and reliability of responses is
adequate for intended purposes. Additionally, if the collection is based on sampling, ensure that
the data can be generalized to the universe under study. If not, provide special justification.
To maximize response rates, OPA offers the survey via the Web as well as a paper survey
option. Reminder letters, emails, and phone calls to nonrespondents are used to maximize
response rates. To reduce respondent burden, web-based surveys use “smart skip” technology to
2

ensure respondents only answer questions that are applicable to them. To ensure the accuracy
and reliability of responses, OPA conduct nonresponse adjustments as part of the weighting
process. (The results for the 2019 ADSS nonresponse adjustments contained in the 2019 ADSS
Statistical Methodology Report and is available on request: Office of People Analytics. (August
2020). 2019 Survey of Active Duty Spouses: Statistical Methodology Report. (OPA Report No.
2020-050). Alexandria, VA.
OPA has done more extensive Non Response Bias (NRB) analyses for the Status of
Forces Survey and an NRB is planned for the 2021 ADSS to more directly test for NRB.
To increase response rates, individual QR codes will be included on the postal
letters, offering a quick mechanism for respondents to access and complete the survey via their
mobile device. The first letter will also include an infographic of the results from the last ADSS
survey.
To maximize response rates, all spouses will be encouraged via various
communications to go to the OPA Survey lookup site (2021 version currently in development)
(https://qa.surveysdrc.com/dmdc/lookupticket.aspx) to confirm participation in the survey.
Those who are in the sample, will be taken to the survey link. Those who are not, will be given a
short supplemental survey including several standard survey questions and an open ended
question(s) and be able to provide their opinions as a military spouse. Those qualitative
responses will be analyzed separately from the main survey. The responses to the standard
ADSS questions will be used to gauge potential differences between the scientifically sampled
and weighted ADSS responses and the convenience sample responding to the supplemental
survey. Also, at the end of the supplemental survey, spouses will be asked if they would like to
voluntarily provide their personal email address to be contacted for future spouse surveys. The
emails that are provided will be stored by OPA in a database and used as a contact means for
future spouse surveys.
To increase response rates, OPA will work with MC&FP to utilize ~ 100,000 spouse
personal emails contained in the Spouse Employment Program database.
OPA uses complex probability sampling and post-stratification weighting to ensure the
survey data can be generalized to the universe under study. (A detailed description of the
sampling and weighting procedures used for the ADSS is available on request: Office of People
Analytics. (August 2020). 2019 Survey of Active Duty Spouses: Statistical Methodology Report.
(OPA Report No. 2020-050). Alexandria, VA.
4. Tests of Procedures
Describe any tests of procedures or methods to be undertaken. Testing of potential
respondents (9 or fewer) is encouraged as a means of refining proposed collections to reduce
respondent burden, as well as to improve the collection instrument utility. These tests check for
internal consistency and the effectiveness of previous similar collection activities.
3

Not applicable.
5. Statistical Consultation and Information Analysis
a. Provide names and telephone number of individual(s) consulted on statistical
aspects of the design.
Mr. David McGrath, Branch Chief; Statistical Methods Team, Methods, Analysis,
and Systems Support, Office of People Analytics (OPA); (571) 372-0983.
Ms. Wendy Barboza, Team Lead; Statistical Methods Team, Methods, Analysis,
and Systems Support, Office of People Analytics (OPA); (571) 372-1099.

b. Provide name and organization of person(s) who will actually collect and analyze
the collected information.
The data will be collected by Data Recognition Corporation (DRC), which is OPA’s
operations contractor. Ms. Valerie Waller is the Senior Managing Director at DRC.
The data will be analyzed by OPA analysts. Robin Myers, Jason Haynes, and Amy
Campbell are the lead operations analysts.

4

Attachment A. 2021 ADSS - Population and Sample Size by Strata

Stratum
All
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40

Stratum Definitions
Total
001 ARMY_E1-E4+E0_MALE+UNK_MAR+CHILD_
002 ARMY_E1-E4+E0_MALE+UNK_MARNOCHILD_
003 ARMY_E1-E4+E0_FEMALE_MAR+CHILD_
004 ARMY_E1-E4+E0_FEMALE_MARNOCHILD_
005 ARMY_E5-E6_MALE+UNK_MAR+CHILD_
006 ARMY_E5-E6_MALE+UNK_MARNOCHILD_
007 ARMY_E5-E6_FEMALE_MAR+CHILD_
008 ARMY_E5-E6_FEMALE_MARNOCHILD_
009 ARMY_E7-E9_MALE+UNK_MAR+CHILD_
010 ARMY_E7-E9_MALE+UNK_MARNOCHILD_
011 ARMY_E7-E9_FEMALE_MAR+CHILD_
012 ARMY_E7-E9_FEMALE_MARNOCHILD_
013 ARMY_W1-W5+W0_MALE+UNK_MAR+CHILD_
014 ARMY_W1-W5+W0_MALE+UNK_MARNOCHILD_
015 ARMY_W1-W5+W0_FEMALE_MARCHILD+NOCHILD_
016 ARMY_O1-O3+O0_MALE+UNK_MAR+CHILD_
017 ARMY_O1-O3+O0_MALE+UNK_MARNOCHILD_
018 ARMY_O1-O3+O0_FEMALE_MAR+CHILD_
019 ARMY_O1-O3+O0_FEMALE_MARNOCHILD_
020 ARMY_O4-O6_MALE+UNK_MAR+CHILD_
021 ARMY_O4-O6_MALE+UNK_MARNOCHILD_
022 ARMY_O4-O6_FEMALE_MAR+CHILD_
023 ARMY_O4-O6_FEMALE_MARNOCHILD_
024 NAVY_E1-E4+E0_MALE+UNK_MAR+CHILD_
025 NAVY_E1-E4+E0_MALE+UNK_MARNOCHILD_
026 NAVY_E1-E4+E0_FEMALE_MAR+CHILD_
027 NAVY_E1-E4+E0_FEMALE_MARNOCHILD_
028 NAVY_E5-E6_MALE+UNK_MAR+CHILD_
029 NAVY_E5-E6_MALE+UNK_MARNOCHILD_
030 NAVY_E5-E6_FEMALE_MAR+CHILD_
031 NAVY_E5-E6_FEMALE_MARNOCHILD_
032 NAVY_E7-E9_MALE+UNK_MAR+CHILD_
033 NAVY_E7-E9_MALE+UNK_MARNOCHILD_
034 NAVY_E7-E9_FEMALE_MAR+CHILD_
035 NAVY_E7-E9_FEMALE_MARNOCHILD_
036 NAVY_W1-W5+W0_MALE+FEMALE_MARCHILD+NOCHILD_

037 NAVY_O1-O3+O0_MALE+UNK_MAR+CHILD_
038 NAVY_O1-O3+O0_MALE+UNK_MARNOCHILD_
039 NAVY_O1-O3+O0_FEMALE_MAR+CHILD_
040 NAVY_O1-O3+O0_FEMALE_MARNOCHILD_

5

Population
Size
665,074
23,301
23,287
4,462
7,329
55,935
21,464
5,512
4,966
34,129
4,364
2,551
889
9,401
1,602
866
11,858
7,879
1,625
2,812
18,869
2,920
2,435
1,042
7,875
16,557
2,633
6,666
40,219
19,892
5,428
4,907
21,098
3,316
1,756
620
1,647
7,687
5,435
1,117
1,820

Sample
Size
65,818
2,635
2,436
615
1,036
2,721
963
337
291
2,438
297
225
77
136
21
20
986
617
163
253
1,317
198
190
79
1,359
2,651
552
1,319
2,171
984
366
295
2,143
311
216
71
33
962
601
163
243

41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80

041 NAVY_O4-O6_MALE+UNK_MAR+CHILD_
042 NAVY_O4-O6_MALE+UNK_MARNOCHILD_
043 NAVY_O4-O6_FEMALE_MAR+CHILD_
044 NAVY_O4-O6_FEMALE_MARNOCHILD_
045 USMC_E1-E4+E0_MALE+UNK_MAR+CHILD_
046 USMC_E1-E4+E0_MALE+UNK_MARNOCHILD_
047 USMC_E1-E4+E0_FEMALE_MAR+CHILD_
048 USMC_E1-E4+E0_FEMALE_MARNOCHILD_
049 USMC_E5-E6_MALE+UNK_MAR+CHILD_
050 USMC_E5-E6_MALE+UNK_MARNOCHILD_
051 USMC_E5-E6_FEMALE_MAR+CHILD_
052 USMC_E5-E6_FEMALE_MARNOCHILD_
053 USMC_E7-E9_MALE+UNK_MAR+CHILD_
054 USMC_E7-E9_MALE+UNK_MARNOCHILD_
055 USMC_E7-E9_FEMALE_MARCHILD+NOCHILD_
056 USMC_W1-W5+W0_MALE+FEMALE_MARCHILD+NOCHILD_

057 USMC_O1-O3+O0_MALE+UNK_MAR+CHILD_
058 USMC_O1-O3+O0_MALE+UNK_MARNOCHILD_
059 USMC_O1-O3+O0_FEMALE_MARCHILD+NOCHILD_
060 USMC_O4-O6_MALE+FEMALE_MARCHILD+NOCHILD_
061 USAF_E1-E4+E0_MALE+UNK_MAR+CHILD_
062 USAF_E1-E4+E0_MALE+UNK_MARNOCHILD_
063 USAF_E1-E4+E0_FEMALE_MAR+CHILD_
064 USAF_E1-E4+E0_FEMALE_MARNOCHILD_
065 USAF_E5-E6_MALE+UNK_MAR+CHILD_
066 USAF_E5-E6_MALE+UNK_MARNOCHILD_
067 USAF_E5-E6_FEMALE_MAR+CHILD_
068 USAF_E5-E6_FEMALE_MARNOCHILD_
069 USAF_E7-E9_MALE+UNK_MAR+CHILD_
070 USAF_E7-E9_MALE+UNK_MARNOCHILD_
071 USAF_E7-E9_FEMALE_MAR+CHILD_
072 USAF_E7-E9_FEMALE_MARNOCHILD_
073 USAF_O1-O3+O0_MALE+UNK_MAR+CHILD_
074 USAF_O1-O3+O0_MALE+UNK_MARNOCHILD_
075 USAF_O1-O3+O0_FEMALE_MAR+CHILD_
076 USAF_O1-O3+O0_FEMALE_MARNOCHILD_
077 USAF_O4-O6_MALE+UNK_MAR+CHILD_
078 USAF_O4-O6_MALE+UNK_MARNOCHILD_
079 USAF_O4-O6_FEMALE_MAR+CHILD_
080 USAF_O4-O6_FEMALE_MARNOCHILD_

6

13,090
2,392
1,589
771
4,754
14,104
588
2,148
14,297
8,338
893
1,039
10,162
1,194
550
1,909
2,965
2,764
463
5,928
9,719
17,578
2,407
7,294
38,106
18,594
5,732
5,099
20,524
3,333
3,699
1,199
8,416
7,048
1,592
2,880
16,894
3,083
2,578
1,190

1,168
206
154
81
1,483
3,935
268
743
2,612
1,428
199
228
2,773
304
183
90
951
822
166
1,765
1,175
2,137
396
984
1,881
875
341
276
1,686
261
352
103
741
573
165
250
1,096
191
201
84