Defense Civilian Personnel Advisory Service (DCPAS) College Students’ and Recent Graduates’ Knowledge and Awareness of Civilian Jobs and Scholarship Opportunities Survey
QUESTIONNAIRE - 3/7/2018
NOTE TO REVIEWER: This document is a questionnaire designed to illustrate the order and wording of specific questions presented to participants in the DCPAS College Students’ and Recent Graduates’ Knowledge and Awareness of Civilian Jobs and Scholarship Opportunities Survey. Variable/data labels will be added in once this questionnaire is finalized. The purpose of the survey is to understand the knowledge, awareness, and behaviors associated with pursuing a civilian job within the Department of Defense (DoD). The survey will be conducted with a variety of college students and recent graduates, and will include questions to understand job-seeking behaviors and awareness of DoD civilian jobs, psychographics, and demographics.
The order of the survey is as follows:
Section |
Section Title |
Section 1 |
Screening Questions |
Section 2 |
Job-Seeking Behaviors |
Section 3 |
Knowledge and Awareness of Federal Government Job Opportunities |
Section 4 |
Knowledge and Awareness of Department of Defense (DoD) Civilian Job Opportunities |
Section 5 |
Influencers |
Section 6 |
Department of Defense (DoD) Civilian Job Beliefs and Associations |
Section 7 |
Interest in Applying to Department of Defense (DoD) Civilian Jobs |
Section 8 |
Employment and Educational Background |
Section 9 |
Demographics |
Research Questions:
What are the job search norms and behaviors of the target audience?
What level of knowledge and awareness does the target audience have of federal government jobs?
Do college students and recent graduates know how to apply for federal jobs?
What level of knowledge and awareness does the target audience have of Department of Defense (DoD) civilian jobs?
Do college students and recent graduates know of the various job types available at the Department of Defense (DoD)?
What external/environmental factors (e.g., people, the economy, barriers) influence the target audience’s decision to apply for a Department of Defense (DoD) civilian job?
What are the beliefs, associations, and outcome expectations that the target audience has regarding Department of Defense (DoD) civilian jobs?
How interested are college students and recent graduates in applying for Department of Defense (DoD) civilian jobs?
How likely are college students and recent graduates to apply for Department of Defense (DoD) civilian jobs?
Screening Questions
Question 1
Are you currently enrolled in a college or university?
0=No
1=Yes
-99=Refused
If Q1=0 “No” or -99 “Refused”, GO TO Q2.
If Q1=1 “Yes”, SKIP TO Q4
Question 2
Are you currently enrolled in a community college with the intent to earn a bachelor’s degree or higher?
0=No
1=Yes
-99=Refused
If Q2=0 “No” or -99 “Refused”, GO TO Q3
IF Q2=1 “Yes” SKIP TO Q4
Question 3
Have you graduated from a college or university with a bachelor’s degree in the last two years?
0=No
1=Yes
-99=Refused
If Q3=0 “No” or -99 “Refused”, respondent was an INELIGIBLE respondent.
If Q3=1 “Yes”, GO TO Q4.
Question 4
Please indicate your age.
1=Under 18 years old
2=18 years old
3=19 years old
4=20 years old
5=21 years old
6=22 years old
7=23 years old
8=24 years old
9=25 years old
10=Over 25 years old
-99=Refused
If Q4=1 “Under 18”, 10 “Over 25 years old”, OR -99 “Refused”, respondent was an INELIGIBLE respondent.
If Q4=2 “18 years old,” OR 3 “19 years old,” OR 4 “20 years old,” OR 5 “21 years old,” OR 6 “22 years old,” OR 7 “23 years old,” OR 8 “24 years old,” OR 9 “25 years old” then direct respondent to Privacy Act/Informed Consent Form.
[PLACEHOLDER PRIVACY ACT/INFORMED CONSENT]
PRIVACY
ACT STATEMENT
In
accordance with the Privacy Act of 1974 (Public Law 93-579), this
notice informs you of the purpose of the survey and how the findings
will be used. Please read it carefully.
AUTHORITY:
10 USC 503, 2358
PRINCIPAL PURPOSE: Information
collected in this survey will be used to assess college students’
and recent graduates’ knowledge and awareness of civilian jobs
within the Department of Defense (DoD). This information will be used
to assist the Department of Defense (DoD) in enhancing its marketing
strategies for college students and recent graduates seeking
scholarship and civilian job opportunities.
ROUTINE
USES: None.
DISCLOSURE: Providing information on
this survey is voluntary. There is no penalty if you choose not to
respond. However, your maximum participation is encouraged so that
the data collected will be complete and representative. Your survey
instrument will be treated as confidential. Personally identifiable
information will be used only by persons engaged in, and for the
purposes of, the survey. Only group statistics will be reported.
1=I wish to continue
2=I do not wish to continue
-99=Refused
If 2 or -99, respondent was an INELIGIBLE respondent.
If 1, proceed to next page.
PAGE BREAK
We are inviting you to take part in a research study. This will involve completing a web-based survey that asks questions about your knowledge and attitudes regarding jobs in the federal government. It should take you about 20–30 minutes to complete. This study is sponsored by the Department of Defense (DoD).
There are neither risks nor benefits to you taking part in this survey. Any money you receive is a small token to thank you for taking part, if you choose to do so.
Your participation is voluntary. This means that you are free to choose not to take part, or to skip certain questions. There is no penalty if you choose not to respond. However, your complete participation will help DoD make program-related decisions regarding what factors should be prioritized in future recruitment efforts and marketing activities. It is important that as many people respond to this survey as possible so that the information we get is complete.
Your personal information will be kept separate from your survey responses. Government personnel will not have access to your name, address, or email address; they will only have access to your responses. Government personnel will not be able to trace your responses back to you. Answers will be reported only for the whole group. If you have any questions about this survey at any time, please contact the survey administrator by emailing pi@forsmarshgroup.com.
Thank
you for considering participation in this survey.
Job-Seeking Behaviors
Question 5
Are you currently looking for a job?
1=I am actively looking for a job
2=Not actively, but I would consider new job opportunities
3=I
am not currently looking for a job
-99=Refused
If Q5=1”I am actively looking for a job” OR 2 “Not actively, but I would consider new job opportunities”, GO TO Q6
If Q5=3 “I am not currently looking for a job” OR -99 “Refused”, GO TO Q7
Question 6
What type of job are you looking for or considering?
1=Part-time employment
2=Full time employment
-99=Refused
Question 7
In the next three years, what type of work would you like to be doing? (Select all That Apply)
1=Accounting/Budget/Finance
2=Administrative Support
3=Arts/Design, Entertainment, or Media
4=Automotive/Air Craft Mechanics
5=Auditing
6=Business Management
7=Communication/Public Affairs/Marketing
8=Contracting
9=Cyber
10=Education
11=Engineering
12=Environmental Science
13=Financial Services
14=Medical: Physician, Dentist, Nurse
15=Human Resources
16=Information Technology/Computer Science
17=International Affairs
18=Intelligence
19=Law Enforcement/Security
20=Legal/Attorney
21=Logistics/Supply Chain Management
22=Mathematics
23=Management/Program Analyst
24=Military Services
25=Quality Assurance
26=Retail and Sales
27=Security, Law Enforcement, Police
28=Social Sciences (e.g., therapist or social worker)
29=Transportation
98=Unsure/Don’t know
99=Refused
Question 8
In the next three years, how likely is it that you will choose to work for…
1=A large private corporation/for-profit company
2=A local small business/for-profit company
3=A nonprofit organization
4=A service-based organization (e.g., Peace Corps, Teach for America, AmeriCorps)
5=Yourself (i.e., start your own business)
6=A local/state government agency (e.g., public school system, fire or police departments)
7=Federal agency, not Department of Defense (DoD)
8=Federal agency, Department of Defense (DoD)
9=Serve in the Military (Active, Reserve, or Guard)
10=Other
RESPONSES:
1=Definitely not
2=Probably not
3=Probably
4=Definitely
-99=Refused
Question 9 [GRID AND RANDOMIZE]
When thinking about choosing an organization to work for, what would you say are the most important factors? (Select all That Apply)
1=Competitive pay
2=Travel opportunities
3=Getting experience that can prepare you for a future job
4=Benefits (e.g., health insurance, life insurance, retirement plan)
5=Opportunity to make a difference
6=Job security
7=Work–life balance (e.g., family-friendly policies, flexible schedule)
8=Opportunity to contribute to the security of America
9=Training and development
10=Access to cutting-edge technology
11=Challenging yet rewarding work experience
12=Opportunity for personal growth (job advancement)
13=Recognition for achievements
14=Telework opportunity
15=Global opportunities
16=To do something you can be proud of
17=The opportunity to develop leadership skills
18=The opportunity to help others
19=Other(s): [open-ended]
Question 10
Which of the following words describe your ideal employer? (Select all That Apply)
Friendly
Reliable
Original
Innovative
Secure
Leader
Sincere
Young
Creative
Sophisticated
Successful
Technical
Attractive
Family-oriented
Other: __________________
Question 11
Which of those words describing your ideal employer is most important to you? (Select One)
(Programmer note: only pipe in items selected in Q10)
Friendly
Reliable
Original
Innovative
Secure
Leader
Sincere
Young
Creative
Sophisticated
Successful
Technical
Attractive
Family-oriented
Other: __________________
Question 12 [GRID AND RANDOMIZE]
How
often do you use the following methods to conduct your job search?
(Select One
Answer From Each Row in the Grid)
Career counseling services at your school
Campus career fairs
Virtual career fairs
Information sessions on campus
Contacting people I know
Networking/building new relationships
USAJOBS.gov, a federal government job board
Other job boards (e.g., Indeed, Monster)
Networking sites (e.g., LinkedIn)
Social media sites (e.g., Facebook, Twitter)
Other
RESPONSES:
1=Never
2=Seldom
3=Sometimes
4=Often
5=Almost always
-99=Refused
Question 13 [GRID AND RANDOMIZE]
How often do you use the following sites during your job search activities?
(Select One Answer From Each Row in the Grid)
ITEMS IN ROW:
Indeed
Monster
Idealist
LinkUp
CareerBuilder
Dice
USAJOBS.gov
Glassdoor
The Ladders
Job.com
Simply Hired
ZipRecruiter
Craigslist
Looksharp
Snapchat
Other
RESPONSES:
1=Never
2=Seldom
3=Sometimes
4=Often
5=Almost always
-99=Refused
Knowledge and Awareness of Federal Governmental Job Opportunities
Question 14
Before taking this survey, how much consideration had you given to applying for a job in the U.S. Federal Government?
RESPONSES:
1=Never thought about it
2=Gave it some consideration
3=Gave it serious consideration
-99=Refused
If Q14=2 “Gave it some consideration” OR 3 “Gave it serious consideration”, GO TO Q15
If Q14=1”Never thought about it” OR -99 “Refused”, GO TO Q20
Question 15 [GRID AND RANDOMIZE]
Which agency have you considered a job in? (Select all That Apply)
ITEMS IN ROW:
Department of Agriculture (USDA)
Department of Energy (DOE)
Department of Health and Human Services (HHS)
Department of Homeland Security (DHS)
Department of Justice (DOJ)
Department of Labor (DOL)
Department of State (DoS)
Department of Veterans Affairs (VA)
Environmental Protection Agency (EPA)
Department of Defense (DoD)
U.S. Agency for International Development (USAID)
Other [Open-Ended]
Question 16
Are you still considering applying for a job in the [Pipe in Department of the U.S. Federal Government]?
1=Yes, I am still considering it.
2=No, I stopped considering it within the past few weeks.
3=No, I stopped considering it within the past few months.
4=No, I stopped considering it within the past year.
5=No, I stopped considering it more than a year ago.
98=Don’t know
-99=Refused
Question 17
Have you ever applied for a federal government job before?
Responses:
0=No
1=Yes
-99=Refused
If Question 17=0 “No” or -99 “Refused GO TO Q20
Question 18
How was your experience applying for a federal government job?
Responses:
1=Extremely positive
2=Somewhat positive
3=Neutral
4=Somewhat negative
5=Extremely negative
Question 19 [OPEN-ENDED] Why was your experience [pipe in Q20 response here]?
Knowledge and Awareness of Department of Defense (DoD) Civilian Job Opportunities
Question 20 [RANDOMIZE; OPEN-ENDED]
What comes to mind when you hear the term civilian?
What is a typical job in the Department of Defense (DoD) for someone who is not in the Military? Describe what you think that job is like.
Question 21
The Department of Defense (DoD) offers a multitude of job opportunities for non-military individuals (known as civilians) interested in playing an important role of providing support to our Armed Forces (Military). DoD hires civilians in nearly every type of job available in the private sector. Opportunities exist for scholarships, internships, short-term and long-term positions, as well as entry level to senior executive-level positions.
How knowledgeable are you about the various types of non-military or civilian jobs available in the Department of Defense (DoD)?
(Scale item; 1–5)
1=Not at all knowledgeable
5=Extremely knowledgeable
-99=Refused
Question 22
Do you know someone who is currently working or has previously held a civilian job in the Department of Defense (DoD)?
0=No
1=Yes
-99=Refused
[If Question 22=0 “No,” GO TO Q24]
Question 23 [GRID AND RANDOMIZE]
Who do you know that is currently working for or has previously held a civilian job in the Department of Defense (DoD)? (Select all That Apply)
ITEMS IN ROW:
Your father
Your mother
Your brother(s) and/or sister(s)
Your uncle(s) and/or aunt(s)
Your grandparent(s)
Your cousin(s)
Your spouse/partner/girlfriend/boyfriend
A friend
Myself
Other: (open-end)
RESPONSES:
0=No
1=Yes
-99=Refused
Question 24: [GRID AND RANDOMIZE]
Please indicate whether you agree or disagree with the following statements:
(Select One Answer From Each Row in the Grid)
I know how to apply for Department of Defense (DoD) civilian jobs.
I know the main differences and requirements for a federal government résumé compared to a private sector résumé.
I know what civilian jobs are available within the Department of Defense (DoD).
I am familiar with the various agencies within the Department of Defense (DoD) that offer civilian jobs.
I am familiar with what the agencies within the Department of Defense (DoD) that offer civilian jobs do.
I know what scholarships are available to me from the Department of Defense (DoD).
I know how to apply for Department of Defense (DoD) scholarships.
If I applied to a Department of Defense (DoD) civilian job, I would be selected for an interview.
If I were offered a Department of Defense (DoD) civilian job, I would be a successful employee.
People who work for the Department of Defense (DoD) as civilians are people like me.
RESPONSES IN COLUMN:
1=Strongly disagree
2=Somewhat disagree
3=Neither agree nor disagree
4=Somewhat agree
5=Strongly agree
-99=Refused
Question 25
In the next three years, how likely would you be to apply for a job offered by the Department of Defense (DoD)?
Responses:
1=Definitely not
2=Probably not
3=Probably
4=Definitely
-99=Refused
Question 26
Before taking this survey, how much consideration had you given to applying for a civilian job within the Department of Defense (DoD)?
RESPONSES:
1=Never thought about it
2=Gave it some consideration
3=Gave it serious consideration
-99=Refused
Question
27
In the next three years, how likely would you be to apply for a scholarship offered by the Department of Defense (DoD)?
Responses:
1=Definitely not
2=Probably not
3=Probably
4=Definitely
-99=Refused
Influencers
Question 28
How difficult is it for someone your age to get a full-time job in your community?
1=Almost impossible
2=Very difficult
3=Somewhat difficult
4=Not difficult at all
-97=Multiple Response
-99=Refused
Question 29
Do you think the important influencers in your life would be supportive if you got a job as a civilian in the Department of Defense (DoD)?
RESPONSES:
1=Definitely not
2=Probably not
3=Probably
4=Definitely
-99=Refused
Question 30
Does the reputation of the federal government make you more likely or less likely to apply to a civilian job within the Department of Defense (DoD)?
1=Less likely
2=Neither more nor less likely
3=More likely
-99=Refused
If Q30=1 “Less likely” OR 3 “More likely” GO TO Q31
If Q30=2 “Neither more nor less likely” OR -99 “Refused” GO TO Q32
Question 31 [open-ended]
How does the reputation of the federal government make you [pipe in response Q25] to apply to a civilian job within the Department of Defense (DoD)?
Question 32
What are the main reasons you would consider applying to work as a civilian in the Department of Defense (DoD)?
RESPONSES:
1=Competitive pay
2=Travel opportunities
3=Getting experiences that can prepare you for a future job
4=Benefits (e.g., health insurance, life insurance, retirement plan)
5=Opportunity to make a difference
6=Job security
7=Work–life balance (e.g., family-friendly policies, flexible schedule)
8=Opportunity to contribute to the security of America
9=Training and development
10=Access to cutting-edge technology
11=Challenging yet rewarding work experience
12=Opportunity for personal growth (career advancement)
13=Recognition for achievements
14=Telework opportunity
15=Global opportunities
16=To do something you can be proud of
17=The opportunity to develop leadership skills
18=The opportunity to help others
19=Other(s): [open-ended]
Question 33
What are the main reasons you would not consider applying to work as a civilian in the Department of Defense (DoD)?
RESPONSES:
1=Non-competitive pay/benefits
2=Dislike of structured environment
3=Other career interests
4=Opposition by family or friends
5=Don’t believe I would qualify
6=Don’t know anything about it
7=Limited career advancement opportunities
8=Not prestigious enough
9=No jobs in my desired field
10=Application process is too difficult or cumbersome
11=Other(s): [open-ended]
Department of Defense (DoD) Civilian Job Beliefs and Associations
Question 34 [GRID AND RANDOMIZE]
Please rate the extent to which you agree or disagree with the following statements about Department of Defense (DoD) Civilian Jobs. (Select One Answer From Each Row in the Grid)
Organizational Attractiveness
For me, a Department of Defense (DoD) agency would be a good place to work if I wanted a federal government job.
A civilian job at a Department of Defense (DoD) agency is very appealing to me.
Intention to Pursue
Civilian jobs at the Department of Defense (DoD) are one of my first choices for employment.
If a Department of Defense (DoD) agency invited me to interview for a civilian job, I would accept.
I would accept a civilian job offer from a Department of Defense (DoD) agency.
Prestige
Employees are proud to say they work for the Department of Defense (DoD).
The Department of Defense (DoD) has a reputation for being an excellent employer.
I would find the Department of Defense (DoD) a prestigious place to work.
RESPONSES IN COLUMN:
1=Strongly disagree
2=Somewhat disagree
3=Neither agree nor disagree
4=Somewhat agree
5=Strongly agree
-99=Refused
Question 35 [GRID AND RANDOMIZE] COMMENT NEEDED ABOUT DCPAS UPDATES
How likely is it that a Department of Defense (DoD) civilian job would provide the following? (Select all That Apply)
1=Competitive pay
2=Travel opportunities
3=Getting experience that can prepare you for a future job
4=Benefits (e.g., health insurance, life insurance, retirement plan)
5=Opportunity to make a difference
6=Job security
7=Work–life balance (e.g., family-friendly policies, flexible schedule)
8=Opportunity to contribute to the security of America
9=Training and development
10=Access to cutting-edge technology
11=Challenging yet rewarding work experience
12=Opportunity for personal growth (career advancement)
13=Recognition for achievements
14=Telework opportunity
15=Global opportunities
16=To do something you can be proud of
17=The opportunity to develop leadership skills
18=The opportunity to help others
19=Other(s): [open-ended]
RESPONSES:
1=Very Unlikely
5=Very Likely
Question 36
Which of the following words do you associate with Department of Defense (DoD) civilian jobs? (Select all That Apply)
RESPONSES:
Friendly
Reliable
Original
Innovative
Secure
Leader
Sincere
Young
Creative
Sophisticated
Successful
Technical
Attractive
Family-oriented
Other: __________________
Question 37
Which of these words that you selected do you most associate with Department of Defense (DoD) civilian jobs? (Select One. Pipe in responses from previous question.)
RESPONSES:
Friendly
Reliable
Original
Innovative
Secure
Leader
Sincere
Young
Creative
Sophisticated
Successful
Technical
Attractive
Family-oriented
Other: __________________
Interest in Applying to Department of Defense (DOD) Civilian Jobs
Question 38
Have you ever spoken with someone who is a current or past civilian employee of the Department of Defense (DoD)?
0=No
1=Yes
-99=Refused
If Q41=0 “No” OR -99 “Refused” GO TO Q43
If Q41=1 “Yes” GO TO Q42
Question 39
How did this conversation affect your perception of Department of Defense (DoD) civilian jobs as a whole?
RESPONSES:
1=Extremely positive
2=Somewhat positive
3=Neutral
4=Somewhat negative
5=Extremely negative
-99=Refused
Question 40 [GRID AND RANDOMIZE]
In
the past year, have you…?
(Select
One Answer From Each Row in the Grid)
Heard or seen anything about Department of Defense (DoD) civilian jobs in the media
Viewed an advertisement for civilian job within a Department of Defense (DoD) agency
Contacted a civilian job recruiter from the Department of Defense (DoD)
Had a Department of Defense (DoD) civilian job recruiter contact you
Had a conversation with a friend or family member about working for the Department of Defense (DoD) in a civilian job
Visited a Department of Defense (DoD) agency’s website about civilian jobs
Visited a Department of Defense (DoD) agency’s social media page about civilian jobs
RESPONSES:
0=No
1=Yes
-99=Refused
Question 41 [GRID AND RANDOMIZE]
In the next year, how likely is it that you will…?
(Select One Answer From Each Row in the Grid)
Contact a recruiter from an agency of the Department of Defense (DoD)
Have a conversation with a friend or family member about applying for a job within the Department of Defense (DoD)
Visit a Department of Defense (DoD) agency’s website
RESPONSES IN COLUMN:
(Scale item; 1-5)
1=Very unlikely
5=Very likely
-99=Refused
Question 42
How likely would you be to talk to a recruiter in person?
(Scale item; 1-5)
1=Very unlikely
5=Very likely
-99=Refused
Question 43
How likely would you be to talk to a recruiter in a virtual chat room?
(Scale item; 1-5)
1=Very unlikely
5=Very likely
-99=Refused
Question 44 [GRID AND RANDOMIZE]
If you were interested in learning more about a job or organization, would you prefer to talk to someone in person or in a virtual chat room?
RESPONSES:
1=Virtual chat room
2=In person
-99=Refused
Question 45 [OPEN-ENDED]
Why would you prefer to interact with a recruiter in [pipe in response from previous question here]?
Employment and Educational Background
Question 46
Please select the year of college in which you are currently enrolled:
RESPONSES:
1=1st year college/university (freshman)
2=2nd year college/university (sophomore)
3=3rd year college/university (junior)
4=4th year college/university (senior)
5=5th year college/university
6=Graduated from college
-99=Refused
Question 47 [GRID AND RANDOMIZE]
What is/was your major in college? (Select all that apply)
ITEMS IN ROW:
Physical/Natural Sciences:
1=Agriculture
2=Biology
3=Chemistry
4=Environmental science
5=Health sciences/Nursing
6=Physics
Technology, Engineering, and Math:
7=Computer and information science
8=Engineering
9=Mathematics/Statistics
Social Sciences
10=Anthropology
11=Economics
12=Education
13=Political Science
14=Psychology
15=Sociology
Humanities
16=English language/literature
17=Fine arts
18=Foreign language
19=History
20=Philosophy
Professional Studies
21=Business
22=Communication/journalism
23=Criminal justice
24=Public administration/Social work
-99=Refused
RESPONSES:
0=No
1=Yes
-99=Refused
Question 48
What is/was your college GPA?
RESPONSES:
1=Above 4.0
2=3.7–4.0
3=3.3–3.69
4=3.0–3.29
5=2.7–2.99
6=2.3–2.69
7=2.0–2.29
8=Below 2.0
-99=Refused
Demographics
Question 49
What is your gender?
RESPONSES:
1=Male
2=Female
-99=Refused
Question 50
Are you of Hispanic, Latino, or Spanish origin?
RESPONSES:
1=No, not of Hispanic, Latino, or Spanish origin
2=Yes, Mexican, Mexican American, Chicano
3=Yes, Puerto Rican
4=Yes, Cuban
5=Yes, of Hispanic, Latino, or Spanish origin
-97=Multiple Response
-99=Refused
Question 51
What is your race? (Mark one or more races to indicate what you consider yourself to be)
1=White
2=Black or African American
3=Asian Indian
4=Chinese
5=Filipino
6=Japanese
7=Korean
8=Vietnamese
9=Other Asian
10=Native Hawaiian or Other Pacific Islander
99=Refused
Question 52 [OPEN ENDED]
Thinking about the topics covered in this survey, do you have any comments you would like to share? Any comments are welcome!
THANK YOU VERY MUCH!
File Type | application/vnd.openxmlformats-officedocument.wordprocessingml.document |
File Title | 81 - DCPAS Survey - Combined DCPAS + OPA feedback_CKM_TO TE.docx |
Author | Karen Molloy |
File Modified | 0000-00-00 |
File Created | 2021-01-21 |