The Department of State’s Bureau of
Educational and Cultural Affairs (ECA) regularly monitors and
evaluates its programs through the collection of data about program
accomplishments in order to enable program staff to assess the
results of its programs, where improvements may be necessary, and
to modify/plan future programs. In order to more systematically
assess the efficacy and impact of ECA funded-programs and to
address the requirements of the Foreign Aid Transparency and
Accountability Act (FATAA) and the Department of State’s updated
monitoring and evaluation guidance (18 FAM 300), ECA’s Evaluation
Division has created a robust performance monitoring framework that
is responsive to these directives, measures programmatic goals and
objectives, and provides a comprehensive view of overall Bureau
activities. The Monitoring Data for ECA (MODE) Framework
(https://eca.state.gov/impact/eca-evaluation-division/monitoring-data-eca-mode-framework)
includes a results framework with indicators designed to track
program performance and the direction, pace, and magnitude of
change of ECA programs - leading to strengthened feedback
mechanisms resulting in more effective programs. Each of these
indicators has corresponding data collection questions defined so
data will be collected uniformly whether by the program office, the
Evaluation Division, or an award recipient. Implementation of the
MODE Framework will enable ECA to standardize and utilize its data
in the following ways: • Assess data and performance metrics to
enhance program performance • Inform strategic planning activities
at the Bureau, division, and individual exchange program levels •
Supplement the information ECA program officers receive from their
award recipients and exchange participants to provide a
comprehensive view of programmatic activities • Respond quickly and
reliably to ad-hoc requests from Congress, the Office of Management
and Budget (OMB), and internal Department of State stakeholders In
order to collect data for the MODE Framework, the ECA Evaluation
Division intends to conduct ongoing surveys of program
participants, alumni, and participant host and home communities to
monitor program performance, assess impact, and identify issues for
further evaluation. Specifically, ECA will coordinate with award
recipients to provide standard survey questions for both foreign
national and U.S. citizen exchange participants immediately after
completing the exchange (“Participant Post-Program Survey”). ECA’s
Evaluation Division also intends to administer standard surveys to
foreign national and U.S. citizen exchange alumni roughly one year,
three years and five years after completing their exchange
experience. Conducting post-program surveys, particularly after
three and five years, will provide information on the impact of ECA
programs and insight into the achievements of participants. To
examine multiplier effects of ECA exchange programs on foreign and
U.S. communities and institutions that sponsor, support, or provide
exchange programs support or services, ECA intends to administer
standard surveys to foreign and U.S. host community members
(individuals or institutions) where feasible.
On behalf of this Federal agency, I certify that
the collection of information encompassed by this request complies
with 5 CFR 1320.9 and the related provisions of 5 CFR
1320.8(b)(3).
The following is a summary of the topics, regarding
the proposed collection of information, that the certification
covers:
(i) Why the information is being collected;
(ii) Use of information;
(iii) Burden estimate;
(iv) Nature of response (voluntary, required for a
benefit, or mandatory);
(v) Nature and extent of confidentiality; and
(vi) Need to display currently valid OMB control
number;
If you are unable to certify compliance with any of
these provisions, identify the item by leaving the box unchecked
and explain the reason in the Supporting Statement.
OMB PRA Legal Authorities_ECA MODE.docx
Monitoring Data for ECA (MODE) Framework