FY2019 IES Annual Principal Investigators (PI) Meeting F

Annual Principal Investigators Meeting
Conference Survey 2019
Thank you for attending the Institute of Education Sciences (IES) Annual Principal Investigators (PI) Meeting. The purpose of this feedback survey is to
gather information about your PI Meeting experience that can inform the development of next year’s agenda. Your answers are voluntary, but your feedback
is very important. Your responses will be anonymous and it will take about 15 minutes per response to complete the survey.
NOTE: Please do not use your browser's back button. Instead, please use the back and next buttons at the bottom of each survey page. When
you have completed the survey, click submit. Once you have submitted your survey, you will NOT be able to change your responses.
If you have any questions about this survey, please contact the IES Planning Team at IESHELP@manhattanstrategy.com

We appreciate your feedback.
Public Burden Statement
According to the Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unless such collection displays a valid OMB control number. The valid OMB control number for this information collection
is 1880-0542. Public reporting burden for this collection of information is estimated to average 15 minutes per response, including time for reviewing instructions, searching existing data sources, gathering and maintaining the data
needed, and completing and reviewing the collection of information. The obligation to respond to this collection is voluntary. If you have comments or concerns regarding the status of your individual submission of this survey, please
contact Christina Chhin directly at, U.S. Department of Education, Institute of Education Sciences, 400 Maryland Ave., SW, PCP-4124, Washington, DC 20202. Number 1880-0542 (Expires 7/31/2020). Note: Please do not return the
completed Customer Feedback Form to this address.

This year's theme, Critical Questions and Practical Solutions: Improving the Practice and Usefulness of Education Research, highlights the importance of
the connections between research and practice, and serves as an invitation for candid discussions of the challenges in conducting education research.

1. Please indicate the extent to which the overall IES Annual PI Meeting met your expectations.
Exceeded Expectations
Met Expectations
Fell Short of Expectations
Not Applicable/No Opinion

2. Please indicate the extent to which the conference met your expectations with respect to each of the objectives listed below.
Exceeded
Expectations

Met
Expectations

Fell Short of
Expectations

Not Applicable/No
Opinion

Discuss IES and the U.S. Department of Education
priorities and programs
Address challenges and solutions in the field of
education research
Address challenges and solutions in the field of
education practice
Highlight new research findings and approaches from
IES-funded projects
Offer professional development on a range of substantive
and methodological topics
Provide time for PIs to meet with their program officers (or
IES staff)
Foster connections with other education researchers
Foster connections with other education practitioners

(untitled)

PI MEETING LOGISTICS

3. Please indicate your satisfaction with each of the logistics items listed below.
Very
Satisfied
Conference announcement
Registration procedures
Conference website
Conference program/agenda
Poster abstract submission guidelines and procedures
Mobile application
Meeting space
Hotel accommodations
Hotel location
Responses to your questions and concerns
Onsite registration process
Onsite assistance provided
Overall logistics
Overall conference experience

Satisfied

Neither Satisfied nor
Dissatisfied

Dissatisfied

Very
Dissatisfied

Not
Applicable

4. Please indicate your satisfaction with each of the networking and engagement items listed below.
Very
Satisfied

Satisfied

Neither Satisfied nor
Dissatisfied

Dissatisfied

Very
Dissatisfied

Not
Applicable

Very
Dissatisfied

Not
Applicable

Use of the mobile app to connect with other meeting
participants
Time for networking and informal meet-ups
Lunch meet-ups

(untitled)

WEDNESDAY, JANUARY 9

5. Wednesday, January 9, 8:30 AM - 9:00 AM Opening Plenary: IES Director's Welcome
Please provide an overall rating of the Opening Plenary: IES Director's Welcome session using the scale provided.
Excellent
Average
Poor
Did not attend

6. Please indicate your satisfaction with the Opening Plenary: IES Director's Welcome.
Very
Satisfied

Satisfied

Neither Satisfied nor
Dissatisfied

Dissatisfied

The applicability of the IES Director's Welcome to your
research or practice
The extent to which the session format allowed speakers
to share their work or experience
The extent to which the session format allowed for
audience engagement and/or discussion

7. Please indicate the extent to which you feel the Opening Plenary: IES Director's Welcome was effective in accomplishing each of the following:
Very Effective
Helping you understand IES research programs and
priorities
Setting a positive tone for the PI meeting
Stressing the importance of improving the practice and
usefulness of education research

Effective

Moderately Effective

Somewhat Effective

Ineffective

8. Wednesday, January 9, 9:15 AM - 10:00 AM Plenary Session: Commissioner's Welcome: NCER
Please provide an overall rating for the Plenary Session: Commissioner's Welcome: NCER.
Excellent
Average
Poor
Did not attend

9. Please indicate your satisfaction with the Plenary Session: Commissioner's Welcome: NCER.
Very
Satisfied

Satisfied

Neither Satisfied nor
Dissatisfied

Dissatisfied

Very
Dissatisfied

Not
Applicable

The applicability of the Commissioner's Welcome to your
research or practice
The extent to which the session format allowed speakers
to share their work or experience
The extent to which the session format allowed for
audience engagement and/or discussion

10. Please indicate the extent to which you feel the Plenary Session: Commissioner's Welcome: NCER was effective in accomplishing each of the
following:
Very Effective

Effective

Moderately Effective

Somewhat Effective

Ineffective

Helping you understand IES research programs and
priorities
Setting a positive tone for the PI meeting
Stressing the importance of improving the practice and
usefulness of education research

11. Wednesday, January 9, 9:15 AM - 10:00 AM Plenary Session: Commissioner's Welcome: NCSER
Please provide an overall rating for the Plenary Session: Commissioner's Welcome: NCSER.
Excellent
Average
Poor
Did not attend

12. Please indicate your satisfaction with the Plenary Session: Commissioner's Welcome: NCSER.
Very
Satisfied
The applicability of the Commissioner's Welcome to your
research or practice
The extent to which the session format allowed speakers
to share their work or experience
The extent to which the session format allowed for
audience engagement and/or discussion

Satisfied

Neither Satisfied nor
Dissatisfied

Dissatisfied

Very
Dissatisfied

Not
Applicable

13. Please indicate the extent to which you feel the Plenary Session: Commissioner's Welcome: NCSER was effective in accomplishing each of the
following:
Very Effective

Effective

Moderately Effective

Somewhat Effective

Ineffective

Helping you understand IES research programs and
priorities
Setting a positive tone for the PI meeting
Stressing the importance of improving the practice and
usefulness of education research

PI Meeting Sessions (Wednesday, January 9)
For the next set of questions, we'd like your feedback on the quality of each of the sessions you attended on Wednesday, January 9,
2019. Using the scale provided, please rate each session you attended. If you attended more than one session during a time-band,
please rate up to TWO sessions.

14. Please select the title of the FIRST/ONLY session you attended during the Wednesday, January 9, 10:15 AM - 11:45 AM time-band from the dropdown menu below. (If you attended more than one session during the time-band, an opportunity to rate the second session is provided below.)
Developmental Education Reform
Findings from the Center for the Study of Adult Literacy (CSAL)
Making Your Research Accessible and Relevant to Non-Scientific Audiences
The Misalignment of Reading Comprehension Interventions and the Measures We Use to Explore their Efficacy: A Case for Experimenter-Designed Tests
New Assessment Tools for Early Learners: The Development of Measures to Assess the School Readiness Skills of Young Dual Language Learners
The Use of Single-Case Methods in Syntheses and Meta-Analyses
Using Research and Evidence in Decision-Making
Where Do the Results Generalize? Defining Populations, Developing Recruitment Strategies, and Understanding Heterogeneity in Intervention Research
Did not attend
Left conference before this session

15. Please provide an overall rating for the first session using the scale provided.
Excellent
Average
Poor

16. Please indicate your satisfaction with this session.
Very
Satisfied
The speaker(s)
The applicability of the session to your research or
practice
The extent to which the session format allowed speakers
to share their work or experience
The extent to which the session format allowed for
audience engagement and/or discussion

Satisfied

Neither Satisfied nor
Dissatisfied

Dissatisfied

Very
Dissatisfied

Not
Applicable

17. Please select the title of the SECOND session you attended (if applicable) during the Wednesday, January 9, 10:15 AM - 11:45 AM time-band
from the drop-down menu below.
Developmental Education Reform
Findings from the Center for the Study of Adult Literacy
Making Your Research Accessible and Relevant to Non-Scientific Audiences
The Misalignment of Reading Comprehension Interventions and the Measures We Use to Explore their Efficacy: A Case for Experimenter-Designed Tests
New Assessment Tools for Early Learners: The Development of Measures to Assess the School Readiness Skills of Young Dual Language Learners
The Use of Single-Case Methods in Syntheses and Meta-Analyses
Using Research and Evidence in Decision-Making
Where Do the Results Generalize? Defining Populations, Developing Recruitment Strategies, and Understanding Heterogeneity in Intervention Research
Did not attend
Left conference before this session

18. Please provide an overall rating for the second session using the scale provided.
Excellent
Average
Poor

19. Please indicate your satisfaction with this session.
Very
Satisfied

Satisfied

Neither Satisfied nor
Dissatisfied

The speaker(s)
The applicability of the session to your research or
practice
The extent to which the session format allowed speakers
to share their work or experience
The extent to which the session format allowed for
audience engagement and/or discussion

20. Wednesday, January 9, 12:15 PM - 1:15 PM Lunch Meet-Ups
Please the select the Lunch Meet-up you attended from the drop down menu below.
The Challenges of Implementing and Conducting Research on Multi-Tiered Systems of Support
Moving Interventions/Products to Scale: Models that Worked
Open Science: Promoting Transparency in Education Research
Recruitment of Schools in RCTs
Successful Transitions Beyond High School
Did not attend
Left conference before lunch meet-up

Dissatisfied

Very
Dissatisfied

Not
Applicable

21. If you did not attend a Lunch Meet-Up, please indicate why from the list below (select all that apply).
Preferred to get out of the hotel
Had a meeting
Preferred to have lunch with friends
Preferred to network in a less-structured environment
Needed some alone time
None of the meet-up topics interested me
Other

22. Please provide an overall rating for Lunch Meet-Up you attended according to the scale below.
Excellent
Average
Poor

23. Please indicate your satisfaction with the Lunch Meet-Up you attended.
Very
Satisfied

Satisfied

Neither Satisfied nor
Dissatisfied

Dissatisfied

Very
Dissatisfied

Not
Applicable

The applicability of the Lunch Meet-up to your research and
practice
The extent to which the session format allowed speakers to
share their work or experience
The extent to which the session format allowed for audience
engagement and/or discussion

24. Please select the title of the FIRST/ONLY session you attended during the Wednesday, January 9, 1:30 PM - 2:45 PM time-band from the drop-down
menu below. (If you attended more than one session during the time-band, an opportunity to rate the second session is provided below.)
Career and Technical Education Research Updates and Discussion
A Delicate Dance: The Challenges of Creating and Sustaining Research Partnerships
Findings from the Center for Analytics of Longitudinal Data in Education Research (CALDER)
The Future of STEM Education
Measuring Teaching Practice in General Education and Special Education Contexts
Treatment Effect Heterogeneity
We Need to Talk! Conversations from the Front Lines of Social Behavioral Assessments
What's New and What's Coming to the What Works Clearinghouse
Did not attend
Left conference before this session

25. Please provide an overall rating for the first session using the scale provided.
Excellent
Average
Poor

26. Please indicate your satisfaction with this session.
Very
Satisfied

Satisfied

Neither Satisfied nor
Dissatisfied

Dissatisfied

Very
Dissatisfied

Not
Applicable

The speaker(s)
The applicability of the session to your research or
practice
The extent to which the session format allowed speakers
to share their work or experience
The extent to which the session format allowed for
audience engagement and/or discussion

27. Please select the title of the SECOND session you attended (if applicable) during the Wednesday, January 9, 1:30 PM - 2:45 PM time-band from the
drop-down menu below below.
Career and Technical Education Research Updates and Discussion
A Delicate Dance: The Challenges of Creating and Sustaining Research Partnerships
Findings from the Center for Analysis of Longitudinal Data in Education Research (CALDER)
The Future of STEM Education
Measuring Teaching Practice in General Education and Special Education Contexts
Treatment Effect Heterogeneity
We Need to Talk! Conversation from the Front Lines of Social Behavioral Assessment
What's New and What's Coming to the What Works Clearinghouse
Did not attend
Left conference before this session

28. Please provide an overall rating for the second session using the scale provided.
Excellent
Average
Poor

29. Please indicate your satisfaction with this session.
Very
Satisfied

Satisfied

Neither Satisfied nor
Dissatisfied

Dissatisfied

Very
Dissatisfied

Not
Applicable

The speaker(s)
The applicability of the session to your research or
practice
The extent to which the session format allowed speakers
to share their work or experience
The extent to which the session format allowed for
audience engagement and/or discussion

30. Wednesday, January 9, 3:15 PM - 4:30 PM Plenary Session: Edtech: The Buzz, the Promise, the Evidence, and the Future
Please provide an overall rating of the Plenary Session: Edtech: The Buzz, the Promise, the Evidence, and the Future session using the scale
provided.
Excellent
Average
Poor

31. Please indicate your satisfaction with Plenary Session: Edtech: The Buzz, the Promise, the Evidence, and the Future.
Very
Satisfied

Satisfied

Neither Satisfied nor
Dissatisfied

Dissatisfied

Very
Dissatisfied

Not
Applicable

The speaker(s)
The applicability of the session to your research or
practice
The extent to which the session format allowed speakers
to share their work or experience
The extent to which the session format allowed for
audience engagement and/or discussion

32. Wednesday, January 9, 4:30 PM - 5:45 PM Poster Session
Please provide an overall rating of the Poster Session using the scale provided.
Excellent Average

Poor Did not attend

Left the conference before poster session

Technology demonstrations
Traditional poster presentations

33. Please indicate your satisfaction with the Poster Session.
Very
Satisfied

Satisfied

Neither Satisfied nor
Dissatisfied

Dissatisfied

Very
Dissatisfied

Not
Applicable

The applicability of the poster session to your research or
practice
The extent to which the session format allowed speakers
to share their work or experience
The extent to which the session format allowed for
audience engagement and/or discussion

34. As part of the poster selection process this year, PI meeting attendees were provided the opportunity to vote for posters they wanted to see presented
at the meeting. Please indicate how useful this opportunity was.
Very Useful
Useful
Neither Useful nor Unuseful
Unuseful
Very Unuseful
Did not know about this opportunity

(untitled)

THURSDAY, JANUARY 10

PI Meeting Sessions (Thursday, January 10)
For the next set of questions, we'd like your feedback on the quality of each of the sessions you attended on Thursday, January 10, 2019. Using the scale
provided, please rate each session you attended. If you attended more than one session during a time-band, please rate up to TWO sessions.

35. Thursday, January 10, 8:30 AM - 10:00 AM Plenary Session: Working Together to Better Inform Policy and Practice
Please provide an overall rating of the Plenary Session: Working Together to Better Inform Policy and Practice using the scale provided.
Excellent
Average
Poor
Did not attend
Left conference before this session

36. Please indicate your satisfaction with this session.
Very
Satisfied

Satisfied

Neither Satisfied nor
Dissatisfied

Dissatisfied

Very
Dissatisfied

Not
Applicable

The speaker(s)
The applicability of the session to your research or
practice
The extent to which the session format allowed speakers
to share their work or experience
The extent to which the session format allowed for
audience engagement and/or discussion

37. Please select the title of the FIRST/ONLY session you attended during the Thursday, January 10, 10:30 AM - 11:45 AM time-band from the dropdown menu below. (If you attended more than one session during the time-band, an opportunity to rate the second session is provided below.)
Education Technology Meets Data Privacy
Going Beyond Impact: Opening the Black Box of Teacher Learning
Making Practitioner Voices Heard in Partnerships
Meta-Analysis in Education Research
Pathways to the Education Sciences Program Meeting
The Promise of Personalizing Learning to Meet All Students' Needs
Tricks of the Trade: Strategies for Research Planning and Implementation
We Are All EL Researchers
Why Researcher-Practitioner Partnerships Fail
Did not attend
Left conference before this session

38. Please provide an overall rating for the first session using the scale provided.
Excellent
Average
Poor

39. Please indicate your satisfaction with this session.
Very
Satisfied

Satisfied

Neither Satisfied nor
Dissatisfied

Dissatisfied

Very
Dissatisfied

Not
Applicable

The speaker(s)
The applicability of the session to your research or
practice
The extent to which the session format allowed speakers
to share their work or experience
The extent to which the session format allowed for
audience engagement and/or discussion

40. Please select the title of the SECOND session you attended (if applicable) during the Thursday, January 10, 10:30 AM - 11:45 AM time-band from
the drop-down menu below.
Education Technology Meets Data Privacy
Going Beyond Impact: Opening the Black Box of Teacher Learning
Making Practitioner Voices Heard in Partnerships
Meta-Analysis in Education Research
Pathways to the Education Sciences Program Meeting
The Promise of Personalizing Learning to Meet All Students' Needs
Tricks of the Trade: Strategies for Research Planning and Implementation
We Are All EL Researchers
Why Researcher-Practitioner Partnerships Fail
Did not attend
Left conference before this session

41. Please provide an overall rating for the second session using the scale provided.
Excellent
Average
Poor

42. Please indicate your satisfaction with this session.
Very
Satisfied
The speaker(s)
The applicability of the session to your research or
practice
The extent to which the session format allowed speakers
to share their work or experience
The extent to which the session format allowed for
audience engagement and/or discussion

Satisfied

Neither Satisfied nor
Dissatisfied

Dissatisfied

Very
Dissatisfied

Not
Applicable

43. Thursday, January 10, 12:15 PM - 1:15 PM Lunch Meet-ups
Please select the Lunch Meet-up you attended from the drop down menu below.
Collaborating for Better English Learner Research and Development
Effective Teachers and Teaching
How Should We Evaluate Researcher-Practitioner Partnerships?
The IES Scientific Peer-Review Process: Overview and Common Myths and Misconceptions
Research and Education in Rural Settings
Did not attend
Left conference before the Lunch Meet-Up

44. Please provide an overall rating of the Lunch Meet-up you attended according to the scale below.
Excellent
Average
Poor

45. Please indicate your satisfaction with the Lunch Meet-up you attended.
Very
Satisfied

Satisfied

Neither Satisfied nor
Dissatisfied

The applicability of the Lunch Meet-up to your research
or practice
The extent to which the session format allowed speakers
to share their work or experience
The extent to which the session format allowed for
audience engagement and/or discussion

46. If you did not attend a Lunch Meet-up, please indicate why from the list below (select all that apply).
Preferred to get out of the hotel
Had a meeting
Preferred to have lunch with friends
Preferred to network in a less-structured environment
Needed some alone time
None of the meet-up topics interested me
Other

Dissatisfied

Very
Dissatisfied

Not
Applicable

47. Please indicate the title of the FIRST/ONLY session you attended during the Thursday, January 10, 1:30 PM - 3:00 PM time-band in the textbox
below. (If you attended more than one session during the time-band, an opportunity to rate the second session is provided below.)
Big Data Goes to School: The Role of Data Science in Programs, Research, and Decision-Making
College Completion Network: Increasing Success and Broad-Access Colleges and Universities
Cost Analyses and Integrating Costs into Efficacy Studies
Developing and Evaluating Adaptive Interventions in Education
Early Learning Research Network: Supporting Early Learning from Preschool through Early Elementary School Grades
Implementation Science Methods
Statistics and Methodology Software Demo
When Worlds Collide: The Science and the Reality of Behavior and Mental Health Screening in School
Did not attend
Left conference before this session

48. Please provide an overall rating for the first session using the scale provided.
Excellent
Average
Poor

49. Please indicate your satisfaction with this session.
Very
Satisfied

Satisfied

Neither Satisfied nor
Dissatisfied

Dissatisfied

Very
Dissatisfied

Not
Applicable

The speaker(s)
The applicability of the session to your research or
practice
The extent to which the session format allowed speakers
to share their work or experience
The extent to which the session format allowed for
audience engagement and/or discussion

50. Please indicate the title of the SECOND session (if applicable) you attended during the Thursday, January 10, 1:30 PM - 3:00 PM time-band in the
textbox below.
Big Data Goes to School: The Role of Data Science in Programs, Research, and Decision-Making
College Completion Network: Increasing Success and Broad-Access Colleges and Universities
Cost Analyses and Integrating Costs into Efficacy Studies
Developing and Evaluating Adaptive Interventions in Education
Early Learning Research Network: Supporting Early Learning from Preschool through Early Elementary School Grades
Implementation Science Methods
Statistics and Methodology Software Demo
When Worlds Collide: The Science and the Reality of Behavior and Mental Health Screening in School
Did not attend
Left conference before this session

51. Please provide an overall rating for the second session using the scale provided.
Excellent
Average
Poor

52. Please indicate your satisfaction with this session.
Very
Satisfied

Satisfied

Neither Satisfied nor
Dissatisfied

Dissatisfied

Very
Dissatisfied

Not
Applicable

Very
Dissatisfied

Not
Applicable

The speaker(s)
The applicability of the session to your research or
practice
The extent to which the session format allowed speakers
to share their work or experience
The extent to which the session format allowed for
audience engagement and/or discussion

53. Thursday, January 10, 3:15 PM - 4:15 PM Meet Your Program Officer: Office Hours and Topic Meetings
Please rate Meet Your Program Officer: Office Hours and Topic Meetings using the scale provided.
Excellent
Average
Poor
My program officer did not host office hours during this time
Did not attend
Left conference before this session

54. Please indicate your satisfaction with Meet Your Program Officer: Office Hours and Topic Meetings.
Very
Satisfied
The extent to which you could access your program
officer
The helpfulness of the discussion to your research
The format allowing for individual project updates and
questions
The timing of the session

(untitled)

THINKING AHEAD TO THE NEXT IES ANNUAL PI MEETING

Satisfied

Neither Satisfied nor
Dissatisfied

Dissatisfied

55. Please provide feedback on the items listed below to help inform the next IES Annual PI Meeting. For each of the questions, you may provide up to two
responses in the corresponding text boxes.
Suggestion 1

Suggestion 2

What did you like best about this year's meeting?
What topic(s) from this year's meeting would you like to
see again at the next PI Meeting?
What new topic(s) would you like to see included at the
next PI Meeting?
What suggestions do you have for improving the meeting
format or logistics?
What suggestions do you have for improving the
networking and engagement activities?

56. Please provide any additional comments/suggestions for how we can improve the PI Meeting in future.

PI MEETING PRESENTERS' FEEDBACK

57. If you were a presenter at the IES Annual PI Meeting, please rate your satisfaction for each of the following questions. If you were not a
presenter/speaker, please leave this section blank.
Very
Satisfied

Satisfied

Neither Satisfied nor
Dissatisfied

Dissatisfied

Very
Dissatisfied

Not
Applicable

The communication from IES prior to the meeting
The resources available at the meeting to support your
presentation

Thank You!

Thank you for taking this survey, we appreciate your feedback. If you have any questions about this survey, please contact the IES Planning Team at
IESHELP@manhattanstrategy.com.