OLL K-12 INTERVIEW PROTOCOL—2007-2008
ONLINE APPLICATION DEVELOPER
This protocol is for use with developers. Ideally, you will have sixty minutes for this interview.
Introduction
The following is a suggested introduction. When you begin the interview, make these points, but use your own words for a more personal introduction.
You may know that we are working on a project sponsored by the U.S. Department of Education to look at characteristics associated with prevalent types of online learning and identify promising practices that are associated with improved student achievement. One of our priorities in this project is to learn more from you about the features and capabilities of your online offering, as well as how the application is implemented.
Before we start, I need to have you review and sign this consent form. [AFTER THE RESPONDENT REVIEWS CONSENT FORM] Do you have any questions before we get started?
Curriculum Design
Features of curriculum (subject matter / grade level, synch / asynch, pedagogical approach, strategies for maximizing student access, technologies used, hardware / bandwidth)
What is the goal of this online program? (curriculum goals, etc.)
Please describe the curriculum design features of this online program. (e.g., synchronous v asynchronous; technologies used)
What assumptions were made in the design of this online program? What did reality show in this regard?
What features of the curriculum are unique in this program, as compared with programs with similar educational intention? Why?
What success factors were considered in the design of this online program? Why?
If you were to redesign this online program, what features of the curriculum would you change? Why?
What means (e.g., forum, email, chat, voice chat, video conferences…) are used to support online interaction between facilitators, students, and/or facilitators and students? What are the facilitators and student responses to these forms of communication (do students like chatting, video, etc.)? What do you think is the right combination of these tools?
Type / frequency of interaction between facilitators, facilitators and students, among students
Please describe the type / frequency of interaction between facilitators, facilitators, and students, among students in this online program.
Does the program promote face-to-face interaction between facilitators, students, and/or facilitators and students? When? Why? Does it add value to the program? If there is no face-to-face interaction, why not? Is there any advantage or disadvantage to a purely online model?
If there is some kind of blending (online / onsite) from the interaction perspective, how is that mix? Does it add value to the program?
Curriculum Development Process
What is the structure of a typical curriculum module, or unit, of this online program? How many weeks does it take to a participant to study a typical module?
Please describe the main steps in the curriculum development process of a typical curriculum module. For each step, explain what roles are assumed by staff members, by consultants and by outsourcers. Also, provide a typical timeline for the curriculum development process
Does technology play an important role in the curriculum development process? Please explain which steps are technology mediated and the kind of tools used
If you had the opportunity to change the curriculum development process, what would you change and why?
Do you consider the curriculum development process followed in the creation of the online program to be cost-effective? Why?
Financing Model
How is new development of the following financed? Program areas, courses or content, tools/technologies, training materials.
What are the up front and ongoing costs of implementation for the developer (tech installation and maintenance, training and support, etc.) and the customer (stipends, release time, substitutes, instructor training, program coordination, matriculation fees)? Is the implementation usually paid for by the customer (district, school or individual), a grant, or other third party? If paid by LEA, from what budget(s)?
Can/does this program scale to reach all who need it? What are the challenges or barriers to sustainability and scalability?
Quality Assurances
Do you have a QA process or metric for assessing the quality of your curriculum? Pedagogy? Assessments? Please describe.
Do students and/or instructors fill out course evaluations? Please describe.
Is there a review process in place for rethinking course design based on performance and evaluation results? Please describe.
Do you have criteria and/or ways to assess the quality of instruction by instructors? Please describe.
How does your program evaluate students in terms of: participation, completion & retention rates, formative and/or final assessments, learning outcomes, transfer of learning to classroom instruction?
Instructor Recruitment and Pay
Please describe how instructors are selected.
Are instructors paid or otherwise compensated?
Are there specific knowledge, skills, and competencies that candidate instructors must have to be selected?
Please describe the content, length and structure of the training instructors receive.
How many instructors, facilitators, moderators, and other staff conduct a typical course? What kind of interaction is promoted between instructors (formal / informal, periodic every?) Please describe.
Enrollment Process and Policies
Who is eligible for this online program? Why were these criteria defined? Please describe any eligibility requirements associated with participation
What dissemination strategies were considered in the design of the program?
How do students enroll in the online program? Do students decide to enroll themselves or are they selected or nominated? Do students enroll as individuals, in teams, or either?
What type of students was the online program designed for? Which design or implementation principles, if any, take into consideration the demographic users of the program?
What is the maximum number of students per section in this online program? What is the recommended instructor: student ratio? What is the minimum number of students required for running the online course successfully?
User Services and Support
What academic support services were designed specially for this online program? (e.g., program orientation, time management, online technology support, on the Web FAQ, virtual study groups, online facilitation, peer mentoring, peer coaching, etc).
What types of technical support were designed for this online program? Who / How were these services to be provided? If you had to redesign these services, what would you change?
Are there support services for online facilitators or for program administrators?
Facilitators/Barriers
What barriers / facilitators of teachers’ participation were considered in the design of the online program?
Is access to technology and / or technology fluency by participating teachers considered a facilitator or a barrier in the implementation of this online program? Why?
Are there time requirements (e.g., X number of hours per week), interaction requirements (e.g., online / onsite synchronous activities), technology requirements (e.g., the use of X browser o software) for effective participation in the online program? Which requirements facilitate the process and which become barriers for participation?
What is the most significant barrier for participation in this program? What could be done in order to overcome it?
Does the program promote / give support to virtual study groups, online learning communities or other networking strategies for overcoming participation barriers from the part of participants?
What role do online tutors / facilitators play concerning barriers for student participation?
What barriers may have online tutors in their facilitation role? Comment on situational, technological, pedagogical, or other types of barriers for facilitating online learning by the students.
Strengths and Weaknesses
What are the expected gains, if any, of taking this online program for students? Of facilitating in this program for instructors? Of offering the online for the site? What kind of changes / gains in student learning do you expect to see with this online program?
When this program was designed, what challenges were foreseen implementing this online program for the site(s), the instructor(s), the students? Why?
Besides the use of online technologies, what are major differences between this online program and similar face-to-face courses? Major similarities?
Instructor Background and Characteristics
Was this online TDP designed for students and facilitators with another day job? Does this matter in this program? Why?
What is the ideal expertise / knowledge an instructor should have to teach this online program? What are the minimal requirements for an instructor?
How much preparation / time should an instructor spend preparing for this online program? How much time does an instructor spend weekly on online program delivery / interaction with students?
What do you think are the characteristics of a good online instructor?
Closing
Is there anything else you would like to add about your applications design and / or implementation?
Before you leave, be sure to ask for information to identify one typical site and one exemplary site where the offering has been implemented. Also be sure to ask for any available data on student outcomes / achievement.
| File Type | application/msword |
| File Modified | 0000-00-00 |
| File Created | 0000-00-00 |