Responses to OMB comments

From:                                         Abrams, Andrew

Sent:                                           Wednesday, July 13, 2011 3:51 PM

To:                                               Ingalls, Katrina

Subject:                                     RE: OMB comments on Equitable Distribution of Effective Teacher Aid study

Attachments:                          OMB response memo 7 13 (2).docx

 

Katrina,

 

Unfortunately the contractor is on vacation so I can’t confirm if pilot testing was conducted in fall 2010.  I agree with you that it’s safer just to say that it will be conducted 2 months after OMB approval is received.

 

Our plan was to see if the responses are acceptable and then submit the revisions, we’d hate to undertake that work and that not have a response be acceptable.  Please let me know if you have further questions.  Thanks, Andy

 

 

Andy – In the response to Question 6 B.4, Where in the supporting statement part A or B did you say that you conducted a pilot test of SEA instruments in the fall of 2010?  I may have overlooked it – but I only see reference to the pilots that you plan to do after OMB approval is received. How big was the pilot?  Hopefully not more than 9 respondents. I want to be very careful about sharing additional information with OMB that they are not asking.  Here they asked “When will pilot testing be completed?” I would just respond that you anticipate that pilot testing will be completed X number of months after OMB approval is received.  

 

Are you planning to see if the responses are acceptable and then submit the revisions – or do you want to make the changes to the documents and submit the changes along with the responses? If you want to make the changes and submit them with the responses, send them along and we will send them to Josh in the same email.

 

Thanks. Katrina

 

Katrina

 

 

 

 

Katrina,

 

Please see responses, attached.

 

 

Andy,

 

Here are the OMB comments. Please prepare your response (and any revisions to documents –such as SS Part A) and forward the revisions to me . I will get them to OMB right away.  Thanks.

 

Katrina

 

 

Good morning,

 

Our comments on this study are below. Apologize for the delay.

 

Thanks,

Josh

 

·         Telephone survey design – It looks like some of the questions ask for information that the interviewees may not have immediately available. Will a copy of the questionnaire be sent to the respondents in advance so that they can check their records before the interview?

·         The sample design – Could you elaborate on why the 75 leading-edge district sampling method is the best approach to get the desired information? Also, could you be clearer in the supporting statements that the results of this approach will not be generalizable? In particular, we suggest clarifying that the reports that will be prepared for policy officials to share the results of the study will include disclaimers that the results are not generalizable.

·         A.1, bottom of page – The first sentence of the last paragraph states that “Federal policymakers need to know whether the policies and programs they sponsor under these laws contribute to teacher quality for disadvantaged students,” but this survey is only designed to provide information regarding which policies are being used, not whether they are effective. Suggest revising this language to better reflect the survey design.

·         A.4 – Suggest providing more detail regarding how this study will coordinate with the Integrated Evaluation of ARRA Funding, Implementations, and Outcomes study.

·         B.4 – When will pilot testing will be completed?

·         Will any effort be made to collect cost data for EQ 4?

 

ICR #	Agency	Title	Type	Stat
201012-1875-001	ED/OPEPD	Equitable Distribution of Effective Teachers: State and Local Response to Federal Initiatives	ICR New	Yes

 

 

 

 

--

Josh Brammer
Office of Information and Regulatory Affairs
(202) 395-0710 | jbrammer@omb.eop.gov