1

**International Education and Foreign Language (IFLE) Summary of Public Comments**  **o n**  **Proposed Changes to the Survey of Post** 
**- Graduate Outcomes for International Education**  **Fellowship Recipients Following 60 Day Review Period** 

On July 12 , 2012, the Department o f Education (Department) published a Notice of Proposed In formation Collection Request (Notice) in the Federal Register inviting comments by September 10, 2012

. All comments addressed the Foreign Language and Area Studies (FLAS) F ellowship P rogram. No co mments were received regarding the Institute for International Public Policy program ( IIPP ). Five respondents submitted comments on behalf of approximately 1 6 grantees (i.e., multiple FLAS programs at the same institution submitted 1 set of comments ). Re spondent s commented on the need for clarity in the survey and requested directions regarding the administration of the survey . Two respondents commented on the burden of administering this survey

to their FLAS recipients due to the nature of their summer programs , and that the response rates tied to these particular students may be lower. A respondent comment ed that the overall projected response rate was high

. One respondent suggested an alternate approach to the selecting the cohort to be surveyed

. Sug gestions for minor changes are not discussed below, but in response to those suggestions, some clarifications and technical alterations have been made in the revised form and/or instructions. **Tracking Survey Comments:**  IF LE received comments stating the n eed for definitions of terms , and more clarity regarding the academic years in which FLAS fellows received their funding. Respondents also commented on the need for technical assistance regarding the use of Qaultrics. **Discussion:** After review of the comm ents received, IFLE agree d that that further clarity of definition s terms and academic ye ars is needed. IF LE also discussed th e ty pe s of technical assistance that can be provided to grantees regarding the survey and use of Qualtrics. **Action Taken by ED by ED**  **:** IF LE updated the survey

instrument to reflect more accuratel y and clearl y the academic ye ars that we are requesting information for. IFLE will also clarify terms. Technical Assistance will be providing via a w ebinar, to all FLAS Coordinator s . Part of the w ebinar will provide instructions regarding the use of Qualtrics. Qualtrics h elp d esk support will also be available to users. Additionally , IFLE staff will receive Qualtrics training so that they are able to provide assistance during the admini stration of the survey. **Comments:** One respondent commented on the project ed response rate for the survey . They stated that the response rate is unrealistically high and should be reconsidered based on past survey responses (2006 ED Survey

of Graduate Fel lowship programs

– 44.1%)

.2

**Discussion:** The response rates are estimated to be high due to IF LE’s experience with fellows submitting FLAS online academic and summer performance reports on an annual basis. Nearl y all fellows submit these reports during the course of their fellowship, with only a small number (2

- 3% ) not submitting

. Because all prospective survey participants will have a performance report history with the FLAS and IIPP programs , high participation rates are expected

. **Action Taken by ED:** IF LE has not changed the anticipated response rate for the reason listed above. If the response rate falls below the estimate d rate, IFLE will work with FLAS and IIPP Coordinators to determine why the response rate is low. If the response rate falls below 85%, IFLE, with information and feedback provided b y the FLA S and IIPP Coordinators, will do an analy sis of non - responders

. **Comments:** Two respondents commented on the burden of administering the survey to their FLAS recipients due to the nature of their s ummer programs, and the anticipated lower response rate tied to these ty pes of students

. Both stated that their summer language programs draw students from throughout the US, and that 6 weeks of language programming is insufficient to build a potential alumni tracking relationship with these students. Another potential issue expressed by the respondents is establishing “ownership” of some summer FLAS fellows atte nding summer intensive programs. It was stated that this may be difficult or impossible becau se some fellows may have multiple university

affiliations, making both the tracking of, and response rate of these fellows challenging. **Discussion** IF LE acknowledges that it will not be possible to track all students at all times, but we maintain that the survey

requirements do not place and unrealistic burden on FLAS and IIPP grantees. IF LE was proactive in making grantees aware of the tracking requirement during the FY 10

- 13 NRC/FLAS Director’ s Meeting, held in September 2010. We also provided information to the IIPP grantee through communication with them. IFLE i nformation sessions explained the legislative purpose , significance , and anticipated timing of the administration of the survey
. IF LE informed all grantees that the FLAS survey would begin wi th the Academic Y ear 2010

- 2011 grantees. **Action Taken by ED:** Due to the nature of the students and the information provided in the discussion, IFLE anticipates a high response rate. IFL E will provide further guidance to grantees during the webinar regarding the tracking of FLAS and IIPP fellows in the first cohort to be surveyed. **Comments:** One respondent offered an alternate approach to the selection of cohorts to survey . They recommended that IFLE survey all FLAS fellow s , regardless of graduation status, and that information be collected from graduates as earl y as 2008 and 2009, which would require surveying FLAS fellows, in some cases, who received a fellowship as far back as 2000.3

**Discussion:** Though IFLE applauds this suggestion, we think this would be burdensome on FLAS granting institutions. Since tracking graduates was not required until the FY 10

- 13 grant period, IFLE thinks it would be an undue and unexpected burden to ask FLAS granting institutions (some of which no longer hav e FLAS funding) to collect this data for submission to US/ED. **Action Taken by ED by ED :**  IF LE will collect data biannually as provided for in the legislation, starting with ye ar 2010 graduates.