1

International Education and Foreign Language (IFLE) Summary of Public Comments on

Proposed Changes to the Survey of Post-Graduate Outcomes for International Education 

Fellowship Recipients

Following 60 Day Review Period

On July 12, 2012, the Department of Education (Department) published a Notice of Proposed 

Information Collection Request (Notice) in the Federal Register inviting comments by

September 10, 2012. All comments addressed the Foreign Language and Area Studies (FLAS) 

Fellowship Program. No comments were received regarding the Institute for International Public 

Policy program (IIPP). Five respondents submitted comments on behalf of approximately 16 

grantees (i.e., multiple FLAS programs at the same institution submitted 1 set of comments). 

Respondents commented on the need for clarity in the survey and requested directions regarding 

the administration of the survey. Two respondents commented on the burden of administering 

this survey to their FLAS recipients due to the nature of their summer programs, and that the 

response rates tied to these particular students may be lower. A respondent commented that the

overall projected response rate was high. One respondent suggested an alternate approach to the 

selecting the cohort to be surveyed. Suggestions for minor changes are not discussed below, but 

in response to those suggestions, some clarifications and technical alterations have been made in 

the revised form and/or instructions.

Tracking Survey

Comments:

IFLE received comments stating the need for definitions of terms, and more clarity regarding the 

academic years in which FLAS fellows received their funding. Respondents also commented on 

the need for technical assistance regarding the use of Qaultrics.

Discussion:

After review of the comments received, IFLE agreed that that further clarity of definitions terms 

and academic years is needed. IFLE also discussed the types of technical assistance that can be 

provided to grantees regarding the survey and use of Qualtrics. 

Action Taken by ED by ED:

IFLE updated the survey instrument to reflect more accurately and clearly the academic years 

that we are requesting information for. IFLE will also clarify terms. Technical Assistance will 

be providing via a webinar, to all FLAS Coordinators. Part of the webinar will provide 

instructions regarding the use of Qualtrics. Qualtrics help desk support will also be available to 

users. Additionally, IFLE staff will receive Qualtrics training so that they are able to provide 

assistance during the administration of the survey.

Comments:

One respondent commented on the projected response rate for the survey. They stated that the 

response rate is unrealistically high and should be reconsidered based on past survey responses 

(2006 ED Survey of Graduate Fellowship programs – 44.1%).
2

Discussion:

The response rates are estimated to be high due to IFLE’s experience with fellows submitting 

FLAS online academic and summer performance reports on an annual basis. Nearly all fellows 

submit these reports during the course of their fellowship, with only a small number (2-3%) not 

submitting. Because all prospective survey participants will have a performance report history

with the FLAS and IIPP programs, high participation rates are expected.

Action Taken by ED:

IFLE has not changed the anticipated response rate for the reason listed above. If the response 

rate falls below the estimated rate, IFLE will work with FLAS and IIPP Coordinators to 

determine why the response rate is low. If the response rate falls below 85%, IFLE, with 

information and feedback provided by the FLAS and IIPP Coordinators, will do an analysis of 

non-responders.

Comments:

Two respondents commented on the burden of administering the survey to their FLAS recipients 

due to the nature of their summer programs, and the anticipated lower response rate tied to these 

types of students. Both stated that their summer language programs draw students from 

throughout the US, and that 6 weeks of language programming is insufficient to build a potential

alumni tracking relationship with these students. Another potential issue expressed by the 

respondents is establishing “ownership” of some summer FLAS fellows attending summer 

intensive programs. It was stated that this may be difficult or impossible because some fellows 

may have multiple university affiliations, making both the tracking of, and response rate of these 

fellows challenging.

Discussion

IFLE acknowledges that it will not be possible to track all students at all times, but we maintain 

that the survey requirements do not place and unrealistic burden on FLAS and IIPP grantees. 

IFLE was proactive in making grantees aware of the tracking requirement during the FY 10-13 

NRC/FLAS Director’s Meeting, held in September 2010. We also provided information to the 

IIPP grantee through communication with them. IFLE information sessions explained the 

legislative purpose, significance, and anticipated timing of the administration of the survey. 

IFLE informed all grantees that the FLAS survey would begin with the Academic Year 2010-

2011 grantees. 

Action Taken by ED:

Due to the nature of the students and the information provided in the discussion, IFLE anticipates 

a high response rate. IFLE will provide further guidance to grantees during the webinar 

regarding the tracking of FLAS and IIPP fellows in the first cohort to be surveyed.

Comments:

One respondent offered an alternate approach to the selection of cohorts to survey. They

recommended that IFLE survey all FLAS fellows, regardless of graduation status, and that 

information be collected from graduates as early as 2008 and 2009, which would require 

surveying FLAS fellows, in some cases, who received a fellowship as far back as 2000. 
3

Discussion:

Though IFLE applauds this suggestion, we think this would be burdensome on FLAS granting 

institutions. Since tracking graduates was not required until the FY 10-13 grant period, IFLE 

thinks it would be an undue and unexpected burden to ask FLAS granting institutions (some of 

which no longer have FLAS funding) to collect this data for submission to US/ED. 

Action Taken by ED by ED:

IFLE will collect data biannually as provided for in the legislation, starting with year 2010 

graduates.