Gateway faculty members will enter attendance data in Starfish during the first two days of class. 100% of faculty teaching Gateway courses will participate in the attendance alert process. Starfish Attendance Data Evaluate the scope of faculty participation. Students who have not logged-into online gateway sections within 48 hours of the course opening will be identified. 100% of students who have not logged-in within 48 hours will be flagged by Starfish. Starfish Alert Data Evaluate Starfish’s Flagging process. Students with first week attendance alerts will be contacted by gateway faculty. 100% of students who generate an attendance flag will be contacted by faculty via email within 24 hours of the flag. Starfish Contact Data Evaluate faculty participation and speed of interventions. Online students who do not log-in within 96 hours will be identified. 100% of students who have not logged-into Blackboard within 96 hours of course opening will be flagged by Starfish. Starfish and Blackboard Attendance Data Evaluate the communication between Starfish and Blackboard. Online students who have not logged into Blackboard within 96 hours will be contacted by phone. 100% of students who have not logged into Blackboard within 96 hours will be contacted by phone. Starfish Alert Data and notes from phone conversations. Evaluate the participation of the ASC staff and the feasibility of the follow-up process. Faculty, administrators, and relevant advisors will be informed of the results of the phone conversations. A summary of 100% of phone conversations will be into Starfish notes page. Starfish Student Notes Data Evaluate the “closing of the loop” process. Table 2: Formative Assessment Plan for the Cumulative Attendance Early Alert Process Attendance Early Alert Action Step Goals Target Measures Data Source Use of Results Gateway faculty members will enter attendance data in Starfish. 100% of faculty teaching Gateway courses will participate in the attendance alert process. Starfish Attendance Data Evaluate the scope of faculty participation.
Students with 4 cumulative absences will be identified. 100% of students with 4 absences will be flagged by Starfish. Starfish Alert Data Evaluate Starfish’s Flagging process. Students with attendance alerts will be contacted by faculty in a timely manner 100% of students who generate an attendance alert will be contacted by faculty with scripted email with 24 hours of the flag. Starfish Contact Data Evaluate faculty participation and speed of interventions. Students who miss 6 class meetings will be identified. 100% of students who generate an attendance alert will be flagged by Starfish. Starfish and Blackboard Attendance Data Evaluate the communication between Starfish and Blackboard. Students who generate a second attendance alert will receive a phone call from the Academic Success Center. 100% of students who generate a second attendance alert will be contacted by phone within 24 hours of the flag. Starfish Alert Data and notes from phone conversations. Evaluate the participation of the ASC staff and the feasibility of the follow-up process. Faculty, administrators, and relevant advisors will be informed of the results of the phone conversations. A summary of 100% of phone conversations will be into Starfish notes page. Starfish Student Notes Data Evaluate the “closing of the loop” process. Table 3: Summative Assessment Plan of the Attendance Early Alert Attendance Early Alert Goals Target Measures Data Source Use of Results Contacted Students will correct attendance issues after faculty contact email. 50% of students contacted by faculty will correct attendance issues and not generate the second flag. Starfish attendance and alert data Evaluate the impact of email intervention on attendance. 50% of students contacted by phone message will correct attendance issue and miss no more than 1 additional class or log into Blackboard. Notes from phone conversations and Starfish attendance data Evaluate the impact of phone conversations on attendance. Students who generate a cumulative attendance alert will successfully complete the class. Flagged students will successfully complete the Gateway courses at a rate equal to or greater than the institutional course average. Starfish alert data and institutional course pass rates. Evaluate the impact of the cumulative attendance alert on course attrition.
Students who generate a first-week attendance alert will successfully complete the class. Flagged students will successfully complete the Gateway courses at a rate equal to or greater than the institutional course average. Starfish alert data and institutional course pass rates. Evaluate the impact of the first-week attendance alert on course attrition. Assessment Plan for Academic Performance Early Alert Table 4. Formative Assessment Plan of the Academic Performance Early Alert Process Academic Performance Early Alert Action Step Goals Target Measures Data Source Use of Results Gateway faculty members will record grades in Blackboard Grade Center. 100% of faculty teaching Gateway courses will keep an updated working average column in the Blackboard Grade Center Starfish Data and Blackboard Grade Center Evaluate the scope of faculty participation. Students who fall below the alert criteria will be identified. 100% of students with averages below 75% in Blackboard will be flagged by Starfish. Starfish Alert Data and Blackboard Grade Center Evaluate Starfish’s Flagging process and communication with Blackboard. Students with academic performance alerts will be contacted by faculty in a timely manner. 100% of students who generate a low grade alert will be contacted by faculty with scripted email within 24 hours of the flag. Starfish Contact and Alert Data Evaluate faculty participation and speed of interventions. Students who do not seek academic support services will be contacted a second time. 100% of students who do not seek services within one week will be contacted by phone. Starfish Usage Data from the ASC. Evaluate the participation of the ASC staff. Faculty, administrators, and relevant advisors will be informed of the results of the phone conversations. A summary of the results of 100% of phone conversation will be entered into Starfish notes page. Starfish Student Notes Data Evaluate the “closing of the loop” process. Table 5: Summative Assessment Plan of the Attendance Early Alert
Academic Performance Early Alert Goals Target Measures Data Source Use of Results Contacted Students will promptly seek academic support services. 50% of students contacted by faculty will seek academic assistance within one week. Starfish contact data and ASC usage data. Evaluate the effectiveness of the electronic interventions. 50% of students contacted by phone message will seek services within one week. Notes from phone conversations and ASC usage data. Evaluate the impact of phone conversations on encouraging students to seek services. Students who generate an academic performance alert will successfully complete the course. Flagged students will successfully complete the Gateway courses at a rate equal to or greater than the institutional course average. Starfish alert data and institutional course pass rates. Evaluate the impact of the academic alert on course attrition. The number of flagged students who seek services will grow each semester. The number of flagged students seeking academic support services will grow by 3% annually. ASC usage data and Starfish alert data Evaluate the effectiveness of alert communication and logistics of ASC. Assessment Plan for At-Risk Early Alert Table 6. Formative Assessment Plan for At-Risk Early Alert Process At-Risk Early Alert Action Step Goals Target Measures Data Source Use of Results Students who meet the criteria for At-Risk will be identified. 100% of students who meet the At-Risk criteria will be identified by Starfish and/or the Coordinator of Testing. Starfish Data and Compass Data Evaluate the effectiveness and feasibility of the identification process. Students who are identified will meet initially with a designated At-Risk advisor. 90% of students who are identified will meet with the At-Risk advisor(s) prior to registration. Starfish Notes Data Evaluate the identification and advising process.
Students who are identified as At-Risk will develop a “Success Plan.” 100% of students who meet with an At-Risk advisor will develop and record a Success Plan in Starfish. Starfish Plan and Notes Data Evaluate quality of advising process. At-Risk students will be strongly encouraged to take Gateway sections with supplemental instructors. 50% of At-Risk students will enroll in a Gateway section with a supplemental instructor. Banner and Starfish Flag data Evaluate the scheduling and availability of supplemental instructors. At-Risk students will be followed during the semester. 100% of At-Risk students will meet with At-Risk advisor once during the semester. Starfish Flag Data and Notes Data Evaluate student participation/interest in follow-up meeting. Table 7. Summative Assessment Plan for At-Risk Early Alert At-Risk Early Alert Goals Target Measures Data Source Use of Results Academic struggles for students will be reduced. At-Risk students who are in sections with supplemental instructors will generate fewer academic performance alerts than their peers. Starfish Alert Data Evaluate the effectiveness of the supplemental instructor interventions. Retention for At-Risk Students will be increased. The semester and yearly retention rate for the At-Risk population will be equal to the rates of the overall student population. Starfish alert data and institutional retention data. Evaluate the impact of the At-Risk intervention process on student attrition. Assessment Plan for Academic Success Center Table 8: Formative Assessment Plan of Academic Success Center Academic Success Center Procedural Goals Target Measures Data Source Use of Results Students will visit the Academic Support Center for services. 30% of students in focus Gateway courses will participate in at least 1 academic support session. Starfish Usage Data Evaluate the marketing strategy and hours of operation of the ASC.
The Academic Support Center will recruit quality tutors. 100% of tutors will have a 3.0 GPA and completed a transfer level course in the respective subject with a B or higher. Tutor Application Data Evaluate tutor recruitment. The Academic Support Center will train tutors. 100% of tutors will attend tutor training and monthly tutoring professional development sessions. Tutor Training Data Evaluate participation in tutor training. Table 9: Summative Assessment Plan of Academic Success Center Academic Success Center Summative Goals Target Measures Data Source Use of Results Students who attend academic support sessions will benefit academically. Students receiving academic support services will successfully complete the Gateway course at a rate equal to or greater than the course average. Starfish usage data and institutional course pass rates. Evaluate the impact of academic support services on student success. Students who attend student skills sessions will benefit academically. Students attending a student skills session will successfully complete the Gateway course at a rate equal to a greater than the course average. Student skills attendance data and institutional course pass rates. Evaluate the impact of the first-week attendance alert on course attrition. Students will be satisfied with quality of support provided. The average student score for the survey question how satisfied are you with the academic support services will be a 3.25 on a 4 point scale. Student surveys at end of each session. Evaluate student perception of support sessions. APPENDIX A QEP Committee Meeting Wednesday, Aug. 17, 2011, at 8:30 a.m. Dr. Miller’s office (Student Success Center)