Source: http://www.google.com/patents/US6652287?dq=%22robert+sheehan%22
Timestamp: 2016-06-27 09:25:48
Document Index: 261238790

Matched Legal Cases: ['art 186', 'art 203', 'art 234', 'art 244', 'art 246', 'art 248', 'art 250', 'art 252', 'art 254', 'art 244', 'art 246', 'art 250', 'art 252', 'art 254', 'art 252', 'art 272', 'art 272', 'art 304', 'art 306', 'art 308']

Patent US6652287 - Administrator and instructor course management application for an online ... - Google PatentsSearch Images Maps Play YouTube News Gmail Drive More »Sign inPatentsA system and method for permitting an administrator or faculty member in an online education course to monitor and manage faculty and student activity is provided. The system includes a computer network having an administrator and instructor course management application tool for generating administrator...http://www.google.com/patents/US6652287?utm_source=gb-gplus-sharePatent US6652287 - Administrator and instructor course management application for an online education courseAdvanced Patent SearchPublication numberUS6652287 B1Publication typeGrantApplication numberUS 09/746,592Publication dateNov 25, 2003Filing dateDec 21, 2000Priority dateDec 21, 2000Fee statusPaidPublication number09746592, 746592, US 6652287 B1, US 6652287B1, US-B1-6652287, US6652287 B1, US6652287B1InventorsHenry B. Strub, Stepanie B. Woodson, Joshua D. Barr, Alan S. DrimmerOriginal AssigneeUnext.ComExport CitationBiBTeX, EndNote, RefManPatent Citations (29), Non-Patent Citations (24), Referenced by (111), Classifications (10), Legal Events (11) External Links: USPTO, USPTO Assignment, EspacenetAdministrator and instructor course management application for an online education course
US 6652287 B1Abstract
A system and method for permitting an administrator or faculty member in an online education course to monitor and manage faculty and student activity is provided. The system includes a computer network having an administrator and instructor course management application tool for generating administrator and instructor interfaces displaying student or faculty information and facilitating an instructor's ability to manage student activities, as well as facilitating administrator management and review of both students and faculty. The method includes automatically recording student and faculty access to online educational course resources and tasks, and presenting a plurality of interactive student and faculty management selections to administrators and faculty in response to queries for student and faculty information.
We claim: 1. A method of monitoring and managing student activities in an online educational course, the method comprising:
receiving a completed student assignment in electronic form; associating the completed student assignment with an instructor and storing the completed student assignment in a database; and generating a grade book for the instructor, wherein generating the gradebook comprises: displaying grade information for each of a plurality of students in a course section taught by the instructor, wherein the grade book comprises student identification information, grade information for any graded student assignment, and an automated link to any completed student assignment that is ungraded; and displaying a visual time indicator for each completed student assignment that is ungraded, wherein the visual time indicator represents an elapsed time from a time each ungraded completed student assignment was received. 2. The method of claim 1, wherein displaying the visual time indicator further comprises increasing a size of the visual time indicator as the elapsed time increases.
3. The method of claim 1, wherein generating a grade book for an instructor comprising displaying the grade information in graphical format, wherein one of a predetermined set of graphical elements, each of the graphical elements representing a particular student performance level, is displayed for each graded student assignment.
4. The method of claim 3, further comprising displaying student activity completion indicia adjacent the graphical elements representing student performance level for graded assignments.
5. The method of claim 1, wherein the visual time indicator comprises a graphical visual time indicator.
6. The method of claim 1, further comprising generating a time stamp at the database upon receipt of the student assignment.
7. The method of claim 6, wherein the elapsed time further comprises comparing the time stamp to a time the instructor logs onto a network.
8. The method of claim 1, further comprising receiving an assignment submission form associated with the completed student assignment.
9. The method of claim 8, wherein the assignment submission form comprises a name of the student, a course name, a section identifier and a task identifier.
10. The method of claim 1, wherein a visibility of the visual time indicator changes to indicate greater urgency as more time elapses.
11. The method of claim 1, wherein displaying the visual time indicator comprises changing a size of the visual time indicator after predetermined time increments.
12. The method of claim 1, further comprising updating the visual time indicator each time the instructor logs onto a network.
13. A method of monitoring and managing student activities in an online educational course, the method comprising:
receiving a completed student assignment in electronic form; associating the completed student assignment with an instructor and storing the completed student assignment in a database; generating a grade book for the instructor by displaying grade information for each of a plurality of students in a course section taught by the instructor, wherein the grade book comprises student identification information, grade information for any graded student assignment, and an automated link to any completed student assignment that is ungraded; and presenting an instructor with an assignment grading template in response to receipt of a request via the automated link to an ungraded completed student assignment for a particular student, the assignment grading template providing an automated link to any previously graded student assignment for the particular student, the assignment grading template further comprising an instructor comment section configured to receive instructor comments regarding the completed student assignment. Description
1. “Virtual University,” U.S. application Ser. No. 09/344,732, filed Jun. 25, 1999, now abandoned.
2. “Online Collaborative Apprenticeship,” U.S. application Ser. No. 09/344,659, filed Jun. 25, 1999, now U.S. Pat. No. 6,301,462.
3. “Online Virtual Campus,” U.S. application Ser. No. 09/344,754, filed Jun. 25, 1999, now U.S. Pat. No. 6,347,333.
This invention relates to a software learning engine offered online via a network of multimedia nodes. More particularly, this invention relates to an administrator and instructor course management application for managing and monitoring student and instructor activity in an online educational course.
Traditional campus-based universities are often limited in the number of learners they can reach by limitations in their physical resources. Classroom and campus constraints generally dictate a relatively small consumer base embodied as learners.
In addition, fixed schedules, a passive learning approach and a relatively lengthy academic school year have resulted in the limited education models known today based on utilizing a physical campus with one teacher and many learners. One limitation of the prevailing education model is that it is only available to people, such as younger students during the first stages of their lives, who can dedicate the majority of their time to exclusively studying and attending classes.
There is a need for an educational forum that provides interactive lessons asynchronously such that a learner can participate in a lesson using an on-demand schedule and also reap the benefits of an interactive learning environment. Such an educational forum should provide for access to large numbers of students that may be geographically dispersed while offering all students the guidance, feedback and access to resources generally available to traditional campus-based students. There is also a need for instructor tools in such an interactive environment to permit instructors to effectively monitor and manage students. Additionally, there is a need for administrator tools in this interactive environment to facilitate monitoring of instructors and the online educational forum as a whole.
FIG. 1 illustrates a computer network according to a preferred embodiment.
FIG. 2 is illustrates types of data and applications preferably stored in the server side of the computer network of FIG. 1.
FIG. 3 shows a student graphic user interface for a preferred online educational course operative on the computer network of FIG. 1.
FIG. 4 is a flow diagram of a method of providing administrators and instructors information on students using instructor tool applications.
FIG. 5 is an online instructor grade book interface generated by an administrator and instructor tool application according to a preferred embodiment.
FIG. 6A is an online instructor grade book interface generated by an administrator and instructor tool application according to a second preferred embodiment.
FIG. 6B illustrates a graphical grading scale for use in the online grade book of FIGS. 5 and 6A.
FIG. 6C illustrates an alternative graphical grading scale, for use in the online grade book of FIGS. 5 and 6A.
FIG. 7 is an instructor grade submission template suitable for use with the grade book of FIGS. 5 and 6.
FIG. 8 is a student view of the grade book of FIGS. 5 and 6.
FIG. 9 is a discussion thread rating interface according to a preferred embodiment.
FIG. 10 illustrates a dashboard view containing multiple graphical views of information related to a particular student in an online educational course according to a preferred embodiment.
FIG. 11 illustrates a dashboard view containing multiple graphical views of information related to students in an entire course section in an online educational course according to a preferred embodiment.
FIG. 12 is an instructor administration screen illustrating instructor performance information.
FIG. 13 is an administrator dashboard view summarizing overall academic performance in an online educational environment.
FIG. 14 is an online educational system program selection screen.
FIG. 15 is an online educational system course selection screen.
FIG. 16 is an interactive chart illustrating completion rates of students by section in an online educational system.
FIG. 17 is an online educational system faculty selection screen.
FIG. 18 is a faculty data screen for a faculty member selected through the faculty selection screen of FIG. 17.
FIG. 19 is a continuation of the faculty data screen of FIG. 18 that illustrates faculty performance metrics for the selected faculty member.
In order to enhance an online educational experience and provide for effective and efficient student management by online faculty members, a system and method for providing faculty member tools in an online educational environment is described below. Furthermore, administrator tools and functionality are disclosed that permit the monitoring and assisting of faculty, as well as aiding management of the overall online educational environment. In order to provide an example of an appropriate environment within which preferred embodiments of the online faculty member and administrator tools may be described, an example of one suitable network and course structure is now described.
Referring to FIG. 1, a preferred online educational network 10 is shown. The network 10 includes a server side 12 and a plurality of user computers 14. Each of the user computers 14 includes a processor, memory, a user input device such as a keyboard and/or mouse, a user output device such as a video display and may include other user output devices such as printers. The user computers 14 may be directly connected to an Internet Service Provider (ISP) 15 via a modem or other communication device. The user computers 14, via an ISP 15 or other communication device, may communicate with the server side 12 of the network 10 over the public switched telephone network (PSTN) 17. Alternatively, one or more user computers 14 may be connected to the internet via a server already operating on an internet backbone. Any of a number of commonly available communications means may be used by user computers to communicate with the internet.
The server side 12 of the network 10 communicates with the various users 14 through routers 16 and switches 18 that direct queries through a firewall 20 protecting the server side 12 from unauthorized access. Suitable routers and switches are Cisco 75xx routers and Cisco 55xx switches available from Cisco Systems, Inc. The user computers may interact with the server side 12 as if the server side 12 was a single entity in the network 10. The server side 12 of the network 10 may include a central server device or may include multiple processing and database sub-networks, such as cooperative or redundant processing and/or database servers that can be geographically dispersed throughout the network 10. In some implementations, groups of user computers 14 may communicate with the server side 12 through a local server 22. The local server 22 may be a proxy server or a caching server.
The server side 12 of the network 10 preferably includes one or more databases storing online course programming course materials. A large variety of course materials may be stored in the databases at the server side 12. For example, text, audio, video, graphics, animations, and illustrations may be included in the materials utilized in the particular online course that a student may use for online testing and assessment. A student may access the server side 12 of the network 10 using software residing and executed at the user's computer. The user software may include a generic Hypertext Markup Language (HTML) browser, such as Netscape Navigator, Microsoft Internet Explorer, or other commonly available Internet web browsers. In order to interpret the various multimedia materials utilized in an online educational course maintained on the server side 12, the user computers implement the browser software to interpret HTML and JavaScript commands and also preferably use standard browser plug-in, such as QuickTime and other commonly available audio and video data interpretation software. Although standard Internet connections using browsers that understand HTML, JavaScript and other standard Internet programs is preferred, the user software may also be a proprietary browser and/or other host access software.
Referring to the server side 12 of the network 10, a plurality of individual servers 24 may be connected together via an Ethernet connection via a local area network 25 such as a 100 Mbps VLAN. Mass storage devices, such as mass storage device 26, may be in communication with one or more of the servers 24 via a hub. Databases stored in the mass storage devices 26 may include an Enterprise Resource Planning (ERP) database, a Customer Relationship Management (CRM) database, and a user profile database. The ERP database preferably includes customer and billing information and standard payroll and accounting information relevant to the online educational system. The CRM database may be a standard CRM database such as those supported by Oracle Corporation of Redwood Shores, Calif.
In one embodiment, an online course is preferably stored on the server side 12 as a collection of HTML templates programmed to retrieve content information from the mass storage device 26 when a user computer 14 accesses a particular page in the online course. In one preferred embodiment, the servers 24 may contain online courses programmed using a customizable database format such as the database format and programming language available from BroadVision, Inc. of Redwood City, Calif. Suitable servers 24 may be E250, E450, and other servers available from Sun Microsystems, Inc. of Palo Alto, Calif. The mass storage device 26 may be one or more hard disk drive storage devices such as an EMC Symmetrix device available from EMC Corporation of Hopkinton, Massachusetts.
The user computers 14 may be operated by students taking online courses, adjunct faculty members (hereinafter instructors) leading the online courses, advisory faculty members overseeing the performance of a group of instructors, or administrators overseeing the online courses and educational environment as a whole. Each of the respective types of users preferably accesses information in the server side 12 of the network 10 through use of user identification and password prompts over the Internet. In one embodiment, all of the types of users may access the educational information and services through a standard Internet web page interfaces. Utilizing the above-described structure, students preferably sign up for and take online educational courses with other remotely located class mates who are typically grouped together in course sections based on course starting date so that, while each student may proceed at his or her own pace, the students may interact and provide some assistance to each other in a group learning environment.
In a preferred embodiment, the course structure for online courses residing on the server side 12 of the network 10 is a problem-based learning structure adapted for the online environment. The problem-based learning organization of the course materials is designed so that student learning is driven by learning outcomes linked to authentic projects or problems. Students learn on problems having real world relevance using a learning-by-doing approach. The “virtual university” embodied in the server side 12 of the network 10 provides this type of learning experience by combining the resources of traditional learning institutions (e.g., universities), that generally provide courses over a long period of time, with the techniques used in training courses, typically more intense, short courses directed towards a particular skill or technique. Combining a computerized communication network and courses embodied in software in the network allows coursework to be accomplished through asynchronous learning. Asynchronous learning allows a student to access educational material at a time convenient to the student while avoiding scheduling conflicts inherent in traditional learning institutions.
The preferred type of courses resulting from the blending of these two approaches, along with the problem-based learning technique, are course suites providing a learning experience, and containing material, not typically available in any one place. As shown in FIG. 2, the server side 12 of the network 10 contains a course database 40 where each course suite 42 resides. Each course suite may comprise multiple separate courses 44 that cumulatively provide the substance and experience of an entire university level course, but in discreet logical pieces more suitable for the online environment. In one embodiment, the courses 44 consist of templates 45 created in HTML format using an HTML generator such as Dreamweaver available from Macromedia, Inc. of San Francisco, Calif. One or more templates represent the instructions necessary to build each page of the course 44 requested by a student. The templates 45 may include executable software, such as JavaScript commands, and include references to the course content data 47, stored in mass storage 26 on the server side 12, necessary to populate the HTML templates. Standard business logic programmed in Java or any of a number of commonly available languages may be used to provide an interface between any disparate platforms maintaining data on the server side 12 using standard common object request broker architecture (CORBA).
Students logging on to the Internet from their respective user computers 14 to access their particular course 44 will provide identification information, such as a user ID and password, to access the course that he or she has registered in. If this is the first time a student has accessed or attempted to register for a course, the student will be prompted for appropriate biographical and financial information. Once the student has registered for a course, an appropriate one of the variety of courses 44 and course suites 42 stored on the server side 12 of the network 10 are accessed by software code operative on the servers 24 to present the appropriate course and materials to the student.
Referring to FIG. 2, each student provides biographical data 28 to the server side 12 when they register for a course. Biographical data includes name, email address, physical address, telephone information, company, and position (if employed). Because the online educational services offered in the network 10 may be accessed by numerous students worldwide, other information such as time zone and native language may also be recorded. This information on biographic data is preferably stored in a database on the mass storage device 26.
In addition to biographical data, the server side 12 of the network 10 also stores and tracks student information relating directly to the coursework and related activities of each student. This course-related student information 30 includes student status (whether the student is active/inactive), the date the particular course began, information as to previous courses the student has taken, and the personal schedule of a student as it relates to the availability of the student to access the online educational environment on a timely basis. The course-related student information stored in the server side 12 also includes information such as whether the student has received the necessary books for the course, whether evaluations for instructors or assignments have been completed, the number of complaints logged by the student in the present or previous courses, and similar administrative student information. Each time a student accesses the online course materials and resources, a record of the student's access, also referred to as the clickstream, is recorded. The student clickstream record may include time, date, duration and type of accessed resource data. Other information stored in mass storage 26 includes instructor information 49 and course email and threaded discussion information 51.
An example of a student graphic user interface 48 for one preferred embodiment of an online educational course is shown in FIG. 3. The student user interface is preferably visible to students on user computers 14 and is operative to present student specific course information. In the example of FIG. 3, a student's web browser displays information retrieved from the server side 12 of the network 10 relating to a financial accounting course. Information is preferably transmitted in data packet formats that may, in one embodiment, conform to the transmission control protocol/Internet protocol (TCP/IP). In a TCP/IP implementation, a packet network terminal server in the server side 12 is assigned a unique Internet protocol (IP) network address. TCP/IP switching equipment within the network can direct a TCP/IP packet to an intended recipient based on the packets' destination IP address. Other implementations may use other networking protocols and packet formats.
As mentioned above, the information passed to the user computer 14 is preferably assembled from a collection of HTML templates stored on one or more servers operating database software such as BroadVision database software. Information and data for the particular course page represented by the HTML template is drawn from the mass storage device. The resulting stream of information, generated by populating the HTML template in the server side of the network with the data required by the template, is sent to the user computer. The browser software interprets the HTML commands received to arrange the accompanying course data so that the student sees a screen such as shown in FIG. 3 on her user computer.
Additionally, each time a student logs on to the online educational service, the server side 12 of the network 10 records the student's presence. All of the student's subsequent activities are also recorded and catalogued by the databases residing on the server side 12 so that a complete picture of the student's activities is recorded. Each student's activities may be recorded based on the student's login information or other mechanisms, such as cookies, such that every selection and activity by the student is recorded. Referring again to FIG. 3, the interface 48 displayed on a user computer display to a student taking a course provides access to multiple resources. In one embodiment, the interface 48 may consist of a course resource navigation bar 50, an upper navigation bar 52, and an information display region 54. The image displayed in the display region 54 to the student who selects the course guide link 56 shows an image of the portions of the selected course.
When the user selects the course guide link 56, the user triggers a query for information located at an address identified by, for example, a Universal Resource Locator (URL) containing an address in hypertext transfer protocol (HTTP) associated with the course information in the servers on the server side 12 of the network 10. Information at the address is then retrieved, assembled and sent to the user computer 14 for presentation in the display region 54. Each of the links in the course resource navigation bar 50 on the interface 48 sends a request for information to the server side of the network and causes information to be retrieved. Examples of materials that a student may access include introductory materials such as the course guide 56, project information including a list of project tasks 58 that the student is required to complete in order to complete the course, resources and tools 60 related to the task presented to the student in the course, and numerous research modules 62 that summarize key points of knowledge that a student will need to know to complete the tasks. The research modules may provide background information on various topics, practice exercises and links to multimedia (video, audio, etc.) explanations of methods and terminology.
Students taking online courses may also link to, in a preferred embodiment, course discussion threads. The course discussion thread is preferably an online bulletin board maintained in the server side 12 of the network and accessible only to students of a particular course section and their instructor. Course discussion threads are focused on questions and issues directly related to the course. Both students and instructors may post messages to the course discussion thread. The course discussion thread may be accessed through a top navigation bar 52 that provides a discussion link 64. In one embodiment, the course discussion thread is maintained in one or more servers on the server side 12 of the network utilizing Lotus Domino software. Other links, such as a library resources link 66, a student home link 68, and a technical support link 70 are accessible on the upper navigation bar 52.
According to a preferred embodiment, an administrator and instructor tool application 80 (FIG. 2) provides authorized administrators and instructors (who may be advisory faculty or general instructors) for the online educational network 10 with the ability to manage and monitor student activity. In the following discussion, examples of instructor-level functionality are first discussed. Preferably, all authorized users, other than students, have access to instructor-level functionality. In the embodiment described below, an instructor is identified as utilizing certain functionality. Advisory faculty and administrators for the online educational network also have access to all of the instructor-level functionality. Each of the instructors, advisory faculty, and administrators is identified by the online educational network through her respective logon and password information. Any of a number of known authentication and security techniques may be used for this purpose. In one embodiment, the user interface may display a complete set of information and functionality access mechanisms to all users and deny access to users on a request-by-request basis. In another embodiment, the user interface may be tailored to display only those information and functionality access mechanisms appropriate to that particular user. Although the embodiment described below provides a hierarchy where instructors have a first level of access, advisory faculty have a second level of access that includes the first level, and administrators have the highest level of access (including everything available at the first and second levels), other embodiments may provide additional layers of information and functionality access, or access to various pieces within a certain level.
Referring to FIG. 4, an instructor provides logon information, for example a user ID and a password, to the server side 12 through a user computer 14 (at 82). The server side 12 authenticates the instructor's information (at 84) and will receive and act on a student information query (at 86) if the instructor is an authorized instructor registered with the online education network. In response to the instructor query, the server side accesses the administrator and instructor tools 80 and transmits student management tool selections to the instructor (at 88). When an administrator and instructor tool selection is made by the instructor, the appropriate student information is retrieved for the instructor from the student biographical information database 28, course related student information database 30, and any other databases maintaining student information. Preferably, the instructor only is permitted access to student information for students in her course sections. Specific types of information and instructor tools are described in greater detail below. The functionality of each of the administrator and instructor tools 80 available on the server side 12 of the network may be implemented in software code operative to retrieve and populate HTML templates with requested data in the same fashion as described above with respect to student access of the online educational courses 44.
Referring to FIG. 5, an embodiment of one interactive instructor tool, specifically a grade book screen 100 provides instructors for the online educational courses current information on grades assigned to students in their section for various tasks required of the course. As described above, only students assigned to a particular instructor are accessible by the instructor. If an instructor is teaching more than one section of a course, the instructor may provide information to indicate which section she is interested in and receive displayed information for that particular section. As shown in FIG. 5, an embodiment of an online grade book includes a listing of student names 102 in a table format associated with grade entries 104 for those tasks graded and previously posted. Although the embodiment of FIG. 5 indicates letter grades assigned to each graded project, other grading scales may be implemented.
Students preferably submit completed tasks in an electronic format, for example via email, to the instructor so that a database in the server side 12 of the network 10 may then store the assignment and create a link to its location for the instructor the next time the instructor accesses the grade book. In one embodiment, students may attach a completed assignment to an assignment inbox via a student grade book view screen displayed on the student computer. The student view 131 of the grade book, as shown in FIG. 8, provides a view of the grade 133 assigned for each assignment 135 submitted, along with the date submitted 137 and date graded 139. The student sees a submit button 141 for each assignment remaining. Each submit button 141 preferably automatically links the student to an assignment submission form pre-populated with relevant information such as student name, course name, section identifier and task identifier. The assignment attached to the assignment submission form is routed to a database, such as a CRM database as described above, when the student submits the completed assignment. A time stamp is automatically generated at the database upon receipt of the assignment. Additionally, the data on the prepopulated form may be used to cross-reference the assignment to the section, course, instructor and other parameters for later retrieval and use.
Referring to the embodiment of FIG. 6A, an alternate grade book display format 120 is illustrated with a grade scale made up of non-traditional letter indicators 122, such as M, P, I and N (for Mastery, Passing, Needs Improvement and Incomplete, respectively). In addition to the letter grade, the grade book display may include an assignment attempt indicator 124 denoting a student's first attempt at a homework assignment with a single indicator marker and a second attempt at a homework attempt with multiple markers. Alternate embodiments of graphical grade indicators 127, 129 are illustrated in FIGS. 6B and 6C.
In order to assist instructors in prioritizing which student assignments require attention, the grade book administrator and instructor tool preferably generates an elapsed time indicator 126 indicating the time elapsed from when each student submitted a homework assignment. This elapsed time may be generated by the instructor grade book tool on the server side of the network 10 by comparing the time stamp of the received homework to the time that the instructor logs on to the network. As shown in FIG. 6A, the elapsed time markers 126 may include text and/or graphics. Preferably, the visibility of the marker 126 changes to indicate greater urgency as more time elapses. The change in the marker 126 may be implemented as an increased size, a pixel blinking mechanism, or other visual indicator. Additionally, the markers 126 may be set to change size or other features after predetermined time increments. The instructor grade book tool updates the elapsed time markers displayed to an instructor each time the instructor logs on to the network, or in an alternative environment, may be automatically refreshed through instructing the instructor's browser software to automatically refresh the link. Similar to grade button 109 shown in the embodiment of FIG. 5, the display 120 of FIG. 6A provides a visible, ungraded student assignment link 128 allowing the instructor ready access to a particular student's ungraded assignment. Preferably, the instructor grade book display incorporates redundant perceptual queues, such as combinations of shape, color, blinking features or icon movement, etc., to enhance administrator or instructor comprehension of grade related information.
When an instructor views the grade book display screen and decides on a student assignment to grade, the instructor clicks on the button or other indicator to retrieve the student's assignment from the database side of the network. The instructor may download an assignment to view immediately, or the instructor may download and print the assignment to grade at a later time. As shown in FIG. 7, the link selected by the instructor provides the instructor with a grade submission template 130 identifying the student assignment 132 and containing an comments 134 provided by the student to explain issues related to the assignment. The grade submission template 130 provides the instructor with a text box 136 within which to generate a message to the students with comments on the assignment. After reviewing the assignment through an automated link in the grade book, the instructor accesses a grade menu 138, such as a pull down menu listing letter or symbol grade designations, and selects the appropriate grade. When the instructor finishes grading, she may click on the save button 140 to transmit the grade and any comments back to the database in the server side of the network. In other preferred embodiments, the grade submission template and/or the grade book include links to previously graded assignments for the student or other student's graded assignments along with the option of displaying different assignments alongside one another. The grade menu 138 of the grade submission template may include a collection of prepared comments or hints for the instructor to access and paste into the text box 136 when grading assignments. Once a grade is entered, the student can view the grade in a student view 131 of the grade book (See FIG. 8).
As discussed above, one useful teaching and communication tool provided in a preferred embodiment of the online educational courses is the guided discussion thread. The discussion threads operate in an online bulletin board environment to permit students, and the instructor, to read and post messages on issues directly related to the course. Preferably, the instructor is provided access to the discussion thread through the instruction interface tools 80. Referring again to FIG. 5, an instructor may view a discussion by selecting a link 106 on a navigation bar 108 displayed to the instructor to retrieve a listing of postings to the discussion by topic and date. In order to assist the instructor in assessing student participation in discussion threads, a discussion thread rating interface 150, such as illustrated in FIG. 8, permits the instructor to selectively open and attach ratings to various messages. Activating the discussion thread link 106 (FIG. 5) preferably triggers the administrator and instructor tool module 80 to assemble the discussion thread rating interface 150 and draw in the appropriate posting references into the first window 152. In one embodiment, a first window 152 is presented to an instructor displaying a scrollable list of the postings in the discussion thread and a second window 154 displays a selected one of the messages in the scrollable list 152. Alternatively, the instructor may access the discussion thread through a link 64 (FIG. 3) on a navigation bar 52 on the instructor's display.
An instructor preferably uses the discussion thread tool interface 150 to review and append a rating to student postings. The instructor appends a rating to a posting by selecting a rating 156 provided in a pull down menu 158 in the discussion thread interface 150. Preferably, the assigned rating is then indicated next to the student posting in the form of a graphic or icon 160 in the listing of postings viewed in the lower window 152 of the instructor discussion thread interface 150. Although the ratings are displayed to the instructor, students preferably do not see any indication of the assigned rating. A discussion thread navigation bar 162 on the discussion thread instructor interface 150 contains buttons operative to sort postings by rating 164, dates 166, author 168 and topic 170. Other discussion thread navigation functions, such as a button 172 to display all messages directed to one topic or search button 174 to look for messages based on customized search criteria are also provided in the discussion thread navigation menu 162. In one embodiment, student postings may count toward a task grade in a particular online course. The ratings provided by an instructor may be tallied and used to efficiently and automatically generate a grade for each student relating to postings. For example, the instructor may count up the number of “excellent” or “good” comments that she has given to a student and provide a indication that the student rates a separate commendation (e.g. a statement of “with distinction”) in addition to the overall course grade. Conversely, the ratings assigned to the discussion threads may be a tool to quickly identify inappropriate postings, for example a posting that constitutes sexual harassment or some other type of inappropriate behavior, so that students may be warned or removed from the course.
As part of the administrator and instructor tool set 80 available to instructors for managing and monitoring student activity (and to administrators to monitor student and instructor activity), instructors preferably may request a variety of information on students in their sections, student performance, and their own efficiency as instructors. Not only does the instructor tool set provide access to up-to-date information, it preferably generates graphical or tabular representations of the data discreetly or collectively. An instructor may request individual or section data in this manner. For example, as illustrated in FIG. 10, an instructor can quickly access a particular student's performance using a dashboard view screen 180 generated from data stored in the server side of the network as requested by commands in the administrator and instructor tool set 80. This data is accumulated from submissions from the student (e.g. biographical data provided during course registration) and by the student's activity in the online course.
A first section 182 of the dashboard view screen preferably presents biographic data for the student, such as name, address and contact information. A second section of the dashboard view may be a graphical representation of course activities. The course activity information may be generated from a number of clicks, or a number of times a link is accessed by a student, for activities directly related to the online course. Course activities may include viewing research modules related to the course, accessing the tasks in the course, posting or viewing material in the discussion threads, or viewing the resources and tools provided to assist the student in the course. In one embodiment, the second section 184 of the dashboard view 180 may illustrate the course activity in terms of a bar chart 186 having a separate bar for each activity tracked and extending along an axis listing the number of clicks by the student into that course activity. In alternative embodiments, overlaid linear graphs may be generated having an X-axis illustrating time (week number of the course) and a Y-axis indicating the number of clicks. In a third portion 186 of the dashboard profile, a similar graphical representation of out-of-course activities may be presented. The out-of-course activities may include postings to threaded discussions related to other online educational issues posted by the host system, the number of times the online library resources have been accessed, clicks into chat room discussions, and other activities indirectly related to the course. Another section 188 of the dashboard view 180 may contain a link 190 to automated email forms providing a pre-addressed form for the instructor to directly email the student. In other links such as a threaded discussion link 192 that may, for example, access recent posting by the students to allow the instructor to post a note in the discussion thread to the student.
As illustrated in FIG. 11, a similar dashboard view 200 may be accessed through the instructor interface to invoke the administrator and instructor tools 80 to retrieve and generate class profile information. A student demographic section 202 may occupy one section of the class profile dashboard view 200. The student demographic section 202 includes course and student summary information regarding the number of students, the number of students without the recommended course books, a listing of complaints or compliments logged and related information. The student demographic data section 202 may also be configured to display graphical status information for the section including a bar chart 203 of student assignment submissions graphically illustrating the number of students having turned in the assignment for each of a preset number of assignments in the online course. An course activity section 204 and an out-of-course activity section 206, similar to the sections displaying of these pieces of information for an individual student, may be included. A class communication section 208 preferably provides for a link 210 to automatic email templates that are pre-addressed to students in the instructor's section and a link 212 to the threaded discussion for the section. Each of the sections providing students course section information to an instructor preferably allows the instructor to zoom in and display the section on the entire screen presented to the instructor. Alternatively, the instructor interface preferably permits the instructor to select links in navigation bars on the screen to directly go to a specific type of information illustrated in the composite view. For each section of the composite display, or if only a particular one of the student information displays is shown, a student selection mechanism, such as the pull down menu 205 shown adjacent the course activity section 204, may be provided for ease of instructor access to a particular student.
Another administrator and instructor tool operative on the server side 12 to assist instructors is an instructor reminder mechanism that can be manifested in the form of a link on an instructor interface to students needing particular attention. Referring again to FIG. 5, the instructor interface generated by the programming operative on a processor in the server side of the network can provide a link 107 identified as “students needing attention” that retrieves a list of students having any of a number of difficulties or performance concerns. For example, the administrator and instructor tool programming can automatically generate a list of students who have not accessed the online course materials in more than a recommended period of time. The administrator and instructor tool can also compile information on students needing attention due to the instructor's tardiness in responding to course duties. For example, the instructor reminder mechanism can compile and display to the instructor outstanding email inquiries from students or ungraded assignment reminders that need attention.
In addition to the student performance tracking capabilities provided to instructors, the administrator and instructor tools provide instructors with self-evaluation information. Preferably, each instructor submits a time log to the online education network on a regular basis. The time log may be accessed with, and information entered through, an instructor administration screen set selectable by the instructor through an administration navigation bar 220 such as shown in FIG. 12. The time log link 222 preferably calls up a time log entry screen prepopulated with the instructor's name, course section and time of last log entry. The instructor then enters in the time spent on various key tasks such as monitoring discussion threads, grading, reviewing and responding to student emails, handling technical problems and other time dedicated to the online education system. After entering the various times in the form, the instructor may submit the form using an automated link that sends the information to a database, such as a CRM database, maintained on the server side 10 of the system.
Referring again to FIG. 12, the instructor may access her performance information using a performance link 224 on the navigation bar 220 of the administration display 226. The instructor may select from a performance period menu 228 and a peer group menu 230 to create a textual or graphical comparison chart 234 showing instructor performance criteria. The performance period menu 228 may present selections of performance since previous review, performance over past week or month, or performance since the start of the course. The peer group selection 230 may include comparison with other instructors in a Net, defined as the group of instructors supervised by a particular advisory faculty member, other instructors teaching the same course, or all other instructors active in the online education system 10. The instructor may then select to regenerate the displayed information according to the selected performance period and peer group using a redraw button 232 displayed on the instructor's computer screen.
The graphical comparison chart generated for the instructor may include separate bar charts for student completion rate, average turnaround time for grading assignments, the average time a student needs to complete a course, the average evaluation received from students and the quality of interaction with students. Preferably, all of the information is automatically gathered from the databases in the server side 12 based on instructor log entries, student evaluations, and automatically date stamped information maintained in the system. Any of a number of commonly available tools for reporting and presenting data, such as those available from BroadBase, BroadVision or Oracle, may be utilized and executed on the server side of the system to generate averages or percentages that the instructor's computer receive in the form of textual or graphical information. The instructor may also directly email the appropriate advisor, faculty member or an administrator using the same administration display 226 with any questions or comments relating to instructor performance using advisory faculty or administrator email links 236, 238 that automatically generate pre-addressed email forms, or email forms with menu selectable addresses.
FIG. 13 illustrates an administrator dashboard view of overall academic performance 240 accessible by administrators of the online educational network and assembled by the administrator and instructor tool set. The administrator dashboard view is automatically updated from data maintained in the server side of the network each time the administrator dashboard view 240 is accessed. The dashboard view indicates the view level 242 represented by the data. In FIG. 13, the view level 242 is indicated by a graphic as the highest (e.g. online educational network as a whole) such that the data is an overall picture of academic performance for the online educational network. Other selectable levels of view include a program view (e.g. all students of an MBA program), course view, faculty view and student view. The data presented to an administrator steadily narrows in focus from the top of the view level 242, where data relevant to the entire online institution is presented, to the individual student level where the administrator may focus on just one student.
In the online educational network view, referred to as CARDEAN in FIG. 13, the dashboard view generates an enrollment chart 244, a course completion rate chart 246, a student withdrawal rate chart 248, an assignment turnaround time chart 250 a student return rate chart 252, and a time to completion chart 254. All these charts are preferably positioned on the same computer display page so that the charts are viewable simultaneously on the screen or by scrolling down on the same screen. Although the information is shown in the form of bar charts in FIG. 13, any of a number of known graphical formats may be used for displaying the information in the dashboard view screen 240. In other embodiments, the data for a given chart may be displayed in alphanumeric form. Each of the charts may include a time scale selection 256 that will manipulate or average data stored on the server side for a desired time period. The administrator and instructor tools may be programmed to provide fixed time scale selections such as the 1 day, 5 day, 3 month, etc. shown, or a customized selection where an administrator may enter a desired time scale. In one embodiment, the same default time scale is automatically applied to each of the different information charts when an administrator initially calls up the dashboard view 240 onto her screen.
The enrollment chart 244 includes the percentage of capacity or goal for enrollment for a given time period. A completion rate chart 246 provides the percentage of students completing each of a selected number of courses (e.g., finance, accounting, marketing). The withdrawal rate chart presents percentage of students voluntarily withdrawing from each of a selected group of courses. The assignment turnaround time chart 250 presents administrators with the average overall time it takes instructors for each of a selected group of online courses to review and grade assignments, exams, or other student course deliverables. The return rate chart 252 represents the percentage of students, who have previously enrolled in courses in the online educational system, returning to take additional online courses. A time to completion chart 254 on the administrator dashboard display 240 presents the average length of time student have taken to complete each of a selected group of online courses. Each of the charts on the administrator dashboard 240 may also include a superimposed graphic indicator 258 such as illustrated in the return rate chart 252. The superimposed graphic indicator 258 may be selected to illustrate a desired goal for the data displayed or it may show a historical trend for the more recent data displayed in the chart. For example, the indicator 258 in the return rate chart may show the average November, December and January return rates for the past 10 years, while the bar charts indicate the return rate for November, December and January of the present year.
The view level indicator 242 allows the administrator to retrieve a degree program (e.g., MBA, MSIT, etc.) screen 260. In one embodiment, the degree listing screen 260 includes a listing of degree programs 262, course suites 264 required for the degree program 262, and any discrete courses 264 within the course suites as shown in FIG. 14. Each one of the programs, course suites and discrete courses preferably include a link that automatically queries the databases on the server side of the system for academic performance data tailored to the selected program, course suite, or discrete course. Thus the administrator dashboard view 240 may be generated from the program selection level, or the course selection level, to provide statistical information relevant to the program or course in the same manner as was described for the entire online educational system in FIG. 13.
Similarly, administrators can select the view level 242 to provide specific course information. As shown in FIG. 15, a course selection menu 268 lists all of the courses offered by the online educational system. Each course selection link 270 is configured to respond to a user selection to query the database on the server side of the system and return relevant information concerning the selected course. For example, one information format provided by the administrator and instructor tools at the course view level is a completion by team chart 272, as shown in FIG. 16. The completion by team chart presents the percentage of students completing the selected course for each course section 274. The completion by team chart 272 includes student section links 276 and links 278 to faculty for each section. These links 276, 278 permit quick and convenient navigation capabilities for the administrator.
When a faculty or student view is selected in the view level area 242 of the screen, an administrator may track down a specific faculty member or student. FIG. 17 illustrates a faculty selection screen 280 containing faculty links 282 to all data for each listed faculty member/instructor. If an administrator or advisory faculty member needs to review a particular faculty member, the administrator or advisory faculty member selects the desired faculty member link 282 and is presented with that faculty member's screen 283 listing personal data listing 284 and history with the online educational system 286 as seen in FIGS. 18-19. The personal data listing 284 may include contact information 286, educational background 290 and so on. The history 286 section preferably includes information on when the faculty member was trained 292, a list of courses previously or presently taught 294, evaluation status 296, a list of any student complaints 298, and an automatic messaging link 300 that will present a pre-addressed email or messaging template for the administrator to contact the faculty member. As with the other screens generated by the administrator and instructor tool, all information on the faculty member is automatically updated each time a user accesses the screen.
As shown in FIG. 19, a team performance dashboard view 302 for the course section(s) taught by the faculty member is also presented when the particular faculty member's screen 283 is accessed. Examples of data presented to the administrator or advisory faculty member include a completion rate chart 304, a withdrawal chart 306, and a return rate chart 308 for tracking the percentage of students completing or withdrawing from courses taught by the faculty member, as well as tracking how many students return to take other courses offered at the online educational system after taking a course from the selected faculty member. Information charts for the faculty member's assignment turnaround time 310, the number of complaints received 312 and the time students take to complete courses taken from the selected faculty member 314 are also listed.
From the foregoing, an administrator and instructor application tool defining a system and method for managing and monitoring students and faculty in an online educational course has been described. Using the system and method described above, an instructor can efficiently review individual student performance or course section performance through instructor interfaces generated by administrator and instructor tools maintained on the servers of the online educational course network. With the ready access to student activity data, biographical data and communications media, such as email and discussion threads, an instructor using the student managing and monitoring tools can effectively assess student difficulties and quickly react to student needs. Typical instructor tasks, such as grading assignments, are also facilitated by the administrator and instructor tools described above. Similarly, administrators and advisory faculty can manage and monitor instructors and students the faculty application tool to gather and present data on the online educational system as a whole, or to easily focus in a specific faculty member or student and address specific needs of that student or faculty member.
Patent CitationsCited PatentFiling datePublication dateApplicantTitleUS4772206Mar 10, 1986Sep 20, 1988International Business Machines CorporationMulti-mode teaching simulatorUS4820167Jan 14, 1987Apr 11, 1989Nobles Anthony AElectronic school teaching systemUS4877404Jan 4, 1988Oct 31, 1989Warren-Forthought, Inc.Graphical interactive software systemUS5002491Apr 28, 1989Mar 26, 1991ComtekElectronic classroom system enabling interactive self-paced learningUS5267865Feb 11, 1992Dec 7, 1993John R. LeeInteractive computer aided natural learning method and apparatusUS5310349 *Apr 30, 1992May 10, 1994Jostens Learning CorporationInstructional management systemUS5395243Jun 20, 1994Mar 7, 1995National Education Training GroupInteractive learning systemUS5441415Dec 6, 1993Aug 15, 1995John R. LeeInteractive computer aided natural learning method and apparatusUS5597312May 4, 1994Jan 28, 1997U S West Technologies, Inc.Intelligent tutoring method and systemUS5727950May 22, 1996Mar 17, 1998Netsage CorporationAgent based instruction system and methodUS5788508Jun 7, 1995Aug 4, 1998John R. LeeInteractive computer aided natural learning method and apparatusUS5810605Nov 4, 1994Sep 22, 1998Ncr CorporationComputerized repositories applied to educationUS5823788Nov 13, 1995Oct 20, 1998Lemelson; Jerome H.Interactive educational system and methodUS5864869 *Jul 18, 1996Jan 26, 1999Doak; Ron K.Method and manufacture of lesson plans and classroom organizers utilizing computers and softwareUS5909589Nov 12, 1996Jun 1, 1999Lance T. ParkerInternet based trainingUS5957699Dec 22, 1997Sep 28, 1999Scientific Learning CorporationRemote computer-assisted professionally supervised teaching systemUS5974446Oct 24, 1996Oct 26, 1999Academy Of Applied ScienceInternet based distance learning system for communicating between server and clients wherein clients communicate with each other or with teacher using different communication techniques via common user interfaceUS5978648 *Mar 6, 1997Nov 2, 1999Forte Systems, Inc.Interactive multimedia performance assessment system and process for use by students, educators and administratorsUS5987443Dec 22, 1998Nov 16, 1999Ac Properties B. V.System, method and article of manufacture for a goal based educational systemUS6014134Aug 23, 1996Jan 11, 2000U S West, Inc.Network-based intelligent tutoring systemUS6024577Nov 4, 1997Feb 15, 2000Fujitsu LimitedNetwork-based education system with capability to provide review material according to individual students' understanding levelsUS6029043Jan 29, 1998Feb 22, 2000Ho; Chi FaiComputer-aided group-learning methods and systemsUS6039575Oct 24, 1996Mar 21, 2000National Education CorporationInteractive learning system with pretestUS6064856 *Mar 23, 1998May 16, 2000Lee; John R.Master workstation which communicates with a plurality of slave workstations in an educational systemUS6064865Mar 1, 1999May 16, 2000Ford Motor CompanyProportional diversity radio receiver system with dynamic noise-controlled antenna phasersUS6302698 *Feb 16, 1999Oct 16, 2001Discourse Technologies, Inc.Method and apparatus for on-line teaching and learningUS6411796 *Nov 14, 1997Jun 25, 2002Sony CorporationComputer assisted learning systemUS6470171 *Aug 27, 1999Oct 22, 2002Ecollege.ComOn-line educational system for display of educational materialsWO1998022864A1Nov 18, 1996May 28, 1998Mann S Edward IiComputer education and execution interface operable over a network* Cited by examinerNon-Patent CitationsReference1ADEC and Virtual Universities "Toward Common Vision and Action", http://www.adec.edu/vuniv/adec/place1.html: Nov. 5, 1998.2Article Discussing Design of Online University: Johnstone/Jones: Western Governors University, http://www.ttu.edu/lists/acw-1/9707/0078.html: Nov. 5, 1998.3Article in Byte Magazine entitled "The Difference in Higher Education" dated Feb. 1987.4Bonar et al., "An Object-Oriented Architecture For Intelligent Tutoring Systems", OOPSLA '86 Proceedings published Sep. 1986.5DSU Open Internet Courses, http://www.courses.dsu.edu/disted/courses.htm: Nov. 23, 1998.6Home Pages For University Without Walls At the University of Massachusetts Amherst, http://www.klaatu.oit.umass.edu/uww/uww_home.html: Nov. 5, 1998.7Menu Pages for "The Commons", http://www.wcc-eun.com/wln/commons/index.html: Nov. 5, 1998.8Meyrowitz, "Intermedia: The Architecture and Construction of an Object-Oriented Hypermedia System and Applications Framework", OOPSLA '86 Proceedings published Sep. 1986.9Micron University Home Page Entitled "Micron U", http://programs.micronpc.com/micro...OL1RTR4UWVPBGP3&where=home&why=gen: Nov. 4, 1998.10Morris et al., "Andrew: A Distributed Personal Computing Environment", Communications of the ACM, Mar. 1986, vol. 29, No. 3.11Patent Abstracts of Japan, English Abstract for Japanese Application Publication No. 08235089 "Education Support System" Published Sep. 13, 1996.12Patent Abstracts of Japan, English Abstract for Japanese Application Publication No. 10040199 "Education Support System" Published Feb. 13, 1998.13Printout of Website for: The Electronic University Network at http://www.wcc-eun.com/eun.html: Nov. 5, 1998.14SINEwave The COB Virtual Campus (Distance Learning at the College of Business at UCB), http://www.colorado.edu/infs/jcb/sinewave/service/virtualcampus/: Nov. 5, 1998.15Slide Show of Information Relating To Online Educational Programs, http://www.howardcc.edu/hcc/facpres/sld003.htm: Nov. 5, 1998 (Slides 3-13 of 14).16U.S. patent application, Ser. No. 09/884,168 filed Jun. 18, 2001, entitled "Method and System for Analyzing Student Performance in an Electronic Course" and the inventor is Alan Drimmer.17Web Page Entitled "Welcome to . . . Apollo Group, Inc.", http://www.apollogrp.com/: Nov. 5, 1998.18Web Pages Relating To Western Governors University Website at http://www.wgu.edu/wgu/academics/dist_learning/html: Nov. 5, 1998.19Website Entitled Brevard Community College Online . . . Telecommute on the Information Super Highway with BCC, http://brevard.cc.fl.us/online/campus/: Nov. 5, 1998.20Website for the University of Phoenix Online Campus at http://www.uophx.edu/online/on1_camp.htm: Nov. 5, 1998.21Welcome to the California Virtual University, http://www.california.edu/about.html: Nov. 5, 1998.22Weyer et al., "A Prototype Electronic Encyclopedia", ACM Transactions on Office Information Systems, vol. 3, No. 1, Jan. 1985, pp. 63-88.23Wiseman, "Teaching (Virtually) Teaching", http://gsula.gsu.edu/faculty/lawppw/vtt/virtual.html, Nov. 23, 1998.24Yahoo! Internet Life Magazine Names Dakota State University the #12 Most Wired College in the Country, http://www.dsu.edu/yahoo.htm: Nov. 23, 1998.Referenced byCiting PatentFiling datePublication dateApplicantTitleUS6816702 *Mar 15, 2002Nov 9, 2004Educational Testing ServiceConsolidated online assessment systemUS6918768 *Feb 27, 2003Jul 19, 2005Enablearning, Inc.Computerized system and method for visually based educationUS6965752Aug 19, 2003Nov 15, 2005Ecollege.ComOn-line educational system having an electronic notebook featureUS6999954 *Oct 10, 2001Feb 14, 2006The Mcgraw-Hill Companies, Inc.Modular instruction using cognitive constructsUS7131842 *Feb 7, 2003Nov 7, 2006John HollingsworthMethods for generating classroom productivity indexUS7200581 *Feb 10, 2006Apr 3, 2007The Mcgraw-Hill Companies, Inc.Modular instruction using cognitive constructsUS7209931 *May 31, 2002Apr 24, 2007Studentuniverse.ComUser matriculation status determination via a computer networkUS7311524 *Jan 17, 2003Dec 25, 2007Harcourt Assessment, Inc.System and method assessing student achievementUS7331791Mar 5, 2002Feb 19, 2008Novell, Inc.System and method for evaluating a person's information technology skillsUS7497688 *Sep 18, 2002Mar 3, 2009Accenture Global Services GmbhCompressed experiential learningUS7516180Jan 28, 2003Apr 7, 2009Lacy Donald DSystem and method for providing instructor services using a plurality of client workstations connected to a central control stationUS7698360 *Apr 13, 2010Novell, Inc.System and method for distance learningUS7702531Dec 12, 2002Apr 20, 2010Accenture Global Services GmbhBusiness driven learning solution particularly suitable for sales-oriented organizationsUS7788207Jul 9, 2007Aug 31, 2010Blackboard Inc.Systems and methods for integrating educational software systemsUS7860736Mar 28, 2003Dec 28, 2010Accenture Global Services GmbhCourse content development method and computer readable medium for business driven learning solutionsUS7873906Jun 22, 2007Jan 18, 2011International Business Machines CorporationMethod and system for presenting a visual notification and delaying an action responsive to an onscreen selectionUS7974864Feb 26, 2010Jul 5, 2011Accenture Global Services LimitedBusiness driven learning solution particularly suitable for sales-oriented organizationsUS8140000 *Dec 16, 2003Mar 20, 2012International Business Machines CorporationCategorizing and sharing learning objectsUS8152529Apr 5, 2005Apr 10, 2012Enablearning, IncComputerized system and method for visually based educationUS8155578Sep 27, 2004Apr 10, 2012Educational Testing ServiceMethod and system for generating and processing an assessment examinationUS8271420Sep 18, 2012Blackboard Inc.Systems and methods for integrating educational software systemsUS8326211 *Jun 11, 2008Dec 4, 2012Distance EDU Learning, Inc.Computer systems for capturing student performanceUS8374540Dec 29, 2006Feb 12, 2013Educational Testing ServiceConsolidated on-line assessment systemUS8380121 *Feb 19, 2013Ecollege.ComLearning outcome managerUS8417581 *Mar 23, 2012Apr 9, 2013Lensoo Inc.Method, system, and medium for enabling a user to access learning content via a single-window learner interfaceUS8495488Aug 21, 2008Jul 23, 2013RemarksPDF Pty LimitedTool for interacting with and comparing scores in marked documentsUS8548836Jul 1, 2011Oct 1, 2013Accenture Global Services LimitedBusiness driven learning solution particularly suitable for sales-oriented organizationsUS8600289Nov 28, 2012Dec 3, 2013Distance EDU Learning, Inc.Computer systems for capturing student performanceUS8699940Oct 11, 2011Apr 15, 2014Amplify Education, Inc.Interactive learning mapUS8699941Oct 11, 2011Apr 15, 2014Amplify Education, Inc.Interactive learning mapUS8707204Oct 27, 2008Apr 22, 2014Microsoft CorporationExploded views for providing rich regularized geometric transformations and interaction models on content for viewing, previewing, and interacting with documents, projects, and tasksUS8707214 *Oct 27, 2008Apr 22, 2014Microsoft CorporationExploded views for providing rich regularized geometric transformations and interaction models on content for viewing, previewing, and interacting with documents, projects, and tasksUS8768240Aug 14, 2009Jul 1, 2014K12 Inc.Systems and methods for producing, delivering and managing educational materialUS8838015Aug 14, 2009Sep 16, 2014K12 Inc.Systems and methods for producing, delivering and managing educational materialUS8893024 *Dec 24, 2008Nov 18, 2014Microsoft CorporationUser evaluation in a collaborative online forumUS9147350 *Oct 17, 2011Sep 29, 2015John Leon BolerStudent performance monitoring system and methodUS9214090Dec 2, 2013Dec 15, 2015Distance EDU Learning, Inc.Computer systems for capturing student performanceUS20020072049 *Sep 7, 2001Jun 13, 2002Prahalad Coimbatore KrishnaraoEducation event module and presentationUS20020115051 *Feb 1, 2002Aug 22, 2002Sanda Joel M.Variable types of sensory interaction for an on-line educational systemUS20020119435 *Feb 1, 2002Aug 29, 2002Himmel Kevin A.Compilation of electronic content relating to use of an on-line educational systemUS20020161719 *Apr 27, 2001Oct 31, 2002Manning David FranklinMethod of and apparatus for on-line enrolmentUS20020178038 *Mar 26, 2002Nov 28, 2002Grybas Donald R.Institutional student tracking systemUS20020178212 *Mar 28, 2001Nov 28, 2002Sun Microsystems, Inc.Match game appletUS20030061187 *Sep 26, 2002Mar 27, 2003Kabushiki Kaisha ToshibaLearning support apparatus and methodUS20030069872 *Oct 10, 2001Apr 10, 2003The Mcgraw-Hill Companies, Inc.Modular instruction using cognitive constructsUS20030099924 *Nov 26, 2002May 29, 2003Sougo TsuboiLearning support method and learning support systemUS20030130972 *Jan 10, 2002Jul 10, 2003Holt Laurence E.Learning by knowledge division into atoms and combination of atoms into payoffsUS20030134261 *Jan 17, 2003Jul 17, 2003Jennen Steven R.System and method for assessing student achievementUS20030138759 *Mar 5, 2002Jul 24, 2003Rowley David D.System and method for evaluating a person's information technology skillsUS20030163784 *Dec 12, 2002Aug 28, 2003Accenture Global Services GmbhCompiling and distributing modular electronic publishing and electronic instruction materialsUS20030177019 *Mar 18, 2002Sep 18, 2003Santos Richard A.System and method for visual representation of an electroni communityUS20030182358 *Feb 26, 2002Sep 25, 2003Rowley David D.System and method for distance learningUS20040002040 *Jun 30, 2003Jan 1, 2004Accenture Global Services GmbhDecision support and work management for synchronizing learning servicesUS20040043363 *Sep 3, 2002Mar 4, 2004Elmar DornerTutor interface with content based messagingUS20040044892 *Sep 3, 2002Mar 4, 2004Elmar DornerContent based messaging for e-learningUS20040048234 *Aug 19, 2003Mar 11, 2004Vance AllenOn-line educational system having an electronic notebook featureUS20040133437 *Jun 30, 2003Jul 8, 2004Accenture Global Services GmbhDelivery module and related platforms for business driven learning solutionUS20040148349 *Jan 28, 2003Jul 29, 2004Lacy Donald D.System and method for connecting a plurality of client workstations to a central control stationUS20040148350 *Jan 28, 2003Jul 29, 2004Lacy Donald DSystem and method for providing instructor services using a plurality of client workstations connected to a central control stationUS20040152053 *Feb 27, 2003Aug 5, 2004Bardige Arthur H.Computerized system and method for visually based educationUS20040157201 *Feb 7, 2003Aug 12, 2004John HollingsworthClassroom productivity indexUS20050131849 *Dec 16, 2003Jun 16, 2005International Business Machines CorporationCategorizing and sharing learning objectsUS20050181345 *Dec 17, 2004Aug 18, 2005Edumedia Development CorporationMentor based computer assisted learningUS20050181349 *Apr 5, 2005Aug 18, 2005Enablearning, Inc.Computerized system and method for visually based educationUS20050255439 *Sep 27, 2004Nov 17, 2005Preston CodyMethod and system for generating and processing an assessment examinationUS20060085755 *May 9, 2003Apr 20, 2006Nobuaki AraiLearning supporting program having tag information function, learning supporting method, and learning supporting systemUS20060105312 *Nov 17, 2004May 18, 2006Mcclimon Desiree LSystems and methods for creating and providing educational materialsUS20060147890 *Jun 27, 2005Jul 6, 2006Ecollege.ComLearning outcome managerUS20060184486 *Feb 10, 2006Aug 17, 2006The Mcgraw-Hill Companies, Inc.Modular instruction using cognitive constructsUS20060216683 *Nov 8, 2005Sep 28, 2006Goradia Gautam DInteractive system for building, organising, and sharing one's own databank of questions and answers in a variety of questioning formats, on any subject in one or more languagesUS20070065788 *Sep 20, 2005Mar 22, 2007Inscape Publishing, Inc.Method for developing a curriculumUS20070099169 *Oct 27, 2005May 3, 2007Darin BeamishSoftware product and methods for recording and improving student performanceUS20070113015 *Feb 9, 2006May 17, 2007Moll Laurent RPower conservation via DRAM access reductionUS20070143275 *Dec 21, 2005Jun 21, 2007International Business Machines CorporationWork-context search strings for work-embedded e-learningUS20070190514 *Feb 14, 2006Aug 16, 2007Diaz Jorge RComputerized assessment tool for an educational institutionUS20080057480 *Aug 31, 2007Mar 6, 2008K12 Inc.Multimedia system and method for teaching basal math and scienceUS20080177504 *Jan 22, 2007Jul 24, 2008Niblock & Associates, LlcMethod, system, signal and program product for measuring educational efficiency and effectivenessUS20080177834 *Mar 26, 2008Jul 24, 2008International Business Machines CorporationContent monitoring in a high volume on-line community applicationUS20080280280 *May 11, 2007Nov 13, 2008Aplia, Inc.Method of capturing workflowUS20080299532 *Jun 4, 2007Dec 4, 2008Ceu Plan, IncorporatedMethod, system, signal and program product for assuring feedback is received from students of an online courseUS20080314968 *May 23, 2008Dec 25, 2008Maher Patrick RSystem and Method for Capturing and Managing Personal Documents and InformationUS20080320576 *Jun 22, 2007Dec 25, 2008Microsoft CorporationUnified online verification serviceUS20090011397 *Jul 2, 2008Jan 8, 2009Greg WriterMethod, system and device for managing compensated educational interactionUS20090018986 *Jul 9, 2007Jan 15, 2009Alcorn Robert LSystems and methods for integrating educational software systemsUS20090064018 *Oct 27, 2008Mar 5, 2009Microsoft CorporationExploded views for providing rich regularized geometric transformations and interaction models on content for viewing, previewing, and interacting with documents, projects, and tasksUS20090064024 *Oct 27, 2008Mar 5, 2009Microsoft CorporationExploded views for providing rich regularized geometric transformations and interaction models on content for viewing, previewing, and interacting with documents, projects, and tasksUS20090182716 *Jul 16, 2009Deborah EverhartSystems and methods for integrating educational software systemsUS20090327053 *Dec 31, 2009Niblock & Associates, LlcMethod, system, signal and program product for measuring educational efficiency and effectivenessUS20100004969 *Jan 7, 2010Steven MenearSystem and Method for Providing Online EducationUS20100162135 *Dec 24, 2008Jun 24, 2010Microsoft CorporationUser evaluation in a collaborative online forumUS20100205027 *Feb 26, 2010Aug 12, 2010Accenture Global Services GmbhBusiness Driven Learning Solution Particularly Suitable for Sales-Oriented OrganizationsUS20100240019 *Mar 17, 2009Sep 23, 2010Sathy Kumar RInstructional aids and methodsUS20100313114 *Aug 21, 2007Dec 9, 2010RemarksPDF Pty Limiteddocument markup toolUS20110020781 *Jul 16, 2010Jan 27, 2011Cheng-Ta YangOn-Line Interactive Learning and Managing SystemUS20110039242 *Feb 17, 2011Ronald Jay PackardSystems and methods for producing, delivering and managing educational materialUS20110039245 *Feb 17, 2011Ronald Jay PackardSystems and methods for producing, delivering and managing educational materialUS20110039247 *Aug 14, 2009Feb 17, 2011Ronald Jay PackardSystems and methods for producing, delivering and managing educational materialUS20110060695 *Oct 21, 2010Mar 10, 2011Thomas BoylandSystem and Method for Automated Admissions Process and Yield Rate ManagementUS20110106660 *May 5, 2011Gopala AjjarapuMethod for providing learning as a service (laas) in a learning networkUS20110136092 *Jul 30, 2008Jun 9, 2011Full Circle Education Pty LtdEducational systems, methods and apparatusUS20110212430 *Sep 2, 2010Sep 1, 2011Smithmier Donald ETeaching and learning systemUS20110307396 *Dec 15, 2011Masteryconnect LlcEducation Tool for Assessing StudentsUS20120094265 *Oct 17, 2011Apr 19, 2012John Leon BolerStudent performance monitoring system and methodUS20120185358 *Jul 19, 2012Lensoo Inc.Learning as a Service in a Learning NetworkUS20130101977 *Oct 25, 2012Apr 25, 2013Kt CorporationMethod and system for providing education contentsUS20140280195 *Mar 11, 2014Sep 18, 2014Doron EtzioniEducational HubWO2005069252A1 *Jan 13, 2005Jul 28, 2005Mario BaccagliniSystem method and apparatus for control of purveyance to a user of information with imagesWO2007062450A1 *Oct 25, 2006Jun 7, 2007University Of New EnglandAssessment of educational servicesWO2009008926A1 *Apr 9, 2008Jan 15, 2009Blackboard Inc.Systems and methods for integrating educational software systemsWO2009023896A1 *Aug 13, 2008Feb 26, 2009Remarkspdf Pty LtdA document markup toolWO2009039569A1 *Sep 25, 2008Apr 2, 2009Grant William GrosserManagement system and method* Cited by examinerClassifications U.S. Classification434/365, 434/322International ClassificationG09B7/00, G09B5/00Cooperative ClassificationG06Q50/20, G06Q40/00, G09B5/00, G09B7/00European ClassificationG09B5/00, G09B7/00Legal EventsDateCodeEventDescriptionDec 21, 2000ASAssignmentOwner name: UNEXT.COM, L.L.C., ILLINOISFree format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:STRUB, HENRY B.;WOODSON, STEPHANIE B.;BARR, JOSHUA D.;AND OTHERS;REEL/FRAME:011405/0833;SIGNING DATES FROM 20001207 TO 20001220Jun 11, 2001ASAssignmentOwner name: THOMSON VENTURES U.S. LLC, CONNECTICUTFree format text: PATENT SECURITY AGREEMENT;ASSIGNOR:UNEXT.COM LLC;REEL/FRAME:011880/0149Effective date: 20010417Owner name: MPI CORP., CONNECTICUTFree format text: ASSIGNMENT OF PATENT SECURITY AGREEMENT;ASSIGNOR:THOMSON VENTURES U.S. LLC;REEL/FRAME:011880/0846Effective date: 20010507Jan 27, 2002ASAssignmentOwner name: UN CAPITAL CO. LLC, CALIFORNIAFree format text: SECURITY AGREEMENT;ASSIGNOR:UNEXT.COM LLC;REEL/FRAME:012581/0248Effective date: 20011109Feb 26, 2007FPAYFee paymentYear of fee payment: 4Jan 26, 2010ASAssignmentOwner name: CARDEAN LEARNING GROUP LLC, ILLINOISFree format text: CHANGE OF NAME;ASSIGNOR:UNEXT.COM LLC;REEL/FRAME:023848/0136Effective date: 20050228Jul 9, 2010ASAssignmentOwner name: UNEXT.COM LLC, ILLINOISFree format text: RELEASE BY SECURED PARTY;ASSIGNOR:UN CAPITAL CO. LLC;REEL/FRAME:024651/0832Effective date: 20030814Owner name: CARDEAN UNIVERSITY LLC, ILLINOISFree format text: RELEASE BY SECURED PARTY;ASSIGNOR:UN CAPITAL CO. LLC;REEL/FRAME:024651/0832Effective date: 20030814Owner name: CAPITAL EDUCATION LLC, VIRGINIAFree format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:CARDEAN LEARNING GROUP LLC;REEL/FRAME:024651/0849Effective date: 20100707Owner name: UNEXT.COM LLC, ILLINOISFree format text: RELEASE BY SECURED PARTY;ASSIGNOR:THOMSON TREASURY LLC AS ASSIGNEE OF MPI CORP.;REEL/FRAME:024662/0095Effective date: 20030814Owner name: CARDEAN UNIVERSITY LLC, ILLINOISFree format text: RELEASE BY SECURED PARTY;ASSIGNOR:THOMSON TREASURY LLC AS ASSIGNEE OF MPI CORP.;REEL/FRAME:024662/0095Effective date: 20030814May 25, 2011FPAYFee paymentYear of fee payment: 8May 7, 2012SULPSurcharge for late paymentJul 2, 2015REMIMaintenance fee reminder mailedSep 9, 2015FPAYFee paymentYear of fee payment: 12Sep 9, 2015SULPSurcharge for late paymentYear of fee payment: 11RotateOriginal ImageGoogle Home - Sitemap - USPTO Bulk Downloads - Privacy Policy - Terms of Service - About Google Patents - Send FeedbackData provided by IFI CLAIMS Patent Services