USER ABILITY-BASED ADAPTIVE SELECTING AND PRESENTING VERSIONS OF A DIGITAL CONTENT ITEM

A content publishing system retrieves user identification information and interaction information associated with a user of the content publishing system. The content publishing system provides a selected content item to the user and calculates a user score representing a reader's reading ability. The score is calculated based on the retrieved user identification information and interaction information. Using the calculated score, content publishing system generates instructions for dynamically selecting a particular version or representation of a selected content item based on the calculated user score associated with the viewing user. The generated instructions are retrieved by a viewing application residing on a client device and used to select the appropriate version of the previously selected content item to present to the user.

DETAILED DESCRIPTION

Overview

A content publishing system retrieves user identification information and interaction information associated with a viewing user of the content publishing system. The content publishing system provides a selected content item to a viewing user and calculates a user score representing a reader's reading ability (e.g. level of literacy and fluency) based at least in part on the retrieved user identification information and interaction information. Using the calculated score, content publishing system generates instructions for dynamically selecting a particular version or representation of a selected content item based on the calculated user score associated with the viewing user. The generated instructions are retrieved by a viewing application, such as an electronic reader application or web browser executing on a computing device (such as a mobile communication device, a tablet computer, or any other suitable computing system) and used to select the appropriate version of the previously selected content item to present to the user. For example, based on interaction information indicating that the viewing user progressed through a portion of a selected content item quickly or made notes or annotations to the selected content item during a viewing session, the content publishing system increases the viewing user's user score. Based on the increased user score, the content publishing system generates instructions for selecting an alternative content version for presentation to the viewing user. During the same or during a different viewing session, the generated instructions are retrieved by a viewing application and used to select an alternative version of the previously selected content that is adapted for a user with a higher reading ability as compared to the previously viewed content version. The generated instructions also operate in conjunction with the selected content item on the computing device used by the viewing user to interact with the selected content item to log interaction information describing one or more interactions by the viewing user with the selected digital content item.

Such a system allows the selected digital content item to exchange information with the content publishing system to provide an interactive reading experience across a range of devices, including personal computers, smart phones, tablet computers, and smart boards, using a web browser or electronic reader (eReader) application. In turn, a viewing user can interact with multiple alternative versions of a content item in an offline mode (e.g., not connected to the content publishing system). The client device can also retrieve logic (e.g., rules about how the content that has been downloaded to the client device should adapt, given the users interactions with the content) from the content publishing system, which enables the experience to be adaptive even in offline mode. The content publishing system can insert or inject new information (core text, assessment, assist information) into the content items that can be viewed later in either online or offline mode. The content publishing system also selectively determines which set of alternative versions of a selected content item to provide to a viewing user based on the calculated user score. For example, the content publishing system may use historical or global interaction information to a set of alternative version, where each version included in the set varies by a specified attribute (e.g., specified level of reading complexity or reader score). Such as system utilizes minimal computing resources of the viewing device and reduces the data bandwidth consumed to exchange information between the computing device and the content publishing system.

A digital content item is organized into a number of components or sections, each including one or more alternative representations or version of the information included in the section. In one implementation, sections include core text and metadata. Metadata includes user reading assessment information, such as questions about the core text used to assess a user's reading ability of a selected content item. In one implementation, the questions are presented as text, symbols, characters, tactile writing system, or other humanly perceivable representation of text in varying formats, including multiple choice, doze, and open-ended questions. In such an implementation, the user reading assessment information may be positioned to appear directly in the core text proximate to a relevant portion of the core text, alongside the core text, or hidden from view and revealed when a viewing user interacts with a specified portion a display region of the computing device used to interact with the selected content item (i.e., a viewing device). In another implementation, the questions are presented audibly and audible responses are captured by an audio recording device accessible by the viewing device.

Metadata also includes user assist information, including vocabulary support, the option to reformat the core text based on user preference, and the option to manually choose an alternative version of the core text of a selected content item. User assist information also includes visual (e.g., highlights) or audible modification of portions of the core text to increase the viewing user's comprehension of the core text. For example, the user assist information includes providing the viewing user an alternative version of the core text in which the vocabulary and grammar as well as the structure of the prose is greatly simplified, inserting in or revealing conditional text at a specific point in a selected content item to help a viewing user better comprehend the text that they are reading or to answer a specific question about the text. As described herein, text refers to default text of a digital text and conditional text refers to supplemental text written about the content item to accompany the item. In another example, the user assist information includes revealing text, audiovisual media, and links to other media, any of which may be intended to help the viewing user read and comprehend the text of the content item that they are reading, or directing the user back to a specific point in a selected content item to point out to the viewing user text that was needed to answer a questions that they answered incorrectly. More generally, the user assist information assists the viewing user to decode words, phrases, or portions of core text, and comprehend portions of the core text that would be otherwise beyond the viewing user's literacy, comprehension, or fluency.

Generally, each alternative version of a section of a content item is assigned a user score or range of user scores. The user score, as described in reference toFIG. 2, provides an indication of a particular user's reading ability. Accordingly, because the alternative version are tagged with a user score or range of user scores the content publishing system may generate instructions that when executed by an application on a viewing device, dynamically select from a set of alternative versions of core text, user assessment, and user assist information based on a user score calculated for a particular viewing user. Where the calculated user score takes into account factors that indicate a viewing user's present reading ability.

Alternative versions of the core text may vary in the level or complexity of vocabulary, grammar, sentence structure, while keeping the underlying meaning of and information conveyed by the core text substantially similar across all versions of the core text associated with a particular digital content item. Alternative versions of user assist features may include providing the user specific media, specific information, or specific advice at specific times to increase their likelihood of comprehending the material that they are viewing. For example, the content publishing system112may prompt a viewing user to read more slowly, or indicate to a viewing user that a passage that they just read is the main idea of the passage, so that the viewing user understands the passage better. The content publishing system112determines when is the best time to provide user assist information to increase their comprehension of the content item they are viewing based at least in part on computed user score. The content publishing system112may also provide the viewing user with a plurality of assessment versions. As the content publishing system gathers information and updates the user score it makes decisions about what assessment to provide a user. The primary purpose of assessment is to determine the most optimal version of the content item for a viewing user. Thus, the assessment will become more difficult or less difficult as needed to pinpoint the optimal level of difficulty for a particular user.

The assessment is also used by the content publishing system112to identify the viewing user's skills and knowledge or gaps in their skills and knowledge. The content publishing system112provides a user a plurality of assessment versions and measures response to those assessments, so that the content publishing system112creates an inventory of the viewing user's skills and abilities. Two users could be viewing the same content item (or modified versions of a content item) and see completely different assessment. The content publishing system112may retrieve new assessment and add those assessments to a content item that a viewing user is viewing in offline mode. The content item will also download the answers to those questions and logic to act on in response to those answers. Thus, viewing user can have an adaptive experience even in an offline mode.

For purposes of illustration, a digital content items included the content publishing system is referred to herein as “content item”, which may include textual articles, books, videos, and any other types of content capable of display within the context of an electronic reader application or web browser.

System Architecture

FIG. 1is a block diagram of a system environment100in which a content publishing102system operates. The system environment100shown byFIG. 1comprises one or more client devices102, one or more sources106, third party processing system network110, and the content publishing system112. In alternative configurations, different and/or additional components may be included in the system environment100. For example, in an alternative configuration, the system100includes supplemental user information providers, such as schools or test administration organizations that may provide information about a user's academic or examination performance, information about the academic or examination performance of a group of people. The group may be specified by one or a combination of grade level, geography, socioeconomic criteria, nationality, ethnicity, or other suitable criteria that may influence a user's reading ability.

A source106includes a computing system capable of providing various types of content to the content publishing system112for display on a client device102. Examples of content provided by a source106include text, images, video, audio or other suitable data. The content provided by a source106may be received from a publisher (e.g., books, videos, or educational material) and distributed by the source106, or a source106may be a publisher of content it generates. For example, a publisher refers to any person or entity that provides multimedia to the content publishing system112, which users can read, watch, play, or interact with, and to which administrative users can add additional information (e.g., meta media).

An administrative user is a person who has the right to view and or modify data on a specific user. In general, an administrative user will be a parent, guardian, teacher, instructor, educational professional, or some person who is responsible for the instruction or care of another user. The content publishing system112provides a user interface, such as a dashboard to enable an administrative user to access profiles of users for which they are approved to do so. An administrative user may manually set the reading score of any user, for which they have administrative authority. An administrative user may also override the reading score assigned by the content publishing system112and may modify how the content publishing system112calculates reading scores for users that full under their administrative authority. An administrative user may author and attach meta media to a published work. The meta media, includes text, test questions, or related multimedia. If the administrative user authors questions, the administrative user may then also define a correct answer, and also define how answering the question correctly and incorrectly impacts a user's reading score. An administrative users may define which users (student or administrative) may view meta media, which that administrator created. An administrative users access the meta media of other administrative users and permission those users under their control to view and engage with meta media from other administrators. An administrative user may make their meta media public and freely available or make it available to specific a user or specific administrator. An administrative user may also charge other administrators and users to access their meta media. Thus, the content publishing system112platform creates a market where administrators can buy, sell, and rent or freely give away their meta media. The content publishing system platform enables administrative users to create meta media, store meta media, provide meta media to users based on rules provided by the administrator, incorporate interactions and engagement with meta media into the calculated user reading score, and provide a marketplace to distribute the meta media with multiple business models.

Returning to publishers, a publisher may upload documents in a wide variety of formats (.txt, .doc, PDF (Portable Document Format), CSS (Cascading Style Sheets), HTML (Hyper Text Markup Language, etc.) and convert those into adaptive, dynamic, multilevel books using the content publishing system112. A publisher may define sections of a content item, such as the core text as the primary text (the default text provided to the reader), and alternative versions of the core text as secondary text, which may be substituted for the primary text when requested by a user or administrator on a users behalf, or substituted for the primary text after the software program on the content publishing system112determines that an alternative version of the core text is the best text for the reader, based on their reading score.

In one implementation, a publisher creates user assessment information (e.g., test questions), define the correct responses for those questions, and also determine how the user's reading experience should adapt or not adapt, based on the user's ability to answer questions about the text correctly or incorrectly. A publisher also sets rules defining the conditions that determine which version of a text, primary text of secondary text (alternative versions of core text), is present to a specific user, based on the users reading score or other unique factors. A publisher may also set an expected user score for content items provided by the publisher. For example, publishers may set an expected user score based on one or a combination of age, education level, user attributes, specifying how a user should interact with a content item. Expected interactions may include, the pace at which a user is expected to read a given page of text, what questions a user should be able to answer correctly about the text, the minimum level of reading ability that a user should be capable of demonstrating when reading a text aloud, and the maximum level of support a user should need to complete a text. The publisher may provide the expected interaction information to the content publishing system112for use in calculating or update a present user score for a viewing user and selecting the appropriate version of a selected content item to present to viewing user. When a user interacts with a publisher's content item, the content publishing system112compares those interactions to the expected interactions defined by the respective publisher or administrative user. The content publishing system112calculates a user reader using their interactions with the content items on the content publishing system112relative to the publishers and administrators expectations.

The client device102is one or more computing devices capable of receiving user input as well as transmitting and/or receiving data via the network120. In one embodiment, the client device102is a conventional computer system, such as a desktop or a laptop computer. Alternatively, the client device130may be a device having computer functionality, such as a personal digital assistant (PDA), a mobile telephone, a smart phone, a tablet computer, smart board, or another suitable device.

In one embodiment, the client device102executes an application allowing a user of the client device102to interact with the content publishing system112. For example, an application executing on the client device102communicates instructions to select from multiple representations of one or more of content, user assist information, or user assessment information based on one or a combination of calculated user score or interaction information obtained by the viewing device. As another example, the client device102executes a browser that presents the selected content item to a user of the client device102. In another embodiment, the client device102interacts with the content publishing system through an application programming interface (API) running on a native operating system of the client device102, such as IOS® or ANDROID™ . WhileFIG. 1shows a single client device102, in various embodiments, any number of client devices102may communicate with the content publishing system112.

The client device102includes a display device to presents content items to a user of the client device102. Examples of the display device include a liquid crystal display (LCD), an active matrix liquid crystal display (AMLCD), an organic light emitting diode (OLED) display, or any other suitable device. Different client devices102may have display devices with different characteristics. For example, different client devices102have display devices with different display areas, different resolutions, or differences in other characteristics.

The client device102includes one or more input devices to receive input from the user. Different input devices may be included in the client device102. For example, the client device102includes a touch-sensitive display for receiving input data, commands, or information from a user. In other embodiments, the client device102may include a keyboard, a trackpad, a mouse, or any other device capable of receiving input from a user. In another example, the input device is configured to receive information from a user of the client device through a touchless interface. Examples of a touchless interface include sensors, such as an image capture device, to receive gestures from a client device user without the user physically contacting the display device or the client device102. Additionally, in some embodiments, the client device130may one or more sensors capable of detecting user biometric information (e.g., eye tracking) Inputs received via the input device may be processed by the adaptive content selection module104to interpret interaction information, respond to instructions from the content publishing system112to select from multiple representations of one or more section of a selected content item, or select from multiple representations of one or more section of a selected content item independent of the instructions received from the content publishing system112.

The content publishing system112adaptively selects one or more representations of a digital content item for presentation to a user based on information or signals that indicate the user's reading ability. In the example shown byFIG. 1, the content publishing system112includes a user profile store114, a content store116, an interaction store118, a user analysis module120, and a scoring module122. In other implementations, the content publishing system112may include additional, fewer, or different components for various applications. Conventional components, such as web servers and network interfaces are not shown as to not obscure the details of the system architecture.

Each user of the content publishing system112is associated with a user profile stored in the user profile store114. A user profile includes declarative information about the user that was explicitly provided by the user and may also include profile information inferred by the content publishing system112or provided by an administrative user as previously described. In one embodiment, a user profile includes multiple data fields, each describing one or more attributes of the corresponding user of the content publishing system112. Examples of information stored in a user profile include biographic, demographic, and other types of descriptive information, such as gender, content preferences, location, or other suitable information.

The interaction store116stores user interaction information describing interactions by a corresponding user with content items presented by the content publishing system112. In one example, interaction information includes one or more of recordings of a user reading a text aloud, a list of words for which the viewing user requested vocabulary support, device level engagement data including notes taken by the viewing user and a count of the number of times a viewing user annotated (e.g., took notes), re-read their own annotations or annotations from peers or teachers, and the number of times a viewing user choose to adapt the text based on their own visual preferences. Interaction information also includes the sequencing of a viewing user's interactions during a reading session (i.e., the order in which any user interactions occur), answers that a viewing user provides to user assessment information, a record of any and all instances of a viewing user manually selecting an alternative version of a section of a selected content item. Interaction information further includes the pace at which a viewing user progresses through a selected content item, any information generated during playing a game or activity (i.e., assessment information) that is related to or embedded within a version of core text. Interaction information further includes, a record of links to third party sites that a user clicked on during a reading session, a record of any third party multimedia that was activated from links within the selected content item (e.g., a digital book), a record of interactions with other programs and applications on the users device, and a record of the time in which the content item was in idle mode as a result of cessation in user activity. In another implementation, user interaction data describing interactions with content items external to the content publishing system112may be retrieved from a third party processing system108and stored in the interaction store116. In one example, a third party processing system108includes a separate website that receives interaction information (e.g., audible data) from the content publishing system112or an external source for processing and interpretation. For example, the third party processing system108receives an audio file, translates it to text, and sends the text back to the application on the client device102or sends the translated text to the content publishing system112for further processing. The audio file, the text generated from the audio file, and any associated metadata may be interpreted by the content publishing system112and used to calculate or update a user's reading score. In another example, the third party processing system108is a database with expected reading ability of for users of a specific age. In this example, the content publishing system112compares data collected and calculated within the content publishing system112with a wider set of data from a third party source. In a further example, the third party processing system108is a website used to grade user assessment information gathered by the content publishing system112. In turn, the content publishing system112sends assessment results to the third party processing system108, so that the third party processing system108may determine if the responses where correct or incorrect.

The content store118stores objects that each represent various types of content. For example, the content store118stores content items received from one or more sources106. Examples of content items stored by the content store118include a digital book, a video, an article, or any other type of content. For each content item stored in the content store118, the content publishing system112maps a user score or other measure associated with a determining a user's reading ability. The content store118also includes sets rules defining the conditions that determine which version of a text, primary text of secondary text (alternative versions of core text), is present to a specific user, based on the users reading score or other unique factors as previously described. The content store118also includes an expected user score for content items provided by a source106. The user analysis module120retrieves user profile information from the user profile store114, user interaction information from the interaction store116, and analyzes the retrieved user interaction information in view of expected interaction information for a particular viewing user or group of users of the content publishing system112. The scoring module122uses the analysis information received from the user analysis module120and rules and expected user scores stored in the content store118to calculate a present user score that represents the present reading ability of a viewing user.

Selecting a Content Version Based on User Interaction Information

FIG. 2is a flowchart of a process200for selecting a representation of a digital content item based on user interaction information. In one embodiment, the process200is performed by the content publishing system112, which may perform the steps illustrated byFIG. 2in different orders. Alternatively, the process200is performed by a content selection application executing on a client device102or by a combination of the content publishing system112and a content selection application executing on a client device102. In some embodiments, different or additional steps than those shown inFIG. 3may be performed.

The content publishing system112receives202identifying information describing one or more attributes of a viewing user from a viewing user via a client device102and the network110. Example attributes of a viewing user include age, grade level, language fluency, or other user information that may be used by the content publishing system112to determine an expected user score. Alternatively or additionally, the content publishing system112receives202identifying information describing a user's reading ability from a third party, such as an educational institution, examination administration service, or an application accessible by the client device102.

The content publishing system112determines204an expected user score of the viewing user based at least in part on the identifying information. In one embodiment, the content publishing system112determines an expected user score by computing scores based on attributes of the identifying information, historical interaction information associate with the user, global information describing identifying information about a group of user (e.g., a group comprising all fifth graders in public schools located in Santa Clara County, California), global information describing interaction information of a set of users of the content publishing system112. Alternatively, the content publishing system112determines and expected user score based on information received from a source106, such as a publisher, as previously described.

During a session (i.e., a viewing session) when the client device102is connected with the content publishing system112, the content publishing system112receives206from the viewing user, a selection of a digital content item accessible from the content publishing system112. In one example, the content publishing system112provides a user interface by which a requesting user interfaces with the content publishing system112, using a client device102, to select from among the various digital content items for download. As previously described, the digital content item is a file organized as multiple sections, where each section includes one or more versions information pertaining to the respective section.

The content publishing system112receives user interaction information describing one or more interactions by the viewing user with the selected digital content item. For example, the content publishing system112may retrieve user interaction information while connected to a client device102during a viewing session. Alternatively or additionally, the content publishing system112retrieves the user interaction information from a third party external to the content publishing system112or from an application residing on the client device.

The content publishing system112interprets the retrieved user interaction information and metadata, and uses the results of the interpretation to calculate210a present user score. For example, using the retrieved user interaction information and metadata the content publishing system112may determine one or more of the following: the viewing user's ability to read a text aloud with proper pacing, pronunciation and tone; the types of words for which a viewing user seeks vocabulary support; engagement level (i.e., is the viewing user demonstrating that they are activity engaging with the text by taking notes, re-reading their own notes, reading notes from a teacher or peers, and actively choosing to adapt the text based on their own visual preferences); how the viewing user responds to an adaption of their reading experience based on their reading score; a viewing user's ability to demonstrate to answer assessment information (e.g., a quiz or test correction after the content publishing system112has provided the viewing user support); a viewing user's determination to select an alternative version of a text, if available; the pace at which a viewing user progresses through a content item; the viewing user's level of reading skill across genres; a viewing user's ability to answer questions about the text; and a viewing user's ability to play or complete games or activities that require understanding of the text.

To calculate210a present user score the content publishing system112applies, using a processing device, one or more rules to one or more attributes of the interaction information. As previously described, the rules may be retrieved from the source (e.g., publisher), specified by administrative user, or otherwise specified. The content publishing system112uses the retrieved user interaction data and any supplemental data and applies an algorithm to that data, which compares data generated by the user to expectations for that user, based at least in part on the users' identifying information. In one example, the content publishing system112computes score, based on the following rules: if a viewing user can read aloud a portion of core text at their grade level correctly, increase present user score, otherwise if the viewing user cannot read the portion correctly decrease the score; if a viewing user request help on a vocabulary word that is below his grade level, decrease present user score, and if the viewing user requests help on vocabulary that is above his grade level, increase present user score; increase present user score when a viewing user annotates a content item; increase a present score of a viewing user if they read notes from another user; increase a present score of a viewing user if they read notes from a teacher; increase a present score of a viewing user if the viewing user revisits their own notes from a passage; increase a present user score of a viewing user if after downward adaptation in text difficulty, the viewing users reads at a faster pace, shows greater engagement, or answers a higher number of questions correctly; if a viewing user answers a question incorrectly for a second time, after having answered it incorrectly and then receiving support, decrease a present user score of the viewing user; if a viewing user selects text that are above their recorded grade level, increase a present user score of the viewing user; if a viewing user selects a text that is below their grade level, decrease a present user score of the viewing user; if a viewing user reads a book at a pace that is below expectation for their grade level, decrease present user score of the viewing user, but if they read a book at a pace that exceeds expectations for their grade level, increase the present score of a viewing user. The computed score may be weighted, for example, the score associated with whether a viewing user can read aloud a portion of core text at their grade level correctly may be weight highest of all computed scores.

The content publishing system112selects212for display to the viewing user based on the calculated user score, one or more updated or alternative version of section included in the previously selected content item. For example, the content publishing system112sends instructions to the user device102associated with the viewing user that causes code residing within the selected content item file to select the appropriate version of one or more sections of the selected content item, based on that viewing user's calculated present reading score. In one example, the instructions operate to substitute a version of core text, or direct an application residing on the client device102to reveal other forms of support that are specific to the viewing user's literacy and fluency. Furthermore, if a viewing user's answers an assessment question incorrectly, the instructions may also cause an application residing on the client device102to direct the viewing user to the area of the text that contains the correct answer to that specific question. The instructions may also cause an application residing on the client device102to reveal guidance on how to respond to specific types of questions. Instructions may also cause an application residing on the client device102to reveal other text, or other types of audio visual media, or links to other text and multimedia, that is intended to help the viewing user comprehend the text which they are reading.

FIG. 3is a flowchart of another process for selecting a representation of a digital content item. In one embodiment, the process300is performed by the client device102, which may perform the steps illustrated byFIG. 2in different orders. Alternatively, the process300is performed by a combination of the content publishing system112and a content selection application executing on a client device102. In some embodiments, different or additional steps than those shown inFIG. 3may be performed.

The client device102sends302identifying information describing one or more attributes of a viewing user from a viewing user via the network110. The identifying information is similar to that described with respect to step202ofFIG. 2. The client device102receives304from the content publishing system112one or more options for selecting a digital content item. In one example, the client device102may include a user interface that allows a viewing user to select a digital content item included in the content publishing system112during a viewing session. Response to a selection made by the viewing user, the client device102sends306an indication of that a particular content items was selected using the device associated with the viewing user. Responsive to the selection, the client device102receives308the selected digital content item. As previously described, the received selected content item includes one or more alternative versions of core text, user assessment information, and user assist information. The received selected content item also includes instructions operable to cause an application residing on the client device to select from among alternative versions of core text, user assessment information, user assist information based on interaction data provided to the content publishing system by the client device102.

During a viewing session, which may occur when the client device102is not in communication with the content publishing system112, the client device102generates310interaction information describing interactions of the viewing user with a selected content item. This may occur in an online or an offline mode, where the client device102is not connected to the content publishing system112. The generated interaction information may be stored locally on the client device102, or uploaded to the content publishing system112during a subsequent viewing session. For example, during a subsequent viewing session, the client device102may receive312instructions that when executed by an application residing on the client device102to select an updated or alternative version of core text, user assessment information, or user assist information based on the interaction information provided to the content publishing system112. The received selected content item also includes instructions operable to cause an application residing on the client device102operating in an offline mode to select from among alternative versions of core text, user assessment information, and user assist information based on interaction data logged by the client device102. The instructions may also cause an application residing on the client device102to reveal guidance on how to respond to specific types of questions. Instructions may also cause an application residing on the client device102to reveal other text, or other types of audio visual media, or links to other text and multimedia, that is intended to help the viewing user comprehend the text which they are reading.

Summary