# Patent

## Title
Method and apparatus for identifying user-selectable elements having a commonality thereof

## Abstract

Operations for identifying user-selectable elements are detailed in the present application, the operations comprising providing a first group of user-selectable elements having a first attribute in common, displaying the first group of user-selectable elements in a first array thereof, providing a second group of user-selectable elements having a second attribute in common, displaying the second group of user-selectable elements in a second array thereof, and displaying a visual distinctive feature in connection with a set of user-selectable elements having a third attribute in common, the set of user-selectable elements comprising at least one user-selectable element from the first group of user-selectable elements and at least one user-selectable elements from the second group of user-selectable elements, wherein the third attribute is associated with each user-selectable elements in the set of user-selectable elements irrespective of the position of each user-selectable element in relation to one another in the first array and the second array, the visual distinctive feature identifying the user-selectable elements associated with the third attribute from the user-selectable elements not associated with the third attribute. Variations thereof, non-transitory instructions and, inter alia, a graphical user interface thereof are also contemplated therein.

## Background
CROSS-REFERENCE
This United States patent application is a continuation application of, relates to and claims priority from U.S. patent application Ser. No. 11/944,014, filed Nov. 21, 2007, entitled METHOD AND TOOL FOR CLASSIFYING DOCUMENTS TO ALLOW A MULTI-DIMENSIONAL GRAPHICAL REPRESENTATION, which relates to, claims priority from and is a non provisional application of provisional application No. 60/957,444, filed Aug. 22, 2007, entitled INFORMATION ELEMENTS LOCATING SYSTEM AND METHOD, and which relates to, claims priority from and is a non provisional application of U.S. provisional application No. 60/971,214, filed Sep. 10, 2007, entitled GEOGRAPHICAL LOCATING SYSTEM AND METHOD. All these documents are enclosed herein by reference in their entireties.


BACKGROUND OF THE INVENTION
1. Field of the Invention
This invention relates generally to computer systems and more specifically to man-machine interfaces that facilitate information localization and organization.
2. Description of the Related Art
Computer systems are changing the way we live. They give access to a tremendous computing power. Now everybody can own and operate a computer system. The evolution of computer systems and software happens quite rapidly. Thirty years ago computers were huge mainframe units with less computer power than today's small calculators; now we have small and powerful computer systems that are relatively inexpensive.
Because they have become sufficiently powerful, computer systems are now part of our everyday communication tools, allowing their users to store larger and larger quantities of data (i.e. information). Given the ever-increasing scale and diversity of information and use of the Internet, improving the technology of information retrieval is important. Information on every form (i.e. data, audio, picture, video . . . ) is now easily accessible like never before with available networks (for instance the Internet). Therefore, the data quantity the computer system user has to deal with is growing at an accelerated rate. The volume of information is already so high that the time necessary to deal properly with it is often unacceptable especially for professionals, scientists and business people. In order for that information to become actually usable knowledge, it needs to be easily accessible, usable and understandable.
Evolution of computer science over recent years has allowed nearly all types of information to be digitized and transformed into a form a computer can handle. The sources of information are numerous, therefore it is difficult for prior art computer systems to store information in a manner that: A) allows retrieval through a common process/presentation, B) allows the storage structure to be adjusted to his/her thinking process, C) allows the user to create links between the elements of information and D) provides visualization that clearly shows the continuity between different elements of information that are using a different time frame. In consequence, the task of efficiently gathering and extracting information from computer systems may be both difficult and tedious.
The systems well known in the art, however, are designed so that the user has to adapt to the computer systems rather than the other way around. Furthermore, the filing process in the computer system will generally lead to some extent, to the loss of the flow of information, as portions of information are separated during the filing process. Creating multiple links is usually tedious, complicated, requires self-discipline and is very costly in terms of time and memory space.
Conventional computer systems for organizing information are often implemented as part of the operating system of the computer system and are therefore provided as a basic utility to the user of the system to allow the user to organize information in a manner embedded in the operating system.
The main organizing system that is usually provided with existing operating systems is the hierarchical filing system. The hierarchical filing system is well known in the prior art and provides a hierarchy of folders (i.e. directories or subdirectories) into which the user may store information, such as text documents, data, pictures, videos, and music files.
Classification and accessibility to the information usually require user knowledge of numerous applications, as well as self-discipline in the mapping of the data storage system. Each type of file has a unique software that is suited to open it. Now, the Internet provides some kind of interchangeability between files of differing format although the interchangeability is often limited to Internet related files (i.e. HTML, XML, JAVA . . . ). Even if the meaning of one information as part of a group of information is critical, generally it is not possible to have a global overview of all the various types of information recorded because of the number of different programs needed to visualize the different file types. The links between various files relate to a common topic and are not obvious to the user.
The most popular hierarchical filing system in operating systems are Windows ExplorerTM on WindowsTM operating system and the FinderTM on the MacintoshTM operating system. Despite popularity, these systems provide tools that manage efficiently only small quantities of information at a time. These systems both remain restrained to filing by file names using the “save as” function in most applications. With this kind of classification a user can only have a “local” view on what is stored in the computer system; a problem typically occurs when the information quantity is too large and diversified. The problem is exacerbated if links between the different information are provided.
While the hierarchical filing system allows a user to specify a structure within which to file and store information in order to avoid the clutter of a single folder receptacle, the hierarchical structure forces the computer user to be as organized as possible in filing information. If the user has difficulty in filing documents because of the difficulty in deciding the proper categories for the document (e.g. the document does not clearly apply to only one specific folder), the user can file the document in a folder where it will be difficult to retrieve considering it could have been placed logically in many different folders. The usual manner prior art systems use would be to save a copy of a document in as many different directories as there are links and save linked documents in the same directories. Such an approach is labor-intensive, requires considerable self-discipline, and is extremely costly in terms of time and memory space. Furthermore, the links between the documents remain non-evident.
As more and more documents are stored in the computer system memory, an increasing number of documents are arbitrarily stored in the hierarchical filing system. The user begins to have a bewildering clutter of documents in every folder. Some of the documents are misplaced or should have been located in many folders at the same time. With time, the user's needs change and the hierarchical filing system must be updated with newer considerations but most users are dissuaded because of the known difficulty and time requirements. Usually, users prefer to continue saving files to the same directories and folders and then wishing they could remember where the files were stored. In addition, the time needed to search in that kind of hierarchical filing system becomes more and more important as the number of files is growing.
It should be noted that the difficulty in filing documents in a computer system also affects the way the user interacts with the computer system in that the user attempts to avoid the difficult work involved in filing a document that is hard to categorize. This tends to result in the computer becoming cluttered with documents that are hard to categorize or otherwise filed or the user does not attempt to place the documents in the computer system memory at all because of the realization it will be difficult to organize. This effect tends to negate the advantages of a filing system that has a hierarchical filing system with a graphical user interface.
Every user has a preferred manner to file information in a computer system. Some prefer a file name to distinguish each document while others will implement different hierarchical architecture. Other users will file information according to time. It is hard for someone else to understand what the computer system is keeping in its memory considering the different ways users can tailor the hierarchical filing system. It is hard to understand what is important, what is not, and what is related to what. Interchangeable knowledge is still difficult to attain between computer systems users. This is obvious in that it is often difficult to understand the information on an unfamiliar computer and the time needed to familiarize oneself with an unfamiliar system is often time-prohibitive.
Prior art information organizing systems usually do not provide a way to easily understand links between the information. Every information is usually considered as a unique piece of information and only the creator of the information is (really) aware as to what it relates to. An E-mail, a web page, a spreadsheet, or a text document is certainly information but the value they have is limited as long as the links between them are not obvious to another user. Computer system do not have information organizing system that allow the user to perceive efficiently the links that connect information elements in an “understandable story” to get the whole meaning of the information. That is, the user is still oblivious to the trends underneath the information.
When one is given a document to review, there is often a desire to annotate the electronic document similar to annotating a paper copy. Doing so with an electronic document will, similar to the paper version, result in permanent alteration of the base document unless a second copy is made. Furthermore, if different notes and comments are aimed at different individuals, there needs to be as many different copies as there are targets or receivers. It then may be desirable that such annotations be made on a layer that does not alter the original document to avoid creating new documents for each desired target.
In addition, conventional information organizing systems suffer from at least another disadvantage: they do not provide a tool to easily search and visualize the search results starting with an arbitrary information element. Search results provided by conventional information organizing system are given in order of relevancy using typed text as a searching interface. Results are not given using pictures or images although the information would be much more valuable since it is not possible to explain in a short paragraph what a picture can show. When the user is doing a search within a conventional organizing system or even with Internet search engines, the user is usually beginning searching with specific words, topics, or file formats. This allows the user to isolate information elements that contain the searched words either in the title or in the file itself. It is similar with file format in that only file names of a specific format will be showed as a search result. Often, results will be presented by relevancy using a listing. Relevancy is based on arbitrary considerations depending on the search engine used. That kind of search fails to present search results where the related links with the information element are clearly shown.
With a prior art information managing system, the user must often meticulously store documents in numerous directories. Easily displaying all the elements linked and their sequence of entry is usually difficult. Furthermore, displaying all the elements of information linked by a combination of attributes to display all the linked elements in the order or sequence that they have been entered (it may, for instance, be useful to show a series of communications that have led to a final memo, or a series of reports that have led to a given professional decision) is also impractical. Conventional information managing systems are often time-consuming and include obstacles that prevent users from regularly maintaining, in a structured manner, significant quantities of information. For example, if a user wants to keep a “life long” information journal or logbook (like R. Buckminster Fuller's Chronofile for instance), the user cannot use prior art information organizing systems to record the information from his/her life. It is not possible for an individual to record and to file various information elements from multiple sources over a long period of time and hope that someone else will be able to understand quickly and efficiently the meaning of the information, the relationship between the information elements as well as the order in which the events occurred. Any sorting of these information would lead to the destruction of the only relation that exists between them.
In corporate environments, it is important that the “knowledge” of the enterprise remains usable, regardless of the employment status of the author. Additionally, it is also desirable that the data management methods used by employees be unified, both for efficiency, interchangeability and ease-of-training reasons. That is, a unified system enables the decision-making process to be more coherent. An efficient and coherent information managing system should also be an intricate part of a company quality assurance program.
Furthermore, companies that are engaged in extensive research and development generate substantial files and documents from several sources. As a result, these document-driven firms need a tool to efficiently track these documents. It can be useful to keep track of project history and the objective behind each stage of the project. By maintaining a detailed history, additional projects may be fostered and repetitive projects avoided. Adding to the need for efficient and organized document management is professional employee turnover. One example of an incentive for a structured file management structure is tax incentive. In some countries, research and development can be tax deductible. In order to have access to the R&D tax credit a company must prove the work was done. With prior art documents filing systems it represents an enormous task to find the information needed to make the proof. Knowledge tracking, recording, and interchangeability represent a constant challenge and a huge task that prior art systems cannot adequately accommodate.
Maintaining an address book and a calendar or agenda are usually considered by conventional information managing systems as separate tasks using separate software. These two relations to information are fundamental and should be included in a complete designed information managing system.
Prior art computer systems or computer interfaces have not provided solutions to deal with the aforementioned problems and each of these deficiencies in the prior art yield a demand for an improved information managing system and method using an intuitive and natural way to visually present information as well as the associations between the information. Other needs might become apparent for a person having skills in the art of information management in view of the present reading.
SUMMARY OF THE INVENTION
It is, therefore, desirable to provide a method and a system that organize information that is an improvement over known information organizing methods and systems and improves at least one of the aforementioned deficiencies.
Accordingly, one aspect of the present invention provides a unified method for graphically representing and organizing documents, that might be any kind of information regardless of the format, type, size, media or nature of the information.
In accordance with another aspect of the present invention, at least one characterization attribute is associated with each information element. A characterization attribute can be described as a “category”, topic, condition, task, action or type of document that characterizes the information element according to the meaning the information element has for the user. Because it is desirable to carry as much context as possible with every information element the invention also provides a tool to work with many characterization attributes for every information element.
One further aspect of the present invention is a vector of information elements. An information element vector is usually the representation of more than one information element in a particular order. Accordingly, this aspect of the present invention provides a first document vector. The first document vector generally includes documents having at least one common characterization attribute. Document vectors present documents regardless of format or origin. The ordering of documents on a vector is made according to a desired order (i.e. time, statistics, memory size, last used, . . . ).
According to another aspect of the present invention, the selection of at least one characterization attribute from at least one document on a document vector generates a second document vector including minimally one, but generally more than one, documents. The ability to simultaneously show a sequence of documents as well as a sequence of linked documents actually creates a multi-dimensional graphic interface.
According to another aspect of the present invention, the generation of a second document vector may act as a relational search engine presenting documents that include at least one common characterization attribute. The second document vector presents documents in a way it is easy to ascertain which document is following the other on a same topic or category associated by an information attribute. In addition, it is intuitive and easy for the user of the information system to follow the path documents using the document vectors in a multi-dimensional environment. The document vectors are evolving in the vectorial space that might be interpreted as a plan or a volume used by the different vectors.
In one aspect of the present invention, the system graphically represents on a display the document vectors containing a representation of documents in a predetermined order so it is possible to perceive what documents are surrounding a selected document, what is before, what is after on one or on many characterization attributes. The graphical representation brings a lot more information in a glimpse of an eye than conventional representations (i.e. listings). Furthermore, the user can switch from one document to another following only the relation between them (i.e. characterization attributes).
It is another aspect of the present invention to have a third document vector.
It is another aspect of the present invention to have a third document vector which may represent the variation in time of a given document. Variations can mean versions, annotations, and updates of a given document.
Another aspect of the present invention provides a progressive zoom in and zoom out of the document vector. A user can then see only a part of one document, one complete document; or many documents on one or more document vectors.
Another aspect of the present invention is to provide a global interface and a plurality of specific document interfaces so that each document has its own specific interface where it is possible to visualize and to act on its particular characterization attributes. This aspect of this invention allows a user to act globally on the system while using the global interface as well as the possibility to act locally on each individual document using the specific information element interface.
Another aspect of the present invention is to provide a multi-vectorial computer operating system. The multi-vectorial locating system acts as a direct link between the documents and the different devices. Furthermore the operating system presents the information using document vectors. The multi-vectorial operating system adds more value than a prior art operating system because it includes more than only the “computer mechanic” by assisting the user to manage documents.
Another aspect of the present invention provides a long-term view of the vectorial space that may be utilized like a radar screen. The representation gives the user an extreme “zoom out” picture of the different visualized document vectors in a simplified form. This representation makes visible in the display a large quantity of graphically represented documents. A time grid might be applied so the user can easily see the documents according to, illustratively, time. Furthermore, a document coloration variation provides more information about the various documents. That way, the user can perceive patterns among documents. The grid can provide a view of the past and the future, relative to a document. Showing the future, for instance would be an appropriate way to present tasks from the user's agenda or future actions to be taken (base or not on previous document). Selection of a simplified form of a document leads the user to alternate information related to the document.
Another aspect of the present invention is that the document vectors are represented in a way it is possible for the user to use a controller to “navigate” within the vectorial space. The information elements being presented on document vectors it is now possible to navigate using the relations between the documents and the links presented to the user. Every move in the vectorial space offers the user a specific multimedia “story”.
In one aspect of present invention, a theme can be applied to the vectorial space to improve the user experience. The theme helps to maximize the user's experience in using the vectorial space. The game theme uses the different document vectors, the zooming effect, and the navigation capabilities of the system to transform information managing in an electronic game mean. Another aspect of this invention is to use a “game controller” instead of a mouse or a keyboard to use the currently described system. A game controller is usually used with game console to improve the user's experience and to maximize the abilities of the user to make many complex actions with a simple tool. The use of the game controller can be made in addition to the mouse, the keyboard or any other means for influencing the computer system.
It is an aspect of the present invention to integrate seamlessly the agenda, the email system and the address book of the user in the information system. The agenda and the address book are generally considered by prior art information managing systems as distinctive “tools” but they are, in fact, either or both documents and characterization attributes.
Another aspect of the present invention is to offer at least three interconnected main document vector types, illustratively: personal, professional, and corporate. Then, if the user needs to, those document vectors can be isolated so only one of them can be shared thereby keeping the others secured. It may also be possible that access to the user's information, restricted or not, be given to other parties, or to the user from a remote location.
According to another aspect of the present invention, every information element has a number. The number is, most of the time, given accordingly to the entry order. Since the document format is standardized in the system, the user can intuitively consider the number as a “page” number so it is easy to refer to a particular document. Complex page numbers are also utilized to identify an information element on more than one document vector. Complex page numbers can also be utilized to add more information to a document page number. The number is also used as a hyperlink inside the system. That way it is possible to link documents between them so it becomes possible to access directly a document from another inside the vectorial space.
Another important aspect of the present invention is to provide a plug-in mean to a conventional browser (i.e. Internet ExplorerTM, NetscapeTM, FireFoxTM or SafariTM). The multi-dimensional plug-in provides the conventional web browser the capacity to navigate document vectors. This leads to another aspect of the present invention providing a web-based system.
Another aspect of the present invention is to provide a direct way to produce an Internet web site. The information element to be included in the web site can be selected choosing the appropriate characterization attribute. This would lead to an easy to build “multi-vectorial” website.
An aspect of the present invention provides a tool for classifying documents to allow a multi-dimensional graphical representation comprising a plurality of characterization attributes associable with a plurality of documents to enable classification of the documents, at least some of the plurality of characterization attributes adapted to enable a first group of documents, each document from the first group of documents having at least one characterization attribute in common; at least some of the plurality of characterization attributes adapted to enable a second group of documents, each document from the second group of documents having at least one characterization attribute in common; and an interface adapted to enable the formation of a first document vector displaying at least some of the documents from the first group of documents and the formation of a second document vector displaying at least some of the documents from the second group of documents, and adapted to enable navigation along each document vectors.
Another aspect of the present invention provides an apparatus and/or a method for representing and managing a plurality of document vectors, each displaying a group of documents, using various visual distinctive features to draw relations between documents according to related characterization attributes, conditions, delays, actions and tasks according to an embodiment of the present invention.
One aspect of the present invention provides an apparatus and/or a method for displaying and managing a document vector along a timeline, that use various visual distinctive features to improve the meaning of the graphical representation of the plurality of documents.
An aspect of the present invention provides a computerized system for displaying, managing and rendering technological mappings by displaying, on document vectors, documents associated with technologies/product/systems and adding various visual distinctive features to the displayed documents and/or displayed document vectors to identify relations between documents and/or document vectors.
An aspect of the present invention provides a non-transitory computer-readable medium having stored thereon computer-readable instructions that, when executed by a processor of a computer system, cause the computer system to perform operations on user-selectable elements, the operations comprising providing a first group of user-selectable elements having a first attribute in common, displaying the first group of user-selectable elements in a first array thereof, providing a second group of user-selectable elements having a second attribute in common, displaying the second group of user-selectable elements in a second array thereof; and displaying a visual distinctive feature in connection with a set of user-selectable elements having a third attribute in common, the set of user-selectable elements comprising at least one user-selectable element from the first group of user-selectable elements and at least one user-selectable elements from the second group of user-selectable elements, wherein the third attribute is associated with each user-selectable elements in the set of user-selectable elements irrespective of the position of each user-selectable element in relation to one another in the first array and the second array, the visual distinctive feature identifying the user-selectable elements associated with the third attribute from the user-selectable elements not associated with the third attribute.
Another aspect of the present invention provides a non-transitory computer readable program code for execution by a computing apparatus for implementing a graphical user interface on a display device, the graphical user interface comprising: a first display area adapted to display a first group of user-selectable elements; and a second display area adapted to display a second group of user-selectable elements; the graphical user interface being adapted to display a visual distinctive feature in connection with user-selectable elements displayed in the first display area and the second display area irrespective of a position of the user-selectable elements in relation to one another on the first display area and on the second display area, the visual distinctive feature discriminating the user-selectable elements displayed in the first display area and the second display area that share a commonality, whereby a user can distinguish the user-selectable elements that share the commonality from the user-selectable elements that do not share the commonality.
An aspect of the present invention provides an apparatus for implementing a user interface adapted to discriminate user-selectable elements displayed thereof, the apparatus comprising: a memory module adapted to store thereon a plurality of user-selectable elements; a processing unit in communication with the memory module, the processing unit being operative for executing computer readable program code stored on a non-transient computer readable medium for implementing a graphical user interface, the graphical user interface being adapted for displaying on a display: a first group of user-selectable elements from the plurality of user-selectable elements that have a first attribute in common, the first group of user-selectable elements being displayed along a first axis; a second group of user-selectable elements from the plurality of user-selectable elements that have a second attribute in common, the second group of user-selectable elements being displayed along a second axis; a visual distinctive feature in connection with a set of user-selectable elements having a commonality, the set of user-selectable elements comprising at least one user-selectable element from the first group of user-selectable elements and at least one user-selectable element from the second group of user-selectable elements, wherein the commonality is attributed to each user-selectable element in the set of user-selectable elements irrespective of a position of each user-selectable element in relation to one another on the first axis and the second axis, the visual distinctive feature discriminating the user-selectable elements associated with the commonality from the documents not associated with the commonality.
These and other advantages and features of the present invention will become apparent from the following description and the attached drawings.



BRIEF DESCRIPTION OF THE DRAWINGS
FIG. 1 is a block-diagram of the sources of information leading to knowledge growth;
FIG. 2 depicts a schematic representation of the growth of an individual's knowledge in time;
FIG. 3 depicts a schematic representation of multiple individual's vectors in time;
FIG. 4 depicts a schematic representation of parallel vectors of individuals in time and the contacts leading to the exchange of information between them;
FIG. 5 depicts a schematic representation of the “bicephal” (personal/professional) aspect of an individual's path in time;
FIG. 6 is a block-diagram of an integrated hardware and software computer system;
FIG. 7 is a block-diagram of a filing process controlled by the SMLOI;
FIG. 8 is a block-diagram of the multiple unique filing process controlled by a prior art operating system;
FIG. 9 is a block-diagram depicting the multiple-link part of the filing process controlled by the SMLOI;
FIG. 10 is a block-diagram depicting the information insertion levels in the SMLOI;
FIG. 11 depicts the notions of information's layer, version and assembly in the SMLOI;
FIG. 12 depicts one SMLOI information element;
FIG. 13a depicts an information element with a date and time counter;
FIG. 13b depicts a unified format representation of an information element;
FIG. 14 depicts a more detailed view of the characterization attribute window from the attribute sub-area in the SMLOI;
FIG. 15 depicts a SMLOI information element illustratively having a unified format representation of an audio document;
FIG. 16 depicts an alternate dynamic assembly of an audio unified format representation document in the SMLOI;
FIG. 17 depicts a SMLOI information element illustratively having a unified format representation of a video document;
FIG. 18 depicts an alternate dynamic assembly of a unified format representation video document;
FIG. 19a depicts a unified format representation of an Internet sourced document;
FIG. 19b depicts an alternative unified format representation of the document of FIG. 19a; 
FIG. 20 depicts an unified format representation of an odd-sized document;
FIG. 21 depicts an unified format representation of an odd-sized document resized in a standard SMLOI information element size;
FIG. 22 depicts an unified format representation of a reference to a non-electronic document;
FIG. 23 depicts a SMLOI basic entry sequencing applied to an unified format representation of a document as it is inserted in the SMLOI;
FIG. 24 depicts an alternative “pile” methods of graphically representing the information element order in the SMLOI;
FIG. 25 depicts an alternative “roll” method of graphically representing the information element order in the SMLOI;
FIG. 26 depicts the use of bookmarks in the SMLOI;
FIG. 27 depicts a bi-dimensional view of two intersecting information element vectors in the SMLOI;
FIG. 28 depicts a bi-dimensional view of multiple intersecting information element vectors in the SMLOI;
FIG. 29 depicts a tri-dimensional view of three information element vectors in the SMLOI;
FIG. 30 depicts a tri-dimensional view of three information element vectors in addition to a fourth vector in the SMLOI;
FIG. 31 depicts the second relative information element vector possibilities according to the fourth vector;
FIG. 32 depicts a typical corporate bloc diagram;
FIG. 33 depicts an alternative SMLOI illustratively applied to a multi-user corporate environment;
FIG. 34 depicts an access grid from a SMLOI in a multi-user corporate environment;
FIG. 35 depicts an alternative SMLOI in a multi-user corporate environment;
FIG. 36 depicts an alternative SMLOI access bloc diagram for a typical corporate environment;
FIG. 37 depicts a uni-dimensional view of the SMLOI with access codes;
FIG. 38 depicts a uni-dimensional limited access view of the SMLOI;
FIG. 39 depicts a privacy-enhanced view of the SMLOI;
FIG. 40 depicts a bi-dimensional limited access view of the SMLOI;
FIG. 41 depicts a uni-dimensional view of the SMLOI;
FIG. 42 depicts a uni-dimensional view of the SMLOI in privacy-enhanced mode;
FIG. 43 depicts a proposed graphical interface for the SMLOI;
FIG. 44 depicts multiple view size windows of the SMLOI;
FIG. 45 depicts a proposed “radar-screen” in the SMLOI;
FIG. 46 depicts a proposed “radar-screen” presenting the future in the SMLOI;
FIG. 47 depicts a proposed view of the SMLOI in a web browser window;
FIG. 48 depicts SMLOI as part of a typical game console;
FIG. 49 depicts a typical game console controller;
FIG. 50 depicts a path using multiple information element vectors;
FIG. 51 depicts a bi-dimensional view of the SMLOI with non-parallel information element vectors intersecting in distinct planes;
FIG. 52 depicts a bi-dimensional view of the SMLOI with animated movements of the information element vectors reacting to navigation in the SMLOI;
FIG. 53 depicts three information element vectors according to an embodiment of the present invention;
FIG. 54 depicts the three information element vectors of FIG. 53 with various information element alignments according to an embodiment of the present invention;
FIG. 55 depicts the three information element vectors of FIG. 54 with various visual distinctive features according to an embodiment of the present invention;
FIG. 56 depicts the three information element vectors of FIG. 55 with additional information element vectors according to an embodiment of the present invention;
FIG. 57 depicts the three information element vectors of FIG. 54 with condition and delay applied to information elements according to an embodiment of the present invention;
FIG. 58 depicts the three information element vectors of FIG. 54 with condition and delay applied to information elements according to an embodiment of the present invention;
FIG. 59 depicts the three information element vectors of FIG. 54 with condition and delay applied to information elements according to an embodiment of the present invention;
FIG. 60 depicts the three information element vectors of FIG. 54 with condition and delay applied to information elements according to an embodiment of the present invention;
FIG. 61 depicts a combination of characterization attributes, visual differentiators and conditions applied to patent prosecution documents according to an embodiment of the present invention; and
FIG. 62 depicts a combination of characterization attributes, visual differentiators and conditions applied to patent prior art management according to an embodiment of the present invention.



DESCRIPTION OF EMBODIMENT(S) OF THE INVENTION
A System and Method for Locating and Organizing Information (SMLOI) illustratively stored in the memory of a computer system will now be described in detail. The following description, specific steps, procedures, method, commands, graphic representation, computer user interface and other specifics are set forth in order to provide a thorough understanding of the present invention. However, it will be apparent to one skilled in the art that the present description of the invention provides only one example of how someone skilled in the art can produce the claimed invention. It will also be apparent to one skilled in the art that the present invention may be practiced without or with only a portion of the specific details disclosed herein. In other instances, well-known systems and methods are shown in schematic and diagrammatic form or not shown at all in order not to obscure with unnecessary details the present invention.
The “Vector” Knowledge Theory
In order to build a good knowledge management system it is necessary to analyze how knowledge is acquired and how it is processed by a human being. A model was created to help understand how people are managing information and knowledge.
To improve the efficiency of knowledge management, the usefulness of the knowledge should be increased. If the knowledge is defined as the sum of the information retained, it can be said that the increase in efficiency of knowledge management can be attained by improving the usefulness of the retained information. The usefulness of the information lies in its ability to be understood, recorded, classified, visualized, anticipated, retrieved, extracted and shared.
FIG. 1 illustrates how someone's knowledge level 10 increases. Information is acquired through contact 14 with other individuals or learned 12. The learned information 12 can be provided by actions 16 and events 18. FIG. 1 illustrates also that information acquired through contact 14 with other individuals can come from meetings or minutes 20, messages or conversations 22, and documents 24.
The information gathering process is continuous for an individual. FIG. 2 shows the path of an individual, schematized by a cylindrical shape 30, relative to the absolute time vector 32, as being a continuous gathering of information. The cylindrical shape 30 is a schematized vector and will be explained in details later in this description. The gathering process is illustratively operating through actions “a” 34, contacts “c” 36 and events “e” 38 for the purpose of this description. The amount of the knowledge or information is represented by the cross area 40 of the cylindrical shape 30, and, as information is acquired through time 32, the knowledge is increased, hence, diameter D2 44>diameter D1 46.
FIG. 3 shows three cylindrical shapes 30 that represent the continuous, parallel paths of three different individuals 50, 52, and 54, respectively, relative to time 32. Interaction 72 occurs between individuals 50, 52, and 54 at time point 56 on the absolute time vector 32 over a period of time.
FIG. 4 shows the continuous, parallel path of individuals 50, 52, 54, 60, 62, 64, and 66, respectively, relative to time 32. Interaction 76 occurs between individuals 64 and 66 at time point 68, interaction 74 occurs between individuals 50 and 60 at time point 70, and interaction 72 occurs between individuals 50, 52 and 54 at time point 56. At interactions 72, 74, and 76 the contacts are likely to generate an exchange of information. The information can be of a personnel or a professional nature. For example, if individuals 50, 52, and 54 are employees of the same company their professional information transmitted during event 72 at time point 56 may be labeled as corporate.
FIG. 5 shows the path of individual 50, 52, 54 and 60 with one professional interaction 72 at time point 56 and one personal interaction 74 at time point 70. Personal interaction 74 is labeled and considered differently than a professional interaction 72.
The cylinder 30 diameter variation, as shown in FIGS. 2 to 5, represents the amount of knowledge 10 acquired by an individual. Equations and algorithms can be applied to that cylindrical representation 30 of the increasing diameter 46. Some of the variables may be the time vector 32, the cross area 40 of the cylinder 30, the time between contacts, the number of individuals, the nature of contacts, the diameter variation rate, the contact rate, the event rate, and the communication rate.
Accordingly, this theory, as schematized by this model, considers the time as a major reference in the knowledge gathering process of an individual. Other references, maybe less intuitive, will be listed later and are within the scope of the present invention. Different interactions between individuals generate information exchange. Further in the description it will be useful to understand that the schematized cylindrical shape 30 is a vector, further described as 230 and 232, in the SMLOI.
The Computer System
The System and Method for Locating and Organizing Information (SMLOI) of the present invention is part of a computer system such as the one shown in FIG. 6. The computer system shown in FIG. 6 is a complicated one, it could have been described only by an input/output interface unit, a system bus or network, a storage device and a processor. The type of computer system presented in FIG. 6, that is well known by one skilled in the art, includes a processing means, such as a microprocessor, a memory mean 84, such as system RAM, and a storage means that can be network based, such as a hard disk or other storage means having a high capacity for storing documents and other information maintained by the filing system. The processing means 82, the memory means 84, and the storage means 86 (which may have its own I/O controller 88) are interconnected by a system bus 90 which includes control signals as well as address lines and data lines for sharing information, including data and instructions, between the components of the computer system. Also connected to the system bus 90 is an I/O controller 92 which controls the signals received from a keyboard 94, a mouse 96, an image capture device 100, a touch screen (not shown), a microphone 102, and a game control 98 and provide those signals, which indicate instructions from the user, to the computer system. A display controller 104 is coupled to the system bus 90 and receives commands and data from the processing means 82 and from the memory means 84 via system bus 90. Display controller/adapter 104 controls a display device 106 in order to provide images for the user. It will be appreciated that the typical computer system includes a bit mapped screen stored in memory, which may be a dedicated frame buffer memory 105 or the system memory. As shown in FIG. 6, a display means 106 displays on a display screen 108 a cursor 110, which is controlled by the pointing device 96. The display means 106 may be any one of a variety of known display systems, such as a video (CRT) display monitor or a liquid crystal display or plasma screen. Future display devices such as E-paper, rolled screen and other display devices such as direct retina projection, direct brain stimulation means, and means for 3D representation are also considered as appropriate display devices. The SMLOI can also use a gaming console, a portable data assistant (PDA), a portable digital music player or a wireless phone as a computer system.
The pointing device 110 of the present invention may be substantially identical to the cursor control means shown in U.S. Pat. No. Reissue 32,632. However, it will be understood by those skilled in the art that many other types of cursor control means may be utilized, such as graphic tablets, keyboard, touch tablets, trackballs, pen input mechanisms, touch screens, game controller for game console, etc. Indeed, any device capable of indicating x-y locations and capable of controlling a cursor on a display means of the computerized system may be utilized in the present SMLOI as a pointing device. This includes the “target point” illustratively located in the center of the display means in action video games.
The pointing device, such as a mouse 96 will often include a signal generation means that typically includes a switch connected to a button 97. A user presses the button 97 to send one signal to the computer and releases the button to send another signal to the computer. Other signal generation means, as is well known in the art, may be used such as using certain keys on a keyboard 94 or using a pen input device which positions a cursor and, by pressing the pen's tip against the display screen, selects the item pointed to/pressed at on the display screen.
Other kind of devices can be utilized as pointing devices and can also work to indicate x-y and x-y-z locations if the display device allows the user to perceive a third dimension. Game pad, tactile glove, voice activation and other kind of pointing devices means are considered as appropriate pointing devices and are within the scope of the present invention.
Entering a document, which can be any kind of digitized information, can be made in more than one way, through at least one action on the computer system. One way is as the user is working on a document through an application software to click on the designated SMLOI icon located in typical windows-like operating system in the “task bar” or “status bar”. One alternate way in a typical windows-like operating system is to drag a document (opened or not) on the SMLOI icon on the “desktop” and drop it. One other alternate way is for the user to consider his/her SMLOI as a printer, and do a print-to-the-SMLOI command. One other alternative way could be for the user to consider his/her SMLOI as a drive, and do a save-under-the-SMLOI command. The SMLOI icon can sit in the “dock” in an Apple-computer-like environment. The SMLOI can also have embedded functions in other applications that automatically achieve the same actions or tasks.
In the SMLOI, the management of the computer memory space allocation can be handled by the SMLOI. FIG. 7 shows a block-diagram of such a handling from the SMLOI. The document 102 is linked to the characteristics (or attributes) 117 and stored 109 under the SMLOI. The SMLOI can generate a standard file 114 on the storage means 86. The SMLOI could provide the added benefit of automatically encoding and/or encrypting all files and illustratively generate a unique or multiple “.SMLOI” type files 115 making their access without the SMLOI impossible, thus increasing security.
All existing documents or other data in a computer system directory can be entered in the SMLOI as the SMLOI is installed on the computer. All existing files found on different memory devices and storage devices such as a floppy disk, a hard drive, magnetic tape, optical drive, RAM, Flash memory, DVD, CD-ROM, USB key or other memory support can be entered as SMLOI elements as a result of a single enter-in-SMLOI command. All incoming e-mails and their attached files can be entered in the SMLOI as a result of the choice of such a default mode in the SMLOI setup options. It is understood all technologies available for wireless data transfer are encompassed by the present invention. Illustratively, the information elements, the axis, the files associated with the information elements and all other data related to the SMLOI can be wirelessly transferred using Wi-Fi networks, cellular phone lines, microwaves, AM and FM band, satellites-based networks and other means for transferring data without physical wires.
The SMLOI reduces the number of times a document file has to be saved in the computer memory means. FIG. 8 shows a block-diagram of a prior art system, where a document 112 gets linked to four different subjects or topics, namely A, B, C and D. This is accomplished by filing copies of the document into four different directories 120, occupying four locations 121 in the computer's memory and four times the memory space. FIG. 9 presents a block-diagram of the SMLOI where a document 112 is singly stored in the computer's memory (through the operating system (OS) or SMLOI) and entered in the SMLOI. The document is then attributed related attributes/characteristics. The only memory spaces occupied are then for the document itself 124, and its SMLOI-only information 126, respectively.
FIG. 10 shows a block-diagram of the system levels. Level zero corresponds to the level without the SMLOI. Level one 130 is attained through installation of the SMLOI. Level one 130 allows the SMLOI to record a document with minimum interaction with the user. Level one 130 considers the primary insertion 133 as a “drag and drop” like means action from the user. The SMLOI automatically records the information linked to the document 112 such as (but not limited to) the file format 135, the time the insertion in the SMLOI was made, and the size of the file. These characteristics are considered as intrinsic characteristics 136 (e.g. intrinsic characterization attributes) because they only ask for the insertion action from the user.
Level two 131, as presented on FIG. 10, is the same as level one 130 with the addition of extrinsic characteristics 138. Extrinsic attributes/characteristics 138 correspond to the information known by the user that helps with understanding the meaning and the relation of the document 112, to that which it relates, and all other information that can assist with understanding the value of the document 112. Simply, each document has its own unique extrinsic attributes/characteristics. The addition of the extrinsic attributes/characteristics requires more actions from the user. As such, level two 131 is considered a secondary insertion 140 because it can be done at a different time from the primary insertion 133 in the SMLOI. Level two 131 also allows the user to modify intrinsic characteristics 141. Level one 130 and level two 131 do not alter the document in the SMLOI itself.
Level three 132 brings the user to a level where the document may be modified in the SMLOI. Annotations 142 can be made by the user in order to add more meaning to the document already entered in the SMLOI. The annotation, namely a layer 143, can be considered as a distinct document. FIG. 11 shows an annotation 142 on which the user can chose to merge 146 the layer 143 so it will become an assembly 144. An assembly 144 is an independent document. Actions on documents through application software can be monitored by the SMLOI and altered documents being saved and entered automatically as new annotations in the SMLOI as a level one 130 insertion.
If source file associated to an information element in an axis of the SMLOI is moved to another location the SMLOI follows the movement of the source file and automatically creates a link between the new location and the information element to which the source file relates to keep the SMLOI's database up to date.
In order to increase the efficiency of the SMLOI, computer peripherals that are well known in the art such as printers, scanners, or safety systems such as the ones used for biometrics recognition of the user can be under direct control of the SMLOI. The SMLOI can also rely on the operating system (OS) to accomplish these tasks. To further increase the efficiency of the SMLOI without requiring too much of the user, links between the SMLOI and certain application software for functions such as e-mail, agenda/schedule or network access may also be provided.
In order to capture ongoing audio stream media or video stream media, a memory buffer allows the user to constantly record information so the user can keep information before he/she gives the recording order. The memory buffer continuously records the streaming media that was seen and/or heard by the user. The buffer has a user's specified time length and eliminates old data to record new data unless the user has instructed the system to keep what has been recorder in the memory. Useful data is then kept in another memory location for further consultation.
The Information Element
Each document, music album, music track, picture, code, voice mail, e-mail, copy of a webpage, E-book, video and other formats of information managed by the SMLOI is called an “information element” and is referred to as types of information. Most of them are files one can save on a computer's memory. Illustratively, a file containing a single music track (illustratively data type 1) could be juxtaposed in the SMLOI to a PDF document (illustratively data type 2), then a complete music album (illustratively data type 3) and followed by a text document (illustratively data type 4). A document, any information, or any other kind of data recorded in the SMLOI is illustratively represented using a “unified format”. Even if a “unified format” is desirable the SMLOI is not limited to use a “unified format”. Many different formats can cooperate in the SMLOI, each having its own visual appearances. One of the goals of a unified format is to provide an easy and constant manner of presenting various documents or data, using the same pattern. An information element is preferably displayed with its specific interface to readily provide information about the document associated therewith. An information element can also be created by direct writing by the user inside the SMLOI using any mean like a keyboard, a touch screen, voice or image recordation or a pen-pointing device. An information element generally presents an image of the information, the multiple characteristics linked to the inserted document, and other information related to document and to the SMLOI. The information element presents either an image of the document or the real document itself. The user can access the real document using the application program on the computer system directly through its information element.
Each information element is composed by a document and by “areas”. The “areas” are presenting, in a standardized manner, the information related to the document in order to give the user an instantaneous overview of what is related to a given document. The areas are distinct for every information element and are illustratively superposed on the related document thus providing an intuitive graphical assembly while letting the underneath document image appear in order to allow the user to see the complete document. The areas are also utilized to manipulate the SMLOI functionalities and are considered as a specific interface for each information element in the SMLOI. The SMLOI then provides a global interface acting on many information elements and multiple specific interfaces respectively acting on their associated information element.
FIG. 12 shows a complete information element 150 with its proposed unified representation. The information element's image 154 is completed by an information area 156, an anterior assemblies area 158, an intra-document multi-page area 160 and an ulterior assemblies information area 162. Alternatively, the anterior and ulterior assemblies information areas can be located at the information element bottom 163.
The information area 156 is itself divided between a date of entry sub-area 165, an event-task-action sub-area 166, a information element characterization attributes sub-area 167, a hyperlink sub-area 168 and an entry sequence number sub-area 169. The information area 156 as presented by FIG. 12 is partially superposed on the document so it is easy to see which area is related to a specific document.
The date of entry sub-area 165 indicates the moment where the information element was inserted in the SMLOI. Generally the user keeps the entry date generated automatically by the SMLOI but it is possible for the user to voluntarily modify the date of entry. The date of entry can be modified if the user wants the information element to appear in the SMLOI at a different sequential order. If the date of entry is modified, the original date of entry is preferably kept by the SMLOI. The information element that has multiple dates of entry can be seen at multiple places in the sequential order of the SMLOI.
FIG. 12 shows the event-task-action sub-area 166. This sub-area has the specific role to provide all kind of time-related information to the SMLOI user. Time-related information includes meetings, tasks, alarms, status (in force, expired or pending in the case of a patent document), reminders, or the like. Icons and text are mixed to give a visual effect in addition to sounds that attract the user's attention. The background color of the event-task-action sub-area can change to give the user further visual indications. For instance, green could mean that everything related to that information element is completed, while yellow could mean that something is currently ongoing and red that something is late or past due. Flashing background color may also have a specific meaning. Selection of this sub-area 166 or selection of the text/icon using the pointing device acts on specific functions as the creation or the modification of a task, an event, or an alarm. The information contained in this sub-area may also generate a to-do list or be fully integrated with the agenda. The colors or other indications related to the event-task-action sub-area 166 can be used to, illustratively, completely fill the information element to provide a high level view of the status of any time related information noted above. These information-elements-presenting-reduced-content are helpful to abstract a portion of the content to focus the attention of the SMLOI user to some more important meaning carried by the information elements.
The characterization attributes sub-area 167 as shown in FIG. 12 presents intrinsic (metadata) and extrinsic characteristics that provide the relationship meaning related to each information element according to the SMLOI user. Each information element and each characterization attribute have their own distinct meaning (i.e. either the information element or the characterization attribute, when taken separately, means something). The characterization attributes can be categories, information element types, status, specific sequences illustratively according to time of entry in the SMLOI, last time printed, last time read, last time selected, alphabetical order, types of songs, length of songs or statistic results; it is in fact any means that gives order or additional meaning to contextualize the information elements. The user can have its own characterization attributes and can have characterization attributes that are shared by a group of SMLOI users. Each characterization attribute selected by the user to be linked with the information element will be presented in this sub-area 167. The visual presentation of each characterization attribute will preferably be in the form of a button or an icon so the SMLOI user can easily select anyone of them individually or in group with the pointing device. No characterization attribute can appear associated with an information element meaning there is only one information attribute associated (or selectable by the user). In this case, selection of the information element itself has the effect of selecting the only characterization attribute. The later action will allow the user to generate relative vectors that will be further explained in this description. The visual aspect of the selected characterization attributes will change so the user will easily know which characterization attribute has been selected. The background color of the sub-area 167 can change to give the user further visual indications. The order in which the characterization attributes are presented in the sub-area is set according to the user preferences. Statistical organization of attributes can be performed by the SMLOI. Favorite or “most often used attribute” can remain, to the user's preference, on top of the list. Alphabetical ordering of the attributes is also possible. Automatic creation of attributes cluster according to occurrence statistical order or any desired relationship can be performed by the SMLOI. The user can be offered first the attributes he is the most likely to select.
The hyperlink sub-area 168 as shown in FIG. 12 contains external hyperlinks and internal hyperlinks. External hyperlinks are generally of two types, Internet related hyperlinks and other users' SMLOI direct access. Internal hyperlinks are generally direct links to other information elements in the SMLOI of the same user. This has the purpose to give direct access to the information element references so the user can have a quick overview of the links to the information element he or she is visualizing.
The entry sequence number sub-area 169 as shown in FIG. 12 presents a sequential number that indicates the sequence in which the information elements are entered in the SMLOI. The entry sequence number helps the user to have an intuitive way of classifying the information element. The entry sequence numbers are hyperlinks in the SMLOI so it is possible for the user to use them to draw quick access path between different information elements in the SMLOI. The entry sequence number can be used as hyperlinks between multiple distinct SMLOI thereby giving direct access to other users information elements using the same intuitive method; although, when a user has another user entry sequence number in its SMLOI, this entry sequence number will be preceded by the other SMLOI user number.
FIG. 12 also shows the anterior assemblies area 158. This area gives the user a direct view of the anterior assemblies, versions, or annotations of the visualized information element according to the time vector 32. The user can directly access another information element assembly by selecting the desired assembly in the anterior assemblies area 158.
FIG. 12 shows the ulterior assemblies area 162. This area gives the user a direct view of the ulterior assemblies, versions, or annotations of the visualized information element according to the time vector 32. The user can directly access another information element assembly by selecting the desired assembly in the ulterior assemblies area 162.
FIG. 12 also presents an alternate way for presenting the anterior and ulterior assemblies. The alternate anterior and ulterior assembly area 163 presents various assemblies, versions, or annotations, according to the time vector 32. The current information element 150, in FIG. 12, is also presented in the anterior and ulterior assembly area 163 as the assembly at location 170. Variation in the size of the presented assembly helps the user to perceive the closest assembly from the currently visualized information element 150, 170.
The multi-pages document area 160 as shown by FIG. 12 presents to the user a few other pages from the information element 150 if the information element 150 includes more than one page. If the information element 150 includes for instance 5 pages, the multi-pages document area 160 will present the four that are not shown in the document image 154. The user can select them if he or she wants to have a bigger picture of the desired page. If the number of pages is larger than the space available arrows 171, 172 will indicate that there is more pages to see so the user can scroll up or down to visualize them.
FIG. 13a presents an information element 150 with its information area 156. The date of entry area 165 generated by the SMLOI is applied to the information element in FIG. 13b. The date the information element is entered in the SMLOI can be seen in its date of entry area 165. The background color of the date of entry area can change to give the user further visual indications. Selection of this sub-area using the pointing device acts on specific functions.
When the user inserts a document in the SMLOI he or she can select the appropriate characterization attributes. FIG. 14 presents a means to select the appropriate characterization attributes for an information element 150. Entry window 174 is used for the display of the intrinsic and extrinsic characterization attributes. FIG. 14 also presents, for instance, only extrinsic characterization attributes. When the user clicks on the characterization attribute sub-area 167, the information element characterization entry window 174 opens, allowing the user to add, modify, or delete information element characterization attributes while getting access to his/her list of “favorites” characterization attributes. The user can either type in a new 176 characterization attribute or click on the proposed attribute or click on the arrow to have the characterization attribute list appear on a specific topic. Picking one with a pointing device from the list will make it appear with a button in the characterization attribute sub-area. To increase the first-glance impact, symbols and colors are added to the characterization attribute sub-area 167 as well.
In the event of a subsequent alteration of these characterization attributes, a trace can be kept of both the change details and the original information. Not all extrinsic characteristic attributes need to be typed in each time. That is, user should be able to build his/her list of favorites, and to select from it. The most frequently characterization attribute can be displayed automatically at the top of the list by the SMLOI. The user is also able to link an information element to a task he or she has to perform or to an event, such as a meeting minutes being linked to the agenda. These are statutory characterization attributes.
The SMLOI provides a unified format for audio and video documents. FIG. 15 shows an information element 150 that is a unified format representation of an audio document with its title 180, duration 181, and audio symbol 182.
FIG. 16 shows a dynamic layer over the unified format representation of an audio document. The title 180 and symbol 182 are part of the basic audio information element 150. Dialog box 185 is part of the layer and allows the commentaries to be displayed/sounded as the basic audio information element is displayed. The display bar 187 gives an idea to the SMLOI user on the position of the audio listening. The position indicator 189 moves from left to right as the video document is played in typical media player fashion; using the pointing device, the user can drag this position indicator 189 to the left or the right, and resume listening to the document at another point. The musical symbol 190 in FIG. 16 is the indicator of additional audio comments added to a layer over the audio information element 150. The triangular symbol 192 is (for instance) an indicator of a written comment added to a layer over the audio document and shown at a specific time. The camera symbol 194 is an indicator of a video comment added to a layer over the audio document. A duration indicator shows up when the user points the pointing device to one of the comment indicators and displays in the window 185 the time at which the comment has been inserted over the total duration of the original information element.
In FIG. 16 are buttons 194 typical of media player and are pause, stop, play, fast reverse, and fast forward, respectively, and are, in addition, commands for the displaying/activating the comments. Comment window 185 shows the written and video comments as their insertion point is reached while the document is played or as the user clicks on the related indicator. If so desired by the user, the document can be automatically stopped from playing momentarily as comments 192, 195 and 190 are “reached”.
FIG. 17 shows an information element 150 that is a unified format representation of a video document with its title 180, duration 181, video symbol 196 and projection window 198 that is used for displaying the video information element 150 of FIG. 17. FIG. 18 shows an assembly built from the addition of a dynamic layer over the unified format representation of a video document. The title 180 and symbol 196 are part of the basic information element and are visible through the clear substrate of the layer. The functions are generally the same as the ones presented previously for an audio document in FIG. 16
FIG. 19a shows an information element where image 200 is the actual picture of a web page as an information element in the SMLOI. The user may either copy information as presented by FIG. 19a into the SMLOI or just writes a hyperlink to reach the information as in FIG. 19b. FIG. 19b shows an alternative representation of the same element with only the symbol 198 on the center of the page and the web address (URL) 199.
Numerous software applications are available to help users keep track of their schedules and of the tasks they need to accomplish. The tasks of the user can be displayed as information elements in the SMLOI, and be graphically recognizable within the SMLOI. Tasks as information elements can be associated with related sub-space (item 166 in FIG. 12) and linked to appropriate characterization attributes. Color and other types of coding are part of the unified format representation of such an information element to graphically inform the user of the status of a given task as previously described. The appropriate sub-area will display codes related to the task as well as the due date characterization attribute. Events from the agenda (such as meeting) or not (such as voice messages or conversations) can be displayed as information elements, and be graphically recognized as such within the SMLOI. Details of the event such as date, time or location are accessible directly form the information element. The user can graphically visualize linked tasks (such as preparation for meeting or an action resulting from a voice mail) as well as linked information element (such as a list of documents he or she may need to recover to go to a given meeting). The user is able to visualize linked tasks graphically, as well as linked elements of information (such as a list of document he or she may need to recover as part of the task). The user can create work lists, prioritized or not, from the tasks inserted in the SMLOI.
Information elements can be linked to individuals (such as a list of participants present at a meeting where a given report has been distributed). Such a link can be established by 1) entering the event as an information element, with its participants as characterization attributes as well as indicating another element (the report) as an hyperlink and 2) by asking on that information element or on the areas of the information element to visualize the linked elements, which would then show the event among other information elements on the relative representation vector, which means the second dimension that will be explained later in details.
For an information element of an event entered in the SMLOI, the statutory sub-area would become the event sub-area by displaying codes such as “preparatory task to be done”, “past event” or “event to come”, etc. . . . A direct link to another information element can be included in the characterization attribute sub-area or in the hyperlink sub-area.
The SMLOI can display documents that were meant to be printed on paper formats different than the user-specified default format (“letter” or “A4” paper size for example). FIG. 20 shows an example of such an odd-sized document, where the proportions of the image are similar to the ones of the real document. Such an approach could, however, prove to be rather inconvenient if more than one element is to be viewed at the same time. It then may be desirable that all the information elements be displayed within a common-size “sheet size”. FIG. 21 shows such an arrangement, where the image 202 of the document and a label 203 indicates the true size of the document. The information element “envelope” would then always be the same for “letter” paper size proportions.
The user can keep track, via his/her SMLOI, of all of his/her information elements, even if they are not under an electronic format. A numbering system for those external reference materials may be created and a short comment for each may be written. FIG. 22 shows a unified format representation for an information element linked to an external reference material where a symbol 205 used to designate such external reference material. A title 206 given to the document by the user, a label 207 showing the number of the document as per the user's numbering system, and the location 208 where the actual document is physically kept may also be implemented.
Some information elements collected by a user can be made available for viewing by others as a means to stimulate creativity. For instance, interesting articles could be sent to a “pool” and available for browsing by other SMLOI users or be sent one at a time at a specific rate through e-mail to selected SMLOI users. A user may also choose to have old clippings sent to him/herself after a certain delay to refresh his/her own memory. Random order element visualization is also an option. Such elements could be sent through e-mails or be used as the “desktop wallpaper of the day”, the “screensaver of the day”, or even be displayed in SMLOI as “publicity stripes”.
The SMLOI user can select the “SMLOI web site” attribute. By doing so, the user may build a “SMLOI web site” with the selected information element. The user website will present the selected information elements in a web page for others to visualize the information elements on the Internet using an SMLOI browser “plug-in”. This way, the SMLOI user can share to everyone on the Internet the selected information elements without any complicated task. The other SMLOI functions that will be further described are also enabled within a browser plug-in.
The SMLOI includes a “collection tool” allowing for easy gathering and organizing of a series of information elements. Options for display are also offered to the user such as a formal portfolio, scrap book, logbook, notebook, or slide show. These collections may be sent to other SMLOI users, not as memory consuming bunch of files, but rather as a list of links and punctual access rights.
The SMLOI has an enabled collection process. For instance, five elements are selected by the SMLOI user who then creates a collection therefrom. The collection then becomes an element, which, among its attributes, has the intrinsic characterization attribute “collection” and is inserted in the SMLOI. The user can then use the collection in many ways. For example, the user may send access rights to another user or do a full or partial print of the information elements. The user could also visualize or print a list of the information elements contained in the collection or creates a slide show of the information elements that could be sent or become presentation material.
It may also be desirable for the SMLOI to narrow the gap between the electronic data management and the more traditional handwritten information. This may be accomplished with the SMLOI through the integration of handwriting recognition, applicable software, and electronic signature capability. This may also be accomplished by integrating in the SMLOI the capability of generating encoded note-taking material and properly filing the digitized hand written material. A purpose-printed note paper (or template) may also be generated by the SMLOI and printed. The template is then used as normal paper for taking notes and is scanned for its insertion in the SMLOI. During the scanning process, the SMLOI recognizes identification marks on the template (such as a printed bar code or a hand filled boxes) and assigns intrinsic attributes accordingly as it creates a new information element in the SMLOI.
The Multi Dimensional Representation
In order for a user to keep track of the sequence in which the information elements are related to each other, the SMLOI provides a way to keep specific sequences between information elements. One means of establishing such a sequence is by representing the entry of an information element. The SMLOI is also providing an entry sequence number to keep the information elements in the order that they have been entered. FIG. 23 shows an element 150 that is added to a pile of elements 210 where the entry sequential number for the first element 212 entered has number one and the last, “n”. The new element 214 added then gets the sequential entry number “n+1”.
The invention provides a way to see part of a sequence through preceding and following information elements. For example, FIG. 24 illustrates that the information elements 150 are placed side by side and in the order that they had been entered. The last information element added to the sequence would be the one at the extreme right 216 according to the time vector 32. FIG. 25 shows another way of viewing the sequence. The information elements 150 are placed side by side and are rolled in that order on a roll 218 still according to the time vector 32.
The time vector 32 usually represents the absolute chronological order that is applied on information element vectors whether they are including all the information elements 150 or only a portion of them. Absolute information element vectors and relative information element vectors are then linked to a time vector 32. The time vector 32 sequence can be replaced by a specific sequence vector that is not necessarily related to time. In that order, only the sequential aspect of the time vector 32 would be kept and applied with some other consideration, like statistical considerations, to a specific sequence. Hence, an information element vector can be related to the number of times an information element has been selected. That is, the information element vector 32 presents the information elements in an incremental order. The information element vector 32 can also be generated ascendingly or descendingly considering the memory size of the information elements 150. The information element vector may also present the information elements 150 based on the number of characterization attributes 178 applied to each information element.
The spreading-the-information-elements exercise, shown on FIG. 24 and FIG. 25, directionally towards the right may also be done in any direction. The display of the information elements in such a manner creates an information element vector allowing the user to visualize the information elements 150 entered as well as the absolute sequence into which entry has been done.
The system user can introduce “breaks” and “bookmarks” in the information element vectors to have reference points within the sequence of information element entry. FIG. 26 shows such an implementation of bookmarks 220, 224 where, in that case, the bookmarks are relative to a period of time. For instance, two information elements 150 have been entered during the period P 222 which is delineated by bookmarks 220 and 224. The bookmarks may also be specifically placed by the user as period markers as shown in FIG. 26 and/or automatically by the SMLOI at every period of time and/or in any user-defined manner.
FIG. 27 shows a bi-dimensional information element vector disposition where all the information elements 150 from the user's SMLOI are represented along a first (horizontal) vector 230, where the most recent is shown on the right side according to the time vector 32. Information element vector 230 is the first, or absolute, information element vector in the sense that all information elements 150 are present on the vector 230 (although a subset of all information elements can form vector 230). The first vector is illustratively horizontally disposed but a person skilled in the art would appreciate a different position is encompassed by the present patent application.
A second information element vector 232, that can be a subset of the first information element vector 230, is graphically represented, non-parallel to, or intersecting the first information element vector 230. The second information element vector 232 is created when a desired characterization attribute, illustratively the “E” characterization attribute 234, is selected by the SMLOI user on at least one information element 246 from the first information element vector 230. The selection of the “E” characterization attribute 234 might automatically create the second information element vector 232. Illustratively, the selection of the desired “E” characterization attribute can be achieved by pressing a button “E” 234 on the desired information element 246. The information element 246 can also be automatically selected when the characterization attribute “E” 234 is selected without any other action. Conversely, if one characterization attribute, for instance the information attribute “E” 234, is primarily associated with desired information element 246 then selecting the desired information element 246 itself would automatically use the information attribute “E” 234 to generate the second information element vector 232 based on information attribute “E” 234. A single information attribute can be blindly associated to its related information element. The first information element can become invisible when the second information element vector becomes visible on the display device.
The second information element vector 232 is generated by the SMLOI at a different angle (illustratively at a 90° angle from the absolute vector 230, on a 2D display) or on a different plane than the first information element vector 230 using the selected information element 246 as a reference (that is illustratively the intersection information element between the two vectors as appreciated on FIG. 51). On the second information element vector 232 are shown only the information elements, from the first information element vector, commonly sharing the “E” characterization attribute 234 (illustratively visually presented in the characterization attribute sub-area). The second information element vector 230 could also present a set of other information elements not present in the first information element vector 230 but related to the selected desired information element 246. The most recent information elements 150 is being shown at the upper end of the information element vector 232 according to the relative time vector 236. As a result, the information element vector 232 is built according to a pre-selected order e.g. in the present situation it is illustratively a chronological order.
Information elements 238 and 240 are actually the unified format representation of the same repeated information element 240 because it appears in both the absolute (or first) information element vector 230 and the second information element vector 232 sorting the “E” characterization attribute 234. The duplicated information elements appear on the second information element vector 232 at their respective chronological positions. This is also true for elements 242 and 244. The generation of the second information element vector 232 can also be made according to the combinative logic equation of multiple characterization attributes (for instance: “A” AND (“B” OR “E”)).
In the event only one characterization attribute is intended to be selectable from an information element the selection of the information element itself can automatically select the single selectable information attribute. The visual aspect of the information element could then not show the potential characterization attribute to simplify the amount of visual data associated to the information element. For instance, selecting a music album on a first vector would lead to generate a second vector displaying the songs contained in the album if the only characterization attribute of the album is “songs in the album”. If the characterization attribute is associated to more than one type of information elements (i.e. songs and pictures for instance) the selection of the album would generate a second vector displaying the songs and the pictures associated with the album.
The absolute and relative information element vectors 230 and 232 in FIG. 27 illustratively create a plane (accordingly, they are co-planar but, as it will be explained later, they could also intersect on distinct planes). A volume can be generated depending on the number of information element vectors when depth is used for a third dimension as depicted by FIG. 29. This plan, or volume if the depth is used, can be considered as a vectorial space 250. The user of the present system can select the vertical or the horizontal axis as default axis. Any axis in any given direction could be selected, according to the preference of the user, to be the “main” axis. The default axis will be the axis presented when only one axis is visible when the user logs in the SMLOI.
More than one relative information element vectors is generated. Each relative information element vector 232 is intersecting an information element on the first information element vector 230 when the selected characterization attribute appears on elements found on the absolute information element vector 230. As shown in FIG. 28, two additional vertical vectors 248 and 252, aligned with elements 254 and 256, respectively, are provided. Other variations might be appreciated by a skilled person.
FIG. 29 shows the SMLOI, now “tri-dimensional” with the addition of assemblies 257, 258 and 259 (or information element versions) related to their respective information elements 262, 263 and 264. The first dimension is the absolute information element vector 230 according to the absolute time vector 32. The second dimension is the relative information element vector 232 containing the attribute “E” 234 according to the relative time vector 236 with its intersection centered on the desired information element 246 from which the characterization attribute “E” is illustratively selected. The third dimension is another relative information element vector relative to time vector 265 and shows the assemblies relative to information elements that possess at least one assembly. The more recent information element in the latter assembly is shown on top according to the time vector 256.
FIG. 30 shows that the system may have four dimensions. The four dimensions are presented on the SMLOI where 230, 270 is the first dimension, or absolute information element vector, 232, 271 is the second dimension or relative information element vector and 257, 272 is the third dimension or relative information element assemblies vector. Item 273 represents the fourth (illustratively) “circular” characterization attribute dimension. The characterization attribute choice, in order to generate the second dimension 232, 271, is a dimension that can be schematically represented as a “circular vector” because of the multiple different possible characterization attribute selection leading to various different second dimension information element vectors. This possible plurality of second information element vector can be visualized as orthogonal 273 to the first information element vector axis 230, 270.
FIG. 31 shows that since there are at least as many relative information element vectors 271, 275, 276 as there are characterization attributes, all the relative sequences can be represented as many rays 278 coming out of a center hub 280 that is the selected information element 246 on the absolute information element vector 270. The fourth dimension 273 as it appears on FIG. 31 is an array 278 (or rays) of information element vectors and the selection of one characterization attribute (or composition of many) dictates which relative sequence of information elements will lead to the generation of the relative information element vector 232. The SMLOI user can group the information elements by combination or segregation of characterization attributes. Using combinative logic, this actually would turn the fourth dimension 273 into an almost infinite number of rays around the center hub 280.
Association of characterization attribute(s) with an information element, or selection of characterization attribute(s), in order to generate an information element vector can be made automatically by the SMLOI. Algorithms, statistics and other mathematical equations are might help to choose the most applicable characterization attributes for a specified information elements or group of information elements in order to create an information element vector.
The SMLOI also provides an intuitive and efficient system for managing the user's elements of information, personal or professional in nature. The user and his or her professional information can be part of a bigger picture if he or she is an employee of a corporation for example. The SMLOI user is able to visualize his/her personal and professional/corporate SMLOI (distinction coming from one major attribute) at once or separately, and that that option be carried out through a single command.
A corporation is considered a moral user of the work related information of its employees. A corporation or other multi-user environment can have all its employees dealing with information elements in a similar manner for training purposes, and for the preservation of the “corporate knowledge” (structured and unstructured data), and for prior art recording purposes. The “corporate knowledge” is considered as a series of “parallel SMLOIs” with an SMLOI for each of its employees in a similar fashion to the previously described parallel paths for individuals. That way, some members of the corporation are able to access the information in the corporation's employees SMLOI.
Multiple and distinct SMLOI can seamlessly be presented on a same time line or axis. Personal and professional SMLOI can be presented on the same time line just as if both personal and professional SMLOIs are only one single SMLOI even if they are not. They just appear to be the same for the user. All the SMLOI of a corporation are similarly mixed and presented as a unique SMLOI, even if in reality they are not, representing the whole corporation's SMLOI.
At least one member of the corporation has the “knowledge administrator” status such an individual has full access to the corporate SMLOIs, can forward corporate messages to employees' SMLOI, and create standardized corporate characterization attributes to ensure cohesion in the filing, among other functions and capabilities. Such an administrator may have a formal role in a quality-assured environment, such as one governed by the ISO 9000 standard or a sophisticated information management analysis in order to provide an information management score that can quantitatively show the user's ability to manage its information.
The corporate administrator can represent the corporation in an intuitive manner, such as the corporation organizational chart 282 as presented in FIG. 32 and directly link to every corporate SMLOI in the corporation as shown on FIG. 33. FIG. 33 shows the corporate SMLOI of an employee that has the position 283 in the organizational chart 282. The planar representation on the organizational chart is considered as the fifth dimension of the SMLOI. The organizational chart for that purpose can be replaced by a grid 285 on FIG. 34 and is, to the corporation user or administrator, a graphical representation of the multiple users. In this case, a two-vector system, for instance “5x” 287 and “5y” 288 is used to “name” different SMLOI users in the corporation, using an alphanumeric format. Other formats may also be implemented.
FIG. 34 shows the fifth-dimension grid 285 where squares are filled using different patterns according to possible access. The grid of FIG. 34 is seen through the eyes of a user represented by box 294 of FIG. 36. As indicated by square 292 of FIG. 34, total access is given at that position of the grid. Hatched squares as in box 296 indicate the SMLOI of fellow employees to which the user 294 (FIG. 36) has full access (professional/corporate side only). Crosshatched squares in box 297 indicate an SMLOI where punctual or microscopic access has been granted to user 294 (of box 292) allowing visualization of selected elements only. Smaller crosshatched squares as in box 298 indicate the SMLOI to which the user of box 292 has absolutely no access to.
FIG. 35 shows the multi-dimensional graphic user interface of an employee of the corporation SMLOI where dimension one 270, dimension two 271, dimension three 272, and dimension four 273, as presciently described, can be seen. Dimension five 287, 288 may also be added. The darkened square contour of the grid 283 at the position “B2” indicates that the SMLOI 290 is the SMLOI of the “B2” employee.
An employee may allow access to his or her SMLOI, in part or in whole, to another employee or user. The user has only access to a portion of its SMLOI (such as the professional part) while maintaining the privacy of the remaining portion (such as the personal part).
FIG. 37 presents the absolute information element vector of the SMLOI of a user “A” where it is possible to see that information elements 315 and 316 have no access restriction. Information elements 309, 310 and 311 can be locked so the user can block modification access to them. The open padlock icon 313 is representing that access is open although it can be locked. The lock 314 on information element 312 indicates the access is denied (which is a default mode for personal information elements).
FIG. 38 shows the absolute information element vector of the SMLOI of a user “A”, as seen through the eyes of a user “B”, where “B” has only access to some information elements. Items that have a dark hatch filling 300, 301, 302, 303 are information elements for which access has been denied to “B” (because of the professional/personal firewall and/or specific access restrictions for a given element). Items 304, 305, with no hatch filling, are seen as they would be through the eyes of a user “A”, the SMLOI owner. These information elements can be seen by the user “B” through his/her SMLOI.
For privacy reasons it is desirable that non-accessible elements, or their quantity be non-visible to other users. FIG. 39 shows the same SMLOI, as seen through the eyes of user “B”, where all non-accessible elements are hidden, and space between accessible elements is reduced. For similar reasons, some parts of the seeable information elements, such as entry sequence numbers, may be hidden as well. Accessible information elements vector 320 all have their entry number “blacked out” so that neither the number of elements in the SMLOI or their relative position in the sequence can be known of user “B”.
FIG. 40 shows information element vectors of the SMLOI of one user “A” where, the user has granted access to information elements 324, 325, 326, 327 to user “B” while refusing him/her access to elements 328, 329, 330, 331.
FIG. 41 shows an absolute information element vector, from the SMLOI of a user “A”, from which information elements 338 and 339 are locked so they cannot appear in the “B” user's SMLOI. FIG. 42 shows the same SMLOI, as viewed through the “eyes” (and SMLOI) of user “B”. Information elements are hidden and replaced by one empty space 342 having a size that is irrelevant of the number of hidden information elements.
The Illustrated Interface
One proposed SMLOI interface using a typical windows-like environment main screen is shown in FIG. 43 although, the SMLOI can also be voice controlled. Item 450 is the operating system's bar displaying SMLOI details such as version 454 and user ID 456 (user name and user number). Item 452 is the menu bar of typical format and usage. Display of this item is left to the user's discretion. Item 458 is the window through which the SMLOI relays most of the information to the user. This is the window where the SMLOI is displayed, is known as the SMLOI window, and occupies the better part of the screen. This window completely fills the space between the menu bar 452 (if displayed) and the status bar 460.
A typical information element 150 is shown in FIG. 43 with its date of entry sub-area 165, an event-task-action sub-area 166, an information element characterization attributes sub-area 167, a hyperlink sub-area 168 and an entry sequence number sub-area 169. The anterior and ulterior assemblies area 170 are also shown as is the multi-pages document area 160. Scroll down buttons 462 are presented on some sub-areas. Margins from the original document 464 are also presented in FIG. 43.
The multi-part toolbox 466 is presented and acts on different functions available depending on the actions the SMLOI user is doing. The toolbox 466 includes buttons identified by icons that allow the SMLOI user to act on selected elements. In some cases the buttons may call menus or dialog boxes.
The navigation box 468 of FIG. 43 includes buttons to navigate in the SMLOI. It contains all the buttons, identified by icons, to allow the user to surf or navigate in his/her SMLOI. Button 470 allows movement along the absolute information element vector 230 according to positive time vector 32. Button 472 allows movement along the absolute information element vector 230 in the time vector 32 opposite direction. Button 474 allows movement along the relative information element vector 232 according to positive time vector 236. Button 476 allows movement along the relative information element vector 232 in the time vector 236 opposite direction. Button 478 is for the “zoom window” function, while button 479 is for “zoom-in” and “zoom out” functions. Button 481 is the “back to the last view” function and button 483 is for “forward to the next visualized view” function. These functions are similar to the “back” and “forward” functions on a web browser. Button 485 allows the SMLOI user to access his/her intra-SMLOI favorites' list while button 487 allows access to his/her Internet favorites' list.
Button 489 allows the user to return directly to the last information element entered in the SMLOI while button 491 opens a new “blank” information element in the SMLOI. This enables the user to work directly on the new information element for inserting pictures or for adding text on a particular project. This is one way the SMLOI can act as a logbook or notebook.
The communication box 495 includes a communication information window 497 for displaying all the information the SMLOI wants the user to know when he or she is using it. The communication information window 497 concentrates all the communications in the same place; as such, it can display alarms, chat, enter phone calls, instant messaging, provide an image of another person when video conferencing or video phone calls. E-mail features are also presented in the communication information window 497 and usual functions such as in-box, new messages, attach document to message, reply, reply to all, transfer, exchange an element, sending box, sent box and contacts are available. The agenda and its related functions including adding the agenda or linking an information element to the agenda are also included. Both the e-mail and agenda capabilities are fully integrated in the SMLOI.
FIG. 43 also illustratively shows the absolute relativisation bar 500 and the relative relativisation bar 502. The purpose of these bars is to provide a broader, but still limited, point of view to the SMLOI user. The user sets limit dates 504 and 506 for each bar so that the length of the time frame represented is customized to the user's desires. Days 508, weeks 510, months 512 and years 514 are displayed time marks, illustratively as little bars (each with their own format), in the relativisation bars 500, 502. The “relative” relativisation bar 502 is only visible when a relative information element vector 232 (2nd dimension) is displayed. Signs of different shape and colors (for instance black triangle 516) can be added as bookmarks to keep trace of important information elements. A cursor (not shown) providing the actual viewing position of the SMLOI is provided so it is possible to drag it to move quickly in the SMLOI.
The user can use its SMLOI in five distinct modes: information elements consultation, information element insertion/creation, information element modification, information elements list and extraction. The toolbox 466 includes different functions related to those different SMLOI modes. There is, for instance, different functions related to the insertion mode: favorites (bookmark, hyperlink, hyperpage), quick insertion (direct insertion without extrinsic attributes), tasks, notes, events, video sequences, audio sequences, digitalization (paper, other), and project creation (reports, slides presentations, collections).
The toolbox 466 also includes functions related to the manipulation mode. The buttons include square manipulation tool, copy, paste, element selection, annotation manipulation, hide element (by sequence of entry number, by date), and search (by sequence of entry number, by characterization attributes, combinative logic, by date, by contact, by key word, by document type, options). There are also functions related to the extraction mode with buttons for deleting, information element collection (add element, remove element, save collection as a new information element, add note in collection, print collection, present collection as slides). The toolbox 466 also includes a system functions section including buttons for setup (personal setup, system setup, general setup, corporate administrator), “favorites” setup, authentication and signature (document authentication, electronic signature), back-up, help, screen management (screen saver, wallpaper, information element presentation sequence) and the like.
Window 458 of the SMLOI includes two buttons 503 and 509. If the user clicks on the appropriate button, only the personal portion of his/her SMLOI can be visualized 503. If he/she clicks on the second button, only the professional/corporate portion of his/her SMLOI can then be visualized 509. Clicking on both buttons 503, 509 (might be done with or without the use of the CTRL and SHIFT keys) will allow visualization of both portions of his/her SMLOI.
FIG. 43 shows a typical information element 150, with an information element characterization attributes sub-area 167, into which each characterization attribute is actually a button 527, or selecting means, that can be clicked for picking the information elements to be included in the information elements of the relative vector. Selecting blank button 528 at the bottom pulls out the main attributes' list for selection of the second dimension. Simple addition of characterization attributes to the selection can also be achieved in a typical fashion by using the CTRL and SHIFT keys from the keyboard. The user is also offered the possibility of including any given attribute in a combinative logic equation for the selection of the second dimension's vector 232 (a pull-down menu can appear for additions and exclusions). Such combinative logic capability can, for instance, allows the user to set border dates for his/her selection of elements carrying the attribute “x”, allows him/her to set border entry numbers dates for his/her selection of elements carrying the attribute “y”, allows him/her to look for attributes common to other system (such as events) or even allow element selection based on common status (such as tasks).
FIG. 44 shows a view of a user's SMLOI where the central information element is 520. Elements 522 and 521 are the preceding and following information elements along the absolute information element vector 230, respectively. Information elements 524 and 523 are the preceding and following information elements along the relative information element vector 232, respectively. Window 530 presents a close view of information element 520. Window 531 presents a zoom-out view of information element 520 and shows, at the same time, the preceding and the following information elements in order to provide a better perspective of the visualized information element 520. Window 532 is a zoom-in view of a part of information element 520 that provides the possibility for the user to visualize details of the information element 520. The zoom-in and zoom-out function can show a significant number of information elements to get the big picture of the information element distribution along the information element vectors 230, 232 or, conversely, could show only a small portion of one information element to see or work on small details.
The SMLOI also has a “radar screen” display format as illustratively shown by FIG. 45. The absolute relativisation bar 500 and the relative relativisation bar 502, as previously mentioned, have weekly time marks 510 (for instance, can be by days, months or other specific time length) extended upward and to the right respectively to effectively create a time grid. An absolute information element vector 550 appears on the grid, and, accordingly, each of its information elements appears as squares 541, 542, 543, 544. The color (and shape) of squares 541, 542, 543, 544 information elements and other visual particularities, illustratively the information element may flash, be animated or have a portion showing a different color or a sign that indicates something more specific about the information element(s). For instance, it can show search results or information elements representing tasks for which the deadline is approaching, show an action is past due, the status of the information element has changed since the last time the user has logged in or simply to attract the SMLOI user's attention for a predetermined reason. This can be linked to any particular area 156 related aspect or any characterization attribute related to an information element. It has to be noted the spacing between information elements might be constant (when the time scale varies) or varies in accordance with the time that has passed between each information elements (when the time scale is fixed). The later is illustratively used for representing both the absolute and the relative information element vectors 550, 551. The fixed or unequal time scale can also be used when not in the radar mode throughout the SMLOI. The relative information element vector 551 presents the same four information elements 542, 543, 544, 545 that appear in the absolute information element vector 550 that share the same selection of characterization attributes. A diagonal representation (not shown) according to the two relativisation bars, referred as 500 and 502 on FIG. 43 but not numbered on FIG. 45, time frame can be utilized as well. It also has to be noted this high level view of information elements 541, 542, 543, 544 can be used outside the “radar screen” as information elements representations in the SMLOI showing only a limited amount of information to help the user focuses on a limited transfer of knowledge from a series of information elements. Selecting, illustratively to double click an information element in its reduced visual appearance, can bring a more detailed view of the same information element, show more details or trigger an action or, illustratively, open a related file in another program.
The “radar screen” display format as shown in FIG. 45 allows the user to have a meaningful overview of what is happening in its SMLOI. Colors and movements add information to the visual distribution of the schematized information elements. The background is used to visualized and magnify a selected portion of the SMLOI found in the “radar screen” and is represented by the box 557. As an alternate way of navigating in the SMLOI, the user can drag, move or resize the selection box 557 and the background view will change accordingly so that the user can visualize whatever information element is in the “radar screen” selection box 557. This function acts like a magnifying glass on a map. When the user is switching from the visualization of an information element to the radar mode, box 557 on the radar mode will show exactly how the presented information element was on the display device. Also, change in the selection box 557 will change the background view as well.
FIG. 46 shows the SMLOI in an alternate “radar screen” display format, including the “future” area 550 that acts like an agenda. Accordingly, information element 552 is a task to be done according to the time frame of the relativisation bars 500 and 502. Separators 553 and 554 visually separate the past and the future and, in fact, 553 and 554 are the lines of the present and their intersection point is “now” 555. This is a way for the user to graphically represent his/her “to do” list.
In FIG. 47 is shown the SMLOI using a web browser or a plug-in applied to a standard web browser. This way, everyone using a web browser (i.e. for example NetscapeTM NavigatorTM or MicrosoftTM Internet ExplorerTM) can add a plug-in (or means to adapt the web browser to use, to visualize or to act on the SMLOI) that allows the multi-dimensional data locating system to run on the web browser. A user can access data, information elements, documents or standard web pages using a web browser with the SMLOI. Non-users can visualize information, adapted web pages or other documents using a web browser with a plug-in. Users can allow access to specific information element to be viewed by other authorized users and non-authorized users with an appropriate web browser. Is considered here a web browser any device that allows navigation on the Internet. While using a web browser it is understood that the SMLOI can be web based and communication with the user is made using a network.
FIG. 47 shows the SMLOI using a web browser as a base program. Item 560 represents the web browser software window. Item 562 represents the web browser classic tools, icons and toolbars. Item 564 represents the windows-like OS task bar, item 466 represents the multi-dimensional data locating system SMLOI toolbox, item 568 represents the multi-dimensional data locating system navigation toolbox, item 150 represents the information element presented in the multi-dimensional data locating system inside the web browser, item 570 represents a selected attribute generating the second dimension in the multi-dimensional data locating system, item 572 represents the absolute information element vector and item 574 represents the relative information element vector.
Story, Game and Simulation with the SMLOI
In order to add meaning to the information contained inside the SMLOI a story or a “game metaphor” can be applied to the vectorial space. This would help to link information elements between them to improve the user understanding. If necessary, when using a “game metaphor”, a score could be calculated using multiple parameters. The SMLOI can use a 3D/virtual reality environment and, to some extent, turn the “chore” of SMLOI into some sort of a game; the system could keep records and statistics of a user's performance as an information organizer and user.
Parameters can be as simple as the time to retrieve any information element, the number of elements inserted in the SMLOI per period of time, the number of information elements exchanged per period of time, the average number of characterization attributes applied to the information elements inserted in the SMLOI or the number of information elements visualized in the SMLOI per period of time. Those examples are given to explain that certain parameters can be evaluated and that a score can be attributed according to pre-established standards. Statistic curves can be used to represent what is considered by an individual or by a company as “information management standards”.
The possibility is given to the user to access his/her SMLOI and some SMLOI functions and tools through other computerized devices, such as a game console, an MP3 player or a PDA. In such cases, the program could be “installed” by the insertion of a “game cartridge”, i.e. a self-contained software/memory block package, or by Internet download. FIG. 48 shows the SMLOI as seen through a game console 582 and computer-controlled display 580 such as a TV screen. The actions are illustratively done using the game controller 585. FIG. 49 shows a typical game console controller. Just as with any game, the user/player can attribute specific commands to most buttons and knobs. Normally the game controller includes a left trigger 590, a right trigger 592, a left thumbstick 594, a left directional pad 596, a white button 598, a black button 599, a “Y” button 600, a “B” button 602, a “X” button 604, a “A” button 606, a right thumbstick 608, a “back” button 610 and a “start” button 612. Multiple extension slots 615 can be used for connecting additional memory or for connecting a microphone/headset device. Other game controllers like the WiiTM, where the user has not physical connection with the computer or the game console is encompassed by the present invention. Movements of the game controller influence the actions on the SMLOI.
For example, illustratively with a more classic game controller, the SMLOI commands could be allocated as follows: the left trigger 590 to move between information elements going back in time, the right trigger 592 to move between information elements going forward in time, a left thumbstick 594 to move on the absolute information element vector 230 and the relative information element vector 232 and to move the box 557 when in the previously described “radar screen” display format. A click on the left thumbstick 594 selects the visualized information element 150, the left directional pad 596 has basically the same functions as the left thumbstick 594, the white button 598 inserts a new blank information element 150 ready to be written while the black button 599 brings the user directly to the last information element inserted into the SMLOI. The “Y” button 600 accesses the “radar screen” display format, the “B” button 602 accesses sequentially the different modes in the SMLOI when an information element is selected, the “X” button 604 selects the communication box 495 and the “A” button 606 selects the toolbox 466. The right thumbstick 608 is used to move a “pan” view if no information element is selected and moves into the different areas/sub-areas if an information element is selected; a click on the right thumbstick 608 would select the pointed area part, the “back” button 610 would be utilized just as the back button on a classic web browser and the “start” button 612 would keep the same role as on a game console.
Multiple command interactions can also be described. For instance, a click and hold on the left thumbstick in addition to the right/left trigger would provide a zoom-in/zoom-out effect. Also, the white button 598 or the black button 599 could be used in conjunction with the right or left triggers 590, 592 to provide other specific commands; this could be fully customizable by the user. One of the goals of adding a “game metaphor” is to improve the user experience and to bring him/her to a point where managing information is not a burden anymore but a funny intuitive interesting task. One other goal is to have a score that quantify the efficiency of the user information management.
Other Uses of the SMLOI
Referring now to FIG. 50, it can be appreciated the SMLOI can become a true relational search tool. Navigation in the SMLOI, beginning with an information element, can move on a first information element vector until the user wants to know more about a first information element encountered on the first information element vector. A characterization attribute is then selected on the first information element to generate a second information element vector showing information elements possessing the selected characterization attribute. The user continues the navigation on the second information element vector until the user wants to know more about a second information element encountered on the second information element vector. A characterization attribute is then selected from the second information element to generate a third information element vector and so forth. This provides an intuitive spatial and graphical relational navigation that could truly be represented on a display device.
FIG. 51 shows a first information element vector 230 and a second information element vector 232 where the “base” intersecting element 246, possessing characterization attributes A, E and H, is duplicated. This superposition of the second information element vector 232 allows the user to vertically move (or navigate, or scroll) the second information element vector 232 while always keeping the first information element vector 230 in the line of sight at the same place on the display device. This helps the user to go explore the second information element vector 232 without loosing its “base” on the first information element vector 230. The second information element vector 232 is illustratively superposing the first information element vector 230 in a distinct plane on FIG. 51 but could perfectly be in the same plane and just curve above the first information element vector 230 when it comes close to the first information element vector. One skilled in the art would easily see other variations to achieve similar results.
The vectors in the SMLOI can be disposed on the side of the screen instead of in the middle of the screen. If the user wants to see what is higher on the vertical axis he scrolls the vertical vector down, thus moving the horizontal axis accordingly. The enlarged information element remaining on the screen slightly moves higher to leave space (down) for positioning the horizontal vector following the movement of the vertical scrolling of the vertical vector. If the scrolling continues, the information element gets bigger taking back the area left unoccupied by the horizontal vector not anymore visible on the screen (because moved lower than the lowermost portion of the screen). These movements can be seen as animation of the vector and the enlarged information element on the screen according to the movement of the vector dictated by the SMLOI's user.
Referring now to FIG. 52, the positions of the first absolute information element vector 230 and the second, or relative, vector 232 are disposed on the bottom-left side of the screen to maximize the useful area 752 on the screen to, illustratively, present an information element in bigger format allowing to see finer details. The position of information element vectors 230, 232 can move, or be animated, to maximize area on the screen to see a bigger picture of an element or any other information useful to the SMLOI's user. This function is depicted by FIG. 52 where the information element vectors 230, 232 changed position to, respectively, reach positions 754, 756 and leaves useful area 750 for illustratively visualizing an information element in greater details. These movements on the vectors can be based on the navigational actions of the user in the SMLOI. For instance, when the user moves along a vector searching for a particular information element, it is possible he/she moves the vector thus effecting the position of the vector on the screen in order to maximize the useful area 752. If the relative information element vector 232 moves from the left side of the screen to the right side of the screen, the position of the useful area 752 moves from the right side of the screen to the left side of the screen to adjust with the position of the vector. Room can remain for the navigation tools between the side of the screen (or any means for visualizing the axis) and vectors. Other animations, like when an information element is selected to be viewed in the useful area 752 it progressively moves from the vector to the useful area 752, can also be made.
Streamed media content can be automatically added to the SMLOI of a user wanting such information to be added to his SMLOI. Newspapers, magazine, financial data, web pages, weather forecasts, and other information can be streamed in the SMLOI of a user. Copyright fees can be automatically calculated and billed to the SMLOI user on a timely basis. Each information element in the SMLOI that is not created by the user of the SMLOI can be subject to copyright or other intellectual property license. The amount due to owners of the intellectual property rights can be automatically calculated by the SMLOI and collected from the SMLOI's user.
Blogs are well known in the art. They are generally disposed as a number of sequential communications posted one on top of the other. This forms a vertical “stream” of distinct communications having at least one common topic. The blog contains a number of information elements on the form of a plurality of short texts related to a particular topic. In the context of this patent application, the blog can be considered a vector. It would become possible to generate another vector just as previously described in this specification by selecting a particular message in the blog. More precise navigation can be obtained by selecting more precise blog attributes to generate more refined vectors.
Patent prior art management is a possible real life application of this SMLOI. Standard patent information such as the title, the inventor's name, the classification, the filing date, the priority date (if any) . . . . Are considered intrinsic attributes and can be gathered automatically using an Internet crawler. Once the image of each page of the patent is collected by the SMLOI, the full text in searchable format and the standard patent information are collected, extrinsic information element attributes can be applied. Illustratively, all collected patents appear on the absolute information element vector. The extrinsic information attributes could be represented, illustratively, in the automotive field, as the mechanical systems (i.e. drive, electrical, transmission, fuel, suspension, brake, hydraulic, seating . . . ). These mechanical systems can be subdivided in more refined sub-systems (i.e. suspension system could be subdivided as: shock absorber, coil, rubber mounts, fasteners, MacPherson type suspension, double a-arm suspension, bumpsteer . . . ). These extrinsic attributes can be applied when patents are analyzed. This classification would rapidly provide a precise and narrow search about a specific patent using the SMLOI.
Each attribute can correspond to another completely different attribute using a cross-reference table. A correspondence is made in the table when two different attributes are related but are on different topics and are unlikely to be selected together because they relate to different users but could be useful for each of them. When one attribute is selected the other will be automatically selected. Other actions may be applied on the second attribute as a consequence of the first attribute. One skilled in the art could make many other examples of similar or related applications without departing from the scope of the SMLOI.
Writing directly in an empty information element (i.e. blank page) can be used as an e-mail to be sent because the e-mail messaging system is fully embedded in the SMLOI. Each information element has its own little “word processing” providing each information element with writing or noting capabilities and therefore be a potential note or e-mail. The server setup (SMTP, POP, POP3 . . . ) is embedded directly in the SMLOI. Selected information elements, individually or by cluster, can directly be sent by e-mail as an e-mail with or without attachments. Embedding in the SMLOI the e-mail system procures the SMLOI a seamless communication capability removing the need of having an e-mail system distinct from the SMLOI. In fact, the SMLOI could fully integrate all functions of an operating system and completely integrate all functions of the operating system (which is not really seen as useful from a user point of view if not to manage files and interconnect various third party applications). Instant messaging, video communication and the like are also intended to be part of the communication system embedded in the SMLOI.
When inserting a batch of information elements in the SMLOI from a classic folder and subfolder classification, the classic folder classification is transferred into attributes on each information element entered in the SMLOI. This provides the possibility for a user to retrieve an information element based on its former location despite the information element is not really located in the folder/subfolder classification.
The SMLOI can also be utilized with a MP3 music player to manage music, albums and songs. The round multidirectional interface of the well-known iPodTM is quite similar to the navigation tool of the SMLOI disclosed in the illustrative embodiment. The iPod's interface manages navigation on the X (absolute) and Y (relative) vectors by simply pressing the click wheel at 0, 90, 180 and 270 degree, by turning the click wheel the user can zoom in/out. Conversely, pressing the click wheel at 0, 90, 180 and 270 degree can zoom in/out the SMLOI interface. Data synchronization is automatic with the SMLOI when the iPod is connected with its base computer or on any computer in the case the SMLOI is web-based. It is encompassed by the present patent application to fully integrate the SMLOI to the iPod's interface and possible functionalities. The SMLOI's attributes are integrated in the iPod menu. The attributes would be managed by the iPod's interface just like the music menu of the iPod. Similarly, the information element vectors might be moved by directly using fingers on a touch screen.
Client-Server
A client-server structure is an alternative to a local software installed on a single computer. The client-server option allows access to the SMLOI from a plurality of different computers or other means for accessing the network used by the SMLOI. Information elements are illustratively stored on various memory devices that could be physically located at various places. For instance the SMLOI user can access the SMLOI from home, office and from the local library. Some information elements based files are recorded on the PC at home, some others on the PC at work, some other on a USB key and some others, needed more frequently, are stored on the SMLOI server. Distribution of information elements on many different computers could also be applied to a peers-to-peers network with no real server managing the data. Each information elements based files have a respective “image” that take less memory space than the actual base file. This “image” is used with the associated information element to display a representation of the document in the SMLOI. The actual file associated with the image is transferred by the SMLOI only when needed (e.g. when edition with the native application is requested for instance).
The information elements visible on the display device (e.g. the documents images and the characterization attributes amongst others) and the database including the corresponding characterization attributes associated with each information elements and all other information associated with the information elements are stored on the server. Storage on the server allows access to a usable SMLOI from anywhere having access to the network (e.g. Internet or LAN or any other type of network wired or wireless). Navigation along axis of the SMLOI is possible using the documents' images even if the base documents are stored on a different computer than the one used by the user of the SMLOI. Access to the base documents from its respective information element in the SMLOI can be done if the document is stored on the local computer or, if access to the other remote storage device on which the desired based document is stored (or recorded), is accessible via the network. Using information element images are intended to reduce the amount of data to be transferred between the clients and the server. The base documents can be displayed and transferred via the network, if bandwidth is sufficient, without departing from the scope of the present invention.
The USB key might be utilized by the SMLOI user to carry base documents (or files) that the user uses more often. The SMLOI will access the network to contact the server and get the database and the information elements to display on the display device used by the SMLOI user. When a base document is requested from one (or many information elements) the SMLOI will evaluate which base documents are available on each accessible memory devices and will provide access to the accessible based documents. The user will have to wait to get access to presently non-accessible base documents when the memory device on which they are stored is accessible by the SMLOI. In the case of the USB key, the SMLOI will search available storage devices (local memory devices and external memory accessible by the computer) and will allow access to the base documents stored on the USB key.
When the user accesses the SMLOI on a remote computer and wants to add a new document in the SMLOI but does not want to store it on the remote computer or on the USB key then, the SMLOI will temporarily upload the new document on the server and store it on, for instance, the home computer the next time the user access the SMLOI from his home computer. The base file could also remain stored on the server depending on the user's preference (i.e. store the base document of information element no. xyz on 1) USB key, and/or 2) home computer, and/or 3) office computer, and/or 4) office network and/or 5) SMLOI server).
Peer-To-Peer Computer Network
Distribution of information elements on many different computers with no real server managing the data could also be applied the SMLOI. A peer-to-peer (P2P) computer network relies primarily on the computing power and bandwidth of the participants in the network rather than concentrating it in a relatively low number of servers. Peer-to-peer networks are typically used for connecting nodes via largely ad hoc connections. Such networks are useful for many purposes. Sharing content files (see file sharing) containing audio, video, data or anything in digital format is very common, and real-time data, such as telephony traffic, is also passed using P2P technology.
A pure peer-to-peer network does not have the notion of clients or servers, but only equal peer nodes that simultaneously function as both “clients” and “servers” to the other nodes on the network. This model of network arrangement differs from the client-server model where communication is usually to and from a central server. A typical example for a non peer-to-peer file transfer is an FTP server where the client and server programs are quite distinct, and the clients initiate the download/uploads and the servers react to and satisfy these requests.
Visual Distinctive Features
Many information element vectors 230, each one depicting a subset grouping of information elements based on different combinations of characterization attribute(s), represented adjacent to one another, provides a useful way to represent a plurality of information elements 150 and draw links between them that are perceivable by a user.
Referring to FIG. 53, one can appreciate a first information element vector 230.1, a second information element vector 230.2 and a third information element vector 230.3 illustratively disposed parallel to each other on a display. Each information element vector 230.1, 230.2, 230.3 uses at least one characterization attribute to determine which information elements 150 subset, taken from a larger group of information elements 150, is displayed. In the illustrative embodiment, information element vector 230.1 displays only information elements 150 associated with characterization attribute 800, information element vector 230.2 displays only information elements 150 associated with characterization attribute 810 and information element vector 230.3 displays only information elements 150 associated with characterization attribute 820.
Each information element vector 230.1, 230.2, 230.3 disposes information elements 150 along a specific order, for example a timeline 32. The distance between information elements 150, for instance distances 802, 812, 822, are illustratively proportional to the length of time between the time of insertion of the two consecutive information elements 150 in the SMLOI. For instance, time gap 802 represents a one week time period, time gap 812 a few minutes and time gap 822 is a month. The distances might be different given the time scale used to represent information element vectors on the display; some slight anachronisms might be unavoidable to fully show each information elements 150 (time gap 812 is proportionally larger for the period of time it represents compared to the time gap 802, representing a week, to prevent superposing the information elements 150 separated by too small time gaps on the information element vector 810).
Still on FIG. 53, the three information element vectors 230.1, 230.2, 230.3 are juxtaposed to each other to allow a user of the SMLOI to see at least a portion of at least two of each information element vectors 230.1, 230.2, 230.3 at the same time. The distance between the information element vectors might vary depending on the desired appearance. Seeing many information element vectors at a glance gives valuable information to the user by giving a view on many related information elements logical order. In this illustrative example, more or less information element vectors 230 can be juxtaposed to fulfill the request of a user without departing from the scope of the present invention. In the present situation we have three information element vectors 230.1, 230.2, 230.3 to better accommodate the following illustrative example that does not intend to be limitative.
Illustrative example: patent practitioners in law firms conventionally use a three-parts file for keeping good record of a patent prosecution matter. The first part, for example, physically on the left side of the file, is used for communications with the patent office; the second part, physically on the center of the physical file, is used to hold a copy of the specification as filed with the figures and the right side, used for communications with the client, is on the right side of the physical file. In the present example, the first part is displayed on information element vector 230.1 associated with characterization attribute 800, the second part is displayed on information element vector 230.2 associated with characterization attribute 810 and the third part is displayed on information element vector 230.3 associated with characterization attribute 820. More precisely, to give a better example, the information element 804 is illustratively the declaration signed by the inventor filed with the patent office, information element 806 is the power of attorney and information element 808 is the filling receipt received from the patent office. On information element vector associated with characterization attribute 810, information element 814 is the specification as filed and information element 816 is the figures as filed. On the client side, information element vector associated with characterization attribute 820 displays an invention disclosure 824 received from the client, information element 826 is an acknowledgement letter sent to the client and information element 828 is additional invention related information received from the client. Only the beginning of the prosecution history is detailed however the remaining of the prosecution documents is illustratively shown on FIG. 53.
Now referring to FIG. 54, the same three information element vectors 230.1, 230.2, 230.3 from FIG. 53 can be appreciated. Characterization attribute 800, which represents communications with the patent office, has been further divided into two sub-characterization attributes 800.1 (communications to the patent office) having a distinctive visual feature putting these information elements slightly above the center of the information element vector 230.1 axis and sub-characterization attribute 800.3 (communications from the patent office) having a distinctive visual feature putting these information elements slightly below the center of the information element vector 230.1. These distinctive visual features improve the understanding of what happened on this part of the file with the patent office by using various visual differentiators—the vertical alignment of information elements 150 on the information element vector being one of the possible visual differentiators.
Characterization attribute 810, that displays the original specification and figures filed with the patent office, has been further divided into three sub-characterization attributes 810.1 (specification) having a distinctive visual feature putting these information elements slightly above the center of the information element vector 230.2, sub-characterization attribute 810.2 (figures) having a distinctive visual feature putting these information elements centered on the information element vector 230.2 and sub-characterization attribute 810.3 (for example preliminary amendment) having a distinctive visual feature putting these information elements slightly lower on the information element vector 230.2, but, since there is no information elements to be shown, this sub-characterization attribute remains empty. These distinctive visual features improve the understanding of what happened on this part of the file with the patent office.
Characterization attribute 820, that is communications with the client, determining the information elements 150 to be displayed on information element vector 230.2, has been further divided into three sub-characterization attributes 820.1 (communications to the client) having a distinctive visual feature putting these information elements slightly above the center of the information element vector 230.3, sub-characterization attribute 800.2 (communications with other law firms) having a distinctive visual feature putting these information elements at the center of the information element vector 230.3 and sub-characterization attribute 820.3 (communication from the client) having a distinctive visual feature putting these information elements slightly lower on the information element vector 230.3. These distinctive visual features improve the understanding of what happened on this part of the file with the patent office.
Additional visual distinctive features are shown on FIG. 55. All information elements 150 being PDF documents are shaded 860 thus improving the visual meaning of the information elements 150 in the SMLOI. Shading 862 illustratively depicts ownership transfer (information element 863 being an assignment filed with the patent office). Shading 861 illustratively depicts a debit note sent to the client. Color filling 864 illustratively represents litigation related documents. Thicker frame 866 illustratively means this document has been filed with the patent office and something is awaited in return from the patent office but hasn't been received yet (a delay and a condition is associated with the visual distinctive feature applied on this information element). Other distinctive visual features are within the scope of the present invention; namely, but not limited to: color, shape, size, alignment with the axis, frame size, frame thickness, frame color, icon, printed character(s) and movement. In other words, a distinctive visual feature could be anything that graphically distinguishes an information element from another so that a user could quickly draw links between information elements by associating information elements associated with similar visual features.
Now referring to FIG. 56, which is substantially identical to FIG. 55 with the exception that too much e-mails “to” and “from” the client 820.1, 820.3 have been reduced in size 870 to minimize their effect on the visual of the information element vector 230.3. The information element having the heavier frame 866 has received the awaited document 872 from patent office and the heavier frame 866 (FIG. 55) is now replaced by lighter frame 867 meaning the condition (receiving a document from the patent office) has been fulfilled. Element junction mark 880 ensures the user sees the connection between the two related information elements 866, 872.
Another difference with FIG. 55 is the additional information element vectors 230.1.1 added on the information element vectors 230.1 and intersecting information element 865. This additional information element vector 230.1.1 depicts all communications with the patent office 800 and the client 820 that have an additional common characterization attribute. As it has been previously described, information element vector 230.1.1, represented along timeline 32, displays the different versions of document 865 (that is version 4 or V4) and is represented non-parallel with the information element vector 230.1. Version 1 (V1) through version 7 (V7) are shown respectively distributed on their own timeline 265 on each side of information element 865 version 4 (V4) that is actually timely placed on the timeline 32 of the information element vector 230.1 displaying the communications with the patent office 800.
The information element vector 230.3 displaying the communications with the client 820 has an intersecting information element vector 230.3.1 displayed along timeline 236 that represents an information element subset from a larger group of information elements having a common characterization attribute “E” (for example, the larger group of information element can be all the information elements or any information element subset). Information element vector 230.3.1 has been generated based on information element 864 already present on the information element vector 230.3 displaying the communications with the client 820. A different characterization attribute, or a combination of characterization attributes (i.e. (E AND J) OR A) after Jun. 4, 2001), could have been selected and provides another subset of information elements related to information element 864 and disposed along information element vector 230.3.1. To continue with the illustrative example, if information element 864 is a litigation document then, if “E” is a characterization attribute meaning “ongoing litigation documents” (or litigation document with the status “active”) then all information elements presented along information element vector 230.3.1 (and timeline 236) are related to litigation documents of ongoing litigation matters and could also be shaded accordingly if such is the desire of the user reflected in the characterization attribute setup drawing relations between characterization attributes and distinctive visual features.
The multiple parallel information element vectors 230.1, 230.2, 230.3 are not limitative of the actions that can be done on each individual information element on any information element vectors, parallel or not. For the illustrating purpose of the present example only two non-parallel vectors 230.1.1, 230.3.1 are displayed but any other functions previously described in the present specification can be applied and generate an infinity of variations. If desired, only parallel information element vectors can be displayed and a non-parallel vector could be discretionally built and displayed simultaneously to show or put more emphasis on a specific topic or a particular characterization attribute.
Lets focus on the first actions performed in the prosecution of this illustrative prosecution file by looking at FIGS. 57 and 58. The element junction mark 882 associates the information elements 804, 806 (illustratively a declaration and a power of attorney, respectively) with an expected document 884 to be received from the patent office. The expected document 884 will be received in the future, past the present moment line 900 intersecting the information element vectors showing where “now” is on the timeline. The filing receipt 884 is expected later (lets assume four months after filing) in time and is aligned with sub-characterization attribute “received from the patent office” 800.3 and has a dotted frame indicating the document has yet to be received. A delay, a condition and an action are associated with the junction 882. They are all characterization attributes related with the information elements 804, 806. The delay is the normal expected delay for receiving the filing receipt, the condition is to enter the filing receipt in the SMLOI and the action is to flag to the user of the SMLOI that the expected filing receipt was not received within the delay. The action uses multiple strategies like changing the visual distinctive feature of expected information element 884, adding the delay into a “past due” list and sending an e-mail to the user when the present moment 900 passes the due date for receiving the expected document 884. These delays, conditions, tasks and actions allow the SMLOI to be used as a workflow management tool and a graphical docket system.
A series of tasks and actions can be predetermined in a specific given order, associated with conditions and delays, to replicate in the SMLOI a desired chain of actions. The SMLOI interconnects information elements with associated actions, delays, tasks and conditions. This provides an easy to follow workflow since everything can be managed with a single system. If we continue with the patent prosecution example we can further use a few examples to illustrate a concrete application of a workflow management SMLOI.
A provisional application (multiple information elements) is filed (action) in the United States patent office, a non-provisional application (multiple information elements e.g. declaration, specification, ADS . . . ) filing (action) and other foreign filings (actions) must be done before (condition) a year from the filing date (delay based on past action that occurred at a specific time) of the provisional application. Additionally, an information disclosure statement IDS must be filed before (condition and delay based on an estimated time for receiving the first office action given the estimated backlog of this Art Unit) the first office action (foreseen action receiving an information element) to avoid paying the official fee (action if the previous condition is not met). If (condition) an international application PCT is filed (multiple information elements associated with an action), a copy of the International Search Report ISR (information element) must be filed (action) in an IDS with the United States patent office. The ISR is normally received by the sixteenth month from earliest priority date (expected delay based on the filing date of the provisional application) and a fee must be paid (action), and so on so forth. A patent agent using the SMLOI could add on top of this a rule requesting to be warned of any condition not met two weeks before the due date.
FIG. 59 depicts the action of the user postponing the expected date by placing further in time expected information element 884.1. Information element 884 now has a different visual distinctive feature still showing a lighter flag 886 and a frame meaning this is passed due and is replaced by a new expected date on which is aligned expected information element 884.1.
FIG. 60 depicts the action of the user postponing the expected date by placing later in time the expected information element 884.2, sending a status inquiry 890 to the patent office to know why there is an unusual delay, sending a letter to the client 888 explaining there is a delay (a link, not shown on FIG. 60, can be made between information elements 890 and 888 to graphically show they are related). The letter to the client 888 and the letter to the patent office 890 are related since they are both dealing with the same issue and are therefore showing the same visual distinctive feature 889. A non-parallel information element vector (230.1.2 not shown) could have been used to search letter models to prepare the letter (information element 886 sent to the patent office while keeping an eye on information element vector 230.1.
Now referring to FIG. 61 illustrating an embodiment where the characterization attributes 950 are presented along with a portion of their possible visual distinctive features, namely the information element color 960, the information element shading 962, the information element size 964, the information element frame 966, the information element animation 968 and the information element alignment 970 on the information element vector. Each characterization attribute can also be selectively visible or invisible 954 on the display such that only a desired group of information elements, with accordingly selected characterization attributes, are visible. FIG. 61 illustrates what could look like a setup window on a computer for dealing with patent prosecution related documents. “Available to client” means the information elements associated with the characterization attribute will be made available to the client's SMLOI when the client logs in its own SMLOI via Internet or other client-server networks. The client will access the information elements in a read only mode to prevent any alteration of the information. When the characterization attribute is “shared” then the other user or the group or other users will benefit of a deeper access providing access to more functions like adding notes or creating a new version. Other access related functions have been discusses earlier and still be applicable here. Each information attribute 950 is also associated with a specific information element vector 952 in the case many vectors are used at the same time like in the illustrative example of FIG. 54. Communications to patent office will be associated with “horizontal vector #1” with the visual distinctive feature “above”. Similarly, all characterization attributes depending from the characterization attribute “communications to the patent office” will be automatically put on the same information element vector. The same logic applies to the characterization attribute “communications from the patent office” is associated with “horizontal vector #1” with the visual distinctive feature “below” and so on so forth. A dot “.” before a characterization attribute means this characterization attribute is part of a larger regrouping characterization attribute (i.e. declaration falls under communications to the patent office). Although it is not shown on FIG. 61, more functions and visual differentiators will become apparent to skilled readers by applying the SMLOI to their particular needs. The example disclosed herein are for illustrative purpose only to show possible applications of the general inventive concepts and are not intended to limit the scope of the present invention. The grey zones indicate no choice is available either because there are none or because it would conflict with another selection already made (i.e. you can't have the same information element aligned above and below at the same time without risking creating confusion).
FIG. 62 illustrates the application of the SMLOI to car engine technology mapping by separating the main characterization attributes into mechanical systems (i.e. engine, transmission, exhaust system . . . ), patent related attributes and other insightful attributes (i.e. type of file, accessed lately, viewed by . . . ). For a technology mapping the first information element vector would present all engine related patents in green when they are expired and flashing if they can still be reinstated. Transmission patents will appear on information element vector #2, parallel to information element vector #1, and displays only large CVT related documents. The client's patent will be displayed on information element vector #3. Expired and reinstatable patents will receive the same visual treatment. PDF documents will appear with shading. Patents will be limited to US patents and blue frames will indicate which patents have been seen by another from the “shared” list. All SMLOI functions previously described are applicable to provide information element vectors presenting documents related to patents and technology mapping in order to facilitate recognition of trends and significant documents among a large group of documents. Zooming in will provide a larger view of a portion of one vector and selecting a specific information element will call the entire document with the related application to open it. Patents from Honda will be displayed above the information element vectors so that they can easily be distinguished. This illustrative example shows how it becomes possible with the SMLOI to easily see where are expired Honda patents related to engine, CVT transmission in relation with our client's patent. All this is done about a timeline to provide a clear distribution of all patents/information elements. Many other variations can be done and are within the scope of the present invention.
The description and the drawings that are presented above are meant to be illustrative of the present invention. They are not meant to be limiting of the scope of the present invention. Modifications to the embodiments described may be made without departing from the present invention, the scope of which is defined by the following claims.

## Claims

1. A non-transitory computer-readable medium having stored thereon computer-readable instructions that, when executed by a processor of a computer system, cause the computer system to perform operations on user-selectable elements, the operations comprising:
providing a first group of user-selectable elements having a first attribute in common;
displaying the first group of user-selectable elements in a first array thereof;
providing a second group of user-selectable elements having a second attribute in common;
displaying the second group of user-selectable elements in a second array thereof; and
displaying a visual distinctive feature in connection with a set of user-selectable elements having a third attribute in common, the set of user-selectable elements comprising at least one user-selectable element from the first group of user-selectable elements and at least one user-selectable elements from the second group of user-selectable elements, wherein the third attribute is associated with each user-selectable elements in the set of user-selectable elements irrespective of the position of each user-selectable element in relation to one another in the first array and the second array, the visual distinctive feature identifying the user-selectable elements associated with the third attribute from the user-selectable elements not associated with the third attribute.

2. The non-transitory computer-readable medium having stored thereon computer-readable instructions that, when executed by a processor of a computer system, cause the computer system to perform operations on user-selectable elements of claim 1, wherein each array is a substantially rectilinear axis of user-selectable elements.

3. The non-transitory computer-readable medium having stored thereon computer-readable instructions that, when executed by a processor of a computer system, cause the computer system to perform operations on user-selectable elements of claim 1, wherein the first array is displayed adjacent and parallel to the second array.

4. The non-transitory computer-readable medium having stored thereon computer-readable instructions that, when executed by a processor of a computer system, cause the computer system to perform operations on user-selectable elements of claim 1, wherein the first array displays user-selectable elements along a first timeline and the second array displays documents along a second timeline.

5. The non-transitory computer-readable medium having stored thereon computer-readable instructions that, when executed by a processor of a computer system, cause the computer system to perform operations on user-selectable elements of claim 4, wherein the first timeline and the second timeline are sharing a same timeline.

6. The non-transitory computer-readable medium having stored thereon computer-readable instructions that, when executed by a processor of a computer system, cause the computer system to perform operations on user-selectable elements of claim 4, further comprising displaying a present moment position, the present moment position identifying the present moment along at least one of the timelines.

7. The non-transitory computer-readable medium having stored thereon computer-readable instructions that, when executed by a processor of a computer system, cause the computer system to perform operations on user-selectable elements of claim 1, wherein the third visual distinctive feature is an offset in alignment of the user-selectable elements from their respective array.

8. The non-transitory computer-readable medium having stored thereon computer-readable instructions that, when executed by a processor of a computer system, cause the computer system to perform operations on user-selectable elements of claim 1, wherein the third visual distinctive feature is a combination of a plurality of visual distinctive features.

9. The non-transitory computer-readable medium having stored thereon computer-readable instructions that, when executed by a processor of a computer system, cause the computer system to perform operations on user-selectable elements of claim 1, wherein the third visual distinctive feature is selectable by a user.

10. The non-transitory computer-readable medium having stored thereon computer-readable instructions that, when executed by a processor of a computer system, cause the computer system to perform operations on user-selectable elements of claim 1, wherein the visual distinctive feature is adapted to be changed by a user.

11. The non-transitory computer-readable medium having stored thereon computer-readable instructions that, when executed by a processor of a computer system, cause the computer system to perform operations on user-selectable elements of claim 1, wherein a group of user-selectable elements is provided on a basis of a query.

12. The non-transitory computer-readable medium having stored thereon computer-readable instructions that, when executed by a processor of a computer system, cause the computer system to perform operations on user-selectable elements of claim 1, further comprising an array of user-selectable elements disposed at an angle from at least one of the arrays, the array of user-selectable elements disposed at an angle being adapted to display a plurality of user-selectable elements having a commonality.

13. The non-transitory computer-readable medium having stored thereon computer-readable instructions that, when executed by a processor of a computer system, cause the computer system to perform operations on user-selectable elements of claim 1, further comprising a plurality of visual distinctive features adapted to visually discriminate user-selectable elements in respect with additional commonalities thereof.

14. The non-transitory computer-readable medium having stored thereon computer-readable instructions that, when executed by a processor of a computer system, cause the computer system to perform operations on user-selectable elements of claim 1, wherein changing the visual distinctive feature is displayed for a predetermined period of time.

15. A non-transitory computer readable program code for execution by a computing apparatus for implementing a graphical user interface on a display device, the graphical user interface comprising:
a first display area adapted to display a first group of user-selectable elements; and
a second display area adapted to display a second group of user-selectable elements;
the graphical user interface being adapted to display a visual distinctive feature in connection with user-selectable elements displayed in the first display area and the second display area irrespective of a position of the user-selectable elements in relation to one another on the first display area and on the second display area, the visual distinctive feature discriminating the user-selectable elements displayed in the first display area and the second display area that share a commonality, whereby a user can distinguish the user-selectable elements that share the commonality from the user-selectable elements that do not share the commonality.

16. The non-transitory computer readable program code for implementing the graphical user interface of claim 15, wherein each array is organizing the user-selectable elements thereon in a substantially rectilinear alignment thereof.

17. The non-transitory computer readable program code for implementing the graphical user interface of claim 15, wherein the first display area includes a first timeline and the second display area includes a second timeline.

18. The non-transitory computer readable program code for implementing the graphical user interface of claim 15, wherein the visual distinctive feature is adapted to be selected by a user of the graphical user interface.

19. An apparatus for implementing a user interface adapted to discriminate user-selectable elements displayed thereof, the apparatus comprising:
a memory module adapted to store thereon a plurality of user-selectable elements;
a processing unit in communication with the memory module, the processing unit being operative for executing computer readable program code stored on a non-transient computer readable medium for implementing a graphical user interface, the graphical user interface being adapted for displaying on a display:
a first group of user-selectable elements from the plurality of user-selectable elements that have a first attribute in common, the first group of user-selectable elements being displayed along a first axis;
a second group of user-selectable elements from the plurality of user-selectable elements that have a second attribute in common, the second group of user-selectable elements being displayed along a second axis;
a visual distinctive feature in connection with a set of user-selectable elements having a commonality, the set of user-selectable elements comprising at least one user-selectable element from the first group of user-selectable elements and at least one user-selectable element from the second group of user-selectable elements, wherein the commonality is attributed to each user-selectable element in the set of user-selectable elements irrespective of a position of each user-selectable element in relation to one another on the first axis and the second axis, the visual distinctive feature discriminating the user-selectable elements associated with the commonality from the documents not associated with the commonality.

20. The apparatus as defined in claim 19, wherein the commonality is a user selected attribute, the apparatus further comprising an input for receiving a signal indicative of the attribute from a user, wherein upon receipt of the signal, the processing unit being adapted to apply the visual distinctive feature associated with the attribute to the user-selectable elements having the attribute on the axes.