Data realization for virtual collaboration environment

An example may include receiving one or more data inputs from collaboration by one or more participant devices operated by a number of meeting participants of a meeting, identifying an initial context of the meeting based on the one or more data inputs, querying a databank of previously stored information to identify one or more additional contexts related to the initial context, linking the initial context and the one or more additional contexts by establishing one or more entity relationships, and forwarding the initial context and the one or more additional contexts as entities in a virtual collaboration space.

BACKGROUND

Meetings can be incidental or scheduled. A structured meeting requires planning, such as scheduling, live attendance by multiple participants, a specific meeting application or location, etc. In general, a meeting is a static event with no history of information other than what is shared by users in a live discussion.

Additionally, a meeting or simply just a collaboration may be flooded with information that no one user can generally corroborate or prove based on their own experience or knowledge, certain resources can be used to assist in this process, however, the information tend to be outside the scope of the meeting and is not available at the desired times.

A static two-dimensional space, such as a user interface is generally used to display one page of a presentation at a time during a collaboration session. This can bore the users in attendance and prohibit information flow from other sources to populate the display area of a computing device.

SUMMARY

One example embodiment may provide a method that includes one or more of receiving one or more data inputs from collaboration by one or more participant devices operated by a plurality of meeting participants of a meeting, identifying an initial context of the meeting based on the one or more data inputs, querying a databank of previously stored information to identify one or more additional contexts related to the initial context, linking the initial context and the one or more additional contexts by establishing one or more entity relationships, and forwarding the initial context and the one or more additional contexts as entities in a virtual collaboration space.

Another example embodiment may include an apparatus that includes a receiver configured to receive one or more data inputs from collaboration by one or more participant devices operated by a plurality of meeting participants of a meeting, and a processor configured to identify an initial context of the meeting based on the one or more data inputs, query a databank of previously stored information to identify one or more additional contexts related to the initial context, link the initial context and the one or more additional contexts by establishing one or more entity relationships, and forward the initial context and the one or more additional contexts as entities in a virtual collaboration space.

Still another example embodiment may include a non-transitory computer readable storage medium configured to store instructions that when executed cause a processor to perform receiving one or more data inputs from collaboration by one or more participant devices operated by a plurality of meeting participants of a meeting, identifying an initial context of the meeting based on the one or more data inputs, querying a databank of previously stored information to identify one or more additional contexts related to the initial context, linking the initial context and the one or more additional contexts by establishing one or more entity relationships, and forwarding the initial context and the one or more additional contexts as entities in a virtual collaboration space.

Yet another example embodiment may include a method that includes one or more of identifying an initial context of a meeting based on one or more data inputs received from one or more participant devices operated by a plurality of meeting participants, querying remote data sources to identify one or more additional contexts associated with one or more of a specific period of time and a trending topic related to the initial context, forwarding a first of the one or more additional contexts to a first collaboration space of a virtual collaboration space, forwarding at least one additional context of the one or more additional contexts to a second collaboration space of the virtual collaboration space, identifying one or more sentiment actions associated with the one or more meeting participants, and overlaying the first collaboration space and the second collaboration space on an augmented reality display of a device based on the one or more sentiment actions.

Still yet another example embodiment may include an apparatus that includes a processor configured to identify an initial context of a meeting based on one or more data inputs received from one or more participant devices operated by a plurality of meeting participants, query remote data sources to identify one or more additional contexts associated with one or more of a specific period of time and a trending topic related to the initial context, forward a first of the one or more additional contexts to a first collaboration space of a virtual collaboration space, forward at least one additional context of the one or more additional contexts to a second collaboration space of the virtual collaboration space, identify one or more sentiment actions associated with the one or more meeting participants, and overlay the first collaboration space and the second collaboration space on an augmented reality display of a device based on the one or more sentiment actions.

Another non-transitory computer readable storage medium configured to store instructions that when executed cause a processor to perform identifying an initial context of a meeting based on one or more data inputs received from one or more participant devices operated by a plurality of meeting participants, querying remote data sources to identify one or more additional contexts associated with one or more of a specific period of time and a trending topic related to the initial context, forwarding a first of the one or more additional contexts to a first collaboration space of a virtual collaboration space, forwarding at least one additional context of the one or more additional contexts to a second collaboration space of the virtual collaboration space, identifying one or more sentiment actions associated with the one or more meeting participants, and overlaying the first collaboration space and the second collaboration space on an augmented reality display of a device based on the one or more sentiment actions.

DETAILED DESCRIPTION

Example embodiments include enhancing a meeting with dynamic data population procedures which may be shared with a meeting user interface or other computer related medium. The information shared may pertain to certain contextual information that is identified during the meeting as the attendees are present and sharing information. Not all information provided by the system application will be made available to all participants. The system application could use criteria, such as, confidentiality, expertise, or other factors, to make some information available (or even displayed) to some participants and not others. In one example, a meeting may have no pre-known purpose that can be identified by an artificial intelligence (AI) application utilized by the computer platform or by others, such as attendees (users) and their respective computer platforms, assuming the meeting is performed online and in remote locations. The purpose may be identified after the meeting has begun by using one or more information gathering and analyzation strategies. Also, a meeting may be based on synchronous (planned event times and/or locations) and asynchronous interactions (unplanned event times and spontaneous congregations of live attendees). Any user may begin sharing information with any other users or a recording platform of a computing device that is recording illustrations drawn on a computer, recording audio, video, etc. Once information is received and identified by the computing device, other information may be imported and saved in a common workspace (e.g., exported file, virtual whiteboard, virtual illustration, etc.). A meeting may also be a workshop, brainstorming session, lecture, question and answer session, and may be conducted via spoken words and/or shared text and drawings only. The meeting may also be performed by a VR device or in person.

One approach to automated importing and information collection may include a user's specific disposition, such as gestures of hands, head, face, eyes, etc. Any one or more of those input actions may be deemed as an approval, disapproval, trigger to import information, trigger to ignore information, etc. In operation, one example may include two or more live attendees which are talking and sharing information, such as a data file presentation, or other digital information, spoken words, input actions, etc. The meeting application may use AI to initiate one or more topics of interest. For example, a user may start the meeting by mentioning certain topics parsed from a phrase “global warming and other climate concerns are effecting countries all over the world, our task is to focus on flooding, farming and the general well being of those living in parts of central and western Africa.” Such a phrase can be identified by the microphone enabled AI function of a computing device to launch an initial context. As the spoken phrase is recorded, the sentence information is parsed to enable an entity extraction (e.g., nouns, unique terms) and a neural network function to establish a relationship among the entities identified. This initial context may appear as one or more entities on a virtual whiteboard all users can view on their conferencing devices. The entities in this example may be “global warming”, “Africa”, “western Africa”, “extreme weather”, etc.

Once the initial context is identified, the content that is shared may be based on current and/or previous information stored in a databank. The databank may be based on information stored in an internal database that is assigned to the conference application. For example, the application may be configured to use information shared among users of an organization, the e-mails, text messages, data files and other information of those users may be stored in the databank as such information pertains to the corporation or other entity which is hosting the information storage. Preferences may be used to limit, include, prioritize, deprioritize or include additional information sources. For instance, a preference to include corporation XYZ information from e-mails, files and folder directories may be initiated by certain users attempting to create new collaboration efforts. Other information sources, such as text messages and other data sources may be omitted per user preferences. Inclusion of still other information sources may be deprioritized based upon a cost (i.e., economic or otherwise) of their use.

Content of a meeting may include user opinions, document collections, social media posts/interactions, avatar representative messages of attendees or groups of attendees, as well as artificial intelligence representing people, opinions, institutional goals, other goals, outcomes, predictions. The artificial intelligences representing non-human actors may include legal systems, collections of legal systems, city ordinances, country ordinances, alliances. AI using deep learning and other techniques may be trained on the laws or legal framework of a country, an alliance could provide an assessment on the legality of certain suggested actions during the meeting. The AI could provide recommendations, visual feedback, multi-dimensional feedback or other representations/syntheses of scientific articles, which are deemed relevant and retrieved responsive to conversations in a meeting, and the AI could correct conversations or contribute to conversations based on its understanding of “truth” or weighted opinion extracted from, but not limited to structured datasets, averages taken across multiple news sources, personal documents on a hard drive, cloud service, browsing history and/or transcribed conversations among other people/AI or collections of documents, such as but not limited to academic journals, news, writings by authors, notes from a person, generated text from artificial intelligences based on features extracted from document collections but not limited to the collections. Scores could be produced as well to establish a fundamental weight or value that users may find helpful to establish validity of AI produced information. Similarly, the AI could estimate a cost of various proposed courses of action, including estimating the utilization levels of various types of resources. This information could be shared upon request, volunteered, or inserted based upon an estimate of its impact on the topic under discussion. Also, agendas and calendars could further provide potential meeting content.

Once a meeting is identified by the AI process of the meeting application, the ‘driving element’ that causes additional actions to be taken may include using key phrases, such as phrases which imply a work process, such as, but not limited to “follow-up”, “next steps”, “progress”, “update”, “review”, and/or “second demo”, etc. or equivalents in other languages. Each meeting may be referred to as a workstream or may just be part of a larger concept workstream. The workstreams may be stored in a workstream database and mapped or linked together over time based on the entity relationships identified (e.g., similar topics of interest). Workstreams may join and/or branch, hibernate and revive. The status of a meeting as part of a workstream may change over time as the course of events and future meetings and workstreams evolves to include new information and to remove old information. In a virtual reality (VR) and/or an augmented reality (AR) environment each real-world geographical location with detectable surfaces can become a unique environment for VR/AR information overlay, this turns a multi-level/room meeting environment into a canvas for information presentation. An ID can be attached to a geo-tag to identify content at certain locations in one or more collaboration spaces. The most common tags and criteria for distinguishing one collaboration space from another includes time, topics, members, key phrases, Notes, themes, Item links, etc. The correlation between collaboration spaces may be large, minimal or non-existent.

Content shared within a meeting/collaboration may include identifying current input, such as spoken words at the start of a meeting and comparing text, network graphs, and other measures generated during a meeting versus text generated during current and earlier meetings to see a correlation coefficient (CC) between sequential meetings or even non-sequential meetings. There may be many different correlation coefficients for a meeting, each representing an attribute, or attributes, of interest. This CC will be a value, normalized 0 to 1, but could be represented in other ways and displayed on a time-based graph, histogram, scatterplot, spider diagram, or other representation. CCs could be combined into a correlation vector representing correlations across may dimensions. The results will indicate if meetings are off-topic, on-topic, creative, converging, diverging, functional/non-functional conflict, and making progress.

The system application could also be used for personal workflows not just “meetings”, such as note taking, personal knowledge organization and retrieval, idea exploration or generation, journaling, etc. This may include training environments which may include using AR for training and skill transfer. A meeting may be replayed. There may be a procedure to compare and/or contrast the output generated by different sessions. If two different groups discuss the same topic, the meetings may be identified as different or the same. The visualization may be 3D, 4D, VR, and AR, this may also include 1D and 2D.

The driving factors to expand and increase the content of a collaboration space may be based on the members'/users' actions. Analysis of gestures, body movement, tone of voice, etc., can be detected by the AI application to generate a more accurate assessment of suitable and non-suitable content. Also, the presentation layout may be based on user approval or disapproval which can be inferred from user sentiment (e.g., gestures, movements, tone, etc.). Ideally, a cluster view of all key meeting concepts/initial contexts of the current and all related previous meetings can be retrieved, displayed and relationships can be illustrated (e.g., connections, lines, Venn diagrams, etc.) to demonstrate relatedness among the contexts. As the meeting or conversation develops, the cluster graph or contextual information visualization can update (continuously or discontinuously) to include new topics or append and integrate new data points as expansions of existing topics.

Adjacent or relevant information from past conversations may be highlighted and placed on the display of a user device and updated in real time based on content received during a live meeting. Semantic knowledge items can be displayed for an entity to include linked data and highlighted items that are not contained/identified in an original cluster. Various sources may be linked to external sources such as GOOGLE drive, iCloud, articles, publications, etc., to build onto a single topic cluster and expose information with various sources.

Interactive search or persistent search results may be displayed to include document collections in a 3D cluster map or context graph that can be rendered and displayed in a real or virtual 3D space or could be mapped to real world or virtual objects including but not limited to surfaces and walls. A 4th-dimension can be introduced that can be navigated with a similar interface. A simple non-limiting example would be a 3D cluster map of news. One could, possibly by using gestures or an interface slider, or voice, or some other approach, have the 3D cluster map change to reflect how the news varied over time as the 4thdimension.

As a non-limiting example a context graph can be triggered by a predefined statement such as “show me . . . ” or other statements made by a user, or by an imaging camera device in an augmented reality display (e.g., smart glasses), or computer camera of a person or persons looking up/down, left/right, to display the graph the context graph, etc., interaction may be performed via voice, mouse movement of the person, movement of another device, moving parts of the body (e.g., hands, fingers, eyes, winks, nods, facial expressions, etc.).

FIG.1illustrates a graphical user interface of example collaboration spaces according to example embodiments. Referring toFIG.1, the example collaboration space(s)100may include a first collaboration space102with various core subjects including an initial context that is detected by a conference or collaboration application. The participating users may be using a mobile device, a computer/laptop and/or other peripheral devices, such as a smart watch, smart glasses, a virtual reality device, or other computing device. As the discussions are shared among the active meeting participants, an initial user input portion110may be populated with certain topics extracted from the spoken words, sentiments (e.g., gestures, body movements, facial movements, etc.) provided by the users. Also, the AI engine which may be part of the application may interpret keywords and phrases form the input and provide examples of topics and related subject matter.

In the example of “Africa”, and more specifically, “Kenya” and “extreme weather” or “global warming”, the topics may quickly be laid out on a display as circles and other entities which may be linked together by arrows, lines, and other linking indicia. The main sources of information may include team data120, which is an established set of user data, such as enterprise or corporate environment data that is initially available by all users to include but not limited to e-mail data126, transcribed phone calls122, application messaging124(e.g., social media accounts, collaboration tools (e.g., SLACK, WHATSAPP), text messages128(e.g., SMS messaging), previous conference data128stored and saved by the application. As may be observed all such resources may be accessed and linked to the user input as new sources. Overlap of information can be identified by Venn style diagrams, links, timelines, and other indicia to demonstrate relatedness among the information. User sentiment can be tracked to confirm and deny certain data entries and their arrangement along a particular collaboration space.

In addition, the specific team resources120, there may be invocation of external data sources132from trusted data sources across the Internet, such as periodicals, journals, universities, government sites, etc. The more common or trusted a site, the more likely the site is to be suggested or used autonomously by the AI application to invoke additional information. A site that is always identified by positive user sentiment may be included with a full weight score, such as 5 out of 5, 10 out of 10, etc., sites where the users normally provide positive sentiment may be scored lower, such as 4 out of 5 or 8/9 out of 10, and so on. Sentiment may be a simple nod of the head, blink of the eyes or a spoken term or phrase, like “yes”, “no way”, etc. The gesture types of sentiment may be detected by a device's sensory features, such as motion detection, sound detection, etc., by a peripheral device, such as smart glasses or by a handheld device with such sensors. Another source of information may be wider corporate databank140, which may include corporate information sources142which are beyond the scope of a particular team or group but still inside a corporate entity, such as other teams or locations for a common enterprise.

In one example, a second or additional collaboration spaces may occur. The decision to end one collaboration space or begin another, such as collaboration space ‘2’104is based on the information organization performed by one or more users of a collaboration. For example, a new topic that is not considered previously related to another topic may cause a new collaboration space. Time may be used as a basis to create a new collaboration space, as well as a new member sharing a new topic or a previously discussed topic. Entity relationships may be created between collaboration spaces, however, the momentum of information sharing is likely to have shifted to a different area of collaboration to invoke a new collaboration space. Collaboration spaces with new information, or considered of greatest relevance to the discussion, may be highlighted in various ways. Similarly, those considered less relevant can be “anti-highlighted” (dimmed, made lower contrast or even transparent etc.).

FIG.2Aillustrates network diagram of the example collaboration spaces being populated with data by remote data sources according to example embodiments. Referring toFIG.2A, the example200includes a user202that is using a user device204to follow along with a collaboration space. The gestures, sentiment, spoken input and other information shared by the user202may ‘drive’ the meeting forward with topics, graphs, entities, relationships, etc., depending on where the discussion is identified at a particular time, such as an initial context, and where the discussion is going based on other topics, suggestions by other members, predictions made by the AI, etc., which can all be shared on the collaboration space. An application server220may be a cloud-based server that is applying the AI application to the meeting. The meeting may be started by a simple access operation of accessing the collaboration application and initiating a topic discussion. Other users may join the meeting at any time or at a later time and share other topics, sentiment and requests for further discussions. Requested data may be a topic part of the collaboration or may invoke a new collaboration space. Information may be collected from previous meetings and discussions212, internal/private data214and/or from external public data sources216.

FIG.2Billustrates example collaboration spaces being included on a virtual space for an augmented reality (AR) according to example embodiments. Referring toFIG.2B, the example250demonstrates a view of an augmented reality space which is controlled by a user device204communicating with a server220and/or a user worn peripheral206, such as smart glasses which provide a projection of a computer display on the glasses worn by the user. The arrangement of information, such as the collaboration space208may be based on user sentiment and actions detected by the peripheral device (smart glasses)206. A user may walk around a room and see collaboration spaces in any arrangement desired. A user may also explicitly move and resize the collaboration spaces through voice, gesture, peripherals, affordances on the collaboration spaces, or other forms of explicit commands.

FIG.3Aillustrates an example user operating a peripheral device according to example embodiments. Referring toFIG.3A, the use202may be wearing a sentiment detecting peripheral device206, such as smart glasses or other devices which have detection capabilities, a memory and a processor. The device may be powered on and ready for user action detection as well as projection capabilities which share a visual display of information, such as an ongoing meeting including a collaboration space of information.

FIG.3Billustrates an example user body action that provides sentiment to a detection feature of the peripheral device according to example embodiments. Referring toFIG.3B, the user202may begin shaking their head, moving their body, arms, legs, etc., to indicate an approval/disapproval of information context and information commitment to the collaboration. The information may come as a queue or list of information that is selected and admitted to the collaboration or dismissed from the collaboration pending a user sentiment towards the information. Also, the placement of the information may be performed by the user sentiment/actions performed. For example, a new topic or network entity may appear in an area the user is facing and the user may shake his/her head to dismiss the topic or move it to another area. Similarly, the user may make a positive sentiment to include information which is automatically identified by the AI application as a potentially valid context.

FIG.3Cillustrates an example user facial action detection feature of the peripheral device according to example embodiments. Referring toFIG.3C, the user202may be accepting, rejecting, moving, storing, etc., information by a simple eye and/or mouth movement212or a lack thereof.FIG.3Dillustrates an example user facial action that provides sentiment to the detection feature of the peripheral device according to example embodiments. For example, the eyes or mouth may shift, be opened, closed214for a period of time and may be detected as a command to control the information on the collaboration space.

FIG.4illustrates an example logic diagram for managing content in a virtual collaboration area according to example embodiments. Referring toFIG.4, the area of collaboration450may be based on a series of operations. The content of the collaboration space is a dynamic and recursive process that depends partially on the user interactions and partially on the AI used to access and reference various information sources. The content that is present in the collaboration space may be analyzed412to identify a current context414. The content may be adjusted dynamically as the discussion progresses into different topics and areas of interest. The body language (i.e., sentiment or tone) of the users is incorporated into the process as non-textual information. The current context414can be used to create a representation422pending user approval424of the representation. The proposed new entity or suggested content may be presented by the AI depending on user settings and the users can permit/deny the representations. The spaces that are created may include certain representations426. Content of the meeting416is used to also generate follow-up418or new questions and suggestions for additional content. The actions may include visual representations which should be explored at a later time. As the content430is retrieved from various sources it may be provided to the area of collaboration450in the form of entities and relationships so a user can navigate the area to identify areas of interest to explore and expand.

FIG.5Aillustrates an example multi-response content creation configuration user interface according to example embodiments. Referring toFIG.5A, this example includes a content creation model500as a user interface to permit input information502, such as text, spoken words and/or document information to be extracted and used to generate multiple outputs522-526. As the input is received, prior to the query and multiple different outputs being generated, the length512of the output may be specified along with the option to add a particular context514to assist with the scope of the output, and certain parameters516can be included as well prior to initiating a “run” operation518. As the outputs522,524and526are generated, the content may vary depending on the initial contexts identified and the constraints of the search effort. The user may select options, such as more532to explore additional content, graph534to observe an analytical view of the content and context536to identify the basis of the search results. As may be observed, the content of each output will vary and may include different contexts, sources and analysis procedures to achieve the separate outputs. The user may be presented with a visualization of the outputs to determine which content to keep in a visual collaboration space and which content to discard. Resources used to achieve the content may also be presented540to identify the sources used to generate the content.

FIG.5Billustrates an example data management process for performing generative labeling according to example embodiments. Referring toFIG.5B, the process may include collecting large blocks of data as input (words, phrases, images)551, cleaning the data552(e.g., parsing, word selection, tagging, tagging images, etc.). For example, input may include web-based news data or other sources and data relationships may be identified between two topics, such as ‘China’ and ‘Africa’. Content may include past conversations, media, in-person/in-meeting, time stamped data, etc. The data cleaning may include parsing the data to identify verbs and nouns and links between words, such as established relationships. In one example, a website may be cleaned to only include text, and labels, and other data, such as links and advertisements are removed.

The process of labeling examples may include identifying hundreds of examples553to label, such as a sentence, paragraph or document level example and build labels to identify specific relevancy. Classes (topics) can be identified and labeled. Signals may be a term to use for signaling whether content of a piece of text of any length is connected to one of the projects being processed. For example, ‘climate risk’ is a label that can be identified as having increased in ‘farming communities in Ghana’, and ‘climate risk’ may be identified as having decreased in ‘Kenya’. Classes are the basis for labels, and sentiments or direction can also be identified, as (very) positive or (very) negative attributes of a label. All statements are established for some sort of class. The pre-trained neural network558, may be trained on a large collection of text which can be filtered to suite the objective by fine tuning the model with collected data and labeling keyword matched examples. The content can be separated into junk and non-junk and newly labeled data may be fine-tuned for a new model or classifier (i.e., data scaling) may introduce randomness to the seeded/example labels554to generate a new labeled example555which can be fine-tuned559based on some specific criteria. Also, a junk class557can be used to establish criteria that is not valid or is not part of the classes used. The data may be cleaned and deduplication may be used to sift through the data to remove highly similar or same documents.

The pre-trained neural network558may be trained on predicting based on seeding numbers, sentences, etc. For example, a large collection of text can be used to predict a next word/next sentence, a large collections of images can be used to match images with descriptions, a large collections of images can be used to match images with temporal sequences (i.e., satellite picture taken every day of a jungle, picture taken of a city every day, increasing defects in lithography or manufacturing processes, etc.). A large collection of temporal numerical sequences (i.e., stock market prices, what prices are next, etc.). A large collection of temporal numerical sequences can be linked to text (i.e., stock market prices linked to news to identify what prices are next and how news can predict stock market prices, etc.). A large collections of temporal audio sequences linked to transcribed text can be used to predict a next sound or word. A large collections of video sequences from AR/VR devices, cameras, can be used to identify what will uses look at next, what will be focused on, what objects are in the images.

The classes in this example may include ‘Kenya’, ‘Ghana’ and other African countries, along with ‘climate risk’ in ‘Africa’, ‘society’, ‘governance’, ‘China’, ‘Company XYZ’, problems among the entities, etc. Many words, sentences, etc., are used in training and to take a seed, which may include a sentence, and finish content of that sentence. One example would be a sentence that has to do with “climate risk”. Labeling may be performed first, then seeding with labeled examples to separate new labels556which can be used with the junk class557when fine tuning the classifier on the generated examples559. This can also be performed with images, to identify elements of an image, a pedestrian, a traffic cone, a car, a defect in manufacturing, a defect in photolithography, etc.). For example, identifying a defect in a MRI scan, or some detailed document to demonstrate an error or to identify the data being examined. VR glasses can be used to demonstrate an AR of what a user is seeing. An optical scanner, sonogram, or other scanner can be used to identify quality of manufacturing, or defects in the images. A set of labeled/classified documents can be combined with large neural networks to produce synthetic training data.

The junk class557is not applicable data, so the content that is removed can be used to increase relevancy as examples are created561and trained562during an evaluation procedure563. In one example, there are three classes, increasing, decreasing, and junk. In addition, this allows for more data to flow through the system of examples561. The examples can be created and expanded then be used as exclusion once it is expanded upon. The randomness may be introduced as a random number generator, the ‘temperature’ is modified by changing ‘weights’ of the neural network558and moving them in different directions, the neural network weights (e.g., 10, 10.1, 10.2, 9.9, etc.) creates inputs and outputs which can be modified. The neural network may include various layers (i.e., 7 layers), and the relationships are modified based on the weights. Generating new labeled examples provides new training examples, which can be fine-tuned to modify the classifier and generate artificial examples. The junk class557can provide exclusion criteria to further optimize the data results. The accuracy percentage results can be obtained by performing training on half of the results and testing on the other half of the results and comparing them to determine a percentage of accuracy. The model assisted candidate selection561can implement a model of examples to provide a candidate selection.

FIG.5Cillustrates an example data management process for using a generative neural network to provide content creation for textual data according to example embodiments. Referring toFIG.5C, the textual data from the content creation model500may provide certain data results based on a generative neural network which generates a limited set of options based on inclusion of randomness to display to a user interface570. A first instance ‘A’571may include a large generative neural network571that is fine tuned572and includes an aggregate of user/user groups network response preferences as a training set575that can be used to train networks/fin tune models and large neural networks customized by modifying responses to input and also including exclusion criteria. This may also provide a large generative neural network573of data. The second instance ‘B’ may provide a user group network used to filter results generated by a large network574. Both instances provide relevant information to a user interface. Content may be fine tuned in the neural network by weights to build a network that is fine-tuned576to a user or group of user preferences to provide feedback to a user with newly generated network results. This can be applied to text, images, video, sounds, graphs, etc. This can also be used for removing bias from generative models trained on unsupervised text, for example, such as gender bias can be identified, removed and revised by providing more appropriate answers as a response.

FIG.5Dillustrates an example data management process for using a generative neural network to provide content creation for image data according to example embodiments. Referring toFIG.5D, the example includes image data577that is identified as including one or more potential types of content. The example is identified in the first instance as a lighthouse577and in the second instance578as one or more options A/B. The image content may be processed by the neural network list of options generated570to display a most likely classification for image content with an option for a user to reclassify the content based on a trigger (icon, voice, command, etc.).

FIG.5Eillustrates an example data realization in a virtual AR workspace among multiple users according to example embodiments. Referring toFIG.5E, the virtual AR collaboration workspace example580may provide one or more users with the capability to view (with the proper periphery devices) virtual information around a particular environment, such as a room. Each of the elements are interactive and can include user commands (voice, gesture, etc.) or changed by AI based on a non-limiting example analysis of the discussion, presentation, typology of the meeting (e.g., brainstorming, problem solving, covering, strategy, etc.). The first visualization example582may be a graph with concepts extracted out of a corpora of data which may be based on conversations or other data sources. The data may be part of a team of collaboration data and may be formatted as part of the world at large. The graph can be 2D, 3D, 4D and may be an AR data realization that can be manipulated to identify relationships among classes of information including topics, relationships, time, etc. In another example, notes584may be placed on a ‘virtual wall’ to include core concepts extracted from a meeting. The notes can be arranged from brainstorming sessions and may include critical flow charts. The other example may include signals of information586overlaid on top of virtual indexes that provide an active overview of indicators on a dashboard, or other information588. The collaboration may include a number of users with VR/AR peripheral devices used to visualize the data which is arranged dynamically around the virtual workspace. The VR/AR can offer a way to create multiple rooms and ‘spaces’, such as a project building with brainstorming space, such as a 3D-mock-up of a car, prototypes, etc.

FIG.5Fillustrates an example data concept extractor process used to generate various different types of visual output models according to example embodiments. Referring toFIG.5F, the key concept extractor590may include key concepts which are identified, such as clustering algorithms, entity/action/event extraction, interplay between themes and knowledge graphs, deep learning to extract causal patterns, themes which are being tracked (deductive and inductive concepts) and which emerge out of a dataset, emotional emphasis provide to transcribed text, known key concepts and patterns expressed in a database, etc. The concept layout591may include a 3D model592which includes an X/Y axis to demonstrate semantic similarities, a Z axis to demonstrate an element of time, interest, importance, etc. A deductive model593may illustrate an organization of themes (collection of articles) and other information in a structured shape or grid, the articles may be organized into themes and an overlay signal (e.g., sentiment, activity, risk, etc.) can be placed on top of the themes. This enables seamless zooming into the theme(s) down to individual graphs and zooming out to see an organization of the theme as a collection of issues. Another realization approach is an inductive graph594, which may map articles by similarity, display key concepts as clusters with a maximum weight of the articles, display distinctive text (font, color, size, etc.) at a center of a weight of the articles/paragraphs/statements which are relevant to a theme.

FIG.6Aillustrates an example multi-collaboration virtual space according to example embodiments. Referring toFIG.6A, the example of multiple collaboration spaces600may include a user wearing a computing headset or computing glasses or contact lenses and other types of peripheral devices, that enable an AR view of content to be displayed in an area where the user is facing. Each collaboration space may be unique and may be modified by additional inputs by other uses sharing the collaboration space(s) and by AI application resources which are attempting to identify additional content. The collaboration spaces may be stacked, overlayed, and represented with different borders or transparency levels to indicate salience or some other attribute. The spaces may also be resized, rotated, and repositioned in any plane. Collaboration and information spaces can leverage the power of AR/VR in many ways, including displaying the information as a 3/4-dimensional object. The object can also evolve over time, based on the collaboration, additional web sources, new information, etc.

FIG.6Billustrates another example data management process for performing generative labeling according to example embodiments. Referring toFIG.6B, the process is similar toFIG.5B, however, there are certain differences in this example as to how the data is managed and used to create generative labeling. Certain examples may include identifying hundreds of examples (553) to label, such as a sentence, paragraph or document level, an image, feature of an image, sound, numerical series, etc., to build labels to identify specific relevancy. Classes (topics or signals) can be identified and labeled. For example, ‘climate risk’ is a label (signal) that can be identified as having increased in ‘a piece of text about Ghana’, and the signal of an increase in ‘climate risk’ may be identified as having decreased in ‘a piece of text about Kenya’. Classes are the basis for labels, and sentiments or direction can also be identified, as more positive or more negative attributes of a label. All statements are established for some sort of class (topic or signal). The pre-trained neural network, which is trained on a large collection of text, images, etc. which can, as a non-limiting example be filtered to an objective such as “a collection of climate change research” to fine-tuning the model with, for example, labeling keyword matched examples “everything we know about climate change” (553). This model is fine-tuned with the several hundred examples to remove any bias from the pre-trained text (655). The fine-tuned model may create newly labeled data (656). The labeled examples can be separated into a junk class (low certainty generated results (text, images, etc.) by the fine-tuned model) and non-junk (660). The labeled data can be used to fine-tune a new (larger) model or classifier (662) based on some specific criteria, which results in a classifier model (659). This process can loop back to curate the manual labels (553) from the evaluation663.

FIG.7illustrates a flow diagram of an example method of operation according to example embodiments. Referring toFIG.7, the AI application function may identify meeting a topic focus, provide an initial context and populate a virtual collaboration environment with visual data. The initial context may evolve into additional contexts over time depending on the information that is provided to the meeting application. The process may include receiving one or more data inputs from collaboration by one or more participant devices operated by a plurality of meeting participants of a meeting712, identifying an initial context of the meeting based on the one or more data inputs714. The initial context may be extracted by the AI function, which utilizes the input data to identify additional content from various sources. The process may also include querying a databank of previously stored information to identify one or more additional contexts related to the initial context716, this may include referencing content from a previous meeting and including relevant information in the current meeting based on the initial context identified from the user input. The process may also include linking the initial context and the one or more additional contexts by establishing one or more entity relationships718. The linking may include a visualization of a relationship, such as a line between two entities, an arrow, or other indicia to provide a visualization of the relationship between entities as they are introduced in the collaboration area. The process may also include forwarding the initial context and the one or more additional contexts as entities in a virtual collaboration space722so all users can share the information space. The user may be able to manipulate the context that the AI has generated. One example may be a purpose behind the topic, such as “Today we will discuss the economic implications of the plan”. This is instead of just the plan itself being presented.

The process may also include identifying an initial context of the meeting further includes parsing terms and phrases from one or more of shared documents and recorded conversations, selecting one or more potential contexts from the parsed terms and phrases, comparing the selected one or more contexts to one or more previous meeting contexts, and identifying the selected one or more contexts matches the one or more previous meeting contexts. The process may also include identifying an initial context of the meeting further includes parsing terms and phrases from one or more of shared documents, recorded conversations and selecting one or more potential contexts from the parsed terms and phrases, identifying one or more instances of sentiment recorded from the one or more of the plurality of meeting participants, and identifying the selected one or more contexts is confirmed based on the one or more instances of sentiment. The process may also include querying a databank of previously stored information to identify one or more additional contexts related to the initial context includes identifying one or more preferences specifying information sources to use for the collaboration, and querying the databank for the previously stored information that is in compliance with the one or more preferences.

The process may also include linking the initial context and the one or more additional contexts includes storing the one or more additional contexts as sub-contexts to the initial context and establishing the one or more entity relationships includes creating an illustration of entities which are connected by line illustrations. The entities may be weighted to modify the presentation of the data. The process may also include creating a first collaborative space as a portion of the virtual collaboration space, and forwarding the initial context and the one or more additional contexts as entities in the first collaborative space, and creating a second collaborative space to store one or more remote information source contexts identified from a remote information source outside of the databank, wherein the one or more remote information sources provide data sources which are related to the initial context. The process may also include identifying one or more instances of negative sentiment recorded from the one or more of the plurality of meeting participant, identifying the one or more remote information source contexts are not confirmed based on the one or more instances of negative sentiment, and removing the one or more remote information source contexts.

FIG.8illustrates a flow diagram of another example method of operation according to example embodiments. The example may include providing numerous multi-source and multi-result buckets based on a single context and applying user response feedback to create the context results. Also, the VR/AR may be used to provide the collaboration spaces. The example may include identifying an initial context of a meeting based on one or more data inputs received from one or more participant devices operated by a plurality of meeting participants812, querying remote data sources to identify one or more additional contexts associated with one or more of a specific period of time and a trending topic related to the initial context814, forwarding a first of the one or more additional contexts to a first collaboration space of a virtual collaboration space816, forwarding at least one additional context of the one or more additional contexts to a second collaboration space of the virtual collaboration space818, identifying one or more sentiment actions associated with the one or more meeting participants822, and overlaying the first collaboration space and the second collaboration space on an augmented reality display of a device based on the one or more sentiment actions824.

The process may also include identifying the one or more sentiment actions include one or more of detecting movement of the one or more meeting participants. The first of the one or more additional contexts may be identified as having a greater relevancy score than a relevancy score of the second of the one or more additional contexts. The process may also include overlaying the first collaboration space and the second collaboration space on the augmented reality display of the device based on the one or more sentiment actions comprises prioritizing a position of the first collaboration space in the augmented reality display over a position of the second collaboration space in the augmented reality space based on the one or more sentiment actions. The one or more sentiment actions comprise an agreeable sentiment includes one or more of a spoken term, a movement of the head, a movement of the eyes, and a hand gesture identified from the one or more meeting participants, and the agreeable sentiment confirms the prioritization of the position of the first collaboration space in the augmented reality display. The agreeable sentiment includes a confirmed focus by the one or more meeting participants to the first collaboration space based on the one or more sentiment actions being performed to the first collaboration space for a threshold period of time. After the agreeable sentiment has been detected for the threshold period of time, the first collaboration space is assigned a highest priority.

FIG.9is not intended to suggest any limitation as to the scope of use or functionality of embodiments of the application described herein. Regardless, the computing node900is capable of being implemented and/or performing any of the functionality set forth hereinabove.

As displayed inFIG.9, computer system/server902in cloud computing node900is displayed in the form of a general-purpose computing device. The components of computer system/server902may include, but are not limited to, one or more processors or processing units904, a system memory906, and a bus that couples various system components including system memory906to processor904.

Computer system/server902typically includes a variety of computer system readable media. Such media may be any available media that is accessible by computer system/server902, and it includes both volatile and non-volatile media, removable and non-removable media. System memory906, in one embodiment, implements the flow diagrams of the other figures. The system memory906can include computer system readable media in the form of volatile memory, such as random-access memory (RAM)910and/or cache memory912. Computer system/server902may further include other removable/non-removable, volatile/non-volatile computer system storage media. By way of example only, storage system914can be provided for reading from and writing to a non-removable, non-volatile magnetic media (not displayed and typically called a “hard drive”). Although not displayed, a magnetic disk drive for reading from and writing to a removable, non-volatile magnetic disk (e.g., a “floppy disk”), and an optical disk drive for reading from or writing to a removable, non-volatile optical disk such as a CD-ROM, DVD-ROM or other optical media can be provided. In such instances, each can be connected to the bus by one or more data media interfaces. As will be further depicted and described below, memory906may include at least one program product having a set (e.g., at least one) of program modules that are configured to carry out the functions of various embodiments of the application.

Program/utility916, having a set (at least one) of program modules918, may be stored in memory906by way of example, and not limitation, as well as an operating system, one or more application programs, other program modules, and program data. Each of the operating system, one or more application programs, other program modules, and program data or some combination thereof, may include an implementation of a networking environment. Program modules918generally carry out the functions and/or methodologies of various embodiments of the application as described herein.

Computer system/server902may also communicate with one or more external devices920such as a keyboard, a pointing device, a display922, etc.; one or more devices that enable a user to interact with computer system/server902; and/or any devices (e.g., network card, modem, etc.) that enable computer system/server902to communicate with one or more other computing devices. Such communication can occur via I/O interfaces924. Still yet, computer system/server902can communicate with one or more networks such as a local area network (LAN), a general wide area network (WAN), and/or a public network (e.g., the Internet) via network adapter926. As depicted, network adapter926communicates with the other components of computer system/server902via a bus. It should be understood that although not displayed, other hardware and/or software components could be used in conjunction with computer system/server902. Examples include, but are not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data archival storage systems, etc.