Source: https://patents.google.com/patent/WO2013181026A1/en
Timestamp: 2019-12-15 11:33:04
Document Index: 790116036

Matched Legal Cases: ['Application No. 61', 'Application No. 12', 'Application No. 61', 'Application No. 12', 'Application No. 12', 'Application No. 12', 'Application No. 13', 'Application No. 13', 'Application No. 12', 'Application No. 12', 'Application No. 61', 'Application No. 13', 'Application No. 61', 'Application No. 61', 'Application No. 61', 'Application No. 13', 'Application No. 13', 'Application No. 12', 'Application No. 12', 'Application No. 12', 'Application No. 61', 'Application No. 12', 'Application No. 12', 'Application No. 13', 'Application No. 13']

WO2013181026A1 - Interfacing with a spatial virtual communications environment - Google Patents
Interfacing with a spatial virtual communications environment Download PDF
WO2013181026A1
WO2013181026A1 PCT/US2013/042083 US2013042083W WO2013181026A1 WO 2013181026 A1 WO2013181026 A1 WO 2013181026A1 US 2013042083 W US2013042083 W US 2013042083W WO 2013181026 A1 WO2013181026 A1 WO 2013181026A1
PCT/US2013/042083
2012-06-02 Priority to US13/487,159 priority Critical patent/US20120246582A1/en
2012-06-02 Priority to US13/487,159 priority
2013-05-21 Application filed by Social Communications Company filed Critical Social Communications Company
2013-12-05 Publication of WO2013181026A1 publication Critical patent/WO2013181026A1/en
A communications environment (10) supports realtime communications between respective network nodes (12, 14) of a user and other communicants in virtual areas (44) associated with respective sets of communicant members. A graphical user interface is provided in connection with the user's network node. The graphical user interface includes controls for establishing presence in respective ones of the virtual areas (44), managing realtime communications with other communicants in respective ones of the virtual areas (44), and presenting different views of communicants associated with the network communications environment (10). Based on user input, a presence is established for the user in a selected one of the virtual areas (44), realtime communications are administered between the user and one or more communicants present in the selected virtual area, and a visualization showing graphical representations, locations of presence, and realtime activities of communicants across respective ones of the virtual areas (44) is displayed.
INTERFACING WITH A SPATIAL VIRTUAL COMMUNICATIONS
[0001 ] When face-to-face communications are not practical, people often rely on one or more technological solutions to meet their communications needs.
Traditional telephony systems enable voice communications between callers. Instant messaging (also referred to as "chat") communications systems enable users to communicate text messages in real time through instant message computer clients that are interconnected by an instant message server. Some instant messaging systems and interactive virtual reality communications systems allow users to be represented by user-controllable graphical objects (referred to as "avatars"). What are needed are improved systems and methods for realtime network communications.
[0002] FIG. 1 is a diagrammatic view of an example of a network
[0003] FIG. 2 is a diagrammatic view of an example of a graphical user interface.
[0004] FIG. 3 is a diagrammatic view of an example of a graphical user interface.
[0005] FIG. 4 is a diagrammatic view of an example of a graphical user interface.
[0006] FIG. 5 is a diagrammatic view of an example of a graphical user interface.
[0007] FIG. 6 is a diagrammatic view of an example of a graphical user interface.
[0008] FIG. 7 is a diagrammatic view of an example of a graphical user interface.
[0009] FIG. 8 is a diagrammatic view of an example of a graphical user interface.
[0010] FIG. 9 is a diagrammatic view of an example of a graphical user interface. [001 1 ] FIG. 10 is a diagrammatic view of an example of a graphical user interface.
[0012] FIG. 1 1 is a diagrammatic view of an example of a graphical user interface.
[0013] FIG. 12A is a diagrammatic view of an example of a graphical user interface.
[0014] FIG. 12B is a diagrammatic view of an example of a graphical user interface.
[0015] FIGS. 13A and 13B are respective diagrammatic views of an example of a graphical user interface.
[0016] FIG. 14 is a flow diagram of an example of a method.
[0017] FIG. 15 is a diagrammatic view of an example of a graphical user interface.
[0018] FIG. 16 is a flow diagram of an example of a method.
[0019] In the following description, like reference numbers are used to identify like elements. Furthermore, the drawings are intended to illustrate major features of exemplary embodiments in a diagrammatic manner. The drawings are not intended to depict every feature of actual embodiments nor relative dimensions of the depicted elements, and are not drawn to scale.
[0020] A "communicant" is a person who communicates or otherwise interacts with other persons over one or more network connections, where the communication or interaction may or may not occur in the context of a virtual area. A "user" is a
communicant who is operating a particular network node that defines a particular perspective for descriptive purposes.
[0021 ] A "computer" is any machine, device, or apparatus that processes data according to computer-readable instructions that are stored on a computer-readable medium either temporarily or permanently. A "computer operating system" is a software component of a computer system that manages and coordinates the performance of tasks and the sharing of computing and hardware resources. A "software application" (also referred to as software, an application, computer software, a computer application, a program, and a computer program) is a set of instructions that a computer can interpret and execute to perform one or more specific tasks. A "data file" is a block of information that durably stores data for use by a software application.
[0022] The term "computer-readable medium" refers to any tangible, non- transitory medium capable storing information (e.g., instructions and data) that is readable by a machine (e.g., a computer). Storage devices suitable for tangibly embodying such information include, but are not limited to, all forms of physical, non- transitory computer-readable memory, including, for example, semiconductor memory devices, such as random access memory (RAM), EPROM, EEPROM, and Flash memory devices, magnetic disks such as internal hard disks and removable hard disks, magneto-optical disks, DVD-ROM/RAM, and CD-ROM/RAM.
[0023] A "data sink" (referred to herein simply as a "sink") is any of a device (e.g., a computer), part of a device, or software that receives data.
[0024] A "data source" (referred to herein simply as a "source") is any of a device (e.g., a computer), part of a device, or software that originates data.
[0025] A "network node" (also referred to simply as a "node") is a junction or connection point in a communications network. Examples of network nodes include, but are not limited to, a terminal, a computer, and a network switch. A "server" network node is a host computer on a network that responds to requests for information or service. A "client network node" is a computer on a network that requests information or service from a server.
[0026] A Uniform Resource Identifier (URI) is a string of characters that identifies a network resource.
[0027] A "network resource" is anything that can be identified by a uniform resource identifier (URI) and accessed over a network, including an electronic
document, an image, a source of information, a service, operators and operands of a mathematical equation, classes, properties, numeric values, and a collection of other resources.
[0028] A "network connection" is a link between two communicating network nodes. A "connection handle" is a pointer or identifier (e.g., a uniform resource identifier (URI)) that can be used to establish a network connection with a network resource. A "network communication" can include any type of information (e.g., text, voice, audio, video, electronic mail message, data file, motion data stream, and data packet) that is transmitted or otherwise conveyed from one network node to another network node over a network connection.
[0029] A "communicant interaction" is any type of direct or indirect action or influence between a communicant and another network entity, which may include for example another communicant, a virtual area, or a network service. Examples of types of communicant interactions include communicants communicating with each other in realtime, a communicant entering a virtual area, and a communicant requesting access to a resource from a network service.
[0030] "Presence" refers to the ability and willingness of a networked entity (e.g., a communicant, service, or device) to communicate, where such willingness affects the ability to detect and obtain information about the state of the entity on a network and the ability to connect to the entity.
[0031 ] A "realtime data stream" is data that is structured and processed in a continuous flow and is designed to be received with no delay or only imperceptible delay. Realtime data streams include digital representations of voice, video, user movements, facial expressions and other physical phenomena, as well as data within the computing environment that may benefit from rapid transmission, rapid execution, or both rapid transmission and rapid execution, including for example, avatar movement instructions, text chat, realtime data feeds (e.g., sensor data, machine control instructions, transaction streams and stock quote information feeds), screen shares, and file transfers.
[0032] A "virtual area" (also referred to as an "area," a "place," or a "space") is a representation of a computer-managed space or scene. Virtual areas typically are one-dimensional, two-dimensional, or three-dimensional representations; although in some examples a virtual area may correspond to a single point. Oftentimes, a virtual area is designed to simulate a physical, real-world space. For example, using a traditional computer monitor, a virtual area may be visualized as a two-dimensional graphic of a three-dimensional computer-generated space. However, virtual areas do not require an associated visualization. A virtual area typically refers to an instance of a virtual area schema, where the schema defines the structure and contents of a virtual area in terms of variables and the instance defines the structure and contents of a virtual area in terms of values that have been resolved from a particular context. [0033] A "position" in a virtual area refers to a location of a point or an area or a volume in the virtual area. A point typically is represented by a single set of one- dimensional, two-dimensional, or three-dimensional coordinates (e.g., x, y, z) that define a spot in the virtual area. An area typically is represented by the three-dimensional coordinates of three or more coplanar vertices that define a boundary of a closed two- dimensional shape in the virtual area. A volume typically is represented by the three- dimensional coordinates of four or more non-coplanar vertices that define a closed boundary of a three-dimensional shape in the virtual area.
[0034] "Navigating" in the context of a virtual area means moving or changing an attentional focus or state of a user or another communicant with respect to the virtual area. For example, a user may navigate his or her attention from one virtual
communication context to another (e.g., from one zone of a virtual area to another or from one virtual area to another). A user also may navigate his or her presence or the presence of another communicant from one virtual communication context to another (e.g., from one zone of a virtual area to another or from one virtual area to another).
[0035] As used herein, the term "includes" means includes but not limited to, the term "including" means including but not limited to. The term "based on" means based at least in part on.
II. INTERFACING WITH A SPATIAL VIRTUAL COMMUNICATIONS
[0036] The examples that are described herein provide systems and methods for providing realtime visualizations of communicants' realtime availabilities and activities across different virtual area based communication contexts. The realtime visualizations enable the communicant to make more informed network interaction decisions (e.g., when to interact with a contact) and encourage users to initiate interactions with other communicants and to join contexts (e.g., an ongoing
conversation between communicants) of which users otherwise would not have been aware. Some examples also apply a spatial metaphor that provides a context for organizing the presentation of various interface elements that are used by
communicants to participate in realtime networked communications.
[0037] FIG. 1 shows an example of a network communications environment 10 that includes a first client network node 12 (Client Node A), a second client network node 14 (Client Network Node B), a virtual area platform 18 and an optional proxy node 19 that are interconnected by a network 20. The network 20 may include one or more of any of a local area network (LAN), a metropolitan area network (MAN), and a wide area network (WAN) (e.g., the internet). The network 20 typically includes a number of different computing platforms and transport facilities that support the transmission of a wide variety of different media types (e.g., text, voice, audio, video, and other data) between network nodes.
[0038] The first client network node 12 includes a computer-readable medium 22 (or "memory"), a processor 24, and input/output (I/O) hardware 26 (including, e.g., a display and network communication hardware). The processor 24 executes at least one virtual area communications application 26 that is stored in the memory 22. The second client network node 14 typically is configured in substantially the same general way as the first client network node 12, with a computer-readable medium 30 storing at least one virtual area communications application 32, a processor 34, and I/O hardware 36.
[0039] Each of the network nodes 12, 14 has a respective set of one or more sources and an exemplary set of one or more sinks. Each source is a device or component that originates data of a particular data stream content type and each sink is a device or component that receives data of a particular data stream content type. A source and a sink of the same data stream content type are referred to herein as being "complementary." Exemplary sources include an audio source (e.g., an audio capture device, such as a microphone), a video source (e.g., a video capture device, such as a video camera), a chat source (e.g., a text capture device, such as a keyboard), a motion data source (e.g., a pointing device, such as a computer mouse), and other sources (e.g., file sharing source or a source of a customized real-time data stream). Exemplary sinks include an audio sink (e.g., an audio rendering device, such as a speaker or headphones), a video sink (e.g., a video rendering device, such as a display monitor), a chat sink (e.g., a text rendering device, such as a display monitor), a motion data sink (e.g., a movement rendering device, such as a display monitor), and other sinks (e.g., a printer for printing shared files, a device for rendering real-time data streams different from those already described, or software that processes real-time streams for analysis or customized display). Each source has an active state in which the source is available for originating data and an inactive state in which the source is not available for originating data. Likewise, each sink has an active state in which the sink is available for receiving data and an inactive state in which the sink is not available for receiving data. The communicants operating the client nodes 12, 14 typically can control the states of the sources and sinks using controls provided by the
communications applications 26, 32. For example, in some examples, the
communications applications 26, 32 provide user controls for turning on/off the local microphones and the local speakers (e.g., headsets) on the client network nodes 12, 14.
[0040] The virtual area platform 18 includes at least one server network node 40 that provides a network infrastructure service environment 42 that manages sessions of the first and second client nodes 12, 14 in one or more virtual areas 44 in accordance with respective virtual area applications 46. One or more of the virtual area applications 44 typically are synchronous conferencing applications that support one or more types of communications between the client nodes 12, 14 (e.g., text chat, audio conferencing, video conferencing, application sharing, and file sharing). The network infrastructure service environment 42 typically includes one or more network infrastructure services that cooperate with the communications applications 26, 32 in the process of
establishing and administering network connections between the client nodes 12, 14 and other network nodes. Among the network infrastructure services that are included in the example of the network infrastructure service environment 42 are an account service, a security service, an area service, a rendezvous service, an interaction service, and a capabilities engine. The area service administers a virtual area 44 by managing sessions of the first and second client nodes 12, 14 in the virtual area 44 in accordance with the virtual area application 46. Examples of the virtual area platform 18 and the virtual area applications 46 are described in U.S. Provisional Patent
Application No. 61/563,088, filed November 23, 201 1 . Examples of an account service, a security service, an area service, a rendezvous service, and an interaction service are described in U.S. Patent Application No. 12/630,973, filed December 4, 2009.
Examples of a capabilities engine are described in U.S. Provisional Patent Application No. 61/535,910, filed September 16, 201 1 .
[0041 ] The network infrastructure service environment 42 maintains a relationship database 47 that contains the records 48 of interactions between
communicants and social network profiles 50 that are associated with respective communicants. Each interaction record describes the context of an interaction between a pair of communicants. Each social network profile 50 typically includes: identity characteristics (e.g., name, age, gender, and geographic location information such as postal mailing address) that describe a respective communicant or a persona that is assumed by the communicant; explicit relationship information that is declared by the communicant; and relationship information that is inferred from the communicant's interactions in the network communication environment 10. Additional details regarding the relationship database 47 and the search and retrieval functionalities associated with the relationship database as described in U.S. Patent Application No. 12/354,709, filed January 15, 2009, U.S. Patent Application No. 12/418,243, filed April 3, 2009, U.S. Patent Application No. 12/631 ,026, filed December 4, 2009, and U.S. Patent Application No. 13/432,837, filed March 28, 2012.
[0042] Some examples provide systems and methods for encapsulating assemblies (e.g., meetings, informal gatherings, and the like) of communicants in one or more virtual areas based on information obtained from the interactions records 48.
These examples provide a wide variety of ways in which to capture features of ongoing and completed assemblies and visualize those features at different levels of detail.
Exemplary visualizations include an activity view that shows a time-based visualization of assemblies within a particular domain, and a timeline view that shows a scalable visualization of a selected subset of the assemblies within a particular domain. The domain may be predefined or specified by a user and may be used to select the assemblies that are presented in the visualizations. The assemblies may be filtered according to a variety of different attributes of the assemblies, including by virtual location (e.g., a particular virtual area or a particular zone of a virtual area in which the assemblies occurred), by communicant (e.g., one or more communicants who
participated in the assemblies), and by time (e.g., a period during which the assemblies started or ended). The assembly visualizations allow communicants to readily obtain a quick summary of the activities occurring in a particular context (e.g., one or more of time, virtual location, participants involved, and types of information shared). They also increase the availability of assembly related information (e.g., notes, shared files, recordings, follow-up tasks, comments and other feedback) by allowing communicants to see and retrieve the information associated with the assemblies in a variety of different ways. Examples of systems and methods of encapsulating and visualizing assemblies of communicants in virtual areas are described in U.S. Patent Application No. 13/432,837, filed March 28, 2012. [0043] The communications applications 26, 32, the area applications 46, and the network infrastructure service environment 42 together provide a platform that administers the realtime connections with network nodes in an instance of a virtual area subject to a set of constraints 43 (e.g., capabilities and other types of permissions, rules, and preferences). Each of the virtual area applications 46 is hosted by a respective one of the virtual areas 44 and includes a description of the respective virtual area 44. Communicants respectively operating the client nodes 12, 14 connect to the virtual areas 44 through the virtual area communications applications 26, 32.
[0044] The communications applications 26, 32 typically present respective views of the virtual areas 44 in accordance with data received from the network infrastructure service environment 42. The communications applications 26, 32 also provide respective interfaces (e.g., one or more of a voice input interface, and audio output interface, and a visual graphical user interface) for receiving commands from the communicants. In visual graphical user interfaces, communicants typically are represented in the virtual areas 44 by respective avatars (e.g., sprites). In audio output interfaces, communicants' states and activities are described using audio signals (e.g., synthesized speech). Communicant avatars typically move about the virtual areas 44 in response to commands that are input by the communicants at their respective network nodes. In some examples, the communications applications 26, 32 establish realtime data stream connections between the first and second client network nodes 12, 14 and other network nodes connected to the virtual area 44 based on the positions of the communicants' avatars in the virtual areas 44. In some examples, each of the client network nodes 12, 14 includes a respective realtime kernel of the type described in U.S. Patent Application No. 12/630,973, filed December 4, 2009, which supports remote configuration of stream handlers for processing data streams (e.g., rendering audio and video data streams) on a client network node.
[0045] A virtual area 44 may correspond to an abstract (non-geometric) virtual area that is defined with respect to abstract coordinates, or a visual virtual area that is defined with respect to one-, two- or three-dimensional geometric coordinates. Abstract virtual areas may or may not be associated with respective visualizations, whereas visual virtual areas are associated with respective visualizations.
[0046] In some of the examples that are described herein, the virtual areas are visual virtual areas of the type disclosed in U.S. Patent Nos. 7,769,806 and 7,844,724. These visual virtual areas include physical geometry and collision geometry. The physical geometry describes the shape of the virtual area. The physical geometry typically is formed from surfaces of triangles, quadrilaterals, or polygons. Colors and textures are mapped onto the physical geometry to create a more realistic appearance for the virtual area. Lighting effects may be painted onto the visual geometry and the texture, color, or intensity near the lighting effects may be modified. The collision geometry describes invisible surfaces that determine the ways in which objects can move in the virtual area. The collision geometry may coincide with the visual geometry, correspond to a simpler approximation of the visual geometry, or relate to application- specific requirements of a virtual area designer.
[0047] Some examples of the virtual area platform 18 enable software application designers to define the semantics of position in an abstract virtual area (e.g., a software application or a computer data file). Through associations with respective connection rules, these position definitions can be used, for example, to drive
connections to virtual areas, entries into virtual areas, connections to communicants and other sources or sinks of realtime data streams, and determinations of presence data relating to communicants, network resources, and network services. Additional details regarding systems and methods of defining the semantics of position in abstract virtual areas are described in US Application No. 12/631 ,008, which was filed on
[0048] A virtual area typically includes one or more zones. A zone may be a rendered spatial extent, a set of rules applied to a spatial extent, or both. Zones may be arranged hierarchically in a virtual area, with an outermost zone (referred to herein as the "Global Governance Zone") enclosing all other zones in the virtual area. Within the Global Governance Zone, there can be location zones (e.g., rooms of a virtual area) or smaller governance zones that enclose a group of location zones and provide regions of governance on the map. A zone definition typically also includes one or more channel definitions that describe how to create respective channels in the zone and specify the information about the channel that is published to a client network node that becomes present in the zone. A channel is always uniquely defined point-to-point and is unique to a virtual area application and a session between a client network node and the virtual area platform. [0049] Examples of the types of rules that may be associated with a zone include switching rules, governance rules, and permission rules.
[0050] Switching rules govern realtime stream connections between network nodes that are linked to the virtual area (e.g., network nodes that are associated with objects, such as avatars, in the virtual area). The switching rules typically include a description of conditions for connecting sources and sinks of realtime data streams in terms of positions in the virtual area. Each switching rule typically includes attributes that define the realtime data stream type to which the rule applies and the location or locations in the virtual area where the rule applies. In some examples, each of the rules optionally may include one or more attributes that specify a required role of the source, a required role of the sink, a priority level of the stream, and a requested data routing topology. In some examples, if there are no explicit switching rules defined for a particular part of the virtual area, one or more implicit or default switching rules may apply to that part of the virtual area. One exemplary default switching rule is a rule that connects every source to every compatible sink within an area, subject to policy rules. Policy rules may apply globally to all connections between the area clients or only to respective connections with individual area clients. An example of a policy rule is a proximity policy rule that only allows connections of sources with compatible sinks that are associated with respective objects that are within a prescribed distance (or radius) of each other in the virtual area. The network connections between network nodes may be arranged in a variety of different data routing topologies, including a peer-to-peer topology, a mediated topology (i.e., a topology in which connections between network nodes are mediated by another network node, such as a server network node, a client network node, or a network switch), and hybrid architectures that combine aspects of peer-to-peer and mediated architectures. In some examples, the switching rules dictate how local connection processes executing on each of the network nodes establishes communications with the other network nodes based on the locations of the associated objects in the zones of the virtual area. A switching rule also may define a direct connection between network nodes or an indirect connection through an intermediate network node (e.g., the proxy node 19 shown in FIG. 1 ).
[0051 ] Governance rules control who has access to resources (e.g., the virtual area itself, regions with the virtual area, and objects within the virtual area), who has access to data (e.g., data streams and other content) that is associated with the virtual area, what is the scope of that access to the data associated the virtual area (e.g., what can a user do with the data), and what are the follow-on consequences of accessing that data (e.g., record keeping, such as audit logs, and payment
requirements). In some examples, an entire virtual area or a zone of the virtual area is associated with a "governance mesh" that enables a software application developer to associate governance rules with a virtual area or a zone of a virtual area. This avoids the need for the creation of individual permissions for every file in a virtual area and avoids the need to deal with the complexity that potentially could arise when there is a need to treat the same document differently depending on the context.
[0052] A permission rule defines a respective capability requirement (e.g., for a respective action, behavior, or state) in terms of one or more capabilities, attributes, and settings, which may be persistent or transient. Examples of permission rules include: a rule that conditions a communicant's ability to enter a target zone on the communicant having a CanEnterZone capability for the target zone; a rule that conditions the ability of a grantee communicant to open a target door of a target room on the grantee communicant having a CanOpenDoor capability for the target room; and a rule that conditions the transmission of a message describing the state of a particular communicant's avatar in a zone to a recipient having a CanSeeState capability for the particular communicant in the zone. A capability provides permission for a client to perform some action within the application. For example, a client may be granted the capability "CanEnterZone" for a specific zone within a virtual area that has been defined with that capability requirement. The client that has the capability can enter the zone, whereas a client without the capability would have their RDS state change rejected when they tried to enter the zone. Examples of capabilities systems for administering permission rules are described in U.S. Provisional Patent Application No. 61/535,910, filed September 16, 201 1 .
[0053] As explained above, the zones of a virtual area can be associated with respective switching rules, each of which instructs the area service to connect sources of a respective data stream type that are associated with a designated source zone with sinks of the respective realtime data stream type that are associated with a designated sink zone. Network nodes can establish respective presences in the zones of a virtual area. In some examples, network nodes associated with respective objects (e.g., avatars representing the communicants operating the network nodes) that can be moved to different locations in the virtual area, and the network nodes are present in the zones in which the associated objects are located. The area service administers data stream connections between the network nodes based on the switching rules, the respective sources and sinks associated with the network nodes, and the respective zones of the virtual area in which the objects are located.
[0054] The virtual area platform 18 enables a wide variety of highly
customizable virtual area applications to be created. Examples of such applications include virtual area applications for creating a virtual office, a virtual personal space, a virtual art gallery, a virtual concert hall, a virtual auditorium, a virtual conference room, and a virtual clubhouse. The virtual area platform 18 supports the creation of network connections between network nodes in the same zone of a virtual area, as well as the creation of one-way or two-way data stream connections between network nodes in different zones.
[0055] A virtual area typically is associated with a specific set of
communicants (e.g., members of the virtual area) and a plurality of persistent zones that define respective sub-contexts within the virtual area. Each zone of a virtual area may support an independent communication session between the network nodes in the zone. For example, a virtual area may include zones in which audio, video, and text chat channel connections are established only between the sources and sinks of network nodes that are in the same zone. In addition, one or more attributes or other data (e.g., a name, a designated purpose, membership, or associated history of interaction in the zone) may be associated with a virtual area zone to define a specific persistent virtual communication context that represents a particular persistent communication opportunity within the virtual area for organizing a communicant's communications with others. In some examples, the visual and audio interfaces that are provided on the client network nodes are configured to present all the independent communication sessions that are occurring in the virtual area. This allows a user to visualize (through sight or imagination) multiple concurrent independent communication interactions and thereby quickly learn who is meeting with whom and the contexts of those meetings (as defined by the zones in which the meetings are occurring).
[0056] FIG. 2 shows an example of a two-dimensional visualization of a virtual area 100 (i.e., the Sococo HQ virtual area). The Sococo HQ virtual area 100 includes a lobby 102, a Main conference room 104, a West Conference room 106, an East Conference room 108, a West Nook zone 1 10, an East Nook zone 1 12, a Courtyard zone 1 14, and sixteen offices. Each of the conference rooms 104-108 includes respective viewscreen objects 1 16-130, table objects 132-136, and respective telephone objects 138-142 and supports realtime audio, chat, and application and network resource sharing communications between the network nodes in the same conference room. Each of the offices includes respective viewscreen objects (not shown) and a respective telephony object (not shown) and supports realtime audio, chat, and application and network resource sharing communications between the network nodes in the same office. Each of the telephony objects supports shared dial-in and dial-out telephony communications as described in U.S. Patent Application No. 13/165,729, filed June 21 , 201 1 . Each of the West Nook 1 10, East Nook 1 12, and Lobby 102 zones respectively supports realtime audio and chat communications between the network nodes in the same zone. The communication properties of an example of the virtual area 100 are described in U.S. Provisional Patent Application No. 61/603,024, filed February 24, 2012.
[0057] Each of the lobby, the conference rooms, and the offices includes a respective door object, which may be in either an open state or a closed state. The area service allows switching rule specified connections to be established through a door object that is in an open state, whereas the area service prevents such
connections from being established through a door object that is in a closed state. In the state shown in FIG. 2, the door 144 of the Main conference room currently is closed, whereas all the other doors in the Sococo HQ virtual area 100 currently are open. In some examples, the door objects correspond to the door objects described in U.S.
Provisional Patent Application No. 61/535,910, filed September 16, 201 1 .
[0058] FIG. 3 shows an example of a virtual area 200 (i.e., the Sococo
Auditorium virtual area) that includes zones and is associated with a visualization of an auditorium. The virtual area 200 includes a stage (or podium) zone 202, a general seating zone 204, a question-and-answer zone 206, a West Conference Room 208, an East Conference Room 210, and a Lobby 212. The stage zone 202 includes
viewscreen objects 214, 216 and speaker props 218, 220. The general seating zone 204 includes a plurality of sub-zones 222 (referred to herein as "bench zones") defining locations where network nodes are permitted to be present in the general seating zone 204. The question-and-answer zone 206 includes a microphone sub-zone 224, a queuing sub-zone 226, and a microphone prop 228. Each of the West Conference Room 208 and the East Conference Room 210 includes a respective viewscreen object 230, 232. The communication properties of an example of the virtual area 200 are described in U.S. Provisional Patent Application No. 61/603,024, filed February 24, 2012.
[0059] FIG. 4 shows an exemplary graphical user interface 300 that is generated by an example of the communications application 26 in a window 302 on a display of the client network node from which a user of the client application ("Art" in this example) is operating. The graphical user interface 300 includes a people panel 304, a viewer panel 306, an audio interaction toolbar 308, a set of panel view controls 310, a Phone button 312, a respective View Screen button 314-320 for each viewscreen 1240130 in the current zone of presence, a Map button 322, and a meeting button 324.
[0060] The audio interaction toolbar 308 includes a headphone control 326 that enables Art to toggle on and off the local speakers of the client network node, and a microphone control 328 that enables Art to toggle on and off the local microphone of the client network node.
[0061 ] The panel view controls 310 include a people panel button 330 for opening and closing the people panel 304, a chat panel button 332 for opening and closing a chat panel, and a viewer panel button 334 for opening and closing the viewer panel 306.
[0062] The Phone button 312 is associated with telephony related
functionality of the platform that enables a user of a Public Switched Telephone Network (PSTN) terminal device to participate in virtual area based communications (e.g., by the PSTN terminal device user calling into a zone of the virtual area or by a user of the communications application 26 to call out to the PSTN terminal device user), as described in U.S. Patent Application No. 13/165,729, filed June 21 , 201 1 .
[0063] Each of the View Screen buttons 314-320 sets the viewer panel 306 to display the content the content being shared in connection with a corresponding one of the viewscreen objects in the current zone of presence or, if no content is being shared in connection with the current viewscreen object, to display a Share button that allows the user to initiate a screen sharing session in connection with the selected view screen object. [0064] The Map button 322 sets the view presented in the viewer panel 306 to a map view of the virtual area.
[0065] The Meeting button 324 sets the view presented in the viewer panel 306 to a meeting user interface for visualizing assemblies of communicants in the virtual area, as described in U.S. Patent Application No. 13/432,837, filed March 28, 2012.
[0066] The graphical user interface 300 also includes a home button 336 that is associated with a control that returns the user's presence to a designated "home" location in the virtual environment (e.g., a designed zone, such as a personal zone or other office that is assigned to the user). Additional details regarding the structure, function, and operation of examples of the navigation controls are described in U.S. Patent Application No. 12/354,709, filed January 15, 2009.
[0067] In the people and viewer panels 304, 306 of the graphical user interface 300, each communicant is represented graphically by a respective circular sprite (or avatar) that is associated with a respective user name of the communicant (i.e., "Art," "Beth," "Carl," "Dan," "Ed," "Fran," and "Garth") and an optional status line that includes additional information about the communicant, such as location of presence (e.g., a virtual area application or a zone of that sever application); availability (e.g., busy, idle), a status message (e.g., "Out of the office next Wednesday"), and the name of the client node from which the communicant is operating (e.g., "workstation 1 " or "mobile phone"). In the map views shown in the viewer panel 304, the spatial positions of the communicant sprites in the respective virtual area zones may be ordered alphabetically by user name or temporally by the times when the communicants established their respective presences in the respective virtual area zones.
[0068] The area service monitors the activities on various communication channels over which the respective communicants are configured to communicate in the virtual areas and generates state data that indicate state information about the communicants and real-time data streams (RDS) that indicate the current realtime activities of the communicants. These states and activities are represented in the graphical user interface 300 by visual cues that are depicted in association with the graphical representations of the communicants in the people panel 304 and the map views shown in the viewer panel 306. For example, the "on" or "off state of a
communicant's local speaker channel is depicted by the presence or absence of a headphones graphic 338 on the communicant's sprite. When a communicant's speakers are on, the headphones graphic 338 is present (see sprites Art, Carl, and Dan) and, when a communicant's speakers are off, the headphones graphic 338 is absent (see sprites Beth and Ed). The "on" or "off state of the communicant's microphone is depicted by the presence or absence of a microphone graphic 340 on the communicant's sprite. When a communicant's microphone is on, the microphone graphic 340 is present (see sprite Dan); and, when a communicant's microphone is off, the microphone graphic 340 is absent (see sprites Art, Beth, Carl, and Ed). The headphones graphic 338 and the microphone graphic 340 provide visual cues of the on or off states of the communicant's sound playback and microphone devices. In addition, the current activity state of a communicant's microphone channel is indicated by a dynamic visualization that lightens and darkens the communicant's avatar in realtime to reflect the presence or absence of audio data on the microphone channel. Thus, whether or not their local speakers are turned on, communicants can determine when another communicant is speaking by the "blinking" of the coloration of that communicant's avatar. The activity state of a communicant's text chat channel is depicted by the presence or absence of the hand graphic 342 adjacent the
communicant's sprite (see sprite Beth). Thus, when a communicant is transmitting text chat data to another network node the hand graphic 342 is present, and when a communicant is not transmitting text chat data the hand graphic 342 is not present. In some examples, the text chat RDS data reflects when keyboard keys are depressed such that the visualization of the communicant's text channel appears as a flashing on and off of the hand graphic 342. In addition, the avatars of communicants who are viewing a shared application in connection with viewscreen props (discussed below) are depicted with a pair of "eyes" 344 to indicate that the represented communicants are viewing the content being shared in connection with the viewscreen props (see, e.g., the avatars of Art and Dan in the Main zone shown in the viewer panel 306 in FIG. 4).
[0069] Members of a virtual area are able to receive the state and RDS information for the communicants in the user's virtual areas of membership whether or not the user is present in the virtual area. For example, the graphical user interface 300 that is presented to Art shows visual cues indicating the states and communication channel activities of the communicants who are present in the SococoHQ virtual area 100 (where Art is present) and the states and communication channel activities of the communicants who are present in other areas of which Art is a member but not currently present (e.g., the Sococo Auditorium virtual area 200).
[0070] In the example shown in FIG. 4, the viewer panel 306 is in the Map view mode, which presents a rendered spatial view of the user's current zone of presence of the SococoHQ virtual area (i.e., SococoHQ/Main as shown in the location bar 346, which indicates that Main is a zone within the virtual area SococoHQ). Each of the communicants who is present in the virtual area is represented graphically in the viewer panel 306 by a respective avatar that corresponds to the communicant's avatar shown in the people panel 304. The virtual area is represented graphically by a two- dimensional top view of a rectangular space. In some examples, the communicants' sprites automatically are positioned in predetermined locations (or "seats") in the virtual area when the communicants initially enter the virtual area.
[0071 ] The Main zone includes four view screen props (or "objects") 124-130 and a table prop 136. Communicants interact with the props by selecting them with an input device (e.g., by single-clicking on the props with a computer mouse, touch pad, touch screen, or the like). The view screen props 124-130 are associated with application sharing functionality of the platform that enables communicants to share applications operating their respective client network nodes. The application sharing functionality is invoked by activating a view screen (e.g., by single-clicking the view screen object with an input device). In some embodiments, the platform provides visual cues that indicate whether or not a communicant is sharing an application over an application sharing channel. In response to a communicant's selection of the view screen prop, the communicant's sprite automatically is moved to a position in the graphical representation of the virtual area that is adjacent the view screen prop. The position of a communicant's sprite adjacent the view screen prop indicates that the communicant currently is sharing or is about to share an application with the other communicants in the virtual area. In addition, the avatar of each communicant who is viewing a shared application is depicted with a pair of "eyes" 130 to indicate that the represented communicants are viewing the content being shared in connection with the view screen props (see, e.g., the avatars of Art and Dan in FIG. 4). The graphical depiction of view screen prop is changed depending on whether or not an active application sharing session is occurring. For example, the depicted color of the view screen may change from a brighter color during an active application sharing session to a darker color when there is no application sharing taking place. Examples of the application sharing process are described in connection with FIGS. 26-28 of U.S. Patent Application No. 12/354,709, filed January 15, 2009, and in U.S. Patent Application No. 12/418,270, filed April 3, 2009.
[0072] In some examples, one or more of the viewscreen props 124-130 may be associated with respective uniform resource identifiers (URIs) of network resources to enable communicants to interact with and share information associated with the network resources via the application sharing (e.g., web browser sharing) functionality associated with the viewscreen objects as described in U.S. Provisional Patent
Application No. 61/444,989, filed February 21 , 201 1 .
[0073] The table prop 136 is associated with file share functionality of the platform that enables communicants to upload computer data files to server storage in association with respective ones of the zones of the virtual area and to download data files that are associated with zones of the virtual area from the server storage to the respective client network nodes. In example shown in FIG. 4, there are two document objects 352, 354 that are associated with the table prop 136 in the Main zone 104 of the Sococo HQ virtual area. The document objects 352, 354 are linked to respective documents that are have been shared in the virtual area and stored in server storage with an index that refers to the unique identifier of the Main zone 104. Any of the document objects 352, 354 may be selected by a communicant (e.g., by double-clicking the document object with an input device, such as a computer mouse) to initiate downloading of the associated document to the communicant's client network node. Additional details regarding the structure, function, and operation of the table prop 136 may be obtained from U.S. Patent Application No. 12/354,709, filed January 15, 2009.
[0074] The people panel 304 depicts the realtime availabilities and activities of communicants that are associated with Art (e.g., by being a contact of Art or being a member of or present in a virtual area of which Art is a member) across different communication contexts.
[0075] The people panel 304 includes a people interaction toolbar 356 that includes includes a Get button 358, a Chat button 360, a Call button 362, and a Locate button 364 that are associated with respective interaction functionalities of the platform that operate with respect to one or more communicants associated with user-selected ones of the avatars in the people panel 304. [0076] Selection of the Get button 358 in connection with one or more user- selected avatars in the people panel 304 opens an invite window that enables the user to invite the communicants corresponding to the one or more selected avatars to a virtual area location (e.g., an area application or zone within that area application) designated by the user. Selection of the Chat button 360 in connection with a user- selected avatar in the people panel 304 opens a chat panel that enables the user to open a private peer-to-peer zone for text chatting with the communicant corresponding to the selected avatar. Additional details regarding embodiments of the methods and functions invoked by the Chat button 360 and the Get button 358 are described in U.S. Patent Application No. 12/354,709, filed January 15, 2009, and U.S. Patent Application No. 13/209,812, filed August 15, 201 1 .
[0077] Selection of the Call button 362 opens a call window that enables the user to place a telephone call to one or more communicants, as described in U.S.
Patent Application No. 13/165,729, filed June 21 , 201 1 . The called communicants are represented in the graphical user interface 300 by avatars that are decorated with graphical representations of a telephone (see, e.g., the avatar 366 in the people panel 304 shown in FIG. 4).
[0078] Selection of the Locate button 364 in connection with the selection of a communicant's avatar in the people panel 304 causes the platform to highlight that communicant's avatar in the Map view shown in the viewer panel 306. Referring to FIG. 5, for example, in response to selection of a communicant's avatar 368 in the people panel 304, the platform shows in the viewer panel 306 a spatial visualization of the virtual area in which the selected communicant is present (e.g., SococoHQ) with that communicant's sprite highlighted with a spotlight visualization 370 over the sprite in the selected communicant's current zone of presence (i.e., Craig's Office). In the illustrated example, the spotlight visualization 370 includes a circular region that is brighter than the other regions of the virtual area. In other examples, different ways of highlighting the location of the selected communicant's presence may be used.
[0079] The people panel 304 also includes a tab bar 400 that includes a set of tabs that are associated with different filtering criteria for presenting different views on the realtime states of Art's contacts and other communicants across Art's virtual areas of membership (i.e., the Sococo HQ virtual area 100 and the Sococo Auditorium virtual area 200 in the illustrated example). The tab bar 400 includes an Active tab 402, a Members tab 404, a Recent tab 406, and a Frequent tab 408.
[0080] The Active tab 402 is associated with filtering criteria that highlight interaction activities grouped by virtual area and by zone within each virtual area, allowing the user to readily determine where the potentially interesting interactions are occurring across the user's areas of membership. With the Active tab 402 selected, the people panel 304 includes a first section 410 that shows the realtime availabilities and activities of the communicants who are present in the Sococo HQ virtual area 100 and a second section 412 that shows the realtime availabilities and activities of the
communicants who are present in the Sococo Auditorium virtual area 200. Each of the virtual area sections 410, 412 includes a respective header bar 414, 416 that includes a descriptive label associated with the virtual area (e.g., the name of the virtual area and other information, such as an announcement, relating to the virtual area) and a respective toggle control that can be toggled to selectively collapse and expand the associated section 410, 412. In the illustrated example, the Sococo HQ section 410 is expanded and the Sococo Auditorium is collapsed.
[0081 ] Within each virtual area section 410, 412, the communicants who are present in the virtual area are grouped as follows: the communicants in the user's current zone of presence (i.e., Main in this example) are displayed in a capsule 418 at the top of the section; next communicants who are co-presence with other
communicants in respective zones of the virtual area are displayed in respective zones of co-presence capsules 420, 422; and the communicants who are alone in respective zones of the virtual area are displayed in a respective "Other Rooms" capsule 424. The zones of co-Presence filtering criteria identify those communicants who are co-present in respective zones of a virtual area. Thus, for each virtual area, the communicants in each group of two or more co-present communicants in the same zone of the virtual area are listed in a separate, selectively expandable and collapsible zone of co- presence capsule in a respective section of the people panel 304. The depiction of the zones of co-presence enables Art to readily visualize all of the conversations that are occurring across all of the communication contexts that are defined by the virtual areas of which Art is a member. In this way, Art can determine whether or not there are any ongoing conversations that he would like to join. [0082] Each of the capsules 418-422 for the current zone of presence and the zones of the co-presences is associated with a respective descriptive user navigable link (e.g., a URI link that includes the name of the zone and other information, such as a label that describes the topic of a meeting currently taking place in the zone - e.g., "Daily Standup" or "Sales Management Meeting"). Each of these capsules 418-422 also is associated with a respective door icon 426, 428, 430 that reflects the current state of the associated door (e.g., open or closed). In the illustrated example, the door icon 426 of the Main zone depicts a door in a closed state to reflect the currently closed state of the Main zone door 144, and each of the door icons 428, 430 depicts a door in an open state to reflect the currently open state of the doors of Paul's Office and the West Conference zones. In this way, the user can obtain a quick sense of the type of meeting that is occurring in the respective zones (e.g., an open or casual meeting, or a closed or private meeting).
[0083] Referring to FIG. 6, the people panel 304 provides different options for navigating and interacting the virtual area based on the user's current zone of presence.
[0084] For example, in response to the user's left-click selection of the door object 428 for the user's current zone of presence (i.e., Main), the graphical user interface 300 generates a room card 452 that presents a reduced-size spatial visualization of the zone that shows avatars of the communicants who are present in the zone and visual cues indicating their current respective states and realtime activities in the zone. The room card 452 also includes a door button 454 that enables the user to change the state of the door of the zone (e.g., from closed to open), and an edit button 456 that allows the user to edit one or more properties of the zone subject to the user's capabilities (e.g., change the zone label).
[0085] In response to the user's right-click selection of the link 450 for the user's current zone of presence (i.e., Main), the graphical user interface generates a menu 458 of options for interacting with the zone. In the illustrated example, the menu 458 includes an open door command that allows the user to change the state of the door of the zone (e.g., from closed to open), a zoom to room command that causes the viewer panel 306 to display a zoomed-in view of the zone, and an edit room command that allows the user to edit one or more properties of the zone subject to the user's capabilities (e.g., change the zone label). [0086] In response to the user's left-click selection of the door object 430 for a zone in which the user is not present (e.g., West Conference), the graphical user interface 300 generates a room card 462 that presents a reduced-size spatial visualization of the zone that shows avatars of the communicants who are present in the zone and visual cues indicating their current respective states and realtime activities in the zone. The room card 462 also includes a knock button 464 that enables the user to send a knock request to one or more occupants of the zone, a go button 466 that enables the user to either (i) enter the zone if the door is open or the user owns the zone or (ii) send a knock request to one or more occupants of the zone if the door is closed and the user is not the owner, and an edit button 468 that allows the user to edit one or more properties of the zone subject to the user's capabilities (e.g., change the zone label).
[0087] In response to the user's right-click selection of the link 460 for a zone in which the user is not present (e.g., West Conference), the graphical user interface 300 generates a menu 470 of options for interacting with the zone. In the illustrated example, the menu 470 includes a knock command that enables the user to send a knock request to one or more occupants of the zone, a go command that enables the user to either (i) enter the zone if the door is open or the user owns the zone or (ii) send a knock request to one or more occupants of the zone if the door is closed and the user does not own the zone, a zoom to room command that causes the viewer panel 306 to display a zoomed-in view of the zone, and an edit room command that allows the user to edit one or more properties of the zone subject to the user's capabilities (e.g., change the zone label).
[0088] In some examples, the graphical user interface 300 generates person cards in response to user selection of a communicant's avatar in the people panel 304. A person card provides information about particular communicant (e.g., attributes, activity information, and state information) and a set of commands for interacting with the communicant. The information and commands that are included in the person card for a particular communicant typically depend on the user's state in relation to the state of the particular communicant. For example, in some examples, communicants are able to broadcast video streams (e.g., video chat streams) into the zones in which they are present, but only communicants in the same zone can subscribe to those video streams. In these examples, the user is not presented with an option to subscribe to the video stream that is broadcasted into a particular zone unless the user is in the same zone as the communicant who is broadcasting the video feed. In some examples, the platform provides a doorbell function that causes a communicant's network node to generate an audible sound (e.g., a doorbell sound) that prompts the communicant to turn on his or her headset. In these examples, the user is not presented with an option to ring the doorbell of a particular communicant unless the user is in the same zone as that communicant.
[0089] FIG. 7 shows examples of person cards 480, 482 that are displayed in the graphical user interface in response to user selection of communicant avatars in the people panel 265.
[0090] The graphical user interface generates the person card 480 in response to user selection of the avatar 484 in the Main zone, where the user currently is present. The person card 480 lists the associated communicant's name (e.g., the communicant's real full or partial name, nickname, pseudonym, or other designation), the communicant's full name (i.e., "Beth Logan"), and the communicant's current zone of presence in the virtual area (i.e., the Main zone in the SococoHQ virtual area). The person card 480 also includes a bell button 486, a chat button 488, a send home button 490, and a mute button 492. The bell button 486 allows the user to cause Beth's network node to generate a sound ("ring the doorbell") that prompts Beth to turn on her headset. The chat button 488 allows the user to communicate with Beth in a persistent private peer-to-peer chat room that is owned jointly by the user and Beth. Subject to the user's capabilities (e.g., the user has a moderator role or is present in the same zone as Beth), the send home button 490 allows the user to move Beth's presence from the current zone to Beth's designated zone (e.g., Beth's home zone or a default zone of the virtual area, such as the Lobby). Subject to the user's capabilities (e.g., the user has a moderator role or is present in the same zone as Beth), the mute button 492 allows the user to mute Beth's microphone such that she cannot broadcast audio into the zone.
[0091 ] The graphical user interface generates the person card 482 in response to user selection of the avatar 494 in the West Conference zone, where the user currently is not present. The person card 482 lists the associated communicant's name (i.e., "Donna M"), the communicant's full name (i.e., "Donna McGee"), and the communicant's current zone of presence in the virtual area (i.e., the West Conference zone in the SococoHQ virtual area). The person card 482 presents a knock button 481 and an associated knock message box 483 that allows the user to send a directed knock message (e.g., "May I join you?") to the target communicant (i.e., Donna M) corresponding to the selected avatar 494. In response to user selection of the knock button 481 , the platform sends a knock notification that includes the knock message only to the target communicant and not to any other communicants in the zone. The person card 482 also includes a get button 496, a chat button 498, a call button 500, and a locate button 502, which operate with respect to the communicant represented by the selected avatar 494 with the same functionalities as the buttons 440-446 described above in connection with the people interaction toolbar 304.
[0092] FIG. 8 shows examples of person cards 504, 506 that are displayed in the graphical user interface 300 in response to user selection of avatars representing telephony device users (e.g., communicants who call into a virtual area zone or communicants who are called by a communicant from a zone of a virtual area) in the people panel 304.
[0093] The graphical user interface 300 generates the person card 504 in response to user selection of an avatar 508 in the Main zone, where the user currently is present. The person card 504 lists the associated telephony device user's name (i.e., "Jack"), the telephony device user's current zone of presence in the virtual area (i.e., the Main zone in the SococoHQ virtual area), and the current duration of the telephony device user's session in the zone. The person card 480 also includes a keypad button 508 that brings up a telephony interface for interacting with the current telephony device usesr (i.e., Jack) or dialing another telephone number, an end call button 510 for terminating the telephone call with Jack, and a mute button 512 that allows the user to mute Jack's microphone such that he cannot broadcast audio into the zone subject to the capabilities of the user (e.g., the user has a moderator role or is present in the same zone as Jack).
[0094] The graphical user interface 300 generates the person card 506 in response to user selection of the avatar 494 in the West Conference zone, where the user currently is not present. The person card 506 lists the associated telephony device user's name (i.e., "Carl"), the telephony device user's current zone of presence in the virtual area (i.e., the Carl's Office zone in the SococoHQ virtual area), and current duration of the telephony device user's session in the zone. [0095] FIG. 9 shows an example of a person card 520 that is displayed in the graphical user interface 300 in response to user selection of an avatar 522 of a selected communicant who is broadcasting a video feed (e.g., a video chat feed) into the user's current zone of presence. The person card 520 lists the selected communicant's name (i.e., "Beth Logan"), the select communicant's current zone of presence in the virtual area (i.e., the Main zone in the SococoHQ virtual area), and the selected
communicant's status attribute (i.e., "Busy - Heads Down"). The person card 520 includes a video display window 518 in which the video feed broadcasted by the selected communicant is rendered. The person card 520 also includes a chat button 524, a bell button 526, and a send home button 528, which operate with respect to the selected communicant with the same functionalities as the buttons 488, 486, and 490 described above in connection with the person card 480 shown in FIG. 7.
[0096] Referring to FIG. 10, the Members tab 404 of the people panel 304 is associated with filtering criteria that enable identity-based searching of communicants grouped by membership. The Members tab 404 highlights the current locations and activities of the members of a particular virtual area, allowing the user to readily find particular communicants based on their respective memberships regardless of their current location or state in the virtual communications environment. In the illustrated example, Art is a member of the Sococo Product Development virtual area ("Sococo Product Dev").
[0097] With the Members tab 404 selected, the people panel 304 includes an online members section 600 and an offline members section 602. The online member section 600 lists all of the members of the Sococo Product Development virtual area who currently are logged into the virtual communications environment alphabetically by display name, whereas the offline members section 602 lists all of the remaining members of the communications environment who currently are logged out of the communications environment alphabetically by display name. For each communicant listed in the online members section 600 and the offline members section 602, the people panel 304 displays the communicant's avatar 604 (along with visual cues revealing the communicant's current state and activity) and the communicant's name 605 (e.g., "Dirk Z"). For each communicant listed in the online members section 600, the people panel 265 also includes a descriptive, user-navigable link 606 (e.g., a URI) to the communicant's current location of presence in the communications environment (e.g., the Gates zone of the virtual area in which the user currently is present). In addition to naming the communicant's zone of presence, the link 606 also includes the name of any prop with which the communicant currently is interacting. For example, if a communicant currently is sharing or viewing an application in connection with a viewscreen object in a particular zone or sharing a file in connection with a table object in a particular zone, the people panel 304 will include in the location link 606 the name of the viewscreen object along with the name of the particular zone (see, e.g., the listing for Carl C, which shows that the communicant currently is associated with Screen 2 in the Jobs zone of the user's current virtual area of presence). In response to the user's selection of the link associated with a particular communicant in the online members section 600, the platform automatically navigates the user to the zone or prop identified by the link. For example, in response to user selection of the link 607 associated with Carl C, the platform automatically navigates the user to the Gates zone of the user 's current area of presence and in response to user selection of the link 609 associated with Carl C, the platform automatically navigates the user to the Jobs zone of the user's current area of presence and configures that user's communications application 26 to view screen share video feeds of an application (e.g., a document processing application, such as a Microsoft Office® application) being shared in connection with the Screen 2 viewscreen object.
[0098] The Members tab 404 also displays a toggle control 608 beside the selection control 604 of each of the communicants who currently is co-located with one or more other communicants in a particular zone of a virtual area in the communications environment. Each toggle control 608 can be toggled to selectively open and close a zone of co-presence capsule that lists the associated communicant and the other communicants who are co-present in the same zone. For example, the toggle control associated with the communicant Gary B has been set to display a zone of co-presence capsule 610 that shows the communicant's name ("Gary B"), a link to the zone of co- presence (i.e., the Briefing Room zone of the Lansing HQ virtual area) in which the communicant is present, and a list of all the other communicants who also are present in the zone (e.g., Evelyn M, Marianne Arnolds, and Zev Michaels), where each of the communicant names in the list is shown adjacent the communicant's avatar (along with visual cues revealing the communicant's current state and activity) . [0099] Referring to FIG. 1 1 , the Recent tab 406 of the people panel 304 is associated with filtering criteria that highlight communicants with whom the user has most recently interacted.
[00100] The Recent tab 406 shows a list of the communicants with whom the user has interacted via any communication channel (e.g., voice, chat, video, application sharing, or file sharing) in reverse chronological order. For each communicant listed in the Recent tab 406, the people panel 304 displays the communicant's avatar 620 (along with visual cues revealing the communicant's current state and activity) and the communicant's name 622. If a communicant is offline, the people panel 304 includes a status message 623 below the communicant's name. If a communicant is online, the people panel 304 includes below the communicant's name a descriptive, user-navigable link 624 (e.g., a URI) to the communicant's current location of presence in the communications environment and the name of any prop with which the communicant currently is interacting. In response to the user's selection of the link associated with a particular communicant, the platform automatically navigates the user to the zone or prop identified by the link.
[00101 ] The Recent tab 406 also displays a respective toggle control 626 beside the avatar 620 of each of the communicants who currently is co-located with another communicant in a particular zone of a virtual area in the communications environment. Each toggle control 626 can be toggled to selectively open and close a respective zone of co-presence capsule 628 that lists the associated communicant and the other communicants who are co-present in the same zone. Each zone of co- presence capsule shows the communicant's name 630, a link 632 to the zone of co- presence in which the communicant is present, and a list 634 of all the other
communicants who also are present in the zone, where each of the communicant names in the list is associated with a respective selection control.
[00102] Referring to FIG. 12A, the Frequent tab 408 of the people panel tab 304 is associated with filtering criteria that highlights communicants with whom the user has most frequently interacted.
[00103] The Frequent tab 408 shows a list of the communicants with whom the user has most frequently interacted via any communication channel (e.g., voice, chat, video, application sharing, or file sharing) in order of interaction frequency. For each communicant listed in the Frequent tab 408, the people panel 304 displays the comnnunicant's avatar 640 (along with visual cues revealing the communicant's current state and activity) and the communicant's name 642. If a communicant is offline, the people panel 304 includes a status message 643 below the communicant's name (e.g., Offline"). If a communicant is online, the people panel 304 includes below the communicant's name a descriptive, user-navigable link 644 (e.g., a URI) to the communicant's current location of presence in the communications environment and the name of any prop with which the communicant currently is interacting. In response to the user's selection of the link associated with a particular communicant, the platform automatically navigates the user to the zone or prop identified by the link.
[00104] The Frequent tab 408 also displays a respective toggle control 646 beside the avatar 640 of each of the communicants who currently is co-located with one or more other communicants in a particular zone of a virtual area in the communications environment. Each toggle control 646 can be toggled to selectively open and close a respective zone of co-presence capsule 648 that lists the associated communicant and the other communicants who are co-present in the same zone. Each zone of co- presence capsule shows the communicant's name 650, a link 652 to the zone of co- presence in which the communicant is present, and a list 654 of all the other
communicants who also are present in the zone, where each of the communicant names in the list is shown adjacent the communicant's avatar 640 (along with visual cues revealing the communicant's current state and activity).
[00105] Some examples of the graphical user interface 304 include a control that allows the user to add contacts to a Favorites list. In response to user selection of a respective one of the avatars, the graphical user interface 304 presents to the user a people menu that includes an option to add the contact represented by the selected avatar to the Favorites list. In some examples, the Favorites list is incorporated into the view shown in FIG. 12A in connection with the Frequent tab 408. In the example shown in FIG. 12B, the avatars of the user's contact in the Favorites list are displayed in a Favorites section 656 and the list of the communicants with whom the user has most frequently interacted via any communication channel (e.g., voice, chat, video, application sharing, or file sharing) are shown in a Frequents section 658 in order of interaction frequency. For each communicant listed in the Favorites section 656, the people panel 304 displays the communicant's avatar (along with visual cues revealing the communicant's current state and activity) and the communicant's name. If a comnnunicant is offline, the Favorites section 656 includes a status message 643 below the communicant's name (e.g., Offline"). If a communicant is online, the Favorites section 656 includes below the communicant's name a descriptive, user-navigable link (e.g., a URI) to the communicant's current location of presence in the communications environment and the name of any prop with which the communicant currently is interacting. In response to the user's selection of the link associated with a particular communicant, the platform automatically navigates the user to the zone or prop identified by the link. The Favorites section 656 also displays a respective toggle control beside the avatar of each of the communicants who currently is co-located with one or more other communicants in a particular zone of a virtual area in the
communications environment. Each toggle control can be toggled to selectively open and close a respective zone of co-presence capsule that lists the associated
communicant and the other communicants who are co-present in the same zone. Each zone of co-presence capsule shows the communicant's name, a link to the zone of co- presence in which the communicant is present, and a list of all the other communicants who also are present in the zone, where each of the communicant names in the list is shown adjacent the communicant's avatar (along with visual cues revealing the communicant's current state and activity).
[00106] Referring to FIGS. 13A and 13B, the people panel 304 additionally includes a search box 660 that allows the user to search for a specific communicant by name.
[00107] In response to text entered into the search box 660, the platform searches for matching character strings in one or more databases containing lists of the user's contacts, communicants who are co-members of the same virtual areas with the user, co-members of the same organization, and potentially other people who are associated with the user. In some examples, the platform identifies matches between the search text and the first name, last name, nicknames, pseudonyms, or other designations of the communicants who are associated with the user. The matching results are revealed as the text is entered into the search box 660. For each match, the people panel 304 displays the communicant's avatar 662 (along with visual cues revealing the communicant's current state and activity), and the communicant's name 664. If a communicant is offline, the people panel 304 includes a status message 666 below the communicant's name (e.g., Offline"). If a communicant is online, the people panel 304 includes below the communicant's name a descriptive, user-navigable link 668 (e.g., a URI) to the communicant's current location of presence in the
communications environment and the name of any prop with which the communicant currently is interacting. In response to the user's selection of the link associated with a particular communicant, the platform automatically navigates the user to the zone or prop identified by the link.
[00108] The people panel 304 also displays a respective toggle control 670 beside the avatar of each of the communicants who currently is co-located with one or more other communicants in a particular zone of a virtual area in the communications environment. Each toggle control 670 can be toggled to selectively open and close a respective zone of co-presence capsule 672 that lists the associated communicant and the other communicants who are co-present in the same zone. Each zone of co- presence capsule shows the communicant's name 674, a link 676 to the zone of co- presence in which the communicant is present, and a list 678 of all the other
communicants who also are present in the zone, where each of the communicant names in the list is shown adjacent the communicant's avatar 680 (along with visual cues revealing the communicant's current state and activity).
[00109] FIG. 14 shows an example of a method by which the client
communications application generates different views on the realtime states of a user contacts and other communicants across the user's virtual areas of membership. In accordance with this method, the client communications application connects to a network communications environment supporting realtime communications between respective network nodes of a user and other communicants in virtual areas each of which is associated with its own respective set of communicant members (FIG. 14, block 680). In connection with the user's network node, client communications application provides a graphical user interface that includes controls for establishing presence in respective ones of the virtual areas, managing realtime communications with other communicants in respective ones of the virtual areas, and presenting different views of communicants associated with the network communications environment (FIG. 14, block 682). Based on user input in connection with the graphical user interface, client communications application establishes a presence for the user in a selected one of the virtual areas, administers realtime communications between the user and one or more communicants who are present in the selected virtual area, and displays a visualization that shows graphical representations, locations of presence, and realtime activities of communicants across respective ones of the virtual areas (FIG. 14, block 684).
[001 10] In some examples, graphical representations of respective ones of the communicants include respective avatars and associated names.
[001 1 1 ] In some examples, based on information received from the virtual area platform, the client communications application assigns respective ones of the communicants into respective groups according to their respective locations of presence in the virtual areas, and shows the graphical representations and realtime activities of the communicants in different sections of the visualization according to the respective groups into which the communicants are assigned, where each section corresponds to a respective location of presence (e.g., a virtual area or a zone of a virtual area). In some of these examples, the graphical representations and realtime activities of co-located communicants are grouped together in respective sections of the visualization.
[001 12] In some examples, each of respective ones of the virtual areas includes multiple respective zones, where each zone supports establishment of communicant presence and realtime communications between network nodes associated with the zone. In these examples, the client communications application typically shows in the visualization visual indications of the zones in which respective ones of the communicants are present. In some cases, a particular one of the sections of the visualization corresponds to a particular one of the virtual areas that includes multiple zones, and in different sub-sections of the particular section the client communications application shows the graphical representations and realtime activities of the communicants in the particular virtual area according to communicants' respective zones of presence in the particular virtual area.
[001 13] In some examples, the client communications application typically shows the graphical representations and realtime activities of the communicants in the zone in which the user is present in at least one of the sub-sections of the particular section of the visualization.
[001 14] In some examples, for each zone of co-presence in the particular virtual area, the client communications application shows the graphical representations and realtime activities of the communicants in the zone in a respective one of the subsections of the particular section of the visualization.
[001 15] In some examples, the client communications application shows the graphical representations and realtime activities of the communicants who are alone in respective ones of the zones of the particular virtual area grouped together in a respective one of the sub-sections of the particular section of the visualization.
[001 16] In some examples, each of respective ones of the zones of the particular virtual area is associated with a respective door object having different states that are associated with different respective rules for granting communicant access to the zone, and the displaying includes displaying in respective ones of the sub-sections visual indications of the states of the door objects associated with the respective zones. In response to user input in connection with a selected one of the sub-sections, the client communications application presents a zone interface for interacting with the particular zone corresponding to the selected sub-section. The zone interface typically includes a selection of zone interaction controls that depend on whether or not the user is present in the particular zone. Based on a determination that the user is present in the particular zone, the selection of zone interface controls typically includes a door control that enables the user to change the state of the door object associated with the particular zone. Based on a determination that the user is not present in the particular zone, the selection of zone interface controls typically includes a knock control that enables the user to send a message requesting entry into the particular zone to one or more communicants who are present in the particular zone. In some examples, based on a determination that the user is not present in the particular zone, the selection of zone interface controls includes a navigation control, where if the associated door object is in the open state or the user is an owner of the particular zone the navigation control enables the user to enter the particular zone, otherwise the navigation control enables the user to send a message requesting entry into the particular zone to a communicant who is present in the particular zone.
[001 17] In some examples, the client communications application shows the graphical representations and realtime activities of the communicants who are members of a particular one of the virtual areas and are present in the network communications environment in a first section of the visualization, and showing graphical representations of the communicants who are members of the particular virtual area and are not present in the network communications environment in a second section of the visualization.
[001 18] In some examples, the client communications application shows the graphical representations and realtime activities of the communicants who are members of a particular one of the virtual areas and are present in the network communications environment in a sequence ordered by communicant name. In some of these
examples, each of respective ones of the virtual areas includes multiple respective zones, where each zone supports establishment of communicant presence and realtime communications between network nodes associated with the zone. In these examples, the client communications application shows visual indications of the zones in which respective ones of the communicants are present.
[001 19] In some examples, for each of the communicants represented in the visualization and co-present with at least one other communicant in a respective zone of a virtual area, the client communications application shows an associated indication that the communicant is in a zone of co-presence. In connection with a respective one of the indications that a particular one of the communicants is in a zone of co-presence, the client communications application typically shows visual indications of other ones of the communicants who are co-present in the zone of co-presence. The visual indications of the other co-present communicants typically include visual indications of the graphical representations and realtime activities of the other co-present
[00120] In some examples, based on information received from the virtual area platform, the client communications application determines a group of the
communicants based on recentness of interaction with the user. In some of these examples, the client communications application shows the graphical representations and realtime activities of the communicants in the determined group in a sequence ordered by recentness of interaction with the user. In some of these examples, each of respective ones of the virtual areas includes multiple respective zones, where each zone supports establishment of communicant presence and realtime communications between network nodes associated with the zone. The client communications application typically shows visual indications of the zones in which respective ones of the communicants are present. In some examples, for each of the communicants in the determined group and co-present with at least one other communicant in a respective zone of a virtual area, the client communications application shows an associated indication that the communicant is in a zone of co-presence. In connection with a respective one of the indications that a particular one of the communicants is in a zone of co-presence, the client communications application typically shows visual indications of other ones of the communicants who are co-present in the zone of co-presence.
[00121 ] In some examples, based on information received from the virtual area platform, the client communications application determines a group of the
communicants based on frequency of interaction with the user, and the client communications application shows the graphical representations and realtime activities of the communicants in the determined group in a sequence ordered by frequency of interaction with the user. In some of these examples, each of respective ones of the virtual areas includes multiple respective zones, where each zone supports
establishment of communicant presence and realtime communications between network nodes associated with the zone. In these examples, the client communications application typically shows visual indications of the zones in which respective ones of the communicants are present. In some examples, for each of the communicants in the determined group and co-present with at least one other communicant in a respective zone of a virtual area, the client communications application shows an associated indication that the communicant is in a zone of co-presence. In connection with a respective one of the indications that a particular one of the communicants is in a zone of co-presence, the client communications application typically shows visual indications of other ones of the communicants who are co-present in the zone of co-presence.
[00122] In some examples, based on user selection of a respective one of the graphical representations of a particular one of the communicants, the client
communications application presents an interface element showing a set of one or more controls for interacting with the particular communicant. In some of these examples, the location of presence of the particular communicant is associated with a respective door object having different states that are associated with different respective rules for granting communicant access to the zone, and the interface element shows a control associated with functionality for sending a message requesting entry into the location of presence of the particular communicant directed only to the particular communicant. In some examples, the interface element shows a control associated with functionality for triggering the network node of the particular communicant to generate a sound that prompts the particular communicant to enable an audio channel for communicating with the user in the location of presence of the particular communicant. In some examples, the interface element shows a control associated with functionality for automatically removing the particular communicant from the particular communicant's current location of presence to a pre-designated location in a respective one of the virtual areas independently of any input from the particular communicant. In some examples, the interface element shows a control associated with functionality for highlighting the location of presence of the particular communicant in a spatial visualization of the respective virtual area in which the particular communicant is present.
[00123] FIG. 15 shows an example 700 of the graphical user interface 300 with the people panel 304 and the chat panel closed and the viewer panel 306 open. In this example, the viewer panel 306 shows a realtime spatial visualization 702 of each of the virtual areas of which the user is a member. Each spatial visualization 702 shows a respective two-dimensional plan view of the respective virtual area, along with graphical representations (e.g., sprites) of the communicants who are present in the virtual area in their respective zones of presence, along with visual cues indicating the communicants' current states and realtime activities. A zoom control 706 allows the user to change the view presented in the viewer panel 304 from a zoomed-out view of all the user's virtual areas of membership to a zoomed-in view of a selected one of the virtual areas. A star icon 708 is positioned over the user primary virtual area (e.g., designed default space). An enlarged version of the user's avatar 710 is positioned over the user's current virtual area of presence.
[00124] Each spatial visualization 702 is associated with a respective callout 71 1 that shows the total number of communicants who currently are present in the virtual area. In response to user selection of a respective one 713 of the callouts 71 1 associated with the spatial visualization 715 of a particular virtual area, the graphical user interface 700 generates a Members panel 712 that shows the current locations and activities of the members of the particular virtual area. The members are represented by respective avatars, which are associated with the respective name of the member. The Members panel 712 includes an online members section 714 and an offline members section 716. The online member section 714 shows the avatars of all of the members of the Sococo Product Development virtual area who currently are logged into the virtual communications environment grouped by virtual area, whereas the offline mennbers section 716 shows the avatars of all of the remaining members who currently are logged out of the communications environment arranged alphabetically by first name. Of the communicants that are shown in the online members section 714, those that are present in the selected virtual area are represented in a top section 718 labeled with the name of the selected virtual area (e.g., Lansing Engineering) and those that are not present in the selected area are represented in a bottom section 720 labeled
"Members in Other Spaces" where they are grouped by their respective virtual areas of presence.
[00125] FIG. 16 shows an example of a method by which the client
communications application generates different views on the realtime states of a user contacts and other communicants across the user's virtual areas of membership. In accordance with this method, the client communications application connects to a network communications environment supporting realtime communications between respective network nodes of a user and other communicants in virtual areas each of which is associated with its own respective set of communicant members (FIG. 14, block 680). In connection with the user's network node, client communications application provides a graphical user interface that includes controls for establishing presence in respective ones of the virtual areas, managing realtime communications with other communicants in respective ones of the virtual areas, and presenting different views of communicants associated with the network communications environment (FIG. 14, block 682). Based on user input in connection with the graphical user interface, client communications application establishes a presence for the user in a selected one of the virtual areas, administers realtime communications between the user and one or more communicants who are present in the selected virtual area, and displays an arrangement of spatial visualizations of respective ones of the virtual areas, wherein each of the spatial visualizations shows a respective view of the respective virtual area and graphical representations of the communicants who are present in the respective virtual area according to their respective locations of presence.
[00126] In some examples, each of the spatial visualizations shows visual cues indicating current states and realtime activities of the communicants who are present in the respective virtual area. Each of the spatial visualizations typically includes a respective graphic that shows a tally of the communicants who are present in the respective virtual area. Based on user input in connection with a respective one of the spatial virtualizations of a particular one of the virtual areas, examples of the client communications application present an interface element that shows the graphical representations and realtime activities of the communicants who are members of a particular one of the virtual areas and are present in the network communications environment in a first section of the visualization, and show graphical representations of the communicants who are members of the particular virtual area and are not present in the network communications environment in a second section of the visualization.
[00127] Other embodiments are within the scope of the claims.
connecting to a network communications environment (10) supporting realtime communications between respective network nodes (12, 14) of a user and other communicants in virtual areas (44) each of which is associated with its own respective set of communicant members;
in connection with the user's network node, providing a graphical user interface comprising controls for establishing presence in respective ones of the virtual areas (44), managing realtime communications with other communicants in respective ones of the virtual areas (44), and presenting different views of communicants associated with the network communications environment (10); and
based on user input in connection with the graphical user interface, establishing a presence for the user in a selected one of the virtual areas (44), administering realtime communications between the user and one or more communicants who are present in the selected virtual area, and displaying a visualization (304) that shows graphical representations, locations of presence, and realtime activities of communicants across respective ones of the virtual areas (44).
2. The method of claim 1 , further comprising assigning respective ones of the communicants into respective groups according to their respective locations of presence in the virtual areas (44), wherein the displaying comprises showing the graphical representations and realtime activities of the communicants in different sections of the visualization (304) according to the respective groups into which the communicants are assigned, and each section corresponds to a respective location of presence.
3. The method of claim 2, wherein the graphical representations and realtime activities of co-located communicants are grouped together in respective sections of the visualization (304).
4. The method of claim 2, wherein each of respective ones of the virtual areas (44) comprises multiple respective zones, each zone supports establishment of communicant presence and realtime communications between network nodes (12, 14) associated with the zone, and the displaying comprises showing in the visualization (304) visual indications of the zones in which respective ones of the communicants are present.
5. The method of claim 4, wherein within a particular one of the sections of the visualization (304) corresponding to a particular one of the virtual areas (44) comprising multiple zones, the displaying comprises in different sub-sections of the particular section showing the graphical representations and realtime activities of the communicants in the particular virtual area according to communicants' respective zones of presence in the particular virtual area.
6. The method of claim 5, wherein the displaying comprises
in one of the sub-sections of the particular section of the visualization (304), showing the graphical representations and realtime activities of the communicants in the zone in which the user is present.
7. The method of claim 5, wherein the displaying comprises
for each zone of co-presence in the particular virtual area, showing the graphical representations and realtime activities of the communicants in the zone in a respective one of the sub-sections of the particular section of the visualization (304).
8. The method of claim 5, wherein the displaying comprises
showing the graphical representations and realtime activities of the
communicants who are alone in respective ones of the zones of the particular virtual area grouped together in a respective one of the sub-sections of the particular section of the visualization (304).
9. The method of claim 5, wherein each of respective ones of the zones of the particular virtual area is associated with a respective door object having different states that are associated with different respective rules for granting communicant access to the zone, and the displaying comprises displaying in respective ones of the sub-sections visual indications of the states of the door objects associated with the respective zones.
in response to user input in connection with a selected one of the sub-sections, presenting a zone interface for interacting with the particular zone corresponding to the selected sub-section.
1 1 . The method of claim 10, wherein the zone interface comprises a selection of zone interaction controls that depend on whether or not the user is present in the particular zone.
12. The method of claim 1 1 , wherein
based on a determination that the user is present in the particular zone, the selection of zone interface controls comprises a door control that enables the user to change the state of the door object associated with the particular zone.
13. The method of claim 1 1 , wherein
based on a determination that the user is not present in the particular zone, the selection of zone interface controls comprises a knock control that enables the user to send a message requesting entry into the particular zone to one or more communicants who are present in the particular zone.
14. The method of claim 1 1 , wherein
based on a determination that the user is not present in the particular zone, the selection of zone interface controls comprises a navigation control, wherein if the associated door object is in the open state or the user is an owner of the particular zone the navigation control enables the user to enter the particular zone, otherwise the navigation control enables the user to send a message requesting entry into the particular zone to a communicant who is present in the particular zone.
15. The method of claim 1 , wherein the displaying comprises showing the graphical representations and realtime activities of the communicants who are members of a particular one of the virtual areas (44) and are present in the network
communications environment (10) in a first section of the visualization (304), and showing graphical representations of the communicants who are members of the particular virtual area and are not present in the network communications environment (10) in a second section of the visualization (304).
16. The method of claim 1 , wherein the displaying comprises showing the graphical representations and realtime activities of the communicants who are members of a particular one of the virtual areas (44) and are present in the network
communications environment (10) in a sequence ordered by respective names associated with the communicants.
17. The method of claim 16, wherein each of respective ones of the virtual areas (44) comprises multiple respective zones, each zone supports establishment of communicant presence and realtime communications between network nodes (12, 14) associated with the zone, and the displaying comprises showing visual indications of the zones in which respective ones of the communicants are present.
for each of the communicants represented in the visualization (304) and co- present with at least one other communicant in a respective zone of a virtual area, the displaying comprises showing an associated indication that the communicant is in a zone of co-presence.
in connection with a respective one of the indications that a particular one of the communicants is in a zone of co-presence, the displaying comprises showing visual indications of other ones of the communicants who are co-present in the zone of co- presence.
20. The method of claim 19, wherein the visual indications of the other co- present communicants comprises visual indications of the graphical representations and realtime activities of the other co-present communicants.
21 . The method of claim 1 , further comprising determining a group of the communicants based on recentness of interaction with the user, and wherein the displaying comprises showing the graphical representations and realtime activities of the communicants in the determined group in a sequence ordered by recentness of interaction with the user.
22. The method of claim 21 , wherein each of respective ones of the virtual areas (44) comprises multiple respective zones, each zone supports establishment of communicant presence and realtime communications between network nodes (12, 14) associated with the zone, and the displaying comprises showing visual indications of the zones in which respective ones of the communicants are present.
for each of the communicants in the determined group and co-present with at least one other communicant in a respective zone of a virtual area, the displaying comprises showing an associated indication that the communicant is in a zone of co- presence.
25. The method of claim 1 , further comprising determining a group of the communicants based on frequency of interaction with the user, and wherein the displaying comprises showing the graphical representations and realtime activities of the communicants in the determined group in a sequence ordered by frequency of interaction with the user.
26. The method of claim 25, wherein each of respective ones of the virtual areas (44) comprises multiple respective zones, each zone supports establishment of communicant presence and realtime communications between network nodes (12, 14) associated with the zone, and the displaying comprises showing visual indications of the zones in which respective ones of the communicants are present.
29. The method of claim 1 , wherein the graphical user interface comprises a control enabling the user to assign respective ones of the communicants to a favorites list, and the displaying comprises presenting the graphical representations and realtime activities of the communicants in the favorites list in a separate section of the
visualization (304).
30. The method of claim 1 , wherein graphical representations of respective ones of the communicants comprise respective avatars and associated names.
31 . The method of claim 1 , further comprising
based on user selection of a respective one of the graphical representations of a particular one of the communicants, presenting an interface element showing a set of one or more controls for interacting with the particular communicant.
32. The method of claim 31 , wherein the location of presence of the particular communicant is associated with a respective door object having different states that are associated with different respective rules for granting communicant access to the zone, and the interface element shows a control associated with functionality for sending a message requesting entry into the location of presence of the particular communicant directed only to the particular communicant.
33. The method of claim 31 , wherein the interface element shows a control associated with functionality for triggering the network node of the particular
communicant to generate a sound that prompts the particular communicant to enable an audio channel for communicating with the user in the location of presence of the particular communicant.
34. The method of claim 31 , wherein the interface element shows a control associated with functionality for automatically removing the particular communicant from the particular communicant's current location of presence to a pre-designated location in a respective one of the virtual areas (44) independently of any input from the particular communicant.
35. The method of claim 31 , wherein the interface element shows a control associated with functionality for highlighting (370) the location of presence of the particular communicant in a spatial visualization of the respective virtual area in which the particular communicant is present.
36. The method of claim 1 , wherein the displaying comprises presenting an arrangement (700) of spatial visualizations (702) of respective ones of the virtual areas (44), wherein each of the spatial visualizations (702) shows a respective view of the respective virtual area and graphical representations of the communicants who are present in the respective virtual area in the communicants' respective locations of presence.
37. The method of claim 36, wherein each of the spatial visualizations (702) shows visual cues indicating current states and realtime activities of the communicants who are present in the respective virtual area.
38. The method of claim 36, wherein each of the spatial visualizations (702) comprises a respective graphic (71 1 ) that shows a tally of the communicants who are present in the respective virtual area.
based on user input in connection with a respective one of the spatial
virtualizations of a particular one of the virtual areas (44), presenting an interface element (720) that shows the graphical representations and realtime activities of the communicants who are members of a particular one of the virtual areas (44) and are present in the network communications environment (10) in a first section of the visualization, and shows graphical representations of the communicants who are members of the particular virtual area and are not present in the network
communications environment (10) in a second section of the visualization.
40. The method of claim 38, further comprising
virtualizations of a particular one of the virtual areas (44), presenting an interface element (720) that shows the graphical representations and realtime activities of the communicants who are members of a particular one of the virtual areas (44) and are present in the network communications environment (10) in a sequence ordered by respective names associated with the communicants.
41 . Apparatus, comprising:
connecting to a network communications environment (10) supporting realtime communications between respective network nodes (12, 14) of a user and other communicants in virtual areas (44) each of which is associated with its own respective set of communicant members; in connection with the user's network node, providing a graphical user interface comprising controls for establishing presence in respective ones of the virtual areas (44), managing realtime communications with other communicants in respective ones of the virtual areas (44), and presenting different views of communicants associated with the network communications environment (10); and
based on user input in connection with the graphical user interface,
establishing a presence for the user in a selected one of the virtual areas (44), administering realtime communications between the user and one or more communicants who are present in the selected virtual area, and displaying a visualization (304) that shows graphical representations, locations of presence, and realtime activities of communicants across respective ones of the virtual areas (44).
42. At least one non-transitory computer-readable medium having processor- readable program code embodied therein, the processor-readable program code adapted to be executed by a processor to perform operations comprising:
based on user input in connection with the graphical user interface, establishing a presence for the user in a selected one of the virtual areas (44), administering realtime communications between the user and one or more communicants who are present in the selected virtual area, and displaying an arrangement (700) of spatial visualizations (702) of respective ones of the virtual areas (44), wherein each of the spatial
visualizations (702) shows a respective view of the respective virtual area and graphical representations of the communicants who are present in the respective virtual area according to their respective locations of presence.
PCT/US2013/042083 2008-04-05 2013-05-21 Interfacing with a spatial virtual communications environment WO2013181026A1 (en)
US13/487,159 2012-06-02
WO2013181026A1 true WO2013181026A1 (en) 2013-12-05
PCT/US2013/042083 WO2013181026A1 (en) 2008-04-05 2013-05-21 Interfacing with a spatial virtual communications environment
US (1) US10366514B2 (en)
WO2011016967A2 (en) * 2009-07-27 2011-02-10 Social Communications Company Spatial interfaces for realtime networked communications
JP3753207B2 (en) 1997-08-11 2006-03-08 富士ゼロックス株式会社 Collaborative work support system and collaborative work support method
JP3855430B2 (en) 1998-01-23 2006-12-13 ソニー株式会社 Information processing apparatus and method, information processing system, and recording medium
JP3826604B2 (en) 1998-10-16 2006-09-27 富士ゼロックス株式会社 Scenario generation apparatus and scenario generation method for presentation materials
CA2354717A1 (en) 2000-08-01 2002-02-01 Chris Roebuck A method of distributing a product, providing incentives to a consumer, and collecting data on the activities of a consumer
JP2002149580A (en) 2000-11-15 2002-05-24 Canon Inc Server equipment, user terminal equipment, virtual space system, method for distributing user information, method for displaying user information, method for distributing and displaying user information and storage medium
JP2002224447A (en) 2001-01-31 2002-08-13 Square Co Ltd Video game device, method for controlling the same, video game program, and recording medium able to read computer in which the program is recorded
US6724416B1 (en) 2002-10-01 2004-04-20 Jianxin Liu Image transceiving telephone with integrated digital camera
JP2005182331A (en) 2003-12-18 2005-07-07 Sony Corp Information processing system, service providing device and method, information processor and information processing method, program and recording medium
KR20060060788A (en) 2004-11-30 2006-06-05 전경열 Virtual reality system using character and realizing method of the same
JP4643454B2 (en) 2006-01-10 2011-03-02 株式会社東芝 Moving picture decoding apparatus and moving picture decoding method
JP4617268B2 (en) 2006-03-14 2011-01-19 キヤノン株式会社 Storage device and storage device processing method
WO2007114789A1 (en) 2006-03-31 2007-10-11 Heulab Pte Ltd Instant message for a virtual learning community
WO2008106196A1 (en) 2007-03-01 2008-09-04 Sony Computer Entertainment America Inc. Virtual world avatar control, interactivity and communication interactive messaging
EP2132650A4 (en) 2007-03-01 2010-10-27 Sony Comp Entertainment Us System and method for communicating with a virtual world
FR2914523B1 (en) 2007-03-30 2009-09-25 Thales Sa Method and system for routing multipology.
JP5258020B2 (en) 2008-01-25 2013-08-07 インターナショナル・ビジネス・マシーンズ・コーポレーションＩｎｔｅｒｎａｔｉｏｎａｌ Ｂｕｓｉｎｅｓｓ Ｍａｃｈｉｎｅｓ Ｃｏｒｐｏｒａｔｉｏｎ Technology to control communication
KR101467767B1 (en) 2008-03-31 2014-12-03 엘지전자 주식회사 Terminal and method of performing instant messaging service therein
US8453062B2 (en) 2009-02-13 2013-05-28 International Business Machines Corporation Virtual world viewer
US20130073707A1 (en) 2011-09-16 2013-03-21 Social Communications Company Capabilities based management of virtual areas
WO2015065359A1 (en) 2013-10-30 2015-05-07 Hewlett-Packard Development Company, L.P. Modifying realized topologies
US10261834B2 (en) 2013-12-18 2019-04-16 Telefonaktiebolaget Lm Ericsson (Publ) Method and network node for selecting a media processing unit based on a media service handling parameter value
2016-01-29 US US15/010,806 patent/US10366514B2/en active Active
US20160163070A1 (en) 2016-06-09
US10366514B2 (en) 2019-07-30
2014-01-29 121 Ep: the epo has been informed by wipo that ep was designated in this application
Ref document number: 13797688