User interfaces for multi-participant live communication

The present disclosure generally relates to methods and user interfaces for managing live communication between multiple participants using a computer system in accordance with some embodiments.

FIELD

The present disclosure relates generally to computer user interfaces, and more specifically to techniques for live communication involving multiple participants.

BACKGROUND

Users are increasingly using electronic devices to communicate with others for personal and business reasons. Most electronic devices are capable of providing live communication between multiple participants. As an example, some electronic devices provide interactive user interfaces to display and control live communication sessions between multiple participants.

BRIEF SUMMARY

Some techniques for live communication involving multiple participants using electronic devices, however, are generally cumbersome and inefficient. For example, some existing techniques use a complex and time-consuming user interface, which may include multiple key presses or keystrokes. Existing techniques require more time than necessary, wasting user time and device energy. This latter consideration is particularly important in battery-operated devices.

Accordingly, the present technique provides electronic devices with faster, more efficient methods and interfaces for live communication involving multiple participants. Such methods and interfaces optionally complement or replace existing techniques for live communication involving multiple participants. Such methods and interfaces reduce the cognitive burden on a user and produce a more efficient human-machine interface. For battery-operated computing devices, such methods and interfaces conserve power and increase the time between battery charges.

In accordance with some embodiments, a method is described. The method is performed at a computer system. The method comprises: obtaining information about gaze of a first participant in a video conference while the first participant, a second participant, and a third participant are participating in the video conference, where: in a first video conference user interface for the first participant, a characteristic location of the second participant in the first video conference user interface for the first participant is located in a first direction from a characteristic location of the first participant; in a second video conference user interface for the second participant, a characteristic location of the second participant is located in a second direction from a characteristic location of the first participant in the second video conference user interface for the second participant, where the second direction is different from the first direction; and in a third video conference user interface for the third participant, a characteristic location of the second participant in the third video conference user interface for the third participant is located in a third direction from a characteristic location of the first participant in the third video conference user interface for the third participant, where the third direction is different from the first direction; in response to obtaining the information about the gaze of the first participant, providing information that indicates which characteristic location of another participant the first participant is looking at to one or more devices displaying of the video conference to enable video conference user interfaces at the one or more devices to indicate at which characteristic location of another participant the first participant is looking, including in accordance with a determination that a first set of criteria is satisfied, where the first set of criteria includes a criterion that is satisfied when the first participant is looking in the first direction in the video conference: modifying a representation of a gaze direction of the first participant in the second video conference user interface to indicate, in the second video conference user interface for the second participant, that the first participant is looking in the second direction at the characteristic location of the second participant without modifying a representation of a gaze direction of the first participant in the third video conference user interface to indicate, in the third video conference user interface for the third participant, that the first participant is looking at the third participant.

In accordance with some embodiments, a non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system, the one or more programs including instructions for: obtaining information about gaze of a first participant in a video conference while the first participant, a second participant, and a third participant are participating in the video conference, where: in a first video conference user interface for the first participant, a characteristic location of the second participant in the first video conference user interface for the first participant is located in a first direction from a characteristic location of the first participant; in a second video conference user interface for the second participant, a characteristic location of the second participant is located in a second direction from a characteristic location of the first participant in the second video conference user interface for the second participant, where the second direction is different from the first direction; and in a third video conference user interface for the third participant, a characteristic location of the second participant in the third video conference user interface for the third participant is located in a third direction from a characteristic location of the first participant in the third video conference user interface for the third participant, where the third direction is different from the first direction; in response to obtaining the information about the gaze of the first participant, providing information that indicates which characteristic location of another participant the first participant is looking at to one or more devices displaying of the video conference to enable video conference user interfaces at the one or more devices to indicate at which characteristic location of another participant the first participant is looking, including in accordance with a determination that a first set of criteria is satisfied, where the first set of criteria includes a criterion that is satisfied when the first participant is looking in the first direction in the video conference: modifying a representation of a gaze direction of the first participant in the second video conference user interface to indicate, in the second video conference user interface for the second participant, that the first participant is looking in the second direction at the characteristic location of the second participant without modifying a representation of a gaze direction of the first participant in the third video conference user interface to indicate, in the third video conference user interface for the third participant, that the first participant is looking at the third participant.

In accordance with some embodiments, a transitory computer-readable storage medium is described. The transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system, the one or more programs including instructions for: obtaining information about gaze of a first participant in a video conference while the first participant, a second participant, and a third participant are participating in the video conference, where: in a first video conference user interface for the first participant, a characteristic location of the second participant in the first video conference user interface for the first participant is located in a first direction from a characteristic location of the first participant; in a second video conference user interface for the second participant, a characteristic location of the second participant is located in a second direction from a characteristic location of the first participant in the second video conference user interface for the second participant, where the second direction is different from the first direction; and in a third video conference user interface for the third participant, a characteristic location of the second participant in the third video conference user interface for the third participant is located in a third direction from a characteristic location of the first participant in the third video conference user interface for the third participant, where the third direction is different from the first direction; in response to obtaining the information about the gaze of the first participant, providing information that indicates which characteristic location of another participant the first participant is looking at to one or more devices displaying of the video conference to enable video conference user interfaces at the one or more devices to indicate at which characteristic location of another participant the first participant is looking, including in accordance with a determination that a first set of criteria is satisfied, where the first set of criteria includes a criterion that is satisfied when the first participant is looking in the first direction in the video conference: modifying a representation of a gaze direction of the first participant in the second video conference user interface to indicate, in the second video conference user interface for the second participant, that the first participant is looking in the second direction at the characteristic location of the second participant without modifying a representation of a gaze direction of the first participant in the third video conference user interface to indicate, in the third video conference user interface for the third participant, that the first participant is looking at the third participant.

In accordance with some embodiments, a computer system is described. The computer system includes: one or more processors; and memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for: obtaining information about gaze of a first participant in a video conference while the first participant, a second participant, and a third participant are participating in the video conference, where: in a first video conference user interface for the first participant, a characteristic location of the second participant in the first video conference user interface for the first participant is located in a first direction from a characteristic location of the first participant; in a second video conference user interface for the second participant, a characteristic location of the second participant is located in a second direction from a characteristic location of the first participant in the second video conference user interface for the second participant, where the second direction is different from the first direction; and in a third video conference user interface for the third participant, a characteristic location of the second participant in the third video conference user interface for the third participant is located in a third direction from a characteristic location of the first participant in the third video conference user interface for the third participant, where the third direction is different from the first direction; in response to obtaining the information about the gaze of the first participant, providing information that indicates which characteristic location of another participant the first participant is looking at to one or more devices displaying of the video conference to enable video conference user interfaces at the one or more devices to indicate at which characteristic location of another participant the first participant is looking, including in accordance with a determination that a first set of criteria is satisfied, where the first set of criteria includes a criterion that is satisfied when the first participant is looking in the first direction in the video conference: modifying a representation of a gaze direction of the first participant in the second video conference user interface to indicate, in the second video conference user interface for the second participant, that the first participant is looking in the second direction at the characteristic location of the second participant without modifying a representation of a gaze direction of the first participant in the third video conference user interface to indicate, in the third video conference user interface for the third participant, that the first participant is looking at the third participant.

In accordance with some embodiments, a computer system is described. The computer system includes: means for obtaining information about gaze of a first participant in a video conference while the first participant, a second participant, and a third participant are participating in the video conference, where: in a first video conference user interface for the first participant, a characteristic location of the second participant in the first video conference user interface for the first participant is located in a first direction from a characteristic location of the first participant; in a second video conference user interface for the second participant, a characteristic location of the second participant is located in a second direction from a characteristic location of the first participant in the second video conference user interface for the second participant, where the second direction is different from the first direction; and in a third video conference user interface for the third participant, a characteristic location of the second participant in the third video conference user interface for the third participant is located in a third direction from a characteristic location of the first participant in the third video conference user interface for the third participant, where the third direction is different from the first direction; means, responsive to obtaining the information about the gaze of the first participant, for providing information that indicates which characteristic location of another participant the first participant is looking at to one or more devices displaying of the video conference to enable video conference user interfaces at the one or more devices to indicate at which characteristic location of another participant the first participant is looking, including in accordance with a determination that a first set of criteria is satisfied, where the first set of criteria includes a criterion that is satisfied when the first participant is looking in the first direction in the video conference: modifying a representation of a gaze direction of the first participant in the second video conference user interface to indicate, in the second video conference user interface for the second participant, that the first participant is looking in the second direction at the characteristic location of the second participant without modifying a representation of a gaze direction of the first participant in the third video conference user interface to indicate, in the third video conference user interface for the third participant, that the first participant is looking at the third participant.

Thus, devices are provided with faster, more efficient methods and interfaces for live communication involving multiple participants, thereby increasing the effectiveness, efficiency, and user satisfaction with such devices. Such methods and interfaces may complement or replace other methods for live communication involving multiple participants.

DESCRIPTION OF EMBODIMENTS

There is a need for electronic devices that provide efficient methods and interfaces for live communication involving multiple participants. For example, there is a need for electronic devices to allow participants in live communication sessions to identify when a particular user is looking at them. Such techniques can reduce the cognitive burden on a user who participate in live communication sessions, thereby enhancing productivity. Further, such techniques can reduce processor and battery power otherwise wasted on redundant user inputs.

Below,FIGS.1A-1B,2,3,4A-4B, and5A-5Cprovide a description of exemplary devices for performing the techniques for managing event notifications.FIGS.6A-6K,7,8A-8B,9A-9C, and10A-10Cillustrate exemplary user interfaces for managing event notifications.FIG.11illustrates an exemplary diagram for managing live communication between multiple participants.FIG.12is a flow diagram illustrating a method for managing live communication between multiple participants. The user interfaces inFIGS.6A-6K,7,8A-8B,9A-9C, and10A-10Cand the diagram inFIG.11are used to illustrate the processes described below, including the processes inFIG.12.

I/O subsystem106couples input/output peripherals on device100, such as touch screen112and other input control devices116, to peripherals interface118. I/O subsystem106optionally includes display controller156, optical sensor controller158, depth camera controller169, intensity sensor controller159, haptic feedback controller161, and one or more input controllers160for other input or control devices. The one or more input controllers160receive/send electrical signals from/to other input control devices116. The other input control devices116optionally include physical buttons (e.g., push buttons, rocker buttons, etc.), dials, slider switches, joysticks, click wheels, and so forth. In some embodiments, input controller(s)160are, optionally, coupled to any (or none) of the following: a keyboard, an infrared port, a USB port, and a pointer device such as a mouse. The one or more buttons (e.g.,208,FIG.2) optionally include an up/down button for volume control of speaker111and/or microphone113. The one or more buttons optionally include a push button (e.g.,206,FIG.2). In some embodiments, the electronic device is a computer system that is in communication (e.g., via wireless communication, via wired communication) with one or more input devices. In some embodiments, the one or more input devices include a touch-sensitive surface (e.g., a trackpad, as part of a touch-sensitive display). In some embodiments, the one or more input devices include one or more camera sensors (e.g., one or more optical sensors164and/or one or more depth camera sensors175), such as for tracking a user's gestures (e.g., hand gestures) as input. In some embodiments, the one or more input devices are integrated with the computer system. In some embodiments, the one or more input devices are separate from the computer system.

Device100optionally also includes one or more depth camera sensors175.FIG.1Ashows a depth camera sensor coupled to depth camera controller169in I/O subsystem106. Depth camera sensor175receives data from the environment to create a three dimensional model of an object (e.g., a face) within a scene from a viewpoint (e.g., a depth camera sensor). In some embodiments, in conjunction with imaging module143(also called a camera module), depth camera sensor175is optionally used to determine a depth map of different portions of an image captured by the imaging module143. In some embodiments, a depth camera sensor is located on the front of device100so that the user's image with depth information is, optionally, obtained for video conferencing while the user views the other video conference participants on the touch screen display and to capture selfies with depth map data. In some embodiments, the depth camera sensor175is located on the back of device, or on the back and the front of the device100. In some embodiments, the position of depth camera sensor175can be changed by the user (e.g., by rotating the lens and the sensor in the device housing) so that a depth camera sensor175is used along with the touch screen display for both video conferencing and still and/or video image acquisition.

FIG.4Aillustrates an exemplary user interface for a menu of applications on portable multifunction device100in accordance with some embodiments. Similar user interfaces are, optionally, implemented on device300. In some embodiments, user interface400includes the following elements, or a subset or superset thereof:

Signal strength indicator(s)402for wireless communication(s), such as cellular and Wi-Fi signals;

Battery status indicator406;

Tray408with icons for frequently used applications, such as:

Icon416for telephone module138, labeled “Phone,” which optionally includes an indicator414of the number of missed calls or voicemail messages;

Icon418for e-mail client module140, labeled “Mail,” which optionally includes an indicator410of the number of unread e-mails;

Icon422for video and music player module152, also referred to as iPod (trademark of Apple Inc.) module152, labeled “iPod;” and

Icons for other applications, such as:

Icon446for a settings application or module, labeled “Settings,” which provides access to settings for device100and its various applications136.

As used here, the term “affordance” refers to a user-interactive graphical user interface object that is, optionally, displayed on the display screen of devices100,300, and/or500(FIGS.1A,3, and5A-5C). For example, an image (e.g., icon), a button, and text (e.g., hyperlink) each optionally constitute an affordance.

FIG.5Cdepicts an exemplary diagram of a communication session between electronic devices500A,500B, and500C. Devices500A,500B, and500C are similar to electronic device500, and each share with each other one or more data connections510such as an Internet connection, Wi-Fi connection, cellular connection, short-range communication connection, and/or any other such data connection or network so as to facilitate real time communication of audio and/or video data between the respective devices for a duration of time. In some embodiments, an exemplary communication session can include a shared-data session whereby data is communicated from one or more of the electronic devices to the other electronic devices to enable concurrent output of respective content at the electronic devices. In some embodiments, an exemplary communication session can include a video conference session whereby audio and/or video data is communicated between devices500A,500B, and500C such that users of the respective devices can engage in real time communication using the electronic devices.

InFIG.5C, device500A represents an electronic device associated with User A. Device500A is in communication (via data connections510) with devices500B and500C, which are associated with User B and User C, respectively. Device500A includes camera501A, which is used to capture video data for the communication session, and display504A (e.g., a touchscreen), which is used to display content associated with the communication session. Device500A also includes other components, such as a microphone (e.g.,113) for recording audio for the communication session and a speaker (e.g.,111) for outputting audio for the communication session.

Device500A displays, via display504A, communication UI520A, which is a user interface for facilitating a communication session (e.g., a video conference session) between device500B and device500C. Communication UI520A includes video feed525-1A and video feed525-2A. Video feed525-1A is a representation of video data captured at device500B (e.g., using camera501B) and communicated from device500B to devices500A and500C during the communication session. Video feed525-2A is a representation of video data captured at device500C (e.g., using camera501C) and communicated from device500C to devices500A and500B during the communication session.

Communication UI520A includes camera preview550A, which is a representation of video data captured at device500A via camera501A. Camera preview550A represents to User A the prospective video feed of User A that is displayed at respective devices500B and500C.

Communication UI520A includes one or more controls555A for controlling one or more aspects of the communication session. For example, controls555A can include controls for muting audio for the communication session, changing a camera view for the communication session (e.g., changing which camera is used for capturing video for the communication session, adjusting a zoom value), terminating the communication session, applying visual effects to the camera view for the communication session, activating one or more modes associated with the communication session. In some embodiments, one or more controls555A are optionally displayed in communication UI520A. In some embodiments, one or more controls555A are displayed separate from camera preview550A. In some embodiments, one or more controls555A are displayed overlaying at least a portion of camera preview550A.

InFIG.5C, device500B represents an electronic device associated with User B, which is in communication (via data connections510) with devices500A and500C. Device500B includes camera501B, which is used to capture video data for the communication session, and display504B (e.g., a touchscreen), which is used to display content associated with the communication session. Device500B also includes other components, such as a microphone (e.g.,113) for recording audio for the communication session and a speaker (e.g.,111) for outputting audio for the communication session.

Device500B displays, via touchscreen504B, communication UI520B, which is similar to communication UI520A of device500A. Communication UI520B includes video feed525-1B and video feed525-2B. Video feed525-1B is a representation of video data captured at device500A (e.g., using camera501A) and communicated from device500A to devices500B and500C during the communication session. Video feed525-2B is a representation of video data captured at device500C (e.g., using camera501C) and communicated from device500C to devices500A and500B during the communication session. Communication UI520B also includes camera preview550B, which is a representation of video data captured at device500B via camera501B, and one or more controls555B for controlling one or more aspects of the communication session, similar to controls555A. Camera preview550B represents to User B the prospective video feed of User B that is displayed at respective devices500A and500C.

InFIG.5C, device500C represents an electronic device associated with User C, which is in communication (via data connections510) with devices500A and500B. Device500C includes camera501C, which is used to capture video data for the communication session, and display504C (e.g., a touchscreen), which is used to display content associated with the communication session. Device500C also includes other components, such as a microphone (e.g.,113) for recording audio for the communication session and a speaker (e.g.,111) for outputting audio for the communication session.

Device500C displays, via touchscreen504C, communication UI520C, which is similar to communication UI520A of device500A and communication UI520B of device500B. Communication UI520C includes video feed525-1C and video feed525-2C. Video feed525-1C is a representation of video data captured at device500B (e.g., using camera501B) and communicated from device500B to devices500A and500C during the communication session. Video feed525-2C is a representation of video data captured at device500A (e.g., using camera501A) and communicated from device500A to devices500B and500C during the communication session. Communication UI520C also includes camera preview550C, which is a representation of video data captured at device500C via camera501C, and one or more controls555C for controlling one or more aspects of the communication session, similar to controls555A and555B. Camera preview550C represents to User C the prospective video feed of User C that is displayed at respective devices500A and500B.

While the diagram depicted inFIG.5Crepresents a communication session between three electronic devices, the communication session can be established between two or more electronic devices, and the number of devices participating in the communication session can change as electronic devices join or leave the communication session. For example, if one of the electronic devices leaves the communication session, audio and video data from the device that stopped participating in the communication session is no longer represented on the participating devices. For example, if device500B stops participating in the communication session, there is no data connection510between devices500A and500C, and no data connection510between devices500C and500B. Additionally, device500A does not include video feed525-1A and device500C does not include video feed525-1C. Similarly, if a device joins the communication session, a connection is established between the joining device and the existing devices, and the video and audio data is shared among all devices such that each device is capable of outputting data communicated from the other devices.

The embodiment depicted inFIG.5Crepresents a diagram of a communication session between multiple electronic devices, including the example communication sessions depicted inFIGS.6A-6K,7,8A-8B,9A-9C, and10A-10C. In some embodiments, the communication session depicted inFIGS.6A-6K,7,8A-8B,9A-9C, and10A-10Cincludes two or more electronic devices, even if the other electronic devices participating in the communication session are not depicted in the figures.

FIGS.6A-6Killustrate exemplary techniques and user interfaces for managing live communication between multiple participants using a computer system in accordance with some embodiments. The user interfaces in these figures are used to illustrate the processes described below, including the processes inFIG.12.

InFIGS.6A-6K, participant602a(“USER A”), participant602b(“USER B”), and participant602c(“USER C”) are participating in a live or real-time video conference. As illustrated inFIGS.6A-6K, participant602ais using computer system600a, participant602bis using computer system600b, and participant602cis using computer system600c. The examples provided inFIGS.6A-6Kshow exemplary embodiments concerning modifying (or not modifying) a representation (e.g., image) of a gaze of a respective participant that is captured by one or more cameras of the computer system belonging to the respective participant. It should be understood that the embodiments provided inFIGS.6A-6Kare merely exemplary. In some embodiments, one or more other participants using one or more other computer systems are communicating in the live video conference. In some embodiments, the representations of gaze correction that are illustrated inFIGS.6A-6Kare not the exact representations of gaze correction that a respective computer system would display.

FIG.6Aillustrates computer system600a, computer system600b, and computer system600c(“the computer systems”). Computer system600ais a laptop, computer system600bis a phone, and computer system600cis a tablet. In some embodiments, one or more of the computer systems is a different computer system than the computer system depicted inFIG.6A. In some embodiments, one or more of the computer systems is a laptop, phone, tablet, smartwatch, head-mounted display unit, etc. In some embodiments, one or more of the computer systems are and/or include one or more features of devices100,300, and500.

As illustrated inFIG.6A, computer system600aincludes camera600a1, which is currently capturing images (e.g., video) participant602a(“USER A”) that is in the field-of-view of camera600a1. Computer system600bincludes cameras600b1and600b2, where one or more of cameras600b1-600b2is currently capturing images of participant602b(“USER B”) that is in the field-of-view of at least one of cameras600b1-600b2. Computer system600cincludes camera600c1, which is currently capturing images of participant602c(“USER C”) that is in the field-of-view of camera600c1. In some embodiments, cameras600a1,600b1,600b2, and600c1(“the cameras”), at a minimum, include an image sensor that is capable of capturing data representing a portion of the light spectrum (e.g., visible light, infrared light, or ultraviolet light). In some embodiments, one or more of the cameras include multiple image sensors and/or other types of sensors. In addition to capturing data representing sensed light, in some embodiments, one or more of the cameras are capable of capturing other types of data, such as depth data. For example, in some embodiments, one or more of the cameras also capture depth data using techniques based on speckle, time-of-flight, parallax, or focus. Image data that the computer systems capture using one or more of the cameras includes data corresponding to a portion of the light spectrum for a scene within the field-of-view of one or more of the cameras. Additionally, in some embodiments, the captured image data also includes depth data for the light data. In some other embodiments, the captured image data contains data sufficient to determine or generate depth data for the portion of the light spectrum.

In some embodiments, one or more of the computer systems include a depth camera (e.g., as part of each of the one or more cameras), such as an infrared camera, a thermographic camera, or a combination thereof. In some embodiments, one or more of the computer systems further include a light-emitting device (e.g., light projector), such an IR floodlight, a structured light projector, or a combination thereof. In some embodiments, the light-emitting device is, optionally, used to illuminate the subject during capture of the image by a visible light camera and a depth camera (e.g., an IR camera), and the information from the depth camera and the visible light camera are used to determine a depth map of different portions of a subject captured by the visible light camera. In some embodiments, a depth map (e.g., depth map image) contains information (e.g., values) that relates to the distance of objects in a scene from a viewpoint (e.g., a camera). In one embodiment of a depth map, each depth pixel defines the position in the viewpoint's Z-axis where its corresponding two-dimensional pixel is located. In some examples, a depth map is composed of pixels wherein each pixel is defined by a value (e.g., 0-255). For example, the “0” value represents pixels that are located at the most distant place in a “three-dimensional” scene, and the “255” value represents pixels that are located closest to a viewpoint (e.g., camera) in the “three-dimensional” scene. In other embodiments, a depth map represents the distance between an object in a scene and the plane of the viewpoint. In some embodiments, the depth map includes information about the relative depth of various features of an object of interest in view of the depth camera (e.g., the relative depth of eyes, nose, mouth, ears of a user's face). In some embodiments, the depth map includes information that enables the one or more computer systems to determine contours of the object of interest in a z direction.

As stated above, inFIG.6A, participant602a, participant602b, and participant602care participating in a live video conference with each other. Participant602a(“USER A”) is using computer system600athat is displaying a video conference user interface612. Video conference user interface612includes selfie-view representation612a1, participant representation612b, and participant representation612c. Selfie-view representation612a1is a representation of a view captured by camera600a1(which, inFIG.6A, includes a representation of participant602athat is in the field-of-view of and is captured by camera600a1). Participant representation612bis a representation of the view captured by one or more of cameras600b1-600b2of computer system600b, and participant representation612cis a representation of the view captured by camera600c1of computer system600c. In some embodiments, information (e.g., data) representing the field-of-view of one or more of cameras600b1-600b2and/or camera600c1is transmitted to computer system600a(e.g., via a server and/or one or more of computer systems600band600c), and participant representation612band participant representation612care representations of the information that is transmitted to computer system600a. In some embodiments, one or more of the computer systems and/or a server modifies information representing the field-of-view of one or more of cameras600b1-600b2and/or camera600c1. In some embodiments, participant representation612band/or participant representation612cis a representation of the modified version of the information representing the field-of-view view of one or more of cameras600b1-600b2and/or camera600c1.

As illustrated inFIG.6A, participant602b(“USER B”) is using computer system600bthat is displaying a video conference user interface614. Video conference user interface614includes selfie-view representation614b1, participant representation614a, and participant representation614c. Selfie-view representation614b1is a representation of a view captured by one or more of cameras600b1-600b2(which, inFIG.6B, includes a representation of participant602bthat is in the field-of-view of and is captured by one or more of cameras600b1-600b2). Participant representation614ais a representation of the view captured by camera600a1of computer system600a, and participant representation614cis a representation of the view captured by camera600c1of computer system600c. In some embodiments, information (e.g., data) representing the field-of-view of camera600a1and/or camera600c1is transmitted to computer system600b(e.g., via a server and/or one or more of computer systems600aand600c), and participant representation614aand participant representation614care representations of the information that is transmitted to computer system600b. In some embodiments, one or more of the computer systems and/or a server modifies information representing the field-of-view of camera600a1and/or camera600c1. In some embodiments, participant representation614aand/or participant representation614cis a representation of the modified version of the information representing the field-of-view of camera600a1and/or camera600c1.

As illustrated inFIG.6A, participant602c(“USER C”) is using computer system600cthat is displaying a video conference user interface616. Video conference user interface616includes selfie-view representation616c1, participant representation616a, and participant representation616b. Selfie-view representation616c1is a representation of a view captured by camera600c(which, inFIG.6C, includes a representation of participant602cthat is in the field-of-view of and is captured (e.g., currently being) by camera600c). Participant representation616ais a representation of the view captured by camera600a1of computer system600a, and participant representation616bis a representation of the view captured by one or more of cameras600b1-600b2of computer system600b. In some embodiments, information (e.g., data) representing the field-of-view of camera600a1and/or one or more of cameras600b1-600b2is transmitted to computer system600c(e.g., via a server and/or one or more of computer systems600aand600b), and participant representation616aand participant representation616bare representations of the information that is transmitted to computer system600c. In some embodiments, one or more of the computer systems and/or a server modifies information representing the field-of-view of camera600a1and/or one or more of cameras600b1-600b2. In some embodiments, participant representation616aand/or participant representation616bis a representation of the modified version of the information representing the field-of-view of camera600a1and/or one or more of cameras600b1-600b2.

AtFIG.6A, computer system600acaptures (e.g., detects) gaze620aof participant602avia camera600a1. Gaze620ais directed to participant representation612b. While gaze620ais directed to participant representation612b,FIG.6Ashows gaze indication621acoming out of computer system600bto illustrate that gaze620ais virtually directed to participant602band/or computer system600bhas received information that gaze620ahas been captured by computer system600aand is directed to participant602b. In addition,FIG.6Aincludes gaze location indicator652aon participant representation612b, which indicates the position of the gaze of participant602aon computer system600a. It should be understood that gaze location indicator652ais illustrated to aid understanding and, in some embodiments, computer system600adoes not display gaze location indicator652a.

AtFIG.6A, based on a determination that gaze620aof participant602ais directed to (e.g., in the direction of) participant representation612b(e.g., participant602ais “looking at” participant602bin user interface612), computer system600bdisplays participant representation614aofFIG.6A. Participant representation614aincludes a modified version of the representation of gaze shown in selfie-view representation612a1(e.g., the field-of-view of camera600a1that is captured and includes the gaze of participant602a). Thus, participant representation614aofFIG.6Adepicts a different gaze for participant602athan the gaze of participant602athat is captured by camera600a1. For example, the representation of participant602ain participant representation614aappears to be looking straight ahead (e.g., eyes forward, head evenly oriented) while the gaze of participant602ain representation612a1does not appear to be looking straight ahead (e.g., eyes to the left and head tilted to the left, as shown by selfie-view representation612a1). As illustrated inFIG.6A, because a determination was made that gaze620ais not directed to participant representation612c(e.g., participant602ais not looking at representation612cof participant602c), computer system600cdisplays participant representation616aofFIG.6A. Participant representation616aofFIG.6Ais representative of the gaze of participant602ain the field-of-view of camera600a1that is captured (e.g., an unmodified representation of the gaze). Thus, atFIG.6A, computer system600cdoes not modify the gaze of participant602ain representation616abecause no determination was made that participant602ais looking at the representation of participant602c. Similarly, the other participant representations ofFIG.6A(e.g., participant representations612b,612c,614c,616b) are also representative of the representation of the gaze of each respective participant (e.g.,602b,602c) that each respective participant's computer system (e.g.,600b,600c) is currently capturing (e.g., unmodified representations of the gaze).

FIG.6Billustrates an alternative embodiment to the embodiment shown inFIG.6A. In particular, participant representation616ais modified inFIG.6Bbecause the determination is made that gaze622aof participant602ais directed to participant representation612b(as opposed to not being modified inFIG.6Abased on the same determination). AtFIG.6B, computer system600acaptures gaze622aof participant602avia camera600a1. Similar to gaze620ainFIG.6A, gaze622ais directed to participant representation612b. In addition, gaze indication623ais shown coming out of computer system600bto illustrate that gaze622ais directed to participant602band/or computer system600bhas received information that gaze622ahas been captured by computer system600aand is directed to participant602b. AtFIG.6B, computer system600bdisplays participant representation614aofFIG.6Bbecause the determination is made that gaze622ais directed to participant representation612b, using similar techniques and for similar reasons as described above in relation to displaying participant representation614aofFIG.6A.

As illustrated inFIG.6B, computer system600cdisplays participant representation616aofFIG.6Bbecause the determination is made that gaze622aof participant602ais directed to participant representation612b(and, in some embodiments, because the determination was not made that gaze622ais directed to participant representation612c). InFIG.6B, participant representation616aincludes a modified version of the representation of gaze shown in selfie-view representation612a1. However, the representation of the gaze shown in participant representation616adisplayed by computer system600chas not been modified in the same way as the representation of the gaze shown in participant representation614adisplayed by computer system600b. As illustrated inFIG.6B, participant representation616ashows participant602alooking towards participant representation616binstead of straight ahead (and/or forward) like participant602ais shown in participant representation614a. Notably, participant representation616ashows participant602alooking towards participant representation616bto represent that participant602ais looking at participant602b(or the representation of participant602bon device600a). Moreover, participant representation614ais shown looking straight ahead to represent that participant602ais looking at participant602b(or the representation of participant602bon device600a), who is using computer system600b. Thus, when a determination is made that a respective participant is looking at another participant, one or more of the computer systems can modify one or more of the participant representations for the respective participant looking at the other participant using different techniques (e.g., displaying representations of the participant looking at the other participant that have been modified differently). Further, as described above in relation toFIG.6B, a representation of a respective participant that is looking at another participant can be modified on a computer system associated with a participant that is not the respective participant or the other participant at which the respective participant is looking. As illustrated inFIG.6B, the other participant representations ofFIG.6Bare displayed using similar techniques as described above in relation toFIG.6A.

FIG.6Cillustrates an embodiment where representations for a participant are not modified when a determination is made that the participant is looking at a user interface for an application that is different from the video conference application. As illustrated inFIG.6C, computer system600acaptures gaze624aof participant602a. InFIG.6C, gaze624ais directed to notes application user interface608. Notes application user interface608is a user interface for a notes application that is different from the video conference application that includes video conference user interface612. As illustrated inFIG.6C, because a determination is made that gaze624ais directed to notes application user interface608, participant representation614aand participant representation616aofFIG.6Cinclude the representation of the gaze of participant602aas captured by camera600a1. For example, participant representation614aand participant representation616aare not modified versions of selfie-view representation612a1inFIG.6C.

Alternatively, in some embodiments, participant representation614aand participant representation616ainclude a modified representation of the gaze that is currently being captured by camera600a1, such that participant602aappears to be looking straight ahead in participant representation614aand participant representation616a. In these embodiments, participant representation614aand participant representation616ainclude a modified representation of the gaze because participant602bis directed to a user interface for a particular application (e.g., a presenter application, such as an application with a slide deck, a programming application, a whiteboard application, a notes application, etc.). Thus, in some embodiments, a participant representation is modified when a determination is made that a participant is looking at a particular type of application and not modified when a determination is made that the participant is looking at a different application that has a type (e.g., non-presenter application) that is different from the particular type of application. In some embodiments, participant representation614aand participant representation616ainclude a modified representation of the gaze because participant602bis sharing an application with other participants in the live video conference. In some embodiments, no participant representations (e.g.,612b,612c,614c,616b) for a respective participant are modified (or some participant representations for a respective participant are not modified) when a determination is made that the respective participant is not looking at the display screen of their respective computer systems (e.g., as shown inFIG.6Cwhile participant602bis not looking at the display screen of computer system600band/or participant602cis not looking at the display screen of computer system600c).

FIG.6Dillustrates an embodiment where representations for a participant include a modified representation of the gaze for the participant when a determination is made that the participant is looking at a camera of the participant's computer system (e.g., or a particular area of the display of the participant computer system). When the participant is looking at the camera, the representation of the gaze of the participant that is displayed on another participant's computer system can show the participant looking straight ahead (e.g., like participant representation614ainFIG.6A), which can make it appear that the respective participant is looking at the other participant. Thus, to avoid confusion, the representations of the gaze of the participant can be modified on the other participant's computer system, such that the respective participant does not appear to be looking straight ahead.

As illustrated inFIG.6D, computer system600acaptures gaze626aof participant602a. AtFIG.6D, a determination is made that gaze626ais directed to camera600a1of computer system600a. As illustrated inFIG.6D, because the determination is made that gaze626ais directed to camera600a1, participant representation614aand participant representation616aofFIG.6Dinclude a modified representation of the gaze that is currently being captured by camera600a1(e.g., modified versions of selfie-view representation612a1). In particular, participant representation614aand participant representation616adepict a representation of participant602a, where the eyes of participant602ahave been shifted up to show that participant602ais not looking at the representation of participant602band/or the representation of participant602c(e.g., using their respective computer systems). In some embodiments, participant representation614aand participant representation616ainclude a representation of participant602a, where the head of participant602ahas been titled up (or in another direction) to show that participant602ais not looking at the representation of participant602band/or the representation of participant602c.

FIG.6Eillustrates an embodiment where a gaze for a participant is modified only when a determination is made that the participant is a presenter and is looking at another participant. In some embodiments, a participant is determined to be a presenter if the participant has more than a threshold amount of activity (e.g., measured by an amount of movement, speech, sound, etc.) over a predetermined period of time (e.g., 60 seconds, 5 minutes, etc.). In some embodiments, the gaze of a participant is modified only when the live video conference is in a particular mode (e.g., a presenter mode) in addition to the other determinations discussed previously in reference toFIG.6E.

As illustrated inFIG.6E, computer system600acaptures gaze628aof participant602adirected to participant representation612b, and computer system600bcaptures gaze628bof participant602bdirected to participant representation614c. AtFIG.6E, determinations are made that gaze628ais directed to participant representation612b(e.g., participant602ais looking at participant602bas indicated by gaze indication629a) and that participant602ais a presenter (e.g., and/or is presenting as indicated by talk bubble690). As illustrated inFIG.6E, based on these determinations, participant representation614aand participant representation616aare displayed to include a modified representation of the gaze captured by camera600a1, using similar techniques as those discussed above in relation to participant representation614aofFIG.6Band participant representation616aofFIG.6B. AtFIG.6E, determinations are also made that gaze628bof participant602bis directed to participant representation614c(e.g., participant602bis looking at participant602cas indicated by gaze indication629b) and that participant602bis not a presenter (e.g., and/or not presenting as indicated by no talk bubble being adjacent to participant602binFIG.6E). Thus, although a determination is made that gaze628bof participant602bis directed to participant representation614c, participant representation612cand participant614cinclude a representation of the gaze that is captured by camera600c1because participant602bis not a presenter.FIG.6Ealso includes gaze location indicator652bon participant representation614c, which indicates the position of the gaze of participant602bon computer system600b. It should be understood that gaze location indicator652bis illustrated to aid understanding and, in some embodiments, computer system600bdoes not necessary display gaze location indicator652b

As illustrated inFIG.6E, the representations of participant602a(e.g., participant representation614aand participant representation616a) are emphasized (e.g., have a bolder border than other participant representations) to indicate that participant602ais a presenter in the live video conference and participant representation616bis emphasized to indicate that participant602bis a person at whom the presenter (e.g., participant602a) is looking. Thus, a participant can decipher who is a presenter and whom the presenter is looking at based on the participant representation(s) that are emphasized on the video conference user interface of the participant's computer system. As shown inFIG.6E, a representation of a presenter (or the person whom the presenter is looking at) can be emphasized using the same technique on multiple computer systems (e.g., the border of participant representation614ais emphasized in the same way as the border of participant representation616a). In addition, as shown inFIG.6E, the representation for the presenter and the representation for a participant at which the presenter is looking are emphasized differently (e.g., different patterns surrounding the participant representations). In some embodiments, emphasizing a participant representation can include shading, changing the color of, changing the size of, moving, etc. the participant representation relative to another participant representation. In some embodiments, participant representation612bis also emphasized (e.g., in the same way that participant representation616bis emphasized).

FIG.6Fis an alternative embodiment to the embodiment discussed in relation toFIG.6E. Among other things,FIG.6Fillustrates an embodiment where the representation of the gaze for a respective participant is modified when a determination is made that the respective participant is looking at another participant, irrespective of whether the respective participant is a presenter. AtFIG.6F(similar toFIG.6E), participant602ais a presenter (e.g., as indicated by talk bubble690), and participant602bis not a presenter. AtFIG.6F, computer system600acaptures gaze630aof participant602adirected to participant representation612b, and computer system600bcaptures gaze630bof participant602bdirected to participant representation614c. AtFIG.6F, a determination is made that gaze630aof participant602ais directed to participant representation612b(e.g., participant602ais looking at participant602bas indicated by gaze indication631a), and participant representation614aand participant representation616aofFIG.6Fare displayed to include a modified representation of the gaze being captured by camera600a1because of this determination (e.g., using similar techniques as those discussed above in relation to participant representation614aofFIG.6Eand participant representation616aofFIG.6E). AtFIG.6F, a determination is made that gaze630bof participant602bis directed to participant representation614c(e.g., participant602bis looking at participant602cas indicated by gaze indication631b). As illustrated inFIG.6F, because the determination is made that gaze630bis directed to participant representation614c, participant representation616bofFIG.6Fincludes a modified representation of the gaze captured by one or more of cameras600b1-600b2(e.g., modified version of selfie-view representation614b1). As illustrated inFIG.6F, participant representation616bshows participant602blooking straight ahead (e.g., at participant602cwho is using computer system600c).

With respect to participant representation612b, computer system600adisplays participant representation612bwith an unmodified representation of the gaze of participant602b(e.g., the gaze that is captured by the one or more cameras600b1-600b2; the same gaze as shown in selfie-view representation614b1). Here, participant representation612bincludes a representation of the gaze of participant602bthat is currently being captured of the one or more cameras600b1-600b2because the representation of participant602bshown in participant representation612bappears to be looking at participant representation612ccorresponding to participant602c. In other words, a respective participant representation can be displayed with an unmodified representation of the gaze when a determination is made that the gaze in the respective participant representation is oriented towards the participant representation of the participant at which the respective participant is looking. However, inFIG.6F, participant representation616aofFIG.6Fincludes a modified representation of the gaze captured by camera600abecause the representation of participant602ashown in participant representation616awould not appear to be looking at participant representation616bif participant representation616aincluded an unmodified representation of the gaze captured by camera600a. In some embodiments, participant representation612bincludes a modified representation of the gaze captured by camera600a, irrespective of whether a participant representation that is displayed with a representation of the gaze captured by camera600awould appear to be looking at participant representation612c.

FIG.6Gillustrates an embodiment where the representation of the gaze for a participant is modified when a determination is made that the participant is looking at another participant.FIG.6Gillustrates an embodiment where the representation of the gaze for all three participant are changed based on the participant at which each of the three participants are looking. AtFIG.6G, computer system600acaptures gaze632aof participant602adirected to participant representation612b, computer system600bcaptures gaze632bof participant602bdirected to participant representation614c, and computer system captures gaze632cdirected to participant representation616a.

AtFIG.6G, a determination is made that gaze632aof participant602ais directed to participant representation612b(e.g., participant602ais looking at participant602bas indicated by gaze indication633a). As a result, participant representation614aand participant representation616aare displayed inFIG.6Gto include a modified representation of the gaze being captured by camera600a1because of this determination (e.g., using similar techniques as those discussed above in relation to participant representation614aofFIG.6Eand participant representation616aofFIG.6E).

AtFIG.6G, a determination is made that gaze632bof participant602bis directed to participant representation614c(e.g., participant602bis looking at participant602cas indicated by gaze indication633b). As a result, participant representation616binFIG.6Gincludes a modified representation of the gaze being captured by one or more of cameras600b1-600b2because of this determination (e.g., using similar techniques as those discussed above in relation to participant representation616bofFIG.6F). As illustrated inFIG.6G, participant representation612bincludes a representation of the gaze that is currently being captured by one or more cameras600b1-600b2(e.g., selfie-view representation614b1), using similar techniques as described above in relation to participant representation612bofFIG.6F.

AtFIG.6G, a determination is made that gaze632cof participant602cis directed to participant representation616a(e.g., participant602cis looking at participant602aas indicated by gaze indication633c). As a result, participant representation612cincludes a modified representation of the gaze being captured by camera600c1, where participant602crepresented in participant representation612cappears to be looking straight ahead (e.g., at participant602awho is using computer system600a). As illustrated inFIG.6G, participant representation614cincludes a representation of the gaze that is currently being captured by camera600c1(e.g., selfie-view representation616c1), using similar techniques (and for similar reasons) as described above in relation to participant representation612bofFIG.6F.FIG.6Galso includes gaze location indicator652con participant representation616a, which indicates the position of the gaze of participant602c. It should be understood that gaze location indicator652cis illustrated to aid understanding and, in some embodiments, computer system600cdoes not necessary display gaze location indicator652c.

FIG.6Hillustrates an embodiment where the representation of the gaze for a participant is modified when a determination is made that the participant is looking at another participant.FIG.6His different fromFIG.6Fin that the gaze of participant602bis directed to participant602a(e.g.,634binFIG.6H) instead of participant602c(e.g.,632binFIG.6F). Thus, in video conference user interface616, participant602aincluded in participant representation616aappears to be looking at participant602bincluded in participant representation616bto indicate that participant602aand participant602bare looking at each other.

AtFIG.6H, computer system600acaptures gaze634aof participant602adirected to participant representation612b, computer system600bcaptures gaze634bof participant602bdirected to participant representation614a, and computer system600ccaptures gaze634cdirected to participant representation616a. InFIG.6H, participant representations612b,612c,614a,614c, and616ainclude corrected and non-corrected representations using similar techniques as described above for each of these respective representations in relation toFIG.6F.

However, inFIG.6H, a determination is made that gaze634bof participant602bis directed to participant representation614a(e.g., participant602bis looking at participant602aas indicated by gaze indication635b). As a result, participant representation616bofFIG.6Hincludes a modified representation of the gaze being captured by one or more of cameras600b1-600b2because of this determination. InFIG.6H, because a determination is made that gaze634bis directed to participant representation614a(e.g., looking at participant602a), participant representation616bofFIG.6Hshows participant602blooking at participant representation616aof participant602a(and not straight forward at participant602c). Moreover, the participants represented in participant representation616aand participant representation616bappear to be looking at each other because participant representation616ahas been corrected (e.g., using similar techniques as described above in relation toFIG.6F).

As illustrated inFIG.6Hand with respect to computer system600a, participant representation612bofFIG.6Hincludes a modified representation of the gaze that is captured by one or more of cameras600b1-600b2(e.g., the gaze of participant602b) because the determination is made that gaze634bis directed to participant representation614a. Thus, inFIG.6H, participant representation612band participant representation612cshow each of their respective participants looking straight ahead because both participants have been determined to be looking at participant602a(e.g., as indicated by gaze indication635band gaze indication635c). Thus, the gaze for multiple participants can be corrected in the same way when multiple participants are looking at another participant.

FIG.6Iillustrates an alternate embodiment toFIG.6G, where participant indications (e.g.,692a-692c) are displayed (e.g., on participant representations) to indicate the participant at whom the respective participant is looking. AtFIG.6I, computer system600acaptures gaze636a(e.g., same as gaze632aofFIG.6G) of participant602adirected to participant representation612b, computer system600bcaptures gaze636b(e.g., same as gaze632bofFIG.6G) of participant602bdirected to participant representation614c, and computer system captures gaze636c(e.g., same as gaze632cofFIG.6G) directed to participant representation616a. As illustrated inFIG.6I, the participant representations (612b,612c,614a,614c,616a,616b) are displayed using similar techniques as described above in relation toFIG.6G. However, inFIG.6I, the participant representations include one of participant indication692a-692c. Here, each of the participant representations include a participant indication of the participant at whom the participant represented by the participant representation is looking. For example, participant representations612band616bofFIG.6Iinclude participant indication692c(corresponding to participant602c) because gaze636bof participant602bis directed to participant representation614c(or participant602cthat is represented in participant representation614c), participant representations612cand614cofFIG.6Iinclude participant indication692a(corresponding to participant602a) because gaze636cof participant602cis directed to participant representation616a(or participant602athat is represented in participant representation616a), and participant representations614aand616aofFIG.6Iinclude participant indication692b(corresponding to participant602b) because gaze636aof participant602ais directed to participant representation612b(or participant602bthat is represented in participant representation612b). As shown inFIG.6I, each respective participant's selfie-view representation includes a participant indication to indicate the participant at whom the participant of the respective device is looking. In some embodiments, participant indications (e.g.,692a-692c) can include an avatar of a respective participant, a name, an initial or initials, a color associated with a respective participant, etc.

In some embodiments, each of the participant representations can include a participant indication to indicate the participant that is looking at the participant represented by the participant representation. For example, in these embodiments, participant representations612band616bwould include participant indication692abecause gaze636aof participant602ais directed to participant representation612b(participant602ais looking at representation612bof participant602b), participant representations612cand614cwould include participant indication692bbecause gaze636bof participant602bis directed to participant representation614c(participant602bis looking at representation614cof participant602c), and participant representations614aand616awould include participant indication692cbecause gaze636cof participant602cis directed to participant representation616a(participant602cis looking at representation616aof participant602a). In some embodiments, each respective participant's selfie-view representation can include a participate indication to indicate the participant that is looking at the participant represented by the participant's selfie-view representation.

FIG.6Jillustrates an alternate (or additional) embodiment toFIG.6I. AtFIG.6J, computer system600acaptures gaze636aof participant602aand a determination is made that gaze636ais directed to participant representation612b. As illustrated inFIG.6J, because the determination is made that gaze636ais directed to participant representation612b, participant representation614aon computer system600bis moved closer to camera600b1(e.g., participant representation614aand participant representation614cswap positions). In some embodiments, a participant representation is moved to (or closer to) another predetermined location because the determination is made that gaze636ais directed to participant representation612b.

FIG.6Killustrates an alternate embodiment toFIG.6H, where participant indications (e.g.,692a-692c) are displayed on participant representations to indicate the participant at whom the participant represented by the participant representation is looking. AtFIG.6K, computer system600acaptures gaze640a(e.g., same as gaze634aofFIG.6H) of participant602adirected to participant representation612b, computer system600bcaptures gaze640b(e.g., same as gaze634bofFIG.6H) of participant602bdirected to participant representation614a, and computer system captures gaze640c(e.g., same as gaze634cofFIG.6H) directed to participant representation616a. As illustrated inFIG.6K, the participant representations (612b,612c,614a,614c,616a,616b) are displayed using similar techniques as described above in relation toFIG.6H. However, inFIG.6K, each of the participant representations include one of participant indication692a-692c(as opposed to the participant representations ofFIG.6H). Here, each of the participant representations include a participant indication of the participant at whom the participant represented by the participant representation is looking. For example, participant representations612band616bofFIG.6Kinclude participant indication692abecause gaze636bis directed to participant representation614aofFIG.6K(or participant602athat is represented in participant representation614a), participant representations612cand614cinclude participant indication692abecause gaze636cis directed to directed to participant representation616a(or participant602athat is represented in participant representation616a), and participant representations614aand616ainclude participant indication692bbecause gaze636ais directed to participant representation612b(or participant602bthat is represented in participant representation612b). In some embodiments, each of the participant representations can include a participant indication to indicate the participant that is looking at the participant represented by the participant representation (e.g., using similar techniques as those described above in relation toFIG.6I).

FIG.7illustrates exemplary techniques and user interfaces for managing live communication between multiple participants using a computer system in accordance with some embodiments. The user interfaces in this figure are used to illustrate the processes described below, including the processes inFIG.12.

FIG.7illustrates computer system700. InFIG.7, computer system700is a phone. In some embodiments, computer system700is computer system600b, as described above in relation toFIGS.6A-6K. In some embodiments, computer system700is a laptop, phone, tablet, smartwatch, head-mounted display unit, etc. In some embodiments, computer system700includes one or more features of devices100,300, and500.

AtFIG.7, the respective gazes of participant602a(e.g., represented in participant representation714a), participant602b(e.g., represented in participant representation714b), and participant602c(e.g., represented in participant representation714c) are the same as the respective gazes of the respective participants inFIG.6G(as described above). AtFIG.7, participants602a-602care participating in a live video conference with each other (e.g., like inFIG.6G). Thus, atFIG.7, participant602ais looking at a representation of participant602b, participant602bis looking at a representation of participant602c, and participant602cis looking at a representation of participant602a. In addition, participant602bis using computer system700(or computer system700is the same as computer system600binFIG.6G). Thus, atFIG.7, computer system700displays video conference user interface714that includes participant representation714a, participant representation714b, and participant representation714c. Participant representation714a, participant representation714b, and participant representation714cinclude modified representations of the view that is currently being captured by each of the cameras of the respective computer system (e.g., computer system600a,600b(and/or700), and600c). Each of the participant representations are modified. The representation for the presenter (e.g., participant representation714a) is in the center and looking straight to indicate that the presenter is looking at the user of computer system700(e.g., participant602b). The representation(s) for anyone looking at the presenter are displayed to the left of the center representation (e.g., participant representation714c, because participant602cis looking at a representation of participant602ainFIG.6G) and the representation of the gaze is modified to show the participant looking to the left towards the presenter. The representation(s) are displayed to the right of the center representation (e.g., participant representation714b, because participant602cis not looking at a representation of participant602ainFIG.6G) and the representation of the gaze is modified to show the participant looking to the left away from the presenter. Thus,FIG.7illustrates an alternative video conference user interface where the locations of participant representations can be adjusted and the representation of gaze included in the respective representation can be modified in a way that groups the participants who are presenters (or the person looking at the participant representation for the participant using the computer system that is displaying the video conference user interface), participants looking at the presenters, and the participants looking away from the presenters and gives an indication about the respective gazes for the participants.

FIGS.8A-8Billustrate exemplary techniques and user interfaces for managing live communication between multiple participants using a computer system in accordance with some embodiments. Among other things,FIGS.8A-8Billustrate an embodiment where a respective participant representation is moved from one device to another device when a determination is made that the participant represented by the respective participant representation is looking at a participant that is associated (e.g., using) the other device. The user interfaces in these figures are used to illustrate the processes described below, including the processes inFIG.12.

FIG.8Aillustrates computer system600a, computer system600b, and computer system800d. Computer system600ais a laptop that is associated with (e.g., belongs or being used by) participant602a. Computer system600bis a phone, and computer system800dis a laptop. In addition, both computer system600band computer system800dare associated with participant602b. In some embodiments, any one of the computer systems illustrated inFIG.8Ais a laptop, phone, tablet, smartwatch, head-mounted display unit, etc. In some embodiments, any one of the computer systems illustrated inFIG.8Ainclude one or more features of devices100,300, and500.

AtFIG.8A, participant602a, participant602b, and participant602c(shown inFIG.6A) are participating in a live video conference with each other. Participant602is using computer system600athat is displaying a video conference user interface612that includes selfie-view representation612a1, participant representation612b, and participant representation612c(e.g., using similar techniques as described above in relation toFIGS.6A-6K). Moreover, participant602bis using computer system600bthat is displaying a video conference user interface614that includes selfie-view representation614b1, participant representation614a, and participant representation614c(e.g., using similar techniques as described above in relation toFIGS.6A-6K). AtFIG.8A, computer system800dis not displaying any participant representations. However, in some embodiments, computer system800ddisplays one or more participant representations.

With respect to participant representation614a, a determination is made that gaze820aof participant602ais directed to camera600a1of computer system600a. As illustrated inFIG.8A, because the determination is made that gaze820ais directed to camera600a1, participant representation614aincludes a modified representation of the gaze that is currently being captured by camera600a1, where the eyes of participant602ahave been shifted up to show that participant602ais not looking at participant602b(e.g., using one or more techniques as described above in relation toFIG.6D).

AtFIG.8B, computer system600acaptures gaze822aof participant602adirected to participant representation612binstead of camera600a1. As illustrated inFIG.8B, because a determination is made that gaze822aof participant602ais directed to participant612b, the representation of participant602ais moved from being displayed on computer system600bto being displayed on computer system800d. Thus, inFIG.8B, participant representation614aceases to be displayed on computer system600b, and participant representation614dis displayed on computer system800d, where it was not previously displayed. InFIG.8B, participant representation614dincludes a modified representation of the gaze of participant602athat is being captured by camera600a(e.g., using similar techniques as those described above in relation to614ainFIG.6A). In some embodiments (as shown inFIG.8B), the gaze of participant602bchanges (e.g.,820aofFIG.8A to822aofFIG.8B) because the representation of participant602ais displayed next to camera800d1of computer system800d. Thus, in some embodiments, moving a respective participant representation from one device associated with a particular participant to another device associated with the particular participant, when a determination is made that a respective participant represented by the respective participant representation is looking at the particular participant, entices the particular participant to return the gaze (or look at) the respective participant (e.g., a representation of the respective participant) and/or look into a camera.

FIGS.9A-9Cillustrates exemplary techniques and user interfaces for managing live communication between multiple participants using a computer system in accordance with some embodiments. Among other things,FIGS.9A-9Cillustrate an embodiment where individual participant representations are displayed when multiple participants are captured by a camera. The user interfaces in these figures are used to illustrate the processes described below, including the processes inFIG.12.

FIG.9Aillustrates computer system600aand computer system600b. AtFIG.9A, participant602aand participant902aare using computer system600ato participant in a live video conference with participant602bwho is using computer system600b. As illustrated inFIG.9A, computer system600adisplays live video conference user interface612, which includes participant representation612b(e.g., a representation of participant602b) and selfie-view representation612a1. Selfie-view representation612a1is a representation of a view captured by camera600a1(which, inFIG.9A, includes representations of participant602aand participant902aand that are in the field-of-view of and are captured by camera600a1).

As illustrated inFIG.9A, computer system600bdisplays live video conference user interface614, which includes selfie-view representation614b1, participant representation914a1, and participant representation941a2. Selfie-view representation614b1is a representation of a view of one or more of cameras600b1-600b2. Notably, participant representation914a1is a representation of participant902a, and participant representation914a2is a representation of participant902b. Thus, computer system600bdisplays a separate representation of each participant in the field of view of camera600a1instead of displaying, e.g., a single representation that includes both participants (e.g., a participant representation like selfie-view612a1). In some embodiments, computer600bdisplays a representation of each participant in the field-of-view of camera600a1to allow participant602bto identify which participant in the field-of-view of camera600a1is looking at participant602b.

AtFIG.9A, computer system600bcaptures gaze920a1of participant902aand a determination is made that gaze920a1is directed to participant representation612band is the gaze of participant902a. As illustrated inFIG.9A, computer system600bdisplays participant representation914a1that includes a modified representation of the gaze of participant902athat is captured by camera600a1because of this determination. As illustrated inFIG.9A, because a determination is not made that gaze920a1is the gaze of participant602a, computer system600bdisplays participant representation914a2with a representation of the gaze of participant602athat is captured by camera600a1(e.g., unmodified representation of gaze).

AtFIG.9B, computer system600bcaptures gaze920a2of participant602aand a determination is made that gaze920a2is directed to participant representation612band is the gaze of participant602a. As illustrated inFIG.9B, computer system600bdisplays participant representation914a2that includes a modified representation of the gaze of participant602athat is captured by camera600a1because of this determination. As illustrated inFIG.9B, because a determination is not made that gaze920a2is the gaze of participant902a, computer system600bdisplays participant representation914a1with the representation of the gaze of participant902athat is captured by camera600a1(e.g., unmodified representation of gaze).

AtFIG.9C, computer system600bcaptures gaze902a1of participant902aand gaze920a2of participant602aand a determination is made that gaze902a1and gaze920a2are directed to participant representation612b. As illustrated inFIG.9C, computer system600bdisplays participant representation914a1and participant representation914a2with a modified representation of the gaze of participant902aand a modified representation of the gaze of participant602a, respectively, because both participants602aand902aare determined to be looking at participant representation612b.

FIGS.10A-10Cillustrate exemplary techniques and user interfaces for managing live communication between multiple participants using a computer system in accordance with some embodiments. The user interfaces in these figures are used to illustrate the processes described below, including the processes inFIG.12.

FIG.10Aillustrates computer system1000that includes a plurality of cameras1006a-1006h. In some embodiments, computer system1000is and/or includes one or more features of devices100,300, and500. AtFIG.10A, participant602ais a communicating in a live video conference with the participants represented by participant representations1010a-1010fthat are displayed on video conference user interface1010. AtFIG.10A, computer system1000captures gaze1020and a determination is made that gaze1020is directed to participant representation1010b, which is the closest participant representation to camera1006c(e.g., as indicated by camera indication1062a). AtFIG.10A, because of this determination, computer system1000transmits (e.g., via direct or indirect (e.g., via one or more servers) transmission) information that includes data captured by camera1006cto other computer systems for the participants in the live video conference. AtFIG.10B, computer system1000captures gaze1022and a determination is made that gaze1022is directed to participant representation1010c, which is the closest participant representation to camera1006h(e.g., as indicated by camera indication1062b). AtFIG.10B, because of this determination, computer system1000transmits information that includes data captured by camera1006cto other computer systems for the participants in the live video conference. AtFIG.10C, computer system1000captures gaze1024and a determination is made that gaze1024is directed to participant representation1010, which is the closest participant representation to camera1006e(e.g., as indicated by camera indication1062c). AtFIG.10C, because of this determination, computer system1000transmits information that includes data captured by camera1006eto other computer systems for the participants in the live video conference. In some embodiments, computer system1000transmits information described in reference toFIGS.10A-10Cto the computer system that is associated with participant representation at which participant602ais looking. In some embodiments, transmitting information described in reference toFIGS.10A-10Cto the computer system that is associated with the participant representation at which participant602ais looking allows one or more computer systems to modify the transmitted information in order to display a modified representation of the gaze of user602a(e.g., in order to show participant602alooking forward on the computer system of the participant represented by the participant representation at which participant602ais looking). In some embodiments, participants represented by respective participant representations other than the participant representation that participant602ais not looking at receive and display a representation of participant602ausing information captured by the camera of computer system1000that is closest to the respective participant representation.

FIG.11illustrates exemplary techniques and a diagram for managing live communication between multiple participants using a computer system in accordance with some embodiments. The diagram in this figure is used to illustrate the processes described below, including the processes inFIG.12.

AtFIG.11, participant602ais positioned between camera1100aand camera1100b, which are capturing portions of the face of participant602a. AtFIG.11, the portions captured by camera1100aand camera1100bdo not include the entirety of the face of participant602a. However, various techniques can be used to create a three-dimensional representation of the face of participant602afrom the portions captured by camera1100aand camera1100b. In some embodiments, the three-dimensional representation of the face of participant602acan be modified, such that a participant representation that includes a modified representation of the gaze of participant602acan be shown via a computer system. In some embodiments, the technique described in relation toFIG.11can be applied to displaying modified representations of the participant's gaze as described above in relation toFIGS.6A-6K,7,8A-8B,9A-9C,10A-10C, and11. In some embodiments,FIGS.6A-6K,7,8A-8B,9A-9C,10A-10C, and11can be combined to display video conference user interfaces in multiple ways and is not limited to the particular way that the techniques are described herein.

FIG.12is a flow diagram illustrating a method for managing live communication between multiple participants using a computer system in accordance with some embodiments. Method1200is performed at a computer system (e.g.,100,300,500,600a,600b,600c)) (e.g., a smartphone, a smartwatch, a tablet, a computer) (e.g., a remote computer system (e.g., a server) (e.g., a local computer system) (e.g., a computer system having one or more cameras (e.g., one or more cameras (e.g., dual cameras, triple camera, quad cameras, etc.) on the same side or different sides (e.g., a front camera, a back camera) of the computer system)). Some operations in method1200are, optionally, combined, the orders of some operations are, optionally, changed, and some operations are, optionally, omitted.

As described below, method1200provides an intuitive way for managing live communication between multiple participants. The method reduces the cognitive burden on a user for managing live communication between multiple participants, thereby creating a more efficient human-machine interface. For battery-operated computing devices, enabling a user to manage live communication between multiple participants faster and more efficiently conserves power and increases the time between battery charges.

In some embodiments, the computer system is in communication with a display generation component (e.g., a display controller, a touch-sensitive display system). In some embodiments, the computer system is in communication with one or more input devices (e.g., a touch-sensitive surface).

The computer system obtains (1200) (e.g., detects, obtains from memory, receives from a server, receives from a remote computer system, receives (e.g., capturing) data from one or more cameras or camera sensors of the computer system used by the first participant) (e.g., obtains at the computer system) information about gaze (e.g.,620a,622a,624a,626a,628a,632a,634a,636a,640a) of a first participant (e.g.,602a) in a video conference while the first participant, a second participant (e.g.,602b), and a third participant (e.g.,602c) are participating in the video conference. In a first video conference user interface (e.g.,612) for the first participant (1204), a characteristic location (e.g.,612b) of (e.g., a viewpoint of or a graphical representation of) the second participant in the first video conference user interface for the first participant is located in a first direction (e.g., a line-of sight, a path) from a characteristic location (e.g., location of602a) of (e.g., a viewpoint of or a graphical representation of) the first participant. In a second video conference user interface (e.g.,614) for the second participant (1206), a characteristic location (e.g., location of602b) of (e.g., a viewpoint of or a graphical representation of) the second participant is located in a second direction (e.g., a line-of sight, a path) from a characteristic location (e.g.,614a) of (e.g., a viewpoint of or a graphical representation of) the first participant in the second video conference user interface for the second participant, where the second direction is different from the first direction. In a third video conference user interface (e.g.,616) for the third participant (1208), a characteristic location (e.g.,616b) of (e.g., a viewpoint of or a graphical representation of) the second participant in the third video conference user interface for the third participant is located in a third direction (e.g., a line-of sight, a path) from a characteristic location (e.g.,616a) of (e.g., a viewpoint of or a graphical representation of) the first participant in the third video conference user interface for the third participant, where the third direction is different from the first direction (and is also different from the second direction). In some embodiments, information about a gaze of a respective participant in the video conference is obtained when a determination is made that the respective participant is a speaking, is/has a higher activity level than at least one of the other participants (or highest activity level) in the live video conference, is determined to be a presenter, etc.

The computer system, in response to obtaining the information about the gaze of the first participant (e.g.,602a), (e.g., toward the representation of the first participant in the video conference user interface for the first participant) provides (1210) information that indicates which characteristic location of (e.g., a viewpoint of or a graphical representation of) another participant the first participant is looking at to one or more devices (e.g.,600a,600b,600c) (e.g., computer systems) displaying representations (e.g., participant representations, representations of live video (e.g., that is being captured by the one or more devices), graphical representations) of the video conference to enable video conference user interfaces at the one or more devices to indicate at which characteristic location of (e.g., a viewpoint of or a graphical representation of) another participant the first participant is looking, including (e.g., where indicating which characteristic location of (e.g., a viewpoint of or a graphical representation of) another participant the first participant is looking at includes) in accordance with a determination that a first set of criteria is satisfied, where the first set of criteria includes a criterion that is satisfied when the first participant is looking in the first direction in the video conference, modifying (1212) (e.g., changing, providing an instruction that causes a computer system/device to modify) a representation (e.g.,614a) of a gaze direction (e.g., representation of the eyes of a participant, the head of a participant, a visual indication and/or emphasis (e.g., highlighting, enlarging, positioning (e.g., relative to another participant)) of a participant) of the first participant (e.g.,602a) in the second video conference user interface (e.g.,614) to indicate, in the second video conference user interface for the second participant (e.g.,602b), that the first participant (e.g.,602a) is looking in the second direction at the characteristic location (e.g., location of602b) of the second participant without modifying a representation (e.g.,616a) of a gaze direction of the first participant (e.g.,602a) in the third video conference user interface (e.g.,616) to indicate, in the third video conference user interface for the third participant, that the first participant (e.g.,602a) is looking at the third participant (e.g.,602c) (e.g., in a direction of or at a characteristic location of the third participant, in a direction of or at a characteristic location of the third participant that is displayed in the third user interface). In some embodiments, providing information that indicates which characteristic location of another participant that the first participant is looking at to the one or more devices includes modifying a representation of a gaze direction of the first participant in the second video conference user interface to indicate, in the second video conference user interface for the second participant, that the first participant is looking in the second direction at the characteristic location of the second participant in the second video conference user interface without modifying the representation of the gaze direction of the first participant to indicate that the first participant is looking in the third direction at the characteristic location of the second participant in the third video conference user interface. In some embodiments, modifying a representation of a gaze direction of the first participant in the second video conference user interface to indicate, in the second video conference user interface for the second participant, that the first participant is looking in the second direction at the characteristic location of the second participant in the second video conference user interface makes the gaze of the participant appear to be looking forward (e.g., head looking forward, eyes looking forward (e.g., head looking forward, eyes looking forward (e.g., eyes of the representation in a position that represents a forward gaze), eyes looking straight ahead (e.g., a straight ahead gaze with normal eye alignment), eyes looking forward with respect to a display of the another computer system in the second user interface). Providing information that includes modifying a representation of a gaze direction of the first participant in the second video conference user interface to indicate, in the second video conference user interface for the second participant, that the first participant is looking in the second direction at the characteristic location of the second participant without modifying a representation of a gaze direction of the first participant in the third video conference user interface to indicate, in the third video conference user interface for the third participant, that the first participant is looking at the third participant when the first set of criteria is satisfied provides a participant (e.g., second participant/third participant) with enhanced visual feedback about of the gaze of the first participant and allows the second participant (and/or the third participant) to quickly recognize whether or not the first participant is looking at the second participant (or the third participant). Providing improved visual feedback to the user enhances the operability of the system and makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently.

In some embodiments, in response to (1210) obtaining the information about the gaze of the first participant (e.g.,620a,622a,624a,626a,628a,632a,634a,636a,640a), (e.g., toward the representation of the first participant in the video conference user interface for the first participant), the computer system provides information that indicates which characteristic location of (e.g., a viewpoint of or a graphical representation of) another participant the first participant (e.g.,602a) is looking at to the one or more devices (e.g.,600a,600b,600c) displaying representations of the video conference to enable video conference user interfaces at the one or more devices to indicate at which characteristic location of (e.g., a viewpoint of or a graphical representation of) another participant the first participant (e.g.,602a) is looking. In some embodiments, indicating which characteristic location of (e.g., a viewpoint of or a graphical representation of) another participant the first participant is looking at includes: in accordance with the determination that the first set of criteria is satisfied, modifying (1214) the representation (e.g.,616a) of the gaze direction of the first participant (e.g.,602a) in the third video conference user interface (e.g.,616) to indicate, in the third video conference user interface for the third participant, that the first participant (e.g.,602a) is looking in the third direction at the characteristic location (e.g.,616b) of the second participant (e.g.,602b) in the third video conference user interface (e.g.,616). Providing information that includes modifying the representation of the gaze direction of the first participant in the third video conference user interface to indicate, in the third video conference user interface for the third participant, that the first participant is looking in the third direction at the characteristic location of the second participant in the third video conference user interface when the first set of criteria is satisfied provides a user (e.g., third participant) with enhanced visual feedback about of the gaze of the first participant and allows the third participant to quickly recognize that the first participant is looking at the second participant. Providing improved visual feedback to the user enhances the operability of the system and makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently.

In some embodiments, in the first video conference user interface (e.g.,612) for the first participant (e.g.,602a), a characteristic location (e.g.,612c) of (e.g., a viewpoint of or a graphical representation of) the third participant (e.g.,602c) in the first video conference user interface (e.g.,612) for the first participant is located in a fourth direction (e.g., a line-of sight, a path) from the characteristic location of (e.g., a viewpoint of or a graphical representation of) the first participant. In some embodiments, in the second video conference user interface (e.g.,614) for the second participant (e.g.,602b), a characteristic location (e.g.,614c) of (e.g., a viewpoint of or a graphical representation of) the third participant in the second video conference user interface for the second participant is located in a fifth direction (e.g., a line-of sight, a path, defined by a degree of direction) from the characteristic location (e.g.,614a) of (e.g., a viewpoint of or a graphical representation of) the first participant in the second video conference user interface for the second participant, where the fifth direction is different from the fourth direction. In some embodiments, in the third video conference user interface (e.g.,616) for the third participant, a characteristic location (e.g., location of602c) of (e.g., a viewpoint of or a graphical representation of) the third participant is located in a sixth direction from the characteristic location (e.g.,616a) of (e.g., a viewpoint of or a graphical representation of) the first participant in the third video conference user interface for the third participant, where the sixth direction (e.g., a line-of sight, a path) is different from the fourth direction (and is also different from the fifth direction). In some embodiments, in response to obtaining the information about the gaze (e.g.,620a,622a,624a,626a,628a,632a,634a,636a,640a) of the first participant, (e.g., toward the representation of the first participant in the video conference user interface for the first participant), the computer system provides information that indicates which characteristic location of (e.g., a viewpoint of or a graphical representation of) another participant the first participant is looking at to the one or more devices displaying representations of the video conference to enable video conference user interfaces at the one or more devices to indicate at which characteristic location of (e.g., a viewpoint of or a graphical representation of) another participant the first participant is looking. In some embodiments, indicating which characteristic location of (e.g., a viewpoint of or a graphical representation of) another participant the first participant is looking at includes: in accordance with a determination that the first participant (e.g.,602a) is looking in the fourth direction in the video conference (e.g., at a representation of the third participant in the first video conference user interface), modifying the representation (e.g.,616a) of the gaze direction of the first participant in the third video conference user interface (e.g.,616) to indicate, in the third video conference user interface for the third participant, that the first participant (e.g.,602a) is looking in the sixth direction at the characteristic location (e.g., location of602c) of the third participant without modifying the representation (e.g.,614a) of the gaze direction of the first participant in the second video conference user interface (e.g.,614) to indicate, in the second video conference user interface for the second participant, that the first participant (e.g.,602a) is looking at the second participant (e.g.,602b) (e.g., without modifying the representation of the gaze direction of the first participant in the second video conference user interface to indicate, in the second video conference user interface for the second participant, that the first participant is looking in the second direction at the characteristic location of the second participant in the second video conference user interface). In some embodiments, providing information that indicates which characteristic location of another participant that the first participant is looking at to the one or more devices includes modifying the representation of the gaze direction of the first participant in the third video conference user interface to indicate, in the third video conference user interface for the third participant, that the first participant is looking in the sixth direction at the characteristic location of the third participant without modifying a representation of a gaze direction of the first participant in the second video conference user interface to indicate, in the second video conference user interface for the second participant, that the first participant is looking in the fifth direction at the characteristic location of the third participant in the second video conference user interface. In some embodiments, modifying the representation of the gaze direction of the first participant in the third video conference user interface to indicate, in the third video conference user interface for the third participant, that the first participant is looking in the sixth direction at the characteristic location of the third participant makes the gaze of the participant appear to be looking forward (e.g., head looking forward, eyes looking forward (e.g., eyes of the representation in a position that represents a forward gaze), eyes looking straight ahead (e.g., a straight ahead gaze with normal eye alignment), eyes looking forward with respect to a display of the another computer system in the second user interface). Providing information that includes modifying the representation of the gaze direction of the first participant in the third video conference user interface to indicate, in the third video conference user interface for the third participant, that the first participant is looking in the sixth direction at the characteristic location of the third participant without modifying the representation of the gaze direction of the first participant in the second video conference user interface to indicate, in the second video conference user interface for the second participant, that the first participant is looking at the second participant when the first participant is looking in the fourth direction in the video conference provides a user (e.g., second participant/third participant) with enhanced visual feedback about of the gaze of the first participant and allows the third participant (and/or the second participant) to quickly recognize whether or not the first participant is looking at the third participant (or the second participant). Providing improved visual feedback to the user enhances the operability of the system and makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently.

In some embodiments, in response to obtaining the information about the gaze (e.g.,620a,622a,624a,626a,628a,632a,634a,636a,640a) of the first participant (e.g.,602a), (e.g., toward the representation of the first participant in the video conference user interface for the first participant) the computer system provides information that indicates which characteristic location of (e.g., a viewpoint of or a graphical representation of) another participant the first participant is looking at to the one or more devices displaying representations of the video conference to enable video conference user interfaces at the one or more devices to indicate at which characteristic location of (e.g., a viewpoint of or a graphical representation of) another participant the first participant is looking. In some embodiments, indicating which characteristic location of (e.g., a viewpoint of or a graphical representation of) another participant the first participant is looking at includes: in accordance with a determination that the first participant (e.g.,602a) is looking in the fourth direction in the video conference (e.g., at a representation of the third participant in the first video conference user interface), modifying a representation (e.g.,614a) of a gaze direction of the first participant (e.g.,602a) in the second video conference user interface to indicate (e.g.,615), in the second video conference user interface for the second participant, that the first participant is looking in the fifth direction at the characteristic location (e.g.,614c) of the third participant (e.g.,602c) in the second video conference user interface (e.g.,614). In some embodiments, the representation of the gaze direction for a participant who is looking at a respective participant is modified on a video conference user interface for a different respective participant so that the different respective participant is notified that the participant is looking at the respective participant (and not the different respective participant). Providing information that includes modifying a representation of a gaze direction of the first participant in the second video conference user interface to indicate, in the second video conference user interface for the second participant, that the first participant is looking in the fifth direction at the characteristic location of the third participant in the second video conference user interface when the first participant is looking in the fourth direction in the video conference provides a user (e.g., second participant) with enhanced visual feedback about of the gaze of the first participant and allows the second participant to quickly recognize that the first participant is looking at the third participant. Providing improved visual feedback to the user enhances the operability of the system and makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently.

In some embodiments, in response to obtaining information about gaze (e.g.,628b,630b,632b,634b,636b,640b) of the second participant (e.g.,602b) (and while providing information that indicates which characteristic location of (e.g., a viewpoint of or a graphical representation of) another participant the first participant is looking at to the one or more devices displaying representations of the video conference to enable video conference user interfaces at the one or more devices to indicate at which characteristic location of (e.g., a viewpoint of or a graphical representation of) another participant the first participant is looking and in accordance with the determination that the first participant is looking in the first direction in the video conference), the computer system provides information that indicates which characteristic location (e.g., a viewpoint of or a graphical representation of) of another participant the second participant (e.g.,602b) is looking at to the one or more devices (e.g.,600a,600b,600c) displaying representations of the video conference to enable video conference user interfaces at the one or more devices to indicate at which characteristic location of (e.g., a viewpoint of or a graphical representation of) another participant the second participant is looking, including in accordance with a determination that the second participant is looking in the second direction: modifying a representation (e.g.,612b) of a gaze direction of the second participant (e.g.,602b) in the first video conference user interface (e.g.,612) to indicate, in the first video conference user interface for the first participant, that the second participant (e.g.,602b) is looking (e.g., in a direction that is opposite of the first direction, a direction that is a reciprocal direction to the first direction) at the characteristic location (e.g., location of602a) of the first participant (e.g.,602a) without modifying a representation (e.g.,616b) of a gaze direction of the second participant in the third video conference user interface (e.g.,616) to indicate, in the third video conference user interface for the third participant, that the second participant is looking at the third participant. Providing information that includes modifying a representation of a gaze direction of the second participant in the first video conference user interface to indicate, in the first video conference user interface for the first participant, that the second participant is looking at the characteristic location of the first participant without modifying a representation of a gaze direction of the second participant in the third video conference user interface to indicate, in the third video conference user interface for the third participant, that the second participant is looking at the third participant provides a user with enhanced visual feedback about of the gaze of the a participant that is different from the first participant and allows the user to quickly recognize whether or not the participant other than the first participant is looking at the user. Providing improved visual feedback to the user enhances the operability of the system and makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently.

In some embodiments, the representation of a gaze direction of the second participant in the first video conference user interface is modified to indicate, in the first video conference user interface for the first participant, that the second participant is looking (e.g., in a direction that is opposite of the first direction, a direction that is a reciprocal direction to the first direction) at the characteristic location of the first participant without modifying a representation of a gaze direction of the second participant in the third video conference user interface to indicate, in the third video conference user interface for the third participant, that the second participant is looking at the third participant concurrently with modifying a representation of a gaze direction of the first participant in the second video conference user interface to indicate, in the second video conference user interface for the second participant, that the first participant is looking in the second direction at the characteristic location of the second participant without modifying a representation of a gaze direction of the first participant in the third video conference user interface to indicate, in the third video conference user interface for the third participant, that the first participant is looking at the third participant. In some embodiments, representation of the gaze of one participant is concurrently modified with the representation of the gaze of another participant. In some embodiments, the representation of the gaze direction of the second participant is modified in the third user interface (and, in some embodiments, concurrently modified with the gaze direction of the first participant in the third user interface). In some embodiments, while providing information that indicates which characteristic location of (e.g., a viewpoint of or a graphical representation of) another participant the first participant is looking at to the one or more devices displaying representations of the video conference to enable video conference user interfaces at the one or more devices to indicate which characteristic location of (e.g., a viewpoint of or a graphical representation of) another participant the first participant is looking in accordance with the determination that the first participant is looking in the first direction in the video conference and in response to obtaining information about the gaze of the second participant: providing information that indicates which characteristic location (e.g., a viewpoint of or a graphical representation of) of another participant the second participant is looking at to the one or more devices displaying representations of the video conference to enable video conference user interfaces at the one or more devices to indicate at which characteristic location of (e.g., a viewpoint of or a graphical representation of) another participant the second participant is looking includes, in accordance with the determination that the second participant is looking in the second direction, modifying the representation of the gaze direction of the second participant in the third video conference user interface to indicate, in the third video conference user interface for the third participant, that the second participant is looking (e.g., in a direction that is opposite of the third direction, a direction that is a reciprocal direction to the third direction) at the characteristic location of the first participant in the third video conference user interface.

In some embodiments, the first set of criteria includes a criterion that is satisfied when the first participant is determined to be a presenter in the live video conference. In some embodiments the first participant is determined to be a presenter when the first participant is determined to be actively communicating or communicating above a threshold amount in the live video conference. In some embodiments, the first set of criterion includes the criterion that is satisfied when the first participant is determined to be a presenter in the live video conference when the live video conference is in a presenter (e.g., screen sharing, teacher, lecturer, etc.) mode. In some embodiments, in response to obtaining the information about the gaze of the first participant, (e.g., toward the representation of the first participant in the video conference user interface for the first participant) providing information that indicates which characteristic location of (e.g., a viewpoint of or a graphical representation of) another participant the first participant is looking at to the one or more devices displaying representations of the video conference to enable video conference user interfaces at the one or more devices to indicate at which characteristic location of (e.g., a viewpoint of or a graphical representation of) another participant the first participant is looking includes, in accordance with a determination that the first set of criteria is not satisfied (e.g., because the first participant is determined to not be presenting in the live communication session), forgoing modifying the representation of the gaze direction (e.g., representation of the eyes of a participant, the head of a participant, a visual indication and/or emphasis (e.g., highlighting, enlarging, positioning (e.g., relative to another participant)) of a participant) of the first participant in the second video conference user interface to indicate, in the second video conference user interface for the second participant, that the first participant is looking in the second direction at the characteristic location of the second participant in the second video conference user interface without modifying the representation of the gaze direction of the first participant in the third video conference user interface to indicate, in the third video conference user interface for the third participant, that the first participant is looking at the third participant. In some embodiments, in response to obtaining the information about the gaze of the first participant, (e.g., toward the representation of the first participant in the video conference user interface for the first participant) providing information that indicates which characteristic location of (e.g., a viewpoint of or a graphical representation of) another participant the first participant is looking at to the one or more devices displaying representations of the video conference to enable video conference user interfaces at the one or more devices to indicate at which characteristic location of (e.g., a viewpoint of or a graphical representation of) another participant the first participant is looking, including in accordance with a determination the set of first criteria is not satisfied (e.g., because the first participant is determined to not be presenting in the live communication session), forgoing modifying the representation of the gaze direction of the first participant in the third video conference user interface to indicate, in the third video conference user interface for the third participant, that the first participant is looking in the third direction at the characteristic location of the second participant in the third video conference user interface.

In some embodiments, the determination that the first participant (e.g.,602a) is looking in the first direction in the video conference is made when the participant is determined to be looking in one or more directions (e.g., indicated by620a,622a,624a,626a,628a,632a,634a,636a,640a) that correspond to (e.g., are within an angular threshold (e.g., 1-20 degrees) of, are associated with) the first direction. In some embodiments, at least one of the one or more directions is different from the first direction. In some embodiments, the gaze direction correction is not symmetrical to the direction in which the first participant is looking (e.g., when the first participant is detected to be looking in a direction that is within one or more degrees (to the right, left, up, down, right, etc.) of the characteristic location of the second participant in the first user interface (e.g., or the second participant), the representation of the gaze of the first participant can be corrected in the second video conference user interface for the second participant such that the first participant is looking at the second participant).

In some embodiments, in response to obtaining the information about the gaze (e.g.,626a,820a) of the first participant (e.g.,602a), the computer system provides information that indicates which characteristic location of another participant the first participant is looking at to the one or more devices (e.g.,600a,600b,600c) displaying representations of the video conference to enable video conference user interfaces at the one or more devices to indicate which characteristic location of another participant the first participant is looking includes, in accordance with a determination that the first participant is looking in a direction of a camera (e.g.,600a1) (e.g., a camera in communication with a device (and/or computer system) of the first participant) (e.g., and not in the first direction in the video conference), modifying a representation (e.g.,614a) of a gaze direction of the first participant in the second video conference user interface (e.g.,614) to indicate, in the second video conference user interface (e.g.,614) for the second participant (e.g.,602b), that the first participant (e.g.,602a) is not looking in the second direction at the characteristic location (e.g., location of602b) of the second participant (and, in some embodiments, irrespective of whether the representation of the gaze direction of the first participant in the third video conference user interface is or is not modified to indicate, in the third video conference user interface for the third participant, that the first participant is looking at the third participant). Providing information that includes modifying a representation of a gaze direction of the first participant in the second video conference user interface to indicate, in the second video conference user interface for the second participant, that the first participant is not looking in the second direction at the characteristic location of the second participant when the first participant is looking in a direction of a camera provides a user with visual feedback that the first participant is not looking at the second participant in situations where the first participant is looking at a camera and not the second participant. Providing improved visual feedback to the user enhances the operability of the system and makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently.

In some embodiments, in response to obtaining the information (e.g.,622a,624a) about the gaze of the first participant (e.g.,602a), the computer system provides information that indicates which characteristic location of another participant the first participant is looking at to the one or more devices displaying representations of the video conference to enable video conference user interfaces at the one or more devices to indicate which characteristic location of another participant the first participant is looking includes: in accordance with a determination that the first participant (e.g.,602a) is looking in a direction (e.g., indicated by622a) that corresponds to a predefined set of locations (e.g.,612) (e.g., locations on a display screen) (e.g., participant is looking within a particular area of the display screen, participant is looking at the display screen), modifying a representation (e.g.,614a,616a) of a gaze direction of the first participant in the video conference (e.g., as discussed above (e.g.,1212,1214)) (e.g., modifying (e.g., changing, providing an instruction that causes a computer system/device to modify) a representation of a gaze direction (e.g., representation of the eyes of a participant, the head of a participant, a visual indication and/or emphasis (e.g., highlighting, enlarging, positioning (e.g., relative to another participant)) of a participant) of the first participant in the second video conference user interface to indicate, in the second video conference user interface for the second participant, that the first participant is looking in the second direction at the characteristic location of the second participant without modifying a representation of a gaze direction of the first participant in the third video conference user interface to indicate, in the third video conference user interface for the third participant, that the first participant is looking at the third participant); and in accordance with a determination that the first participant (e.g.,602a) is not looking in a direction (e.g., indicated by gaze624aof participant602a) that corresponds to the predefined set of locations (e.g.,608) (e.g., participant is looking outside a particular area of the display screen, participant is not looking at the display screen), forgoing modifying the representation (e.g.,614a,616ainFIG.6C) of the gaze direction of the first participant in the video conference (or, in some embodiments, modifying the representation of the gaze direction of the first participant in the video conference, such that the representation of the gaze of the first participant is not directed at any participant in the video conference in the user interface on the device that is associated with the first participant and/or in the user interface on devices that are associated with participants other than the first participant). Choosing whether to modify or not modify a representation of a gaze direction of the first participant based on whether or not the first participant is looking in a direction that corresponds to a predefined set of locations allows the system to provide information to correct the representation of the gaze direction based on whether the first participant is looking within the predefined set of locations. Performing an operation when a set of conditions has been met without requiring further user input enhances the operability of the system and makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the device more quickly and efficiently.

In some embodiments, the set of locations includes a plurality of locations (e.g.,612and608) on a display screen (e.g., the display screen is a display screen on which the first video conference user interface for the first participant is displayed). In some embodiments, the set of locations does not include a plurality of locations outside (e.g., not on) the display screen on which the first video conference user interface for the first participant is displayed. Choosing whether to modify or not modify a representation of a gaze direction of the first participant based on whether or not the first participant is looking in a direction that corresponds to a predefined set of locations allows the system to provide information to correct the representation of the gaze direction based on whether the first participant is looking at the display screen. Performing an operation when a set of conditions has been met without requiring further user input enhances the operability of the system and makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the device more quickly and efficiently.

In some embodiments, the set of locations includes a plurality of locations (e.g.,612) on a display screen at which the first video conference user interface for the first participant is displayed and does not includes a plurality of locations (e.g.,608) on the display screen at which the first video conference user interface for the first participant is not displayed. Choosing whether to modify or not modify a representation of a gaze direction of the first participant based on whether or not the first participant is looking in a direction that corresponds to a predefined set of locations allows the system to provide information to correct the representation of the gaze direction based on whether the first participant is looking at a particular portion of the display screen. Performing an operation when a set of conditions has been met without requiring further user input enhances the operability of the system and makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the device more quickly and efficiently.

In some embodiments, modifying the representation (e.g.,614a) of the gaze direction of the first participant in the second video conference user interface (e.g.,614) to indicate, in the second video conference user interface for the second participant (e.g.,602b), that the first participant (e.g.,602a) is looking in the second direction at the characteristic location (e.g., location of602b) of the second participant includes modifying a representation (e.g.,614a) of a head of the first participant and a representation of eyes of the first participant (e.g., changed) (e.g., shift head, eyes; rotate/tilt head; move head/eyes laterally) in the second video conference user interface for the second participant. Modifying a representation of a head of the first participant and a representation of eyes of the first participant when the representation of the gaze direction of the first participant in the second video conference user interface is modified to indicate, in the second video conference user interface for the second participant, that the first participant is looking in the second direction at the characteristic location of the second participant allows a user (e.g., a second participant) to quickly identify that the heads and eyes of the first participant are facing the second participant while the first participant is participating in the live video conference. Providing improved visual feedback to the user enhances the operability of the system and makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently.

In some embodiments, the first participant (e.g.,602a) and a fourth participant (e.g.,902a) are both in a field-of-view of a camera (e.g.,600a1) (e.g., a single camera). In some embodiments, in the second video conference user interface (e.g.,614) for the second participant, a representation (e.g.,914a2) of a direction of gaze of the first participant is adjusted separately from adjustment of a representation (e.g.,914a1) of a direction of gaze of the fourth participant. In some embodiments, the first participant and the fourth participant are displayed in separate user interface regions in the second video conference user interface to enabled the representation of gaze of the first participant and the representation of gaze of the fourth participant to be adjusted separately (e.g., while, in the second video user interface for the second participant, the characteristic location of the second participant is located in the second direction from the characteristic location of the first participant in the second video conference user interface for the second participant). In some embodiments, in the first video conference user interface for the first participant, a characteristic location of the second participant in the first video conference user interface for the first participant is located in the first direction from a characteristic location of the fourth participant. In some embodiments, in the third video conference user interface for the third participant, the characteristic location of the second participant in the third video conference user interface for the third participant is located in the third direction from the characteristic location of the first participant in the third video conference user interface for the third participant and the characteristic location of the second participant in the third video conference user interface for the third participant is located in the seventh direction from the characteristic location of the fourth participant in the third video conference user interface for the third participant, where the third direction is different from the seventh direction. Having a second video conference user interface for the second participant where a representation of a direction of gaze of the first participant is adjusted separately from adjustment of a representation of a direction of gaze of the fourth participant while both the first participant and the fourth participant are in the field-of-view of a camera allows the user to quickly distinguish between the different gazes of multiple users that are in the field-of-view of the same camera. Providing improved visual feedback to the user enhances the operability of the system and makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently.

In some embodiments, in response to obtaining information about gaze (e.g.,920a1) of the fourth participant (e.g.,902a) (and while providing information that indicates which characteristic location of (e.g., a viewpoint of or a graphical representation of) another participant the first participant is looking at to the one or more devices displaying representations of the video conference to enable video conference user interfaces at the one or more devices to indicate at which characteristic location of (e.g., a viewpoint of or a graphical representation of) another participant the first participant is looking and in accordance with the determination that the first participant is looking in the first direction in the video conference), the computer system provides information that indicates which characteristic location (e.g., a viewpoint of or a graphical representation of) of another participant the fourth participant is looking at to the one or more devices displaying representations of the video conference to enable video conference user interfaces at the one or more devices to indicate at which characteristic location of (e.g., a viewpoint of or a graphical representation of) another participant the fourth participant is looking, including in accordance with a determination that the fourth participant is looking in the first direction (and, in some embodiments, in accordance with a determination that the first participant is not looking in the first direction): modifying a representation (e.g.,914a1) of a gaze direction of the fourth participant in the second video conference user interface to indicate, in the second video conference user interface (e.g.,614) for the second participant, that the fourth participant (e.g.,902a) is looking in the seventh direction at the characteristic location of the second participant (e.g.,602b) without modifying (e.g.,914a2) a representation of the gaze direction of the first participant (e.g.,602a) in the second video conference user interface to indicate, in the second video conference user interface (e.g.,614) for the second participant, that the first participant is looking in the second direction at the characteristic location of the second participant (and without modifying a representation of a gaze direction of the fourth participant in the third video conference user interface to indicate, in the third video conference user interface for the third participant, that the fourth participant is looking at the third participant).

In some embodiments, in response to obtaining the information about the gaze of the first participant, the computer system provides information that indicates which characteristic location of another participant the first participant is looking at to the one or more devices displaying representations of the video conference to enable video conference user interfaces at the one or more devices to indicate at which characteristic location of another participant the first participant is looking includes, in accordance with the determination the first set of criteria is satisfied: modifying the representation (e.g.,614a) of the gaze direction of the first participant in the second video conference user interface (e.g.,614) to indicate, in the second video conference user interface for the second participant, that the first participant is looking in the second direction at the characteristic location of the second participant includes applying a first modification (e.g., changing the eye position of a representation of a participant, changing the head position of a representation of a participant, changing a position of the representation of a participant, changing the highlighting of representation of a participant, changing the text of representation of a participant, changing the location of the representation of the participant, changing a visual indication of the representation of the participant that is displayed on another representation of a participant); and modifying a representation (e.g.,616a) of the gaze direction of the first participant in the third video conference user interface (e.g.,616) to indicate, in the third video conference user interface for the third participant, that the first participant is looking in the third direction at the characteristic location of the second participant in the third video conference user interface, where modifying the representation of the gaze direction of the first participant in the third video conference user interface includes applying a second modification different from the first modification (e.g., changing the eye position of a representation of a participant, changing the head position of a representation of a participant, changing a position of the representation of a participant, changing the highlighting of representation of a participant, changing the text of representation of a participant, changing the location of the representation of the participant, changing a visual indication of the representation of the participant that is displayed on another representation of a participant) that is different from the first modification (e.g., second modification includes a change in eye/head in a direction that is different the change in eye/head direction included in the first modification).

In some embodiments, the representation (e.g.,614a,616a, indicated by1120) of the gaze direction of the first participant includes a computer-generated (e.g., created by a computer system/device using one or more captured images) three-dimensional graphical representation. In some embodiments, modifying the representation of the gaze direction of the first participant in the second video conference user interface to indicate, in the second video conference user interface for the second participant, that the first participant is looking in the second direction at the characteristic location of the second participant includes manipulating live media (e.g., video, photo media) of the first participant to include a three-dimensional representation, where the head, eyes, body of the first participant in the three-dimensional representation has been changed (e.g., positioned differently, manipulated in three-dimensional space) from the head, eyes, body of the first participant that were actually captured in the live media. In some embodiments, the computer-generated three-dimensional representation is generated from an image of the face of a participant that has been taken from a particular angle. In some embodiments, the computer-generated three-dimensional graphical representation could be a three-dimensional graphical representation that is displayed in a virtual reality and/or augmented reality environment (or context). In some embodiments, the computer system (and/or one or more of the computer systems displaying the first video conference interface, the second video conference interface, and/or the third video conference interface) is a head-mounted display device displaying a virtual reality and/or augmented reality environment that includes the three-dimensional graphical representation. Modifying a representation of the first participant that includes a three-dimensional graphical representation allows a user (e.g., a second participant) to quickly identify where the first participant is looking in three-dimensional space. Providing improved visual feedback to the user enhances the operability of the system and makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently.

In some embodiments, the first video conference user interface (e.g.,612) includes a representation (e.g.,612b) of the second participant (e.g.,602b). In some embodiments, in response to obtaining the information about the gaze (e.g.,620a,622a,624a,626a,628a,632a,634a,636a,640a) of the first participant (e.g.,602a), the computer system provides information that indicates which characteristic location of another participant the first participant is looking at to the one or more devices displaying representations of the video conference to enable video conference user interfaces at the one or more devices to indicate at which characteristic location of another participant the first participant is looking. In some embodiments, indicating which characteristic location of (e.g., a viewpoint of or a graphical representation of) another participant the first participant is looking at includes, in accordance with the determination the first set of criteria is satisfied, visually distinguishing the representation (e.g.,612b) (e.g., a graphical representation (e.g., text, image, video, etc.)) of the second participant (e.g., displayed at the characteristic location of the second participant in the first video conference user interface for the first participant), included in the first video conference user interface (e.g.,612) for the first participant (e.g.,602a) (e.g., increasing/decreasing the size of a representation, changing location of a representation (e.g., in a respective user interface), highlighting/ceasing to highlight a representation, changing color of a representation, emphasizing/de-emphasizing a representation relative to other representations and/or user interface objects) (e.g., visually distinguishing the representation of the second participant, included in the first video conference user interface for the first participant, from one or more representations of other participants in the first video user interface for the first participant). In some embodiments, in accordance with the determination the first set of criteria is satisfied, the representation of the second participant included in the third video conference user interface for the third participant is visually distinguished (and, in some embodiments, the representation of the second participant included in the third video conference user interface for the third participant is distinguished in the same way as the representation of the second participant included in the first video conference user interface for the first participant). Providing information that visually distinguishing the representation, included in the first video conference user interface for the first participant when the first set of criteria is satisfied allows a user (e.g., first participant) to quickly recognize that the first participant is looking at the second participant. Providing improved visual feedback to the user enhances the operability of the system and makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently.

In some embodiments, the second video conference user interface (e.g.,614) includes a representation (e.g.,614a) of the first participant (e.g.,602a) (e.g., a graphical representation (e.g., text, image, video, etc.) displayed at the characteristic location of the first participant in the second video conference user interface for the second participant). In some embodiments, modifying the representation (e.g.,614a) of the gaze direction of the first participant in the second video conference user interface (e.g.,614) to indicate, in the second video conference user interface for the second participant, that the first participant is looking in the second direction at the characteristic location of the second participant includes visually distinguishing the representation of the first participant (602a), included in the second video conference user interface (e.g.,614) for the second participant (e.g.,602b) (e.g., increasing/decreasing the size of a representation, changing location of a representation (e.g., in a respective user interface), highlighting/ceasing to highlight a representation, changing color of a representation, emphasizing/de-emphasizing a representation relative to other representations and/or user interface objects) (e.g., visually distinguishing the representation of the first participant, included in the second video conference user interface for the second participant, from one or more representations of other participants in the second video user interface for the second participant). In some embodiments, in accordance with the determination the first set of criteria is satisfied, the representation of the first participant included in the third video conference user interface for the third participant is visually distinguished (and, in some embodiments, the representation of the first participant included in the third video conference user interface for the third participant is distinguished in the same way as the representation of the first participant included in the second video conference user interface for the second participant). Providing information that visually distinguishes the representation of the first participant, included in the second video conference user interface for the second participant when the first set of criteria is satisfied allows a user (e.g., second participant) to quickly recognize that the first participant is looking at the second participant. Providing improved visual feedback to the user enhances the operability of the system and makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently.

In some embodiments, in accordance with the determination that the first set of criteria is satisfied (and in response to obtaining the information about the gaze of the first participant, the computer system provides information that indicates which characteristic location of another participant the first participant is looking at to the one or more devices displaying representations of the video conference to enable video conference user interfaces at the one or more devices to indicate at which characteristic location of another participant the first participant is looking includes), modifying the representation (e.g.,616a) of the gaze direction of the first participant (e.g.,602a) in the third video conference user interface (e.g.,616) to indicate, in the third video conference user interface for the third participant, that the first participant is looking in the third direction at the characteristic location of the second participant in the third video conference user interface, where modifying the representation of the gaze direction of the first participant in the third video conference user interface includes: displaying, in the third video conference user interface (e.g.,616), a representation (e.g.,692b,692c,692a) (e.g., a name, a face, a color associated with the first participant, an icon associated with the first participant) of the first participant adjacent to (e.g., on top of) a representation of the second participant that is displayed at the characteristic location of the second participant in the third video conference user interface. In some embodiments, the representation of the first participant that is displayed adjacent to the representation of the second participant is smaller than the representation of the second participant. In some embodiments, the representation of the first participant that is displayed adjacent to the representation of the second participant is a non-live representation (e.g., a still image, text, visual indication, non-animated) while the representation of the second participant is a live representation (e.g., live video (a live video stream)) (e.g., on the third video conference user interface). In some embodiments, a second representation of the first participant is displayed concurrently with the representation of the first participant that is displayed adjacent to the representation of the second participant (e.g., on the third video conference user interface). In some embodiments, the second representation of the first participant is bigger than the representation of the first participant that is displayed adjacent to the representation of the second participant (e.g., on the third video conference user interface). In some embodiments, the second representation of the first participant is not displayed adjacent to a representation of a participant (e.g., on the third video conference user interface). In some embodiments, the second representation of the first participant was displayed before the representation of the first participant that is displayed adjacent to the second representation of the second participant (e.g., on the third video conference user interface). In some embodiments, the representation of the first participant continues to be displayed after the representation of the first participant that is displayed adjacent to the representation of the second participant ceases to be displayed (e.g., on the third video conference user interface). Providing information that causes the display of, in the third video conference user interface, a representation of the first participant adjacent to be a representation of the second participant that is displayed at the characteristic location of the second participant in the third video conference user interface allows a user to quickly recognize that the first participant is looking at the second participant and/or vice-versa. Providing improved visual feedback to the user enhances the operability of the system and makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently.

In some embodiments, in response to obtaining the information about the gaze (e.g.,636a) of the first participant (e.g.,602a), the computer system provides information that indicates which characteristic location of another participant the first participant is looking at to the one or more devices (e.g.,600a,600b,600c) displaying representations of the video conference to enable video conference user interfaces at the one or more devices to indicate at which characteristic location of another participant the first participant is looking. In some embodiments, indicating which characteristic location of (e.g., a viewpoint of or a graphical representation of) another participant the first participant is looking at includes in accordance with a determination that the first set of criteria is satisfied, moving a representation (e.g.,612b) of the second participant displayed at the characteristic location of (e.g., a viewpoint of or a graphical representation of) the second participant in the first video conference user interface for the first participant closer to a location of a camera of a device that is displaying the first video conference user interface (and/or closer to a location of a predetermined location on the first video conference user interface). In some embodiments, the location of the camera of the device that is displaying the first video conference user interface is adjacent to and/or the closet point, on the display screen of the device that is displaying the second conference user interface, to the location of the camera of the device that is displaying the first video conference user interface. Providing information that moves a representation of the second participant displayed at the characteristic location of the second participant in the first video conference user interface for the first participant closer to a location of a camera of a device that is displaying the first video conference user interface when the first set of criteria is satisfied allows the first participant to quickly identify that the first participant is looking at the second participant. Providing improved visual feedback to the user enhances the operability of the system and makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently.

In some embodiments, modifying the representation (e.g.,614ainFIG.6J) of the gaze direction of the first participant in the second video conference user interface to indicate, in the second video conference user interface for the second participant, that the first participant is looking in the second direction at the characteristic location of the second participant includes moving a representation (e.g.,614a) of the first participant that is displayed in the second video conference user interface closer to a location of a camera of a device that is displaying the second video conference user interface. In some embodiments, the location of the camera of the device that is displaying the second video conference user interface is adjacent to and/or the closet point, on the display screen of the device that is displaying the second conference user interface, to the location of the camera of the device that is displaying the second video conference user interface. Providing information that moves a representation of the first participant that is displayed in the second video conference user interface closer to a location of a camera of a device that is displaying the second video conference user interface when the first set of criteria is satisfied allows the second participant to quickly identify that the first participant is looking at the second participant and positions the second participant's gaze closer to the position of the camera when the second participant is looking at the representation of the first participant in the second video conference user interface. Providing improved visual feedback to the user enhances the operability of the system and makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently.

In some embodiments, before obtaining information about the gaze of the first participant in a video conference and while the first participant, the second participant, and the third participant are participating in the video conference, the second video conference user interface is displayed on a first device (e.g.,600b) that is associated with the second participant and includes a first representation (e.g.,614a) of the first participant in the second video conference user interface (e.g.,614) for the second participant (e.g.,602b). In some embodiments, in response to obtaining the information about the gaze of the first participant and in accordance with a determination that a first set of criteria is satisfied (and, in some embodiments, while the second video conference user interface is displayed on the first device that is associated with the second participant, modifying the representation of the gaze direction of the first participant in the second video conference user interface to indicate, in the second video conference user interface for the second participant, that the first participant is looking in the second direction at the characteristic location of the second participant includes), the computer system causes a second device (e.g.,800d) that is associated with the second participant (e.g.,602b) to display a seventh video conference user interface for the second participant that includes a second representation (e.g.,614d) of the first participant (e.g.,602a) in the seventh video conference user interface for the second participant (e.g., where the second representation of the first participant in the seventh video conference user interface was not displayed before the first set of criteria was satisfied). In some embodiments, the first representation of the first participant ceases to be displayed within a predetermined period of time (e.g., 0-5 seconds) after (or before) the second video conference user interface for the second participant is displayed. In some embodiments, the seventh video conference user interface for the second participant includes less representations of participants than the second video conference user interface for the second participant. In some embodiments, while the second video conference user interface is displayed on the first device that is associated with the second participant and includes the first representation of the first participant in the second video conference user interface for the second participant, a camera of the first device is activated (or is capturing) to capture data (e.g., image data) related to the field-of-view of the camera of the first device (e.g., of the participant using the first device). In some embodiments, in accordance with a determination that a first set of criteria is satisfied (and while the second device is displaying the seventh video conference user interface for the second participant that includes the second representation of the first participant in the seventh video conference user interface for the second participant), a camera of the second device is activated (or is capturing) to capture data (e.g., image data) related to the field-of-view of the camera of the second device (e.g., of the participant using the first device). In some embodiments, in accordance with a determination that a first set of criteria is satisfied (and while the second device is displaying the seventh video conference user interface for the second participant that includes the second representation of the first participant in the seventh video conference user interface for the second participant), the camera of the first device is deactivated and/or not capturing data (e.g., image data) related to the field-of-view of the camera of the first device (e.g., of the participant using the first device) (e.g., while the camera of the second device is activated). Causing a second device that is associated with the second participant to display a seventh video conference user interface for the second participant that includes a second representation of the first participant in the second video conference user interface for the second participant allows a user to quickly identify that a particular participant (e.g., first participant) is looking at the user (e.g., second user). Providing improved visual feedback to the user enhances the operability of the system and makes the user-system interface more efficient (e.g., by helping the user to provide proper inputs and reducing user mistakes when operating/interacting with the system) which, additionally, reduces power usage and improves battery life of the system by enabling the user to use the system more quickly and efficiently.

In some embodiments, the representation of the gaze is corrected using image manipulation. In some embodiments, the image manipulation involves capturing an image (e.g., via one or more cameras1100a,1100b) of a portion of the face a participant and generating a three-dimensional image of the face of the participant from the image.

In some embodiments, the representation of the gaze direction is corrected by selecting a camera (e.g.,1006a-1006h) closet to the representation (e.g.,1010a-1010f) of the participant at which a participant (e.g.,602a) is locking. In some embodiments, the representation of the gaze direction is corrected by capturing one or more images at a camera that is moving towards the representation of the contact at which the participant is looking.

In some embodiments, the participant (e.g.,602a) is a presenter (e.g., indicated by690). In some embodiments, the participant is a presenter based on movements, audio level being above a threshold level in the video conference. In some embodiments, the representation of the gaze direction of a respective is corrected only when the respective participant is a presenter and/or when the respective is interactive in the communication.

In some embodiments, a computer system displays participant representations (e.g.,714a,714b,714c) in a line. In some embodiments, one or more of the participants are displayed on one side of the line that are looking towards a location (e.g., central location) which contains the participant (e.g., presenter) (e.g., to show that those different people are looking at the participant (e.g., presenter) and/or show that the participant is looking at those different participants or in the direction of those different participant, where participant representation for the presenter is in the middle of display).

In some embodiments, a determination is made as to whether (or how often) to correct the representation of the gaze direction of a respective participant based on whether a respective computer system is operating in a certain mode (e.g., in presenter mode, correct gaze irrespective of where the participant is looking and/or do more gaze direction correction; in another mode, do less gaze direction correction).

The present disclosure recognizes that the use of such personal information data, in the present technology, can be used to the benefit of users. For example, the personal information data can be used to modify representations of a gaze direction for a respective participant in order to improve multi-participant live communication sessions. Accordingly, use of such personal information data enables users to have calculated control of the personal information that is shared to improve multi-participant live communication sessions. Further, other uses for personal information data that benefit the user are also contemplated by the present disclosure. For instance, health and fitness data may be used to provide insights into a user's general wellness, or may be used as positive feedback to individuals using technology to pursue wellness goals.

Therefore, although the present disclosure broadly covers use of personal information data to implement one or more various disclosed embodiments, the present disclosure also contemplates that the various embodiments can also be implemented without the need for accessing such personal information data. That is, the various embodiments of the present technology are not rendered inoperable due to the lack of all or a portion of such personal information data. For example, a representation of gaze for a particular user can be corrected at a system of another user by inferring preferences and/or the gaze direction of the particular user and/or the other user based on non-personal information data or a bare minimum amount of personal information, such as the content being requested by the device associated with a user, other non-personal information available to the multi-participant live communication services, or publicly available information.