Multimedia communication encoding system

Various implementations include devices and approaches for managing multimedia communications. In one aspect, a computer-implemented method of controlling a device connection includes: receiving audio data and video data from an input device connected with a peripheral bus input port; converting the audio data for transmission over an audio over internet protocol (IP) connection or a balun connection and converting the video data for transmission over a video over internet protocol (IP) connection or the balun connection; and transmitting the converted audio data and the converted video data for decoding and output to at least one output device via a multimedia audiovisual interface output port, where the peripheral bus input port is configured to support bidirectional audio and bidirectional video exchange with the input device and bidirectional exchange of IP-based control signals or balun-based control signals with the input device.

TECHNICAL FIELD

This disclosure generally relates to communication systems. More particularly, the disclosure relates to approaches and related devices for processing audio and video data in a communication infrastructure.

BACKGROUND

In conventional multimedia communication systems, users connect one or more input devices to an array of connectors, cables and/or adapters to provide audio and video data to one or more output devices. In the instance of a conferencing system or content presentation system, a user with a portable electronic device such as a laptop computer, tablet, or smart device is often required to connect that portable electronic device to multiple input ports in order to effectively share audio and video data with other users or run a conference or presentation. This conventional configuration is unwieldy, inefficient and discouraging to users.

SUMMARY

Various implementations include an encoder for a multimedia communications system. Additional implementations include a multimedia communications system with an encoder, a decoder and at least one connected output device. Additional implementations include a computer-implemented method of controlling a device connection.

Some particular aspects include an encoder for distributing multimedia communications signals. The encoder includes: a peripheral bus input port; a hub controller coupled with the peripheral bus input port; a processor coupled with the hub controller; and a multimedia audiovisual interface output port coupled with the processor, where the processor is configured to: receive audio data and video data from an input device connected with the peripheral bus input port, via the hub controller; convert the audio data for transmission over an audio over internet protocol (IP) connection or a balun connection and convert the video data for transmission over a video over IP connection or the balun connection; and transmit the converted audio data and the converted video data to at least one output device connected with the multimedia audiovisual interface output port, where the peripheral bus input port is configured to support bidirectional audio and bidirectional video exchange with the input device and bidirectional exchange of IP-based control signals or balun-based control signals with the input device.

Additional particular aspects include a system having: an encoder including: a peripheral bus input port; a hub controller coupled with the peripheral bus input port; a processor coupled with the hub controller; and a multimedia audiovisual interface output port coupled with the processor, where the processor is configured to: receive audio data and video data from an input device connected with the peripheral bus input port, via the hub controller; convert the audio data for transmission over an audio over internet protocol (IP) connection or a balun connection and convert the video data for transmission over a video over IP connection or the balun connection; and transmit the converted audio data and the converted video data to at least one output device, where the peripheral bus input port is configured to support bidirectional audio and bidirectional video exchange with the input device and bidirectional exchange of IP-based control signals or balun-based control signals with the input device; a decoder coupled with the multimedia audiovisual interface output port for decoding the converted audio data and the converted video data; and at least one output device coupled with the decoder for providing audio output and video output.

Further particular aspects include a computer-implemented method of controlling a device connection. The method can include: receiving audio data and video data from an input device connected with a peripheral bus input port; converting the audio data for transmission over an audio over internet protocol (IP) connection or a balun connection and converting the video data for transmission over a video over internet protocol (IP) connection or the balun connection; and transmitting the converted audio data and the converted video data for decoding and output to at least one output device via a multimedia audiovisual interface output port, where the peripheral bus input port is configured to support bidirectional audio and bidirectional video exchange with the input device and bidirectional exchange of IP-based control signals or balun-based control signals with the input device.

In certain implementations, the balun connection includes an HDBaseT connection.

In some aspects, the audio over IP connection includes a Dante connection, and the video over IP connection is a transport connection.

In particular cases, the processor is further configured to send at least one of a wake command or a mute command to the at least one output device in response to detecting the connection with the input device at the peripheral bus input port.

In certain aspects, the processor is configured to simultaneously transmit the converted audio data and the converted video data to the at least one output device, via the multimedia audiovisual interface, in response to detecting a signal between the input device and the encoder at the peripheral bus input port.

In some implementations, the system further includes: an additional encoder; a network switch coupled with the encoder, the additional encoder, and the decoder; an audio processor coupled with the network switch, where the audio processor or the decoder includes a processing component that is configured, in response to detecting a connection with an additional input device at the additional encoder, to: receive additional audio data and additional video data from the additional input device connected with the additional encoder; convert the additional audio data for transmission over the audio over IP connection or the balun connection and convert the additional video data for transmission over the video over IP connection or the balun connection; and transmit the converted additional audio data and the converted additional video data to the at least one output device via the multimedia audiovisual interface output port in response to determining that the additional input device has priority over the input device.

In certain aspects, the converted audio data and the converted video data are transmitted simultaneously to at least one output device.

In some cases, priority between the input device and the additional input device is determined based upon at least one of: a seat location of the input device as compared with a seat location of the additional input device, an order of connection with the encoder, a predefined hierarchy of users associated with the input device and the additional input device, a connection method for the input device as compared with a connection method for the additional input device, a device type of the input device as compared with a device type of the additional input device, or presence of a static device connected to the encoder.

In particular aspects, the peripheral bus input port includes a peripheral component interconnect (PCI) or a universal serial bus (USB) input port.

In some implementations, the IP-based control signals or the balun-based control signals include at least one of human interface device (HID) control signals or USB video device class (UVC) control signals.

In certain cases, the converted video data is compressed for transmission over the video over IP connection or the balun connection at a rate of approximately one gigabit per second (Gbps) to approximately 100 Gbps.

In some aspects, the multimedia audiovisual interface output port includes a high definition multimedia interface (HDMI) output port, and the at least one output device includes an audio digital signal processor.

In some implementations, the set of output devices, the encoder and the decoder are all located in the same room.

In particular cases, the encoder is configured to control operation of the at least one output device via a software function or via an IP-based secondary control platform.

Two or more features described in this disclosure, including those described in this summary section, may be combined to form implementations not specifically described herein.

It is noted that the drawings of the various implementations are not necessarily to scale. The drawings are intended to depict only typical aspects of the disclosure, and therefore should not be considered as limiting the scope of the implementations. In the drawings, like numbering represents like elements between the drawings.

DETAILED DESCRIPTION

This disclosure is based, at least in part, on the realization that an encoder with a peripheral bus input port can be beneficially incorporated into a multimedia communications system for distributing multimedia signals. The devices, systems and related methods can significantly improve the user experience when compared with conventional multimedia communications systems.

Commonly labeled components in the FIGURES are considered to be substantially equivalent components for the purposes of illustration, and redundant discussion of those components is omitted for clarity.

Though the elements of several views of the drawing may be shown and described as discrete elements in a block diagram and may be referred to as “circuitry”, unless otherwise indicated, the elements may be implemented as one of, or a combination of, analog circuitry, digital circuitry, or one or more microprocessors executing software instructions. The software instructions may include digital signal processing (DSP) instructions. Operations may be performed by analog circuitry or by a microprocessor executing software that performs the mathematical or logical equivalent to the analog operation. Unless otherwise indicated, signal lines may be implemented as discrete analog or digital signal lines, as a single discrete digital signal line with appropriate signal processing to process separate streams of audio signals, or as elements of a wireless communication system. Some of the processes may be described in block diagrams. The activities that are performed in each block may be performed by one element or by a plurality of elements, and may be separated in time. The elements that perform the activities of a block may be physically separated. Unless otherwise indicated, audio signals or video signals or both may be encoded and transmitted in either digital or analog form; conventional digital-to-analog or analog-to-digital converters may not be shown in the figures.

As noted herein, conventional multimedia communication systems can be unwieldy, inefficient and discouraging to users. For example, in bring-your-own-codec (BYOC) or bring-your-own-device (BYOD) configurations, one or more users host a presentation or otherwise share multimedia content using an array of different connectors, cables, adapters and device settings. In particular cases, when the presenting user enters a conference room and intends to share video content and/or audio content from that input device, as well as video content and/or audio content detected by camera(s) and/or microphones on the input device or in the conference room, the user is often forced to connect the input device using an Ethernet connection, a universal serial bus (USB) connection, and a high definition multimedia interface (HDMI) connection. That is, in order to effectively share audio data and video data in a multimedia presentation setting (e.g., a conference setting), the conventional systems require multiple device connections, and often require corresponding settings adjustments to manage these connections. Additionally, other steps may be required such as turning a display on, and/or selecting system input, etc., using a remote control. These additional steps, in combination with the conventional systems, are prone to user error as well as configuration errors.

In contrast to these conventional systems, various implementations include a system having an encoder for distributing multimedia communications signals using a peripheral bus input port. In various particular cases, the peripheral bus input port is configured to receive both audio data and video data, and the encoder is configured to convert this data for transmission to one or more output devices. In some cases, the encoder transmits the converted audio and video data to a decoder, which can be coupled with an output device such as a visual display, speaker system, etc.

FIG. 1is a schematic illustration of an environment10including a system20according to various implementations. As shown, the system20can include one or more input devices30connected with an encoder40, for example, via a peripheral bus input connection. In various implementations, the encoder40is configured to distribute multimedia communications signals. Input devices30can include a computing device such as a personal computer or smart device (e.g., smartphone or tablet). Additional input devices30can include one or more microphones, camera(s) or other multimedia devices configured for network communication. A camera is shown as one of the input devices30in this example implementation. It is understood that various input devices30can be connected with the encoder40(or a plurality of encoders40) according to various implementations.

In some cases, an input device30such as a computing device is connected with the encoder40by a peripheral bus input port50, which can include, for example a peripheral component interconnect (PCI) input port or a universal serial bus (USB) input port. In various implementations, the peripheral bus input port50supports both audio and video data transmission to and from the input device30(e.g., computing device). In various implementations, the encoder40is integrated into a network switch60, or is connected with a network switch60for communication with other devices in the system20. The network switch60can be located in an audio-visual (AV) rack70or other housing. Also shown inFIG. 1is a decoder80connected with the network switch60, along with an output device90connected with the decoder80and/or the network switch60. Additional details of the decoder80are described further herein.

The output device(s)90can include a display such as a computer system monitor, television screen, visual projection device, etc., an audio system such as one or more speakers, headphones/earphones, or a combined audio/visual output device such as a computing device having both a display and one or more integrated speakers. These are merely examples of output devices90that can be connected with the decoder80for performing functions according to various implementations. In the particular example depicted inFIG. 1, the output device(s)90, encoder40and decoder80are all located in the same room, e.g., in the same physical room defined by fixed or movable walls. However, as described with reference to additional implementations herein, the output device(s)90, encoder40and/or decoder80can be located in physically separate locations, e.g., different rooms in the same building. In some cases, the environment10depicts a BYOC or BYOD configuration, whereby a user can control communications between one or more input devices30and an output device90using his/her selected input device30. In these scenarios, the computing device that acts as an input device is provided by the user, and in some cases, is the personal computing device (e.g., laptop, tablet or other smart device) belonging to or otherwise associated with that user.

FIG. 2is a schematic data flow diagram200illustrating processes performed by the encoder40, which can be a separate component from the network switch60(FIG. 1), or in other cases, may be integral with the network switch60(e.g., within the same physical housing). As described herein, the encoder40is configured to communicate with the input devices30and the output devices90shown and described with reference toFIG. 1. In various implementations, the encoder40includes the peripheral bus input port50, or is otherwise directly connected (e.g., via hard wire) with the peripheral bus input port50. In some implementations, the encoder40also includes a hub controller210coupled with the peripheral bus input port50, a processor220coupled with the hub controller210, and a multimedia audiovisual interface output port (MAIOP)230coupled with the processor220. However, in other implementations, the encoder40does not include the hub controller210(indicated as optional by dashed lines), and the peripheral bus input port50is directly coupled with the processor220. Additional components in the encoder40can perform conventional functions, and as such, are referred to with less specificity. Connections between components in the data flow diagram inFIG. 2can represent hard-wired connections, and in various implementations, components in the encoder40are contained in the same housing. In particular implementations, components in the encoder40are self-contained in a single housing, e.g., for connection with one or more components in the system20(FIG. 1).

As noted herein, the peripheral bus input port (or simply, peripheral bus)50is configured to receive multimedia communications inputs, e.g., both audio data and video data, from one or more input devices30(FIG. 1). In various implementations, the encoder40is configured to directly communicate with the input devices30via the peripheral bus50. In particular implementations, the peripheral bus50includes a peripheral component interconnect (PCI) or a universal serial bus (USB) input port. The peripheral bus50is configured to support bidirectional audio and bidirectional video exchange with the input device(s)30and bidirectional exchange of IP-based control signals or balun-based control signals with the input device(s)30. In some particular cases, the control signals (e.g., IP-based or balun-based) include human interface device (HID) control signals and/or USB video device class (UVC) control signals. In some cases, balun-based control signals are beneficial for connecting peripheral devices to the input and output signals from the encoder40. For example, it may be beneficial to use a balun connection for devices that directly connect with the encoder40and/or decoder80. In other cases, IP-based control signals are beneficial in connecting between or within the larger device groups in a room.

The peripheral bus50is connected with the hub controller210, e.g., via any connection described herein. In some cases, where the peripheral bus50includes a USB input bus, the hub controller210is connected with the peripheral bus50over a USB connection such as a USB 3.1 connection. The hub controller210can include a USB hub that allows for multiple USB devices to connect with each other. For example, for USB-C devices, the hub controller210includes a multiplexer (mux) to allow for reversal of USB-C connectors.

The processor220is configured to receive data from the hub controller210and perform various processes. In particular, the processor220is configured to:

i) receive audio data and video data from the input device(s)30(FIG. 1) connected with the peripheral bus50, via the hub controller210;

ii) convert the audio data for transmission over an audio over IP connection or balun connection, and convert the video data for transmission over a video over IP connection or balun connection; and

iii) transmit the converted video data to the output device(s)90(FIG. 1) via the MAIOP230. In some cases, as noted herein, the MAIOP230is coupled with the decoder80(FIG. 1) for decoding the converted audio data and the converted video data before output at the output device(s)90. In additional implementations, the converted audio data and the converted video data are transmitted simultaneously to one or more of the output devices90.

As noted herein, in various implementations, the processor220is configured to receive audio data in the form of analog audio data, IP encoded audio data (Dante), digitally encoded audio data (Audio over USB), and/or digitally embedded audio data. The processor220can include one or more codecs and/or chips (or chipsets) configured to convert the audio data for transmission over the audio over IP connection or the balun connection. Similarly, the processor220can include one or more codecs and/or chips (or chipsets) configured to convert received video data from the input device30(e.g., computing device(s)) for transmission over the video over IP connection or the balun connection. In some cases, the video data is converted from DisplayLink compression format to TMDS (HDMI, DisplayPort, etc.) format. The video data can also be packetized for IP transmission over the video over IP connection or the balun connection. In one example, the processor220includes one or more chips configured to convert the received audio data and video data for transmission over the audio over IP connection, video over IP connection and/or the balun connection, such as chip(s) or chipset(s) including Dante, available from the Audinate Company of New South Wales, Australia and/or chip(s) or chipset(s) including DL-6950, available from the DisplayLink Corporation of Palo Alto, Calif., USA.

In particular examples, the audio over IP connection is a Dante connection, and the video over IP connection is a transport connection (e.g., using a compression algorithm such as JPEG2000). In particular cases, the Dante connection can provide reliable, low latency audio interconnectivity with other devices in the system20, while JPEG2000 can be particularly well suited for transporting high resolution, low latency content. In other examples, the audio over IP connection can include one or more of: AES-67, AVB or AES/EBU connection(s). In other examples, the video over IP connection is configured to transmit video data over formats such as a H.264, H.265, MJPEG, SDVoE, SMPTE2210 and/or NewTek NDI.

The balun connection can include any manner of balun connector (balanced to unbalanced connector) capable of converting between a balanced signal and an unbalanced signal. In one particular example, the balun connection is an HDBaseT connection (e.g., an HDBaseT wire or other connector complying with standards established by the HDBaseT Alliance). In another example, the balun connection includes a fiber optic connection.

In some implementations, the multimedia audiovisual interface output port (MAIOP)230includes a high definition multimedia interface (HDMI) output port. In particular cases, the MAIOP230is connected with the output device90(FIG. 1), which in certain cases, includes an audio digital signal processor.

Additional components shown in the data flow200as interacting with the encoder40include a video compressor240coupled with the processor220for compressing video files sent to a network switch60. In one example, the video compressor240can be configured to compress video files received via the processor220to a JPEG standard (defined by the Joint Photographic Experts Group), such as the JPEG2000 standard. In particular examples, the video compressor240can also include an audio-visual (AV) to IP encoder such as an HDBaseT encoder.

The video compressor240is coupled with the network switch60, which can include a network switch capable of data transmission at a rate of approximately one (1) Gbps up to 100 Gbps (e.g., in both copper and fiber variants). Some particular examples of the network switch60are configured for data transmission at a rate of approximately one Gbps. Other particular examples of the network switch60are configured for data transmission at a rate of approximately 10 Gbps (e.g., Software Defined Video Over Ethernet (SDVoE)). In some examples, the processor220sends signals to the video compressor240over a conventional audiovisual connection, e.g., a DisplayPort connection, a USB-C connection, a DVI-D connection. In some particular cases, the processor220sends signals to the video compressor240over an HDMI connection. In other particular cases, the processor220sends signals to the video compressor240over an additional encoding framework, e.g., YUV format or RGB format.

The network switch60is further coupled with a device controller (DC)250, for sending and receiving network and network configuration commands. In some cases, the device controller250can include an Acorn chip, ARM chip or Atom chip (available from Intel Corporation, Santa Clara, Calif.) for performing various processing functions described herein. The network switch60is additionally coupled with a video decoder (e.g., RTSP decoder, or another video decoder using SMPTE2022/2110 and/or NDI coding standards)260, which is connected with a camera controller (e.g., UVC controller)270. The camera controller270is additionally connected with the hub controller210, as well as the device controller250. In some cases, the camera controller270is configured to send camera control commands (e.g., UVC commands) to the device controller250. The network switch60and the processor220are both configured to send and receive commands from a processor hub (P. Hub) chip280. In some cases, the processor hub chip280includes a control chip such as the Dante Ultimo chip (e.g., 4×4), available from the Audinate Company. The processor hub chip280can be configured to communicate with the processor220and the device controller250using electrical serial bus interface standards, e.g., i2s with the processor220and i2c with the device controller250. The camera controller270can also send signals to the device controller250using an electrical serial bus interface standard, e.g., i2c.

The processor220can exchange signals with an information technology (IT) network controller290, which in some cases is controlled by the IT department managing the physical facility or connection infrastructure in the environment10(FIG. 1). For example, the processor220and network controller290can exchange signals using an Ethernet connection.

In some cases, the network switch60is connected to one or more room power inputs and outputs, for example, a room (e.g., conference room) input300and a room (e.g., conference room) output310. In some cases, the input300and output310are power over Ethernet (POE) connections, which can enable power without direct access to an outlet (e.g., over a CATx network cable). In particular examples, the network switch60can be connected with the room input300by a network with POE connection, and can be connected with the room output310by a network connection. In certain cases, the input300is coupled with a POE supply (POE)320, that is supplied with power, e.g., from a source (PS)330(e.g., a DC power source). In certain cases, this architecture enables a second apparatus to be daisy-chained by coupling that second apparatus to the room output310and connecting the PS330to the second apparatus.

In various implementations, the processor220is configured to send a wake command and/or an OFF command to the output device90(FIG. 1) in response to detecting a connection with the input device30at the peripheral bus50. That is, when a user connects an input device30to the peripheral bus50, the processor220receives a signal (e.g., via the hub controller210) indicating that the input device30is connected, and sends a wake command (e.g., via the MAIOP230), e.g., over the HDMI connection, to the output device90(e.g., to awaken a monitor, speaker system, computing device, etc.).

In additional implementations, the processor220is configured to simultaneously transmit the converted audio data and the converted video data to the output device90via the MAIOP230(e.g., over HDMI connection) in response to detecting a signal between the input device30and the encoder40at the peripheral bus50. That is, the processor220is configured to detect synchronization between the input device30and the encoder40using the signal received at the peripheral bus50, and in response to detecting this signal (e.g., via hub controller210), the processor220sends both the converted audio data and the converted video data to the output device90via the MAIOP230.

In various implementations, the processor220works in conjunction with the video compressor240to compress the converted video data for transmission over the balun connection or the video over IP connection. In particular cases, the converted video data is compressed for transmission over the balun connection or the video over IP connection at a rate of approximately one (1) gigabit per second (Gbps) or less.

FIG. 3illustrates a data flow in an example environment300including a system310with a set of encoders40(two shown,40A and40B) each having a primary peripheral bus50, as described with reference toFIG. 2. In this example environment300, input devices30A,30B are connected with encoders40A,40B (e.g., tableside devices) that directly couple with the network switch60(e.g., in a rack70or other housing). In some cases, the network switch60is also coupled with an audio processor410, which can include one or more controllers and/or processors described with respect to the data flow inFIG. 2, e.g., the processor220and the processor hub280. The network switch60in this example can include POE or other power connections described herein. The respective encoders40A,40B are connected to a local area network (LAN)420, as described with respect toFIG. 2(IT network control290). A plurality of additional input devices30C,30D are also shown coupled with the network switch60, e.g., a microphones and cameras in the room (or in one or more additional rooms). Each output device90is shown connected with a respective decoder80.

In the scenario depicted inFIG. 3, multiple input devices30A,30B such as computing devices, as well as additional input devices30C,30D such as cameras, can be connected with the encoders40and/or network switch60for controlling communications in the system310. Two output devices90(e.g., displays) are shown connected with corresponding decoders80in this example. In some cases, this example environment300depicts a multi-user BYOC or BYOD configuration, whereby two or more users can control communications between two or more input devices30A,30B and at least one output device90using the respective selected input device30. In these scenarios, the computing device that acts as an input device is provided by each user, and in some cases, is the personal computing device (e.g., laptop, tablet or other smart device) belonging to or otherwise associated with each user.

Multi-user scenarios can present challenges in terms of which user's content takes precedent over the other user(s), as well as which of the users can control the communication and presentation of content. Various implementations are configured to address multi-user scenarios such as those depicted in the example ofFIG. 3. For example, with reference toFIGS. 2 and 3, the processor220runs on the audio processor410or the encoder80, and is configured to control priority of user content in the system310. In particular cases, the processor220is configured to detect a connection with an additional input device30B at the corresponding peripheral bus50on encoder40B (in addition to input device30B at the peripheral bus50on encoder40A). In response to detecting that additional connection, the processor220is configured to:

iv) receive additional audio data and additional video data from the additional input device30B connected with the additional encoder40B, via the hub controller210;

v) convert the additional audio data for transmission over the audio over IP connection or the balun connection and convert the additional video data for transmission over the video over IP connection or the balun connection; and

vi) transmit the converted additional audio data and the converted additional video data to the output device(s)90via the MAIOP230(FIG. 2) in response to determining that the additional input device30B has priority over the input device30A.

It is understood that the network switch60can have a plurality encoder connections, which can provide for connection with several (or more) input devices30via corresponding encoders40. The illustration of two encoders40A,40B is merely intended to illustrate aspects of connection control amongst a plurality of input devices30.

Determining priority between input devices30can be performed according to various implementations. The processor220can be configured to detect characteristics of the input sources to encoders40A,40B and transmit the converted audio data from one of those input sources to the output devices based upon those detected characteristics. In various implementations, the processor220includes logic for determining priority between input devices30according to one or more priority rules.

For example, the processor220can be configured to determine priority between respective input devices30based upon priority rules including at least one of: a) a seat location of the input device30A as compared with a seat location of the additional input device30B, b) an order of connection with the encoders40A,40B, c) a predefined hierarchy of users associated with the input device30A and the additional input device30B, d) a connection method for the input device30A as compared with a connection method for the additional input device30B, e) a device type of the input device30A as compared with a device type of the additional input device30B, or f) presence of a static device connected to the encoder(s)40A,40B.

With continuing reference toFIGS. 2 and 3, in particular examples, the processor220includes logic that associates known locations of the encoders40A,40B, etc. with a priority rule. For example, a first encoder40A is associated with a primary seating location (e.g., a head seat at a conference room table), while a second encoder40B is associated with a secondary seating location (e.g., a location along the sides of the table). The processor220can be configured to detect connection with input devices30at both encoders40A,40B, and according to the seat location priority rule, transmit the converted audio and video data from the input device30connected with the primary seating location so long as that input device30remains connected to the corresponding encoder (via the peripheral bus50). In certain cases, this seating location rule can supersede an order of connection or other rule, such that regardless of when the prioritized input device30is connected at the peripheral bus50at encoder40, the content from that input device30is prioritized over the input device connected to the additional encoder(s) in the system310.

In still other examples, the order of connection between two input devices30dictates the priority of content transmission. For example, the processor220can include logic that associates connection order at the encoders40A,40B with priority of audio and video data transmission. In these cases, the processor220detects connection of an input device30A with the peripheral bus50(via hub controller210) at an encoder40A, and transmits the audio and video data to one or more output devices90, as described herein. When the processor220detects connection of a second input device30B (e.g., at the peripheral bus50of an additional encoder40B), the processor220is configured to prioritize content from the first input device30A over the second input device30B. In one scenario, the priority rule gives priority to the earliest, or first, connection that is still in place, and even when the second input device30B connects to the second encoder40B, the processor220continues to transmit content from the first input device30A (unless superseded by another rule or command). In another scenario, the priority rule gives priority to the later, or last, connection that is still in place, and when the second input device30B connects to the second encoder40B, the processor220stops transmitting content from the first input device30A and switches to transmitting content from the second input device30B to the output device(s)90.

In still other examples, the processor220includes logic assigning users of input devices30with one or more levels of priority. In these cases, the logic assigns absolute or relative priority to one or more users associated with respective input devices30, e.g., personal computing devices such as laptops, tablets, smart devices, etc. In some cases, the processor220is configured to detect identification characteristics of the input device30after it is connected to one of the encoders40A,40B, and based upon the identification characteristics, either transmit the converted audio and video data associated with that input device30to the output device(s)90or transmit converted audio and video data associated with another input device30to the output device(s)90. In some cases, the processor220is configured to identify IP addresses or numbers of the input devices30and check those addresses/numbers against known priority characteristics to prioritize content (e.g., IP address/number assigned to a user with higher relative priority than IP address/number assigned to user with lower relative priority). In additional cases, the processor220is configured to identify the device(s)30using device IDs assigned by the control software, e.g., stored in a database or otherwise accessible to the processor220.

In one example, the input device30of a first user may have absolute priority over input devices30of all secondary users, while a first one of the secondary users may have relative priority over another one of the secondary users. In this scenario, when the first user connects his/her associated input device30in the peripheral bus of an encoder (e.g., encoder40A), that input device30takes priority over all other user input devices30connected at other encoders (e.g., encoders40B,40B,40C, etc.). However, when the first user is not connected and two secondary users are connected to encoders40via corresponding peripheral buses (e.g., peripheral bus50A, and additional peripheral buses not depicted, such as a peripheral bus50B, peripheral bus50C, etc.), audio and video data from the input device30associated with a user having the highest priority is converted and transmitted in place of content from input device(s)30of other secondary users.

In still other examples, the processor220is configured to prioritize transmission of content from input devices30based upon a connection method. For example, where the peripheral buses50at corresponding encoders40have distinct connection capabilities, the processor220can include logic for prioritizing one or more type(s) of connection over the other(s). In particular examples, a first peripheral bus50at encoder40A can include a PCI input port, while an additional peripheral bus50at encoder40B can include a USB input port. The logic in processor220can be configured to detect connection at both encoders40A,40B, and according to priority rules based upon connection type, transmit the converted audio and video data to the output device(s)90from the input device30connected with encoder40A or encoder40B. In certain cases, priority is given to USB connection, and when the processor220detects connection at two distinct types of peripheral bus50, one of which is a USB connection, the processor220gives priority to the input device30at that USB input port.

In additional examples, the processor220is configured to prioritize transmission of content from input devices30based upon a type of the input device. For example, where the types of input devices30connected with the encoder40differ, the processor220can include logic for prioritizing one or more type(s) of device over the other(s). In particular examples, the input device30connected to the peripheral bus50at an encoder40is a laptop or tablet, while the input device30connected to the peripheral bus50at another encoder40is a smartphone. The logic in processor220can be configured to detect connection at both encoders40, detect the type of input device30at each connection (e.g., based upon known device type, such as stored in a database or other accessible data structure) and according to priority rules based upon device type, transmit the converted audio and video data to the output device(s)90from the input device30at the prioritized encoder40. In certain cases, priority is given to laptops or tablets over smartphones, and when the processor220detects the device connection of a laptop or tablet at one encoder40A and device connection of a smartphone at the additional encoder40B, the processor220gives priority to the input device30A connected at the encoder40A.

In additional examples, priority rules in the logic within processor220give priority to a static input device30connected to the encoder40as compared with other input devices30that do not have a static connection. For example, one of the input devices30can include a desktop, tabletop or other computing device that is physically connected with the environment300(FIG. 3). In this case, the input device30is constantly connected with the encoder40, e.g., via a static connection with peripheral bus50. When the processor220detects an additional input device30connection (e.g., via one or more encoders), the logic in processor220is configured to give priority to the content from the input device30connected with the prioritized encoder40.

It is understood that two or more priority rules can be combined or otherwise conditional upon each other. In these cases, the logic in processor220can be structured in algorithmic form to make priority decisions based upon a plurality of rules, e.g., user hierarchy, connection method, connection order, etc. Additionally, the user of an input device30is also able to defer or adjust priority of content according to one or more rules. In some cases, the user of the prioritized input device30is able to defer priority or otherwise modify priority to give control of content communication to other device users.

FIG. 4illustrates an additional data flow in an example environment400according to various implementations. This data flow depicts distinct input devices30A,30B (e.g., computing devices) in a divisible room scenario (environment400). As shown in environment400, input devices30A,30B are each coupled to respective encoders40A,40B, which are in turn coupled with the network switch60. In some cases, the network switch60is also coupled with the audio processor410, which can include one or more controllers and/or processors described with respect to the data flow inFIG. 2, e.g., the processor220and the processor hub280. The network switch60in this example can include POE or other power connections described herein. The respective encoders40A,40B are connected to the local area network (LAN)420, as described with respect to FIG.2(IT network control290). A plurality of additional input devices30are also shown coupled with the network switch60, e.g., a microphones and cameras in the separate rooms. Each output device90is shown connected with a respective decoder80in the respective rooms. This example configuration can allow users to control communications in a room that is divisible into multiple smaller rooms, e.g., from 1-4 distinct spaces, or Room1through Room X. Each room can have an associated decoder80and output device90(e.g., audio and video output device) for receiving and outputting the converted audio data and video data from the encoder(s)40. However, it is understood that the rooms need not necessarily have a one-to-one connection, such that one room (e.g., Room1) can be connected (via network switch60) with one or more additional rooms (e.g., Rooms2,3, etc.). That is, each room depicted inFIG. 4can have either a one-to-one connection, or a one-to-many connection. Additionally, this divisible room scenario depicted inFIG. 4is not limited to equally divided rooms or proportionally distributed input devices to output devices. That is, one or more input devices30can be connected with one or more output devices90in disproportionate arrangements between rooms.

As described herein, the encoder40(e.g.,FIG. 1) is configured to control operation of at least one output device90(e.g., a display, speaker system, and/or computing device, etc.). In some implementations, the encoder40is configured to control operations, e.g., between input devices30, the network switch60, the decoder80and/or the output device(s)90, with one or more software functions such as programming instructions stored in one or more chips or chipsets described herein. However, in other implementations, the encoder40is configured to control operations, e.g., between input devices30, the network switch60, the decoder80and/or the output device(s)90, using an IP-based secondary control platform. Examples of IP-based secondary control platforms can include Crestron control systems (available from the Crestron Electronics Company of Rockleigh, N.J.), a tablet-based control platform, or a remote software control platform.

As noted herein, in contrast to conventional approaches, various implementations allow for control of both audio and video communications between input devices and output devices over a single device input connection. That is, both audio and video data are transmitted through the single device input connection (e.g., peripheral bus50,FIG. 2)), converted into appropriate output formats, and routed to respective output devices (e.g., output devices90,FIG. 1). This can significantly improve the user experience as compared with the conventional systems and approaches.

The functionality described herein, or portions thereof, and its various modifications (hereinafter “the functions”) can be implemented, at least in part, via a computer program product, e.g., a computer program tangibly embodied in an information carrier, such as one or more non-transitory machine-readable media, for execution by, or to control the operation of, one or more data processing apparatus, e.g., a programmable processor, a computer, multiple computers, and/or programmable logic components.

Actions associated with implementing all or part of the functions can be performed by one or more programmable processors executing one or more computer programs to perform the functions of the calibration process. All or part of the functions can be implemented as, special purpose logic circuitry, e.g., an FPGA and/or an ASIC (application-specific integrated circuit). Processors suitable for the execution of a computer program include, by way of example, both general and special purpose microprocessors, and any one or more processors of any kind of digital computer. Generally, a processor will receive instructions and data from a read-only memory or a random access memory or both. Components of a computer include a processor for executing instructions and one or more memory devices for storing instructions and data.

Additionally, actions associated with implementing all or part of the functions described herein can be performed by one or more networked computing devices. Networked computing devices can be connected over a network, e.g., one or more wired and/or wireless networks such as a local area network (LAN), wide area network (WAN), personal area network (PAN), Internet-connected devices and/or networks and/or a cloud-based computing (e.g., cloud-based servers).

In various implementations, components described as being “coupled” to one another can be joined along one or more interfaces. In some implementations, these interfaces can include junctions between distinct components, and in other cases, these interfaces can include a solidly and/or integrally formed interconnection. That is, in some cases, components that are “coupled” to one another can be simultaneously formed to define a single continuous member. However, in other implementations, these coupled components can be formed as separate members and be subsequently joined through known processes (e.g., soldering, fastening, ultrasonic welding, bonding). In various implementations, electronic components described as being “coupled” can be linked via conventional hard-wired and/or wireless means such that these electronic components can communicate data with one another. Additionally, sub-components within a given component can be considered to be linked via conventional pathways, which may not necessarily be illustrated.

A number of implementations have been described. Nevertheless, it will be understood that additional modifications may be made without departing from the scope of the inventive concepts described herein, and, accordingly, other implementations are within the scope of the following claims.