Patent ID: 12248428

DESCRIPTION OF EMBODIMENTS

Hereinafter, embodiments of the present invention will be described with reference to the drawings.

First Embodiment

FIG.1is a diagram illustrating an example of an overall configuration of an information processing system according to the present embodiment. As illustrated inFIG.1, the information processing system1includes a controller2, computer bases3(3-1,3-2, . . . ,3-n(n is an integer of 1 or more)), user bases4(4a-1,4b-1,4a-2,4b-2, . . . ,4a-m[m is an integer of 1 or more],4b-m), a first network NW1, and a second network NW2(network).

One or a plurality of computers31and UI transceivers32are installed in the computer bases3. In the example ofFIG.1, the computers31(31a-n,31b-n, . . . ) and the UI transceivers32(32a-n,32b-n, . . . ) (first transceivers) are installed in the computer bases3. Note that the computers31and the UI transceivers32may be integrated. InFIG.1, a part of a configuration installed in the computer bases3is omitted. Note that the configuration installed in the computer bases3will be described with reference toFIG.2and the like.

The user bases4include UI devices41(41a-m,41b-m, . . . ), sensors42(42a-m,42b-m, . . . ), and UI transceivers43(43a-m,43b-m, . . . ) (second transceivers).

The information processing system1includes one or a plurality of the computer bases3.

The controller2controls connection relation between the UI transceivers43of the user bases4and the UI transceivers32of the computer bases3. The controller2is connected to the computers31and the UI transceivers32of the computer bases3, a communicator included in the second network NW2(not illustrated), and the UI transceivers43of the user bases4, and can confirm setting information of each device and change the setting. In addition, the controller2performs delay adjustment control. The controller2is connected to the computer bases3, the user bases4, the first network NW1, and the second network NW2in a wired or wireless manner.

Note that the controller2is formed using a processor such as a central processing unit (CPU) and a memory. Note that all or some of each function of the controller2may be implemented using hardware such as an application specific integrated circuit (ASIC), a programmable logic device (PLD), or a field programmable gate array (FPGA). The program may be recorded in a computer-readable recording medium. The computer-readable recording medium is, for example, a portable medium such as a flexible disk, a magneto-optical disk, a read-only memory (ROM), a compact disk read-only disk (CD-ROM), or a semiconductor storage device (for example, a solid state drive [SSD]), or a storage device such as a hard disk or a semiconductor storage device built in a computer system. The program may be transmitted via an electric communication line.

The first network NW1includes, for example, the Internet and includes a communication network. In addition, the first network NW1may have an authentication function.

The second network NW2may be a wired network or a wireless network, may have physical or logical topology, and may be a circuit switched network or a packet switched network.

Next, the computer bases3will be described.

The computer bases3are, for example, data centers, communication buildings, server rooms, or the like.

The computers31may be physical computers or logical computers (virtual computers). In a case of virtual computers, for example, CPUs, graphics processing units (GPUs), memories, storages, and the like are virtualized. Furthermore, the computers31may be game machines. The computers31are connected to other computers or servers of data centers (not illustrated) via the first network NW1. The computers31are connected to the UI transceivers32, and user interface information such as display signals and operation information of the computers31is exchanged. Specific examples of a display signal include a high-definition multimedia interface (HDMI) (registered trademark) and a DisplayPort, and examples of a signal of the operation information include a universal serial bus (USB). Furthermore, examples of a signal obtained by combining a display signal and operation information include a USB4 and a Thunderbolt (registered trademark)3. Note that one user may boost and use a plurality of physical GPUs in cooperation.

The UI transceivers32receive display signals and operation information, and convert the display signals and the operation information into signal formats that enable long-distance communication via the second network NW2. Furthermore, the UI transceivers32are connected to the UI transceivers43of the user bases4via the second network NW2. The signal formats that enable long-distance communication are, for example, Ethernets (registered trademark) or optical transport networks (OTNs). Note that a configuration example of the UI transceivers32will be described below.

Next, the user bases4will be described.

The user bases4are bases where users US (US1, . . . ) perform work, games, and the like, and are, for example, home, companies, business rental spaces, game arcades, or the like.

The UI devices41are devices related to user interfaces, and are, for example, displays, keyboards, mice, operation controllers (actuators), cameras, virtual reality (VR) headsets, augmented reality (AR) headsets, microphones, speakers, or the like. Alternatively, the UI devices41may be any devices that input and output the five human senses (touch, eyesight, hearing, smell, and taste) to and from the computers31, in addition to the above devices. The UI devices41and the UI transceivers43are connected, for example, in signal formats such as HDMIs, DisplayPorts, or USBs.

The sensors42are, for example, sensors that detect movement of hands, faces, bodies, or the like of the users US, position sensors, altitude sensors, speed sensors, acceleration sensors, temperature sensors, humidity sensors, pressure sensors, vibration sensors, optical sensors, sound sensors, electric field sensors, magnetic field sensors, or the like. The sensors42and the UI transceivers43are connected, for example, by signal formats such as USBs.

The UI transceivers43are connected to the UI transceivers32of the computer bases3via the second network NW2. Note that the second network NW2has a switching function, and can flexibly change connection relation between the UL transceivers32of the computer bases3and the UI transceivers43of the user bases4. Note that a plurality of UI signals may be multiplexed in output of the UI transceivers43. Note that the UI transceivers43are only required to be connected to at least one of the UI devices41or the sensors32.

Next, an example of connection between the user bases4and the computer bases3will be described.

In the example ofFIG.1, two users US1and US2use computers31via the second network NW2.

In a first path Cn1, a UI transceiver43a-1of a user base4a-1and a UI transceiver32b-1of a computer base3-1are connected via the second network NW2. In a second path Cn2, a UI transceiver43b-1of a user base4b-1and a UI transceiver32b-2of a computer base3-2are connected via the second network NW2. Note that connection relation between the UI transceivers (32,43) is controlled by the controller2.

Next, a configuration example of the computer bases and the second network will be described.

FIG.2is a diagram illustrating a configuration example of the computer bases and an example of the second network according to the present embodiment. In the example ofFIG.2, for example, at least one of the computers31(31a-1,31b-2,31a-2,31b-2), at least one of the UI transceivers32(32a-1,32b-2,32a-2,32b-2), allocators33(33-1,33-2), and switchers34(34-1,34-2) are installed in the computer bases3(3-1,3-2).

The UI transceivers43of the user bases4are connected to the switchers34of the computer bases3via transmission paths Tm. The transmission paths Tm may be, for example, colored interfaces (IFs) based on wavelength division multiplexing (WDM) signals or grey IFs based on non-WDM signals. The switchers34are also connected to a switcher34of another computer base3via a transmission path Tm, and can flexibly change connection relation between the UI transceivers (32,43). The switchers34are connected to an allocator33of the same computer base3, and can set which computer31of the said computer base3is connected.

The switchers34(switches) switch the transmission paths Tm under the control of the controller2. The switchers34are, for example, optical switches, electric switches, or robot panel switches.

The allocators33(switches) switch the UI transceivers32connected to the UI transceivers43of the user bases4under the control of the controller2. The allocators33are, for example, optical switches, electric switches, or robot panel switches.

In the example ofFIG.2, in a case where a first user US1uses the user base4a-1, the UI transceiver43a-1of the user base4a-1is connected to the UI transceiver32b-1of the computer base3-1via a transmission path Tm-1, and a switcher34-1and an allocator33-1of the computer base3-1as in a path Cn11on the basis of the control of the controller2.

Furthermore, in a case where a second user US2uses the user base4b-1, the UI transceiver43b-1of the user base4b-1is connected to the UI transceiver32b-1of the computer base3-2via a transmission path Tm-2, the switcher34-1of the computer base3-1and the transmission path Tm, and a switcher34-2and an allocator33-2of the computer base3-2as in a path Cn12on the basis of the control of the controller2.

In this case, the second network NW2is a network having a circuit switching function (hereinafter referred to as a “circuit switched network”). The circuit switched network is, for example, an optical transport network (OTN) or synchronous digital hierarchy (SDH). Note that the circuit switched network includes transmission paths Tm, Tm-1, Tm-2, Tm-11, Tm-12, Tm-21, and the like.

For example, in a remote desktop function of the related art, since UI information is exchanged by a network using an Ethernet switch or a router, switching of media access control address (MAC) frames and switching of Internet protocol (IP) packets are performed throughout the network.

At the time of these switching operations, a signal is temporarily stored in a switching queue, and then the signal is switched at a timing when switching is possible, and thus, the delay time fluctuates.

On the other hand, in the circuit switched network according to the present embodiment, since the communication capacity can be occupied by one user and the delay time is constant, the communication between the UI transceivers32and the UI transceivers43is stabilized. One user can occupy the communication capacity by time slots of the communication being allocated by time division multiplexing. Furthermore, the delay time is constant because the allocated time slots are regularly switched without delay even at the time of switching.

Note that the circuit switched network also includes a packet switched network that emulates circuit switching. In the packet switched network that emulates circuit switching, a bandwidth is secured by priority being given to packets, and delay time of switching is stabilized by switching being preferentially performed according to the priority of the packets at the time of switching.

Next, a configuration example of a UI transceiver will be described.

FIG.3is a diagram illustrating an example of a configuration of a UI transceiver according to the present embodiment. In the following description, a case where a UI transceiver32and a UI transceiver43have the same configuration will be described, but the configurations may be different.

As illustrated inFIG.3, the UI transceiver32includes, for example, a monitoring control unit301, at least one UI input and output unit302(302a, . . . ), at least one of a sensor input and output unit307(307a, . . . ) or compression/decompression units303(303a,303b, . . . ), at least one of mapping/demapping units304(304a,304b, . . . ), a multiplexing/demultiplexing unit305, and a transception unit306.

Furthermore, the UI transceiver43includes, for example, a monitoring control unit401, at least one UI input and output unit402(402a, . . . ), at least one of a sensor input and output unit407(407a, . . . ) or compression/decompression units403(403a,403h, . . . ), at least one of mapping/demapping units404(404a,404b, . . . ), a multiplexing/demultiplexing unit405, and a transception unit406. Note that the configuration illustrated in FIG.3is an example, and the present invention is not limited thereto.

In a case of the UI transceiver32, the monitoring control unit301is connected to the controller2by a wired or wireless line, the transception unit306is connected to an allocator33, and the UI input and output unit302and the sensor input and output unit307are connected to a computer31.

In a case of the UI transceiver43, the monitoring control unit401is connected to the controller2by a wired or wireless line, the transception unit406is connected to a transmission path Tm, a UI input and output unit402ais connected to a UI device41, and a sensor input and output unit407ais connected to a sensor42. Note that the arrangement of the transception unit406and the multiplexing/demultiplexing unit405may be reversed.

The monitoring control unit301is connected to each unit of the UI transceiver32, and monitors the state of each unit and changes the setting. The monitoring control unit301is connected to the controller2, and changes connection relation of the UI transceiver32, monitors the state of the UI device41, and performs the operation setting.

The monitoring control unit401is connected to each unit of the UI transceiver43, and monitors the state of each unit and changes the setting. The monitoring control unit401is connected to the controller2, and changes connection relation of the UI transceiver43, monitors the state of the UI device41, and performs the operation setting.

The UI input and output unit302is connected to a UI signal from a computer31in a case of a computer base3. The UI signal is, for example, each signal of an HDMI, a DisplayPort, a USB, a Thunderbolt, a Bluetooth (registered trademark), an analog audio, and a digital audio. The UI input and output unit302is connected to a compression/decompression unit303a.

The UI input and output unit402is connected to the UI device41. The UI input and output unit402is connected to a compression/decompression unit403a.

The sensor input and output unit307is connected to a UI signal from the computer31. The sensor input and output unit307is connected to a compression/decompression unit303b.

The sensor input and output unit407is connected to the sensor42. The sensor input and output unit407is connected to a compression/decompression unit403b.

The compression/decompression units303compress or decompress the capacity of compressible UI signals under the control of the monitoring control unit401. Specific examples include compression of HDMI and DisplayPort signals of display signals, and examples of the compression method include display stream compression (DSC), video electronics standards association (VESA) display compression for mobile (VDC-M), and moving picture experts group (MPEG) defined by VESA. Note that the compression/decompression units303may be omitted. Furthermore, the compression/decompression units303may change the compression method or the decompression method according to the state of the transmission path Tm. For example, the higher the compression rate, the higher the latency of the compression/decompression units303. Therefore, the compression/decompression units303use, for example, no compression or a compression method using a low compression rate in order to implement low latency. The compression/decompression units303are connected to the mapping/demapping units304.

The compression/decompression units403perform reverse processing to that of the compression/decompression units303under the control of the monitoring control unit401. The compression/decompression units403are connected to the mapping/demapping units404.

The mapping/demapping units304convert UI signals into signal forms that enable long-distance transmission under the control of the monitoring control unit301. The signal forms are, for example, OTNs defined by ITU telecommunication standardization sector (ITU-T). The mapping/demapping units304are connected to the multiplexing/demultiplexing unit305.

The mapping/demapping units404convert UI signals into signal forms that enable long-distance transmission under the control of the monitoring control unit401. The mapping/demapping units404are connected to the multiplexing/demultiplexing unit405.

The multiplexing/demultiplexing unit305multiplexes and demultiplexes a plurality of signals under the control of the monitoring control unit301. For example, in a case where OTNs are used as signal forms that enable long-distance transmission, the multiplexing/demultiplexing unit305multiplexes a plurality of optical data unit (ODU) signals output from the mapping/demapping units304into an ODU having larger capacity. The multiplexing/demultiplexing unit305is connected to the transception unit306.

The multiplexing/demultiplexing unit305performs reverse processing to that of the multiplexing/demultiplexing unit305under the control of the monitoring control unit401. The multiplexing/demultiplexing unit405is connected to the transception unit406.

The transception unit306transmits and receives a signal transmitted through the second network NW2under the control of the monitoring control unit301. For example, in a case of an OTN, the transception unit306transmits and receives an optical transport unit (OTU) signal. The transception unit306is connected to the second network NW2to be connected to a UI transceiver43of a user base4via the allocator33, a switcher34, and the transmission path Tm. The information capacity that is transmitted and received is, for example, an OTU0LL, an OTU1, an OTU2, an OTU2e, an OTU3, an OTU4, an OTUCn, a gigabit Ethernet (GbE), 2.5 GbEs, 5 GbEs, 10 GbEs, 25 GbEs, 50 GbEs, 100 GbEs, 400 GbEs, or the like. Note that the transception unit306may change the capacity according to the state of the transmission path Tm.

The transception unit406transmits and receives information to and from a computer base3via the transmission path Tm under the control of the monitoring control unit401.

Next, a processing procedure example of the information processing system1will be described with reference toFIGS.2and4.FIG.4is a sequence diagram of the processing procedure example of a computer system according to the present embodiment.

The first user US1of the user base4a-1selects or inputs a use request of a computer31, for example, by operating the UI device. The UI transceiver43a-1of the user base4a-1transmits the computer use request to the controller2(step S1). The controller2acquires the computer use request transmitted by the UI transceiver43a-1(step32). Note that the computer use request may include performance of a computer desired to be used (including performance of a graphic board) and the like.

On the basis of the computer use request, the controller2selects, for example, a computer31b-1of the computer base3-1closest to the user base4a-1in order to shorten the transmission delay time. In a case where a usable computer31is not in the said computer base3, the controller2may sequentially search for a plurality of computer bases3close to the user base4(step S3).

The controller2controls the switcher34-1and the allocator33-1of the computer base3-1so as to connect the UI transceiver43a-1to the UI transceiver32b-1of the computer base3-1in connection relation of the path Cn11(step34). Under the control of the controller2, the switcher34-1and the allocator33-1of the computer base3-1switch a transmission path Tm-1for connection, allocate the UI transceiver32b-1, and connect the UI transceiver43a-1to the UI transceiver32t-1(step S5). As a result, the UI transceiver43a-1is connected in connection relation of the path Cn11, and the first user US1can use the computer31b-1of the computer base3-1from the user base4a-1.

The second user US2of the user base4b-1selects or inputs a use request of a computer31, for example, by operating the UI device. The UI transceiver43b-1of the user base4b-1transmits the computer use request to the controller2(step S6). The controller2acquires the computer use request transmitted by the UI transceiver43b-1(step S7).

The controller2selects an unused computer31on the basis of the computer use request. For example, in a case where the computers31of the computer base3-1that is closest to the user base4b-1are in use, the controller2selects, for example, a computer31b-2of the computer base3-2that is close to the computer base3-1(step38).

The controller2controls the switcher34-1of the computer base3-1and the switcher34-2and the allocator33-2of the computer base3-2so as to connect the UI transceiver43b-1to the UI transceiver32b-2of the computer base3-2in connection relation of the path Cn12(step S9).

The switcher34-1of the computer base3-1performs switching so as to connect the transmission paths Tm-2and Tm for connection under the control of the controller2(step S10).

Under the control of the controller2, the switcher34-2and the allocator33-2of the computer base3-2perform switching so as to connect the transmission paths Tm-2and Tm, allocate the UI transceiver32b-2, and connect the UI transceiver43b-1to the UI transceiver32b-2(step S10). As a result, the UI transceiver43b-1is connected in connection relation of the path Cn12, and the second user US2can use the computer31b-2of the computer base3-2from the user base4b-1.

As described above, in the present embodiment, the UI devices41and the sensors42of the user bases4are connected to the computers31of the computer bases3via the second network NW2. Note that, in the present embodiment, the delay time between the UI devices41or the sensors42and the computers31can be adjusted, and delay suitable for a delay-sensitive application can be set. Note that the delay time is adjusted by the controller2. As a result, according to the present embodiment, for example, fairness is achieved in gaming and eSports, and sensors can acquire sensing information at a plurality of points at the same time.

Furthermore, according to the present embodiment, the UI devices and the computers can be installed at physically distant locations, the connection relation can be flexibly changed, and also operational feeling that is comparable to that in a case where the UI devices and the computers are locally provided can be achieved.

Second Embodiment

In the present embodiment, connection relation between UI transceivers32and UI transceivers43is determined in consideration of the response time of a UI device41that affects user's operational feeling among UI devices41used by users.

FIG.5is a diagram illustrating an example of an overall configuration of an information processing system according to the present embodiment. As illustrated inFIG.5, an information processing system1X includes a controller2, computer bases3X (3X-1,3X-2, . . . ,3X-n), user bases4X (4X-1,4X-2,4X-3,4X-4, . . . ,4X-m), a first network NW1, and a second network NW2.

In the computer bases3X, computers31(31a-n,31b-n, . . . ) and UI transceivers32X (32Xa-n,32Xb-n, . . . ) (first transceivers) are installed. Note that a part of a configuration of the computer bases3X is omitted.

In the user bases4X, UT devices41(41a-m,41b-m, . . . ), sensors42(42a-m,42b-m, . . . ), and UI transceivers43X (43Xa-m,43Xb-m, . . . ) (second transceivers) are installed.

The information processing system1X includes one or a plurality of the computer bases3X.

In addition to the processing of the controller2, the controller2X controls connection relation between the UI transceivers43X of the user bases4X and the UI transceivers32X of the computer bases3X on the basis of the delay time between the UI transceivers32X and the UI transceivers43X.

Here, the delay time related to operational feeling will be described.

For example, in a case where display devices connected to the UI transceivers43of the user bases4have a refresh rate of 40 (Hz), the update cycle of the display devices is 16.1 (ms). For example, in a case where a user has a keyboard, a computer, and a display device at hand, and inputs a character from the keyboard of the computer to which the keyboard and the display device are directly connected, the character input by the user is reflected on the screen at the next cycle.

On the other hand, in a case where the keyboard and the display are at hand, the computer is remote, and the round-trip delay time is, for example, 100 (me), the lag of the update cycle is 100/16.7=6.0 (frames). In this case, user operation is reflected on the screen with delay of at least six frames being added, and operational feeling is deteriorated.

In the present embodiment, in order to make user's operational feeling comparable to that in a case where a UI device41and a computer31are at hand, the controller2X determines connection relation of UI transceivers such that the delay time falls within predetermined delay time. Note that the predetermined delay time may be, for example, delay time desired by a user. The controller2X selects and connects a UI transceiver32X of a computer base3X such that the round-trip time is within predetermined time desired by a user. For example, in a case where a user requires round-trip time of 16.7 (ms) or less for UI communication, the controller2X selects and connects a UI transceiver32X of a computer base3X on the basis of the predetermined round-trip time and the delay time desired by the user.

Alternatively, in a case where the update frequency of the UI devices41is f (Hz), the controller2X may select and connect a UI transceiver32X of a computer base3X such that the round-trip time between the UI transceivers is 1/f (sec) or less.

As a method of selecting a UI transceiver, there are a method of displaying a table of delay time between the bases included in the controller2X on a display device and selecting delay time by operation of a UI device, a method of calculating delay time from the distance of transmission paths connecting the bases, a method of measuring delay time by actually connecting UI transceivers and changing connection relation until a request condition is satisfied, a combination thereof, and the like.

Next, a configuration example of UI transceivers and measurement of delay time will be described.

FIG.6is a diagram illustrating an example of configurations of UI transceivers according to the present embodiment. In the following description, a case where a UI transceiver32X and a UI transceiver43X have the same configuration will be described, but the configurations may be different. As illustrated inFIG.6, the UI transceiver32X of a computer base3X includes, for example, a monitoring control unit301X, at least one UI input and output unit302(302a, . . . ) or sensor input and output unit307(307a, . . . ), at least one of compression/decompression units303(303a,303b, . . . ), at least one of mapping/demapping units304(304a,304b, . . . ), a multiplexing/demultiplexing unit305, a transception unit306, and a delay measurement unit308. Note that the delay measurement unit308may be arranged between the mapping/demapping units304and the multiplexing/demultiplexing unit305. Note that the configuration illustrated inFIG.6is an example, and the present invention is not limited thereto.

Furthermore, the UI transceiver43X of a user base4X includes, for example, a monitoring control unit401X, at least one UI input and output unit402(402a, . . . ) or sensor input and output unit407(407a, . . . ), at least one of compression/decompression units403(403a,403b, . . . ), at least one of mapping/demapping units404(404a,304b, . . . ), a multiplexing/demultiplexing unit405, a transception unit404, and a delay measurement unit408. Note that the delay measurement unit408may be arranged between the mapping/demapping units404and the multiplexing/demultiplexing unit405. Note that, inFIG.6, a part of the configuration of the UI transceiver43X is omitted.

As illustrated inFIG.6, the UI transceiver32X (43X) of the present embodiment further includes the delay measurement unit308(408) in addition to the UI transceiver32(43) of the first embodiment.

The delay measurement unit308(408) measures delay to the delay measurement unit of the facing UI transceiver. The delay measurement method is, for example, ODU delay measurement (ODU DM) defined by an OTN.

The monitoring control unit301X (401X) acquires the delay time measured by the delay measurement unit308(408). At least either one of the monitoring control unit301X or the monitoring control unit401X outputs delay time information indicating the acquired delay time to the controller2X.

The controller2X determines connection relation between the UI transceiver32and the UL transceiver43on the basis of the delay time acquired from a plurality of UI transceivers33X (or44X).

Next, a processing procedure example of the information processing system1X will be described with reference toFIGS.5to7.FIG.7is a sequence diagram of the processing procedure example of a computer system according to the present embodiment.

A user operates a UK device41of a user base4X to input desired land trip time. A UI transceiver43X transmits the desired land trip time to the controller2X (step S51). The controller2X acquires the desired land trip time of the UI transceiver4(step S52).

The controller2X transmits an instruction to measure delay time to the UI transceivers32X of the computer bases3X (step S53). The UI transceivers32X acquire the instruction to measure delay time (step S54).

The controller2X instructs switchers34and allocators33of the computer bases3so as to temporarily connect the UI transceiver43to the UI transceivers32X of the computer bases3X in order to measure delay time (step S55).

According to the instruction of the controller2X, the switchers34and the allocators33of the computer bases3X perform switching so as to temporarily connect transmission paths for connection, temporarily allocate the UI transceivers32X, and temporarily connect the UI transceiver43X to the UI transceivers32X (step356).

The UI transceiver32X measures delay time between the UI transceivers32X and the UI transceiver43X of the user base4X, and transmits the measurement result obtained by the measuring to the controller2X (step357). The controller2X acquires the measurement result (step S58).

The controller2X selects a computer31to be connected to the UI transceiver43X of the user base4X on the basis of the delay time that is the acquired measurement result (step S59).

The controller2X controls the switchers34and the allocators33of the computer bases3so as to connect the UI transceiver43to a selected UI transceiver32X of a computer base3X (step S60).

Under the control of the controller2X, the switchers34and the allocators33of the computer bases3X perform switching so as to connect the transmission paths for connection, allocate the UI transceiver32X, and connect the UI transceiver43X to the UI transceiver32X (step S61).

Note that the controller2X may acquire and store delay time in advance for each combination of the UI transceivers43X of the user bases4X and the UI transceivers32X of the computer bases3X.

Note that, in a case where a first combination (for example, a UI transceiver43Xa-1and a UI transceiver32Xb-1) is determined, the controller2X may select, for example, a computer31connected to a UT transceiver43Xb-1of a user base4Xb-1on the basis of the delay time of the first combination. For example, the controller2X may select a plurality of combinations of the UI transceiver43Xb-1of the user base4Xb-1and a UI transceiver32Xb-2of the computer base3X-2corresponding to the acquired delay time.

Alternatively, in a case where the first combination is the UI transceiver43Xa-1of the user base4Xa-1and the UI transceiver32Xb-1of a computer base3X-1, for example, a target to be connected to the UI transceiver43Xb-1of another user base4Xb-1may be selected from another UI transceiver32Xa-1of the same computer base3X-1without measuring the delay amount. The reason is because a computer connected to a UK transceiver in the same computer base3X can be considered to have substantially the same delay amount.

As described above, in the present embodiment, the UI devices41and the sensors42of the user bases4are connected to the computers31of the computer bases3via the second network NW2in consideration of delay time. As a result, according to the present embodiment, for example, fairness is achieved in gaming and eSports, and sensors can acquire sensing information at a plurality of points at the same time.

Furthermore, also in the present embodiment, the UI devices and the computers can be installed at physically distant locations, the connection relation can be flexibly changed, and also operational feeling that is comparable to that in a case where the UI devices and the computers are locally provided can be achieved.

First Example

FIG.8is a diagram illustrating a specific first configuration example of an information processing system. In the example ofFIG.8, a graphic board (including GPU321) is provided to a computer31A installed in a computer base3A, and DisplayPorts axe output as video signals. A plurality of terminals may be provided to the graphic board, and for example, signal lines351and352of two systems of DisplayPorts may be simultaneously used as illustrated inFIG.8. Note that a plurality of graphic boards may be provided to one computer, and a plurality of terminals may be used by one user or a plurality of users. Furthermore, the computer31A exchanges operation information and the like with a USB (for example, USB 2.0 or USB 3.2) terminal via the signal lines353and354. Furthermore, a UI transceiver32A of the computer base3A and a UI transceiver43A of a user base4A are connected to, for example, an input and output port (I/O)311of the QSFP28 standard via a transmission path TmA.

The function of the UI transceiver32A is implemented in, for example, an application specific integrated circuit (ASIC) or a field programmable gate array (FPGA).FIG.8illustrates an example in which various signals are accommodated and multiplexed in an OTN using an FPGA in the UI transceiver32A.

A signal transmitted from the UI transceiver32A is transmitted through the optical fiber transmission path TmA and sent to the UI transceiver43A of the user base4A. Note that the transmission path TmA may be single-core bidirectional or double-core bidirectional. In addition, transmission paths may be different depending on the transmission direction, and accordingly, for example, a downstream transmission path may be a passive optical network (PON), and an upstream transmission path may be a transmission path of the fourth generation communication standard or the fifth generation communication standard.

The UI transceiver43A restores the original signals by reverse processing to that of the transmission side. The restored signals, here, the signals of Display Ports451and452, a USB 3.0 (413), and a USB 2.0 (414) are output from the UI transceiver43A, and are, respectively, connected to a display device411, a display device412, an external device413, and an input device414. Examples of the external device413that is a USB device and the input device414that is a USB device include input and output equipment such as keyboards, mice, and gaming controllers, mass storage devices, audio interfaces, cameras, and various sensors. Note that the equipment connected to the UI transceiver43A is not limited thereto. Also in the following configuration examples, equipment similarly connected to a UI transceiver of a user base is not limited thereto.

Although the flow of a signal from the UI transceiver32A of the computer base3A to the UI transceiver43A of the user base4A has been described, data can be transferred in the reverse direction by similar signal processing.

Next, an example in which the UI transceiver32A is implemented in an FPGA will be described with reference toFIG.8. Note that in an implementation g11and the following examples, Comp is an abbreviation for compression, MAP is an abbreviation for mapping, MUX is an abbreviation for multiplexing, Encryp is an abbreviation for encryption, and FEC is an abbreviation for forward error correction.

The FPGA implements a function of an OTN as illustrated in the implementation g11. There are various conceivable resolutions, refresh rates, and color depths of video signals, and, for example, in a case of 4K resolution, 120 (frames per second) (fps), and 24 (bits per pixel) (bpp) in a DisplayPort 1.4, the bit rate is about 26 (Gbps). Compression/decompression units (comps)303(303a,303b) compress the signals as necessary. The compression is performed by, for example, VESA DSC. In a case where the VESA DSC is used, 3:1 compression is performed, and the bit rate can be reduced to about 8.7 (Gbps). In a case where the compression is not performed, there is an advantage of low latency because time for the compression processing is saved, but on the other hand, the transfer capacity increases. On the other hand, in a case where the compression is performed, the compression processing takes time, and thus the latency increases as compared with the case of non-compression, but there is an advantage that the transfer capacity can be reduced.

Note that the bit rate of an image is, for example, 4.67 (Gbps) in a case of 1080p 240 (Hz) DSC, 8.61 (Gbps) in a case of 4K 120 (Hz) 24 (bpp) DSC, and 49.65 (Gbps) in a case of 8K 60 (Hz) 24 (bpp).

Here, processing in the case of non-compression will be described.

DisplayPort signals are accommodated in ODU frames by the mapping function (MAPs363to366) of the OTN. Note that mapping/demapping units304have the mapping function. For the mapping, for example, a bit-synchronous mapping procedure (BMP), an asynchronous mapping procedure (AMP), or a generic mapping procedure (GMP) defined by the OTN can be applied.

The signals accommodated in the ODU are multiplexed into a high-order ODU frame by a multiplexing function (MUX367) of the OTN. When about 26 (Gbps) signals are multiplexed in a case where the high-order ODU is an ODU4, since the size of a tributary slot of the ODU4 is 1.302 (Gbps), the signals can be multiplexed into 20 tributary slots, that is, an ODTU4.20. In the implementation g11, for example, multiplexing hierarchy of the MAPs363to365and the MUX367is ODUflexes (371to373), and multiplexing hierarchy of the MAP366and the MUX367is an ODU0 (374). Furthermore, multiplexing hierarchy of the MUX367and an Ercryp368, multiplexing hierarchy of the Encryp368and an FEC369, and multiplexing hierarchy of an FEC377and the I/O311of the QSFP28 standard are ODU4s (375,376,377). Note that the Encryp368performs encryption processing. The FEC369performs error correction coding processing.

Here, USB signals will be described.

In the example ofFIG.8, a USB 3.0 signal and a USB 2.0 signal are illustrated. The bit rate of the USB 3.0 signal is 5 (Gbps), and the bit rate of the USB 2.0 signal is 480 (Mbps). Similar to the case of a DisplayPort, these USB signals are first accommodated in ODU frames by the mapping function of the OTN, and then multiplexed into a required number of tributary slots of the high-order ODU frame. In a case where the high-order ODU is an ODU4, the USB 3.0 signal can be multiplexed into 4 tributary slots, and the USB 2.0 signal can be multiplexed into 1 tributary slot.

An example of usage of the tributary slots of the ODU4 is illustrated in an area surrounded by a reference sign g12inFIG.8. As long as there is an empty tributary slot, signals other than those illustrated here can be multiplexed. After the multiplexing, an ODU is encrypted as necessary, and then an error correction code (FEC) is assigned to the ODU and output as an OTU4 signal from the UI transceiver. In order to transmit and receive the OTU4 signal to and from the UI transceiver32A, for example, a 100G optical module of the QSFP28 standard or an electric cable including QSFP26 connectors at both ends (direct attachment cable [DAC]) can be used.

Second Example

FIG.9is a diagram illustrating a specific second configuration example of an information processing system. In the example ofFIG.9, signal lines355of computers31B (31B-1,318-2) in a computer base3B are signal lines through which signals of the Thunderbolt 3 standard are transmitted. The computers31B and a UI transceiver32B are connected by the signal lines355. Note that, in a Thunderbolt 3, since a video signal, a USB signal, and the like are multiplexed, both the video signal and the USS signal can be transmitted and received only by the Thunderbolt 3 being transferred. As in an area surrounded by a reference sign922inFIG.9, Thunderbolt 3 signals are accommodated in ODU frames similarly to the first example, then multiplexed into a high-order ODU, and transmitted from the UI transceiver32B to a user base48.

Note that, as illustrated inFIG.9, the UI transceiver32B may be connected to a plurality of the computers31B (31B-1,31B-2), and signals from the computers31B may be multiplexed and transmitted.

A transmission path TmB between the computer base3B and the user base48is, fox example, an OTU4 or an OTL4.4.

The UI transceiver43B of the user base4B is connected to Thunderbolt 3 docks44B (44-1,44B-2). The Thunderbolt 3 docks446demultiplex the multiplexed signals. One or a plurality of display devices411(411-1,411-2) and412(412-1,412-2), external devices413(413-1,413-2) that are USB 3.0 devices, and input devices414(414-1,414-2) such as keyboards and mice are connected to the Thunderbolt 3 docks44B.

Third Example

FIG.10is a diagram illustrating a specific third configuration example of an information processing system. In the example ofFIG.10, signals of two systems of Display Ports are input and output to and from computers31C in a computer base3C via signal lines351and352, and a signal of one system of a USB 2.0 is input and output via a signal line354. These signals are input to a UI transceiver32C. In this example, a case where video signals are 1080p, 60 (fps), and 24 (bpp) is illustrated. In this case, the bit rate of the video signals is about 3.2 (Gbps). USB 2.0 is 480 (Mbps).

These signals are first mapped to ODU frames as in the first and second examples. The ODU signals are multiplexed into a high-order ODU. Here, an ODU2 signal is used as the high-order ODU. The capacity of a tributary slot of the ODU2 is 1.249 (Gbps), and, as in an area surrounded by a reference sign g32inFIG.10, the ODUs including mapped signals are multiplexed into a necessary number of tributary slots. An ODU in which a DisplayPort is accommodated is multiplexed into 3 tributary slots, that is, an ODTU2.3. An ODU in which a USE 2.0 is accommodated is multiplexed into 1 tributary slot, that is, an ODTU2.1.

As in an area surrounded by a reference sign g31inFIG.10, the UI transceiver32C encrypts the ODU2 signal as necessary, assigns an error correction code to the ODU2 signal, and then transmits the OTU2 signal, for example, from an optical module311C of10(Gbps) called small form-factor pluggable plus (SFP+).

A transmission path TmC between the computer base3C and a user base4C is, for example, an OTU2 (LR). Note that the transmission path TmC may be single-core bidirectional or double-core bidirectional.

A UI transceiver43C of the user base4C restores the original signals by reverse processing to that of the transmission side. The restored signals, here, the signals of Display Ports451,452, a USB 2.0 (454) are output from the UI transceiver43C, and are, respectively, connected to the display devices411and412and the input device414that is a USB 2.0 device.

Fourth Example

FIG.11is a diagram illustrating a specific fourth configuration example of an information processing system. In the example ofFIG.11, a plurality of computers31D (31D-1,31D-2,310-3, . . . ) and a plurality of UI transceivers32D (32D-1,32D-2,32D-3, . . . ) are installed in a computer base30.

In this example, performance of graphic board GPUs321D (321D-1,321D-2,321D-3) of three computers31D-1,31D-2, and31D-3is different. For example, a GPU321D-1is a high performance graphic board, a GPU321D-2is a medium performance graphic board, and a GPU321D-3is a low performance graphic board.

Similarly to the first to third examples, the computers31D are connected to the respective UI transceivers32D. An optical switch35D (switch) La connected to output of the UI transceivers32D. The optical switch is, for example, a robot patch panel that changes connection relation of optical connectors by operating a robot arm. The optical switch is connected to each of transmission paths TmD (TmD-1, TmD-2, TmD-3, . . . ), and is connected to UI transceivers43D (43D-1,43D-2,43D-3, . . . ) of user bases4D (4D-1,4D-2,4D-3, . . . ). Note that the transmission paths TmD are, for example, OTU4s or OTL4.4s (LR4).

The UI transceivers43D of the user bases4D are connected to display devices, for example, external devices that are USB 3.0 devices, or, for example, input devices that are USB 2.0 devices, similarly to the first to third examples.

Here, in a case where a user uses graphic performance that is high performance at first time, a computer31D to be used can be selected by connection relation between the UI transceivers32D and the UI transceivers43D being changed by the optical switch35D under the control of a controller2(or2X).

In a case where the same user uses a computer for an application sufficient with graphic performance that is low performance at second time, a suitable computer31D can be used by connection relation between the UI transceivers32D and the UI transceivers43D being changed by the optical switch under the control of the controller2(or2X).

Fifth Example

The mechanism for changing computers to be used is not limited to the configuration using the optical switch35D illustrated inFIG.11of the fourth embodiment.FIG.12is a diagram illustrating a specific fifth configuration example of an information processing system. In the example ofFIG.12, a switch35E is provided between computers31D (31D-1,31D-2,31D-3, . . . ) and UI transceivers32D (32D-1,32D-2,32D-3, . . . ) of a computer base3E. The switch35E is, for example, a display (DP), a USB switch, and the like, and performs switching under the control of a controller2(or2X).

Sixth Example

Furthermore, the optical switch35D illustrated inFIG.11of the fourth example may be a Thunderbolt 3 switch35F (switch) as illustrated inFIG.13.FIG.13is a diagram illustrating a specific sixth configuration example of an information processing system. In the example ofFIG.13, the Thunderbolt 3 switch35F is provided between computers31F (31Fa-1,31Fb-1,31Fa-2,31Fb-2,31Fa-3,31Fb-3, . . . ) and UI transceivers32F (32F-1,32F)-2,32F-3, . . . ) of a computer base3F.

In this case, output ports356of the computers31F are, for example, USB Type-C, and the computers31F and the Thunderbolt 3 switch35F are connected by signal lines355of the Thunderbolt 3 standard or the like.

Note that, for example, computers31F-1(31Fa-1,31Fb-1) are high performance graphic boards, computers31F-2(31Fa-2,31Fb-2) are medium performance graphic boards, and computers31F-3(31Fa-3,31Fb-3) are low performance graphic boards.

Furthermore, in user bases4F (4F-1,4F-2,4F-3, . . . ), ports of UI transceivers43F (43F-1,43F-2,43F-3, . . . ) are connected to Thunderbolt 3 docks44F (44Fa-1,44Fb-1,44Fa-2,44Fb-2,44Fa-3,44Fb-3, . . . ) via signal lines456. Note that switching control of the Thunderbolt 3 docks44F is performed by a controller2(or2X). Furthermore, the configurations of the user bases4F-1,4F-2, and4F-3may be the same or different.

Seventh Example

FIG.14is a diagram illustrating an example of a specific seventh configuration of an information processing system in which a plurality of computer bases is connected to each other.

Here, with reference toFIG.14, a case where a user of a user base4D-1tries to use a computer31G having desired performance, but all computers31G having the performance requested by the user are used by other users and there is no availability in a computer base3G-1directly connected to the user base4D-1by a transmission path, or a case where such a computer31G is not installed will be described.

In this case, it is assumed that a computer31G having performance desired by the user is installed in a computer base3G-2and is available.

At that time, a signal from a UI transceiver43D-1of the user base40-1is connected to an optical switch35G-1of the computer base3G-1directly connected via a transmission path TmD-1as indicated by a dashed line of a path Cn21under the control of a controller2(or2X). Then, in the computer base3G-1, the signal is sent to an optical transmission device36Ga-1for communication with the computer base3G-2in which the computer31G having desired performance by the user is installed. In the computer base3G-1, after the optical transmission device36Ga-1, optical multiplexing is performed by an optical multiplexing device37G-1as necessary, and the signal reaches the computer base3G-2.

In the computer base3G-2, the signal is demultiplexed by an optical multiplexing device37G-2, and the demultiplexed signals are input to an optical transmission device36Ga-2and connected to a UI transceiver32G-2via an optical fiber switch35G-2.

Ports of optical transmission devices36G (36Ga-1,36Gb-1,36Ga-2,36Gb-2) connected to optical switches35G (35G-1,35G-2) (switches) are, for example, ports of the QSFP28 standard. Furthermore, ports of the optical transmission devices36G (36Ga-1,36Gb-1,36Ga-2,36Gb-2) connected to optical multiplexing devices37G (37G-1,37G-2) are, for example, ports of the QSFP56-DD standard.

Furthermore, the optical switches35G (35G-1,35G-2) are, for example, optical fiber switches, robot patch panels, or the like. Furthermore, computer bases3G are connected to each other by a transmission path TmG. The transmission path TmG is, for example, an optical fiber cable or the like through which a signal of 400G-ZR (DWD4) or the OTU4 standard is transmitted.

Note that, inFIG.14, the flow of a signal has been described only in one direction, but the flow in the opposite direction is similar. The configuration described above enables connection to a UI transceiver32G of another computer base3G, and resources of computers31G having desired performance can be interchanged.

Eighth Example

FIG.15is a diagram illustrating another connection example that is a specific eighth configuration example of an information processing system in which adjacent computer bases are connected.

In this example, computer bases3H (3H-1,3H-2) are connected by a transmission medium5H such as a multicore optical fiber or a multicore fiber. By the transmission medium5H, for example, a UI transceiver43D-1of a user base4D-1and a UI transceiver32H-2of a computer base3H-2can be connected. Note that the transmission medium5H may be a multi-path.

Ninth Example

FIG.16is a diagram illustrating another connection example that is a specific ninth configuration example of an information processing system in which adjacent computer bases are connected.

In this example, UI transceivers43J (43J-1,43J-2) of user bases4J (4J-1,4J-2) include WDM interfaces.

As in a path Cn31, a signal from the UI transceivers434reaches an optical switch35J-1of a computer base3J-1to which a user base4J-1is directly connected via transmission paths TmD (TmD-1, TmD-2). Note that optical switches35J (35J,35J-2) (switches) may be optical switches, robot patch switches, or the like. The signal is switched by the optical switch35J-1, input to an optical multiplexing device37J-1or a reconfigurable optical add drop multiplexer (ROADM) so as to be transmitted to an adjacent computer base3J-2, and transmitted to the adjacent computer base3J-2. The transmitted signal is demultiplexed by an optical multiplexing device37J-2or an ROADM, and is connected to a desired UI transceiver32J-2via an optical fiber switch35J-2.

Note that UI transceivers32J (32J-1,323-2) of computer bases3J (3J-1,3J-2) are connected to the optical switches35J via C form-factor pluggable (CFP) 2 ports312, for example. Furthermore, the UI transceivers43J of the user bases4J are connected to the transmission paths TmD (TmD-1, TmD-2) via CFP2 ports457, for example.

Furthermore, a transmission path TmJ is, for example, an optical fiber cable and the like through which a signal of the OTU4 (WDM) standard is transmitted.

Note that each of implementations described above is an example, and the implementation configurations are not limited thereto. For example, another device or the like may be connected to the computer bases3and the user bases4.

As above, the embodiments of the present invention have been described in detail with reference to the drawings. On the other hand, the specific configuration is not limited to the embodiments, and includes design and the like without departing from the spirit of the present invention.

INDUSTRIAL APPLICABILITY

The present invention is applicable to, for example, a gaming system, an eSports system, a remote desktop system, a computer rental system, and the like.

REFERENCE SIGNS LIST

1Information processing system2Controller3Computer base4User base5Position detector31Computer32UI transceiver33Allocator34Switcher35,35E,35F,35G,35H,35J Switch36Optical transmission device37Optical multiplexing device41UI device42Sensor43UI transceiver44Thunderbolt 3 dock301Monitoring control unit302UI input and output unit303Compression/decompression unit304Mapping/demapping unit305Multiplexing/demultiplexing unit304Transception unit307Sensor input and output unit308Delay measurement unit321GPU401Monitoring control unit402UI input and output unit403Compression/decompression unit404Mapping/demapping unit405Multiplexing/demultiplexing unit406Transception unit407Sensor input and output unit408Delay measurement unitNW1First networkNW2Second networkTm Transmission path