Transcription communication

A method of transcription communication may include obtaining, at a first device, audio data during a communication session between the first device and a remote device. The audio data may be obtained from a public switched telephone network. The method may also include directing the audio data from the first device to a second device over a short-range wireless network. The second device may host the short-range wireless network. The method may further include directing the audio data from the second device to a remote transcription system over a wireless cellular network and obtaining, at the second device, transcript data from the remote transcription system over the wireless cellular network. The method may also include limiting data transmitted and received over the wireless cellular network as authorized by the second device to data associated with transcription of audio obtained by the first device over the public switched telephone network.

FIELD

The embodiments discussed herein are related to communication of transcriptions.

BACKGROUND

Audio communications may be performed using different types of devices. In some instances, people that are hard-of-hearing or deaf may need assistance to participate in the audio communications. In these instances, transcriptions of the audio may be provided to the hard-of-hearing or deaf. To provide the transcriptions to a hard-of-hearing or deaf person, a particular device or application running on a mobile device or computer may be used to display text transcriptions of the audio being received by the hard of hearing or deaf person.

SUMMARY

A method of transcription communication may include obtaining, at a first device, audio data during a communication session between the first device and a remote device. The audio data may be obtained from a public switched telephone network. The method may also include directing the audio data from the first device to a second device over a short-range wireless network. The second device may host the short-range wireless network. The method may further include directing the audio data from the second device to a remote transcription system over a wireless cellular network and obtaining, at the second device, transcript data from the remote transcription system over the wireless cellular network. The transcript data may include a transcription of the audio data. The method may also include limiting data transmitted and received over the wireless cellular network as authorized by the second device to data associated with transcription of audio obtained by the first device over the public switched telephone network.

DESCRIPTION OF EMBODIMENTS

Hard-of-hearing people may use one or more devices with a display during communication sessions to assist their understanding of the communication sessions. For example, a transcription of audio of a communication session may be presented in real-time or substantially real-time on a display of a device of a hard-of-hearing person. As a result, the hard-of-hearing person may read the words spoken by a second party during the communication session as well as listen to the words to achieve better understanding during the communication session. In these and other circumstances, to obtain the transcription of the audio, the audio of the communication session may be directed to a transcription system during the communication session. The transcription system may generate the transcription of the audio during the communication session and send the transcription to the device for presentation of the transcription by the device.

Currently, some devices that present transcriptions during communication sessions use Internet protocols (IP) networks connections through an Internet service provider to direct audio to and receive transcriptions from a transcription system for communication sessions conducted over analog voice network, such as a public switched telephone network (PSTN). However, not all hard-of-hearing users have access to an Internet service provider. Some embodiments in this disclosure relate to systems and methods that may be used to send audio to and receive transcriptions from a transcription system without use of IP network connections through an Internet service provider. For example, in some embodiments, the transcription of the audio may be directed back to a device over a wireless cellular network.

In some embodiments, the systems and methods described in this disclosure may be configured to limit data transmitted and received over the wireless cellular network to data associated with transcription of audio obtained over the public switched telephone network. For example, the systems and methods described in this disclosure may limit access to the wireless cellular network to devices that capture audio for transcriptions and present the transcriptions. As another example, the systems and methods described in this disclosure may limit devices that access the Internet or other networks using the wireless cellular network to certain networks or domains.

The systems and methods described in this disclosure may thus provide new and improved systems and methods to provide transcriptions of audio to a device. Furthermore, the systems and methods described in this disclosure may improve technology with respect to audio communications and communication of transcriptions between devices.

Turning to the figures,FIG.1illustrates an example environment100for communication of transcriptions. The environment100may be arranged in accordance with at least one embodiment described in the present disclosure. The environment100may include a first network102, a second network104, a third network106, a remote device110, a first device112, a second device114, and a transcription system130.

The first network102may be configured to communicatively couple the remote device110and the first device112. In some embodiments, the first network102may include any short-range wireless network, such as a wireless local area network (WLAN), a personal area network (PAN), or a wireless mesh network (WMN). For example, the first network102may include networks that use Bluetooth® Class 2 and Class 3 communications with protocols that are managed by the Bluetooth® Special Interest Group (SIG). Other examples of wireless networks may include the IEEE 802.11 networks (commonly referred to as WiFi®), Zigbee networks, Digital Enhanced Cordless Telecommunications (DECT) networks, among other types of LANS, PANS, and WMNS. In some embodiments, the first network102may include an Internet Protocol (IP) based network such as the Internet that is provided by an Internet service provider (ISP). In some embodiments, the first network102may include cellular communication networks for sending and receiving communications and/or data including via hypertext transfer protocol (HTTP), direct data connection, wireless application protocol (WAP), etc. The first network102may also include a mobile data network that may include third-generation (3G), fourth-generation (4G), fifth-generation (5G), long-term evolution (LTE), long-term evolution advanced (LTE-A), Voice-over-LTE (“VoLTE”) or any other mobile data network or combination of mobile data networks. In these or other embodiments, the network may include any combination of analog, digital, and/or optical networks that form a public switched telephone network (PSTN) that may transport audio of a communication session.

Each of the remote device110and the first device112may be any electronic or digital computing device. For example, each of the remote device110and the first device112may include a desktop computer, a laptop computer, a smartphone, a mobile phone, a tablet computer, a telephone, a VoIP (Voice over IP) phone, a phone console, a caption device, a captioning telephone, or any other computing device that may be used for communication between users of the remote device110and the first device112.

In some embodiments, each of the remote device110and the first device112may include memory and at least one processor, which are configured to perform operations as described in this disclosure, among other operations. In some embodiments, each of the remote device110and the first device112may include computer-readable instructions that are configured to be executed by each of the remote device110and the first device112, respectively, to perform operations described in this disclosure.

In some embodiments, each of the remote device110and the first device112may be configured to establish communication sessions with other devices. For example, each of the remote device110and the first device112may be configured to establish an outgoing communication session, such as a telephone call, video call, or other communication session, with another device over a telephone line or other network, such as a portion of the first network102. For example, each of remote device110and the first device112may communicate over a wireless cellular network, a wired Ethernet network, an optical network, and/or a PSTN line.

In some embodiments, each of the remote device110and the first device112may be configured to obtain audio during a communication session. The audio may be part of a video communication or an audio communication, such as a telephone call. As used in this disclosure, the term audio may be used generically to refer to sounds that may include spoken words. Furthermore, the term “audio” may be used generically to include audio in any format, such as a digital format, an analog format, or a propagating wave format. Furthermore, in the digital format, the audio may be compressed using different types of compression schemes. Also, as used in this disclosure, the term video may be used generically to refer to a compilation of images that may be reproduced in a sequence to produce video.

As an example of obtaining audio, the remote device110may be configured to obtain first audio from a first user. For example, the remote device110may obtain the first audio from a microphone of the remote device110or from another device that is communicatively coupled to the remote device110. The remote device110may be configured to direct, to the first device112, the audio of a communication session between the remote device110and the first device112. In these and other embodiments, the first device112may also direct the audio to the transcription system130.

The transcription system130may include any configuration of hardware, such as processors, servers, and storage servers that are networked together and configured to perform a task. For example, the transcription system130may include one or multiple computing systems, such as multiple servers that each include memory and at least one processor. The transcription system130may be configured to generate transcriptions from audio. The audio may include audio from the remote device110, from the first device112, or both the remote device110and the first device112.

In some embodiments, the transcription system130may be an automatic system that automatically recognizes speech independent of human interaction to generate the transcription. In these and other embodiments, the transcription system130may include speech engines that are trained to recognize speech. The speech engine may be trained for general speech and not specifically trained using speech patterns of the participants in the communication session. Alternatively or additionally, the speech engine may be specifically trained using speech patterns of one or both of the participants of the communication session.

Alternatively or additionally, the transcription system130may be a re-voicing system. In a re-voicing system, a human may listen to the audio and re-voice or speak the words in the audio. The re-voiced audio may be provided to a speech recognition system that is trained for the speech of the human that is re-voicing the audio. In some embodiments, the speech recognition system may listen to the audio of the communication session and/or the re-voiced audio. Additionally or alternatively, the speech recognition system may output a transcription of the re-voiced audio and/or of the audio without re-voicing. In these or other embodiments, the transcription system130may be a combination of an interface to a human transcriber and one or more speech engines in various configurations. For example, a speech engine may create a transcription based on audio of the communication session and a human transcriber may listen to the same audio and correct the transcription. Additionally or alternatively, the speech engine may create a first transcription and the human transcriber may create a second transcription and the two transcriptions may be fused into a single transcription.

As described, in some embodiments, the transcription system130may generate a transcription of audio. The transcription system130may also direct the transcription of the audio to the first device112. The first device112may be configured to present the transcription received from the transcription system130. For example, the first device112may be configured to display the received transcriptions on a display that is part of the first device112or a display of a device that is communicatively coupled to the first device112. In some embodiments, the transcription system130may provide captions to multiple devices simultaneously. In some embodiments, the transcription system130, first device112, and/or another system may create and maintain a record of displays selected to show captions for one or more communication sessions. In instances in which a device associated with a first display is conducting a communication session, it may retrieve the record of displays and send a connect message to one or more other displays or to a routing system configured to direct captions to displays.

In some embodiments, the second device114may be configured to relay data between the first device112and the transcription system130using the second network104and the third network106. In these and other embodiments, the second device114may be any electronic or digital computing device. For example, the second device114may include a routing device, a network connection device such as a hotspot device or hub, a desktop computer, a laptop computer, a smartphone, a mobile phone, a tablet computer, or any other computing device that may be used to relay data. In these and other embodiments, the second device114may include memory and at least one processor, which may be configured to perform operations as described in this disclosure, among other operations. In some embodiments, the second device114may include computer-readable instructions that are configured to be executed by the second device114to perform operations described in this disclosure.

In some embodiments, the second network104may include a short-range communication network, such as a wireless local area network (WLAN), a personal area network (PAN), or a wireless mesh network (WMN). For example, the second network104may include networks that use Bluetooth® Class 2 and Class 3 communications with protocols that are managed by the Bluetooth® Special Interest Group (SIG). Other examples of wireless networks may include the IEEE 802.11 networks (commonly referred to as WiFi®), Zigbee networks, Digital Enhanced Cordless Telecommunications (DECT) networks, among other types of LANS, PANS, and WMNS. Alternately or additionally, the second network104may include a wired connection such as a wired router, a USB or USB-C connection, a Thunderbolt connection, a Lightning connection, a packet-based connection such as an Ethernet cable, or an optical connection. In some embodiments, the second network104may include a short-range wireless communication network

In some embodiments, the second network104may be configured to communicatively couple the first device112and the second device114. In these and other embodiments, the second network104may be configured to transfer audio of a communication session that occurs between the remote device110and the first device112. The second network104may transfer the audio between the first device112and the second device114. Alternately or additionally, the second network104may be configured to transfer transcriptions of audio of a communication session that occurs between the remote device110and the first device112that are generated by the transcription system130. The second network104may transfer the transcriptions between the first device112and the second device114. The second network104may also be configured to transfer other data between the first device112and the second device114.

The third network106may include a wide area network. In some embodiments, the third network106may include an Internet Protocol (IP) based network such as the Internet that is provided by an Internet service provider (ISP). In some embodiments, the third network106may include cellular communication networks for sending and receiving communications and/or data including via hypertext transfer protocol (HTTP), direct data connection, wireless application protocol (WAP), etc. Alternately or additionally, the third network106may also include a mobile data network that may include third-generation (3G), fourth-generation (4G), fifth-generation (5G), long-term evolution (LTE), long-term evolution advanced (LTE-A), Voice-over-LTE (“VoLTE”) or any other mobile data network or combination of mobile data networks.

In some embodiments, the third network106may be configured to communicatively couple the second device114and the transcription system130. In these and other embodiments, the third network106may be configured to transfer audio, transcriptions, and other data between the second device114and the transcription system130. In some embodiments, the third network106may be controlled by a wireless telecommunications provider or some other network provider.

An example of the operation of the environment100is now provided. In some embodiments, a communication session between the remote device110and the first device112may be established such that audio originating at the remote device110is directed to the first device112over the first network102. The first device112may present the audio for a user of the first device112. The first device112may also direct the audio to the second device114over the second network104. The second device114may direct the audio to the transcription system130over the third network106. The transcription system130may generate a transcription of the audio and direct the transcription to the second device114over the third network106. The second device114may direct the transcription to the first device112over the second network104. The first device112may present the transcription of the audio to a user of the first device112.

In some embodiments, the third network106may be a general mobile data network that is configured to access the Internet. As a result, any device able to access the second network104may be able to direct data to the second device114for transmission over the third network106. In these and other embodiments, one or more methods to secure the second device114, the second network104, and/or the first device112may be employed to help to prevent unauthorized use of the second device114to direct data over the third network106.

In some embodiments, the systems and methods described herein may limit data transmitted and received over the third network106to data associated with transcription of audio obtained by the first device112over the first network102from the remote device110. In these and other embodiments, the systems and methods described herein may limit data transmitted and received over the third network106as authorized by the second device to data associated with transcription of the audio obtained from the remote device110.

In some embodiments, the data associated with the transcription of audio received from the remote device110may include the audio obtained from the remote device110and transcriptions of the audio obtained from the transcription system130. Alternately or additionally, the data may include data associated with the transcription system130. For example, the transcription system130may provide updates to the first device112over the third network106. Alternately or additionally, the first device112may provide data metrics or other information about the first device112or the user of the first device112that is associated with the transcription system130. In these and other embodiments, data associated with the transcription of audio received from the remote device110may include any data that originates from, is authorized by, or otherwise is associated with the transcription system130.

In some embodiments, limiting data transmitted and received over the third network106may include monitoring an amount or type of data transmitted and/or received over the third network106.

For example, the second device114, the transcription system130, or a system associated with the third network106may be configured to monitor an amount of total download data received over the third network106at the second device114within a particular time period. In these and other embodiments, the first device112, the second device114, and/or the transcription system130may be configured to monitor an amount of transcript data associated with the transcriptions sent to the first device112from the transcription system130over the third network106. Alternately or additionally, the first device112, the second device114, and/or the transcription system130may be configured to monitor other download data obtained by the first device112from the transcription system130within the particular time period. For example, the other download data may include update data and/or configuration data, among other types of data that may be provided by the transcription system130to the first device112within the particular time period. The transcript data and the other download data may be referred to as authorized download data.

A device within the system, such as the first device112, the second device114, and/or the transcription system130may be configured to compare an amount of the total download data to an amount of the authorized download data within the particular time period. The comparison may include determining a difference or ratio between the amounts of the total download data and the authorized download data. In these and other embodiments, the difference or ratio may be compared to a download threshold. If the difference or ratio satisfies the download threshold, it may be determined that data not associated with transcription of audio obtained by the first device112is being obtained over the third network106. The download threshold may be greater than zero to avoid differences in accounting for the amounts of data. For example, the download threshold may be adjusted based on the devices that provide the information. For example, obtaining the information from the transcription system130for the amount of authorized data may result in a first download threshold and obtaining the information from the first device112for the amount of authorized data may result in a second download threshold. The download threshold may assist in not assuming improper use of the second device114for obtaining data from the third network106due to differences in calculating amounts of data.

Alternately or additionally, a device within the system, such as the first device112, the second device114, and/or the transcription system130may be configured to compare an amount of the total upload data sent by the second device114over the third network106to an amount of the authorized upload data sent by the second device114over the third network106within a particular time period. The authorized upload data may be composed of audio provided to the transcription system130and other information provided by the first device112to the transcription system130. The comparison may include determining a difference or ratio between the amounts of the total upload data and the authorized upload data. In these and other embodiments, the difference may be compared to an upload threshold. If the difference or ratio satisfies the upload threshold, it may be determined that data not associated with transcription of audio obtained by the first device112is being transmitted over the third network106. The upload threshold may be determined in a similar manner as the download threshold.

In some embodiments, it may be determined that data not associated with transcription of audio obtained by the first device112is being transmitted over the third network106based on one or both of the upload and download thresholds being satisfied. Alternately or additionally, it may be determined that data not associated with transcription of audio obtained by the first device112is being transmitted over the third network106based on a total data transmitted over a period. The total data transmitted may be a combination of total upload data and total downloaded data over the period. The total data may include authorized data and unauthorized data. In these and other embodiments, it may be determined that data not associated with transcription of audio obtained by the first device112is being transmitted over the third network106based on the total data satisfying a total data threshold. In these and other embodiments, the total data threshold may be selected based on average, maximum, or some other calculation related to typically total data usage for authorized data over the period. When data not associated with transcription of audio obtained by the first device112is being transmitted over the third network106, it may be referred to in this disclosure as improper use of the third network106.

In response to improper use of the third network106, different actions may occur. For example, in some embodiments, an operator of the third network106may be contacted and the credentials to allow the second device114to access the third network106may be suspended. This contact may occur via electronic means such as email, communication via an API, or using other methods. Alternately or additionally, the second device114may be disabled by the transcription system130such that the second device114may not connect to the third network106. In some embodiments, disabling the second device114may include disabling the second device114in a manner such that the first device112may reenable the second device114. For example, the first device112may provide a code to the second device114to reenable the second device114in response to input from a user of the first device112and/or an indication that the inappropriate usage of the second device114has stopped.

Alternately or additionally, an ability of a user of the first device112that is associated with the transcription system130, such as being a customer of a service provided by the transcription system130, to access or receive services from the transcription system130may be reduced or limited. For example, the user may not receive transcriptions of audio of communication sessions with the remote device110or other devices in response to improper use of the third network106.

In some embodiments, a user of the first device112may be contacted when improper use of the third network106is occurring. This contact may be a result of an automated message provided to a call center agent who may contact the user or by an electronic message sent to the user by email, text, automated phone call, or by other automated means. In these and other embodiments, the actions associated with improper user may occur after contacting the user and may be responsive to the user's action or inaction. Alternately or additionally, the actions associated with improper user may occur after contacting the user and further improper use of the third network106occurs. In some embodiments, the use of the third network106may be continued to be monitored and if improper use of the third network106has ended, the actions resulting from improper use may be discontinued.

In some embodiments, limiting data transmitted and received over the third network106may include configuring the second device114and/or the third network106such that only domains associated with the transcription system130may be accessed by the second device114using the third network106. Alternately or additionally, limiting data transmitted and received over the third network106may include configuring the environment100such that credentials to access the third network106stored in an integrated circuit, such as a subscriber identification module (SIM), may be used to access the third network106only when the integrated circuit is used with the second device114. Alternately or additionally, limiting data transmitted and received over the third network106may include configuring the third network106such that an integrated circuit associated with the transcription system130may only be used to access the third network106for data associated with the transcription of audio service provided by the transcription system130. Further examples regarding configurations involving an integrated circuit with credentials to access the third network106are discussed with respect toFIGS.2and3.

In some embodiments, limiting data transmitted and received over the third network106may include configuring the second network104such that only authorized devices may access the second network104and provide data to the second device114for transmission over the third network106. For example, the second network104may be secured such that only authorized devices, such as the first device112, may access the second network104. Further examples of how the second network104may be secured are discussed with respect toFIG.4.

Modifications, additions, or omissions may be made to the environment100and/or the components operating in the environment100without departing from the scope of the present disclosure. For example, in some embodiments, the environment100may be integrated into other environments that provide additional benefits for a user of the environment100.

FIG.2illustrates another example environment200for communication of transcriptions. The environment200may be arranged in accordance with at least one embodiment described in the present disclosure. The environment200may include a network202that includes an access server250, a device210, a transcription system230, and an access server250.

In some embodiments, the network202, the device210, and the transcription system230may include various aspects that are analogous to the third network106, the second device114, and the transcription system130, respectively, ofFIG.1. Accordingly, only further explanation is provided with respect thereto and the description ofFIG.1is applicable to the description ofFIG.2.

The device210may include a memory212that includes a device identifier214and a gateway identifier216. The device210may also include an integrated circuit220that includes credentials222.

The device identifier214may include an International Mobile Equipment Identity (IMEI), a media access control (MAC) address, or some other identifier of the device210. The gateway identifier216may include an access point name (APN) structure that is assigned to the device210to allow the device to access external networks. For example, the gateway identifier216may include information that may allow the network202, in particular, the access server250, to determine a network, such a private network, the Internet, or other network, to connect to the device210by way of the network202. The network202may act as link between the device210and the network specified in the gateway identifier216. In some embodiments, the gateway identifier216may further include parameters that may be used by the network202to establish the link between the device210and the network, such as an IP address to assign to the device210and security methods to employ for the link, among other information.

The integrated circuit220may be a circuit configured to store credentials222for accessing the network202. In some embodiments, the integrated circuit220may be removable and coupled to the device210. For example, the integrated circuit220may be part of a smaller chip that may be placed in communication with the device210or removed from communication with the device210and placed into communication with another device. As an example, the integrated circuit220may be a SIM card. In these and other embodiments, the integrated circuit220may include an operating system configured to securely store the credentials222, such as an international Mobile Subscriber Identity (IMSI) and related keys, that may be used to identify and authenticate a device to allow the device to access the network202.

The access server250may include any configuration of hardware, such as processors, servers, and storage servers that are networked together and configured to perform a task. For example, the access server250may include one or multiple computing systems, such as multiple servers that each include memory and at least one processor. The access server250may be configured to assist in granting the device210access to the network202among other networks, such as the Internet or private networks. For example, the device210may provide the device identifier214, the gateway identifier216, and the credentials222to the access server250. The access server250may analyze the device identifier214, the gateway identifier216, and the credentials222to determine to grant the device210access to the network202and/or a network to link to the device210using the network202.

In some embodiments, the device identifier214, the gateway identifier216, and/or the credentials222may be configured to limit data transmitted and received over the network202to data associated with the transcription system230. Alternately or additionally, the analysis performed by the access server250may be configured to limit data transmitted and received over the network202to data associated with the transcription system230when granting access to the device210.

In some embodiments, access to the network202may be based on the credentials222and on other information provided by the device210. For example, the credentials222may be associated with information. Thus, to access the network202, the device210may provide both the integrated circuit220and the information to the network202. As a result, if the integrated circuit220is used with another device that does not include the information, the connection to the network202may be denied. In some embodiments, the other information may be the device identifier214, the gateway identifier216, a model of the device210, or another identifier or key stored in the memory212of the device210.

As an example of operation, the device210may provisionally connect to the network202. The network202may request credentials and information to allow for the device210to connect to the network202. The device210may provide the credentials222, the device identifier214, the gateway identifier216, and/or other information to the access server250.

The access server250may analyze the credentials222to determine if the credentials222grants access to the network202. The access server250may further analyze the other information to determine if the integrated circuit220is requesting permission for a device210associated with the integrated circuit220. Based on the analysis, the access server250may grant the device210access to the network202.

As an example, the other information may be a particular gateway identifier216. In these and other embodiments, the access server250may verify the credentials222and determine a gateway identifier associated with the credentials222. The access server250may verify that the gateway identifier associated with the credentials222matches the gateway identifier216provided by the device210. In response to a match, the access server250may grant the device210access to the network202. As another example, the other information may be a model or type of the device210such that the credentials222are not associated with a particular device, but a type of device. In these and other embodiments, the access server250may store the association between the credentials222and the device210or after verifying the credentials222may request the other information from another source, such as the transcription system230.

In some embodiments, the gateway identifier216may be configured such that the access server250connects the device210to a specific network, such as a network associated with the transcription system230. As a result, the configuration of the gateway identifier216may limit data transmitted and received over the network202to data associated with the transcription system230. As an example implementation, the gateway identifier216may be configured to point to a network associated with the transcription system230. The device210may be preconfigured with the gateway identifier216. As such, the access server250may form a link through the network202between the network associated with the transcription system230and the device210. As a result, the device210may not be connected to the Internet or other networks and thereby cannot request or send data other than data associated with the transcription system230.

In some embodiments, the gateway identifier216may be configured to point to a particular server or a virtual server, such as a proxy server236associated with the transcription system230. In these and other embodiments, the proxy server236may be configured to forward messages to other servers associated with the transcription system230, such as a first server232and a second server234. Thus, the gateway identifier216may be configured to point to an individual server, the proxy server236, for a connection through the network202. The proxy server236may redirect requests to appropriate servers within the transcription system230.

In some embodiments, to limit data transmitted and received over the network202to data associated with the transcription system230, the device210may be configured to only access a particular website, IP address, range of IP addresses, URL, sub-domain, domain, or other destination. One or more of the destinations may be associated with the transcription system230. As a result, the device210may not be configured to establish connections with websites associated with other domains. For example, an administration server may configure the device210and/or access server250with one or more destinations or lists of destinations that may or may not be allowed. The device210and/or access server250may allow the device210to transmit and/or receive information to/from allowed destinations and block information to/from disallowed destinations.

Modifications, additions, or omissions may be made to the environment200and/or the components operating in the environment200without departing from the scope of the present disclosure. For example, other devices, such as the devices illustrated in the environment100ofFIG.1may be used in the environment200.

FIG.3illustrates another example environment300for communication of transcriptions. The environment300may be arranged in accordance with at least one embodiment described in the present disclosure. The environment300may include a first network302, a second network304, a device310, and a transcription system330.

In some embodiments, the device310and the transcription system330may include various aspects that are analogous to the second device114and the transcription system130, respectively, ofFIG.1. Accordingly, only further explanation is provided with respect thereto and the description ofFIG.1is applicable to the description ofFIG.3. Furthermore, the first network302and the second network304may include various aspects that are analogous to the third network106ofFIG.1. Accordingly, only further explanation is provided with respect thereto and the description ofFIG.1is applicable to the description ofFIG.3.

The device310may include a memory312, a first integrated circuit314, and a second integrated circuit316. The first integrated circuit314, and the second integrated circuit316may include various aspects that are analogous to the integrated circuit220ofFIG.2. Accordingly, only further explanation is provided with respect thereto and the description ofFIG.2is applicable to the description ofFIG.3.

In some embodiments, the first network302may be of the same type as the second network304. However, the first network302and the second network304may be different networks. For example, the first network302and the second network304may each be wireless data network, such as a 3G, 4G, LTE, satellite, or 5G data network that are maintained by different wireless telecommunications providers. In some embodiments, the first network302and/or the second network304may each be a wired data network, such as DSL, cable Internet, a fiber network, Ethernet, or a wired LAN or WAN. In these and other embodiments, the first integrated circuit314may be associated with the first network302and may include credentials that may allow the device310to access the first network302. Alternately or additionally, the second integrated circuit316may be associated with the second network304and may include credentials that may allow the device310to access the second network304. Both of the first network302and the second network304may independently couple the device310to the transcription system330to allow communication therebetween.

In some embodiments, a determination may be made regarding which network, selecting from the first network302, the second network304, or a combination of the first network302and the second network304, to use for communication between the transcription system330and the device310.

In some embodiments, the determination of which network to use may be based on one or more criteria. For example, the criteria may include a signal strength, upload connection speeds, download connection speeds, cost of data transmission, performance statistics for communication between the transcription system330and the device310, measures of how fully loaded a network is such as average network traffic estimates, signals or messages indicating network status such as outages or loss of connections, among other criteria. In these and other embodiments, performance statistics for communication between the transcription system330and the device310may include a percentage of time communication is available; a number, frequency, and/or length of interruptions of communication; and performance with respect the particular data being transmitted, such as the transmission of audio to the transcription system330and transmission of transcriptions to the device310.

In some embodiments, the determination of which network to use may be based on evaluating the networks individually. In these and other embodiments, if one of the networks does not meet a particular threshold, a different network may be selected. Alternately or additionally, the determination of which network to use may be based on a comparison among the different networks. For example, the comparison among the different networks may be made based on scoring for each of the network. In these and other embodiments, each of the different criteria for each of the networks may be assigned a score. The score for each network may be a sum of the scores for each of the criteria. In these and other embodiments, the network with the highest or most favorable score may be selected for use.

In some embodiments, the determination of which network to use may be performed at different intervals or continuously. In these and other embodiments, the intervals may be at particular or random time periods; at a particular or random number of communication sessions or portions of communication sessions, such as portions of a communication session separated by silence; at particular or random amount of data exchanged between the transcription system330and the device310; at the start or end of each communication session; or some other interval. As a result, in some embodiments, the selected network may change between communication sessions and/or during a single communication session. In these and other embodiments, when the selected network changes during a communication session, the change may occur during a period when data exchanged between the transcription system330and the device310is not occurring, such as during periods of silence or when the remote device is not providing audio with speech.

Modifications, additions, or omissions may be made to the environment300and/or the components operating in the environment300without departing from the scope of the present disclosure. For example, other devices, such as the devices illustrated in the environment100ofFIG.1may be used in the environment300. Alternately or additionally, the configuration of the environment200ofFIG.2may be used in the environment300. Alternately or additionally, the environment300may include additional networks connecting the device310and transcription system330or in series with the first network302or second network304. These additional networks may be used and selected using methods and criteria as described above for the first network302and the second network304.

FIG.4illustrates another example environment400for communication of transcriptions. The environment400may be arranged in accordance with at least one embodiment described in the present disclosure. The environment400may include a network402, a first device412, and a second device414.

In some embodiments, the network402, the first device412, and the second device414may include various aspects that are analogous to the second network104, the first device112, and the second device114, respectively, ofFIG.1. Alternately or additionally, the network402, the first device412, and the second device414may include various aspects that are analogous to the third network106, the second device114, and the transcription system130, respectively, ofFIG.1. Accordingly, only further explanation is provided with respect thereto and the description ofFIG.1is applicable to the description ofFIG.4.

In some embodiments, the network402may be configured to such that only authorized devices may access the network402and provide data to the second device414. An example of an authorized device may be the first device412. In these and other embodiments, the second device414may provide data obtained over the network402to another device or system, such as a transcription system over another network.

In some embodiments, the network402may be controlled by the second device414. In these and other embodiments, the second device414may grant the first device412access to the network402based on credentials supplied by the first device412to the second device414. The first device412may obtain the credentials using one or more methods. The credentials may include a MAC address, passwords, a client certification, a device name, a device type, a global or local IP address, a URL, a password, an IMEI, key exchanges, among other credentials.

In some embodiments, the first device412may obtain credentials to access the network402based on information stored in the first device412. For example, the first device412may be manufactured to include the credentials to access the network402. In these and other embodiments, the first device412may include particular credentials that are set based on credentials for the second device414.

In some embodiments, the first device412may obtain credentials to access the network402based on requesting information. For example, the first device412may be configured to request information from a user. In these and other embodiments, the first device412may obtain information from the user that may be used to access the network402. The information may include one or more of an identifier of the network402such as the SSID and a password, a fingerprint, face identification, voiceprint, or other biometric reading of the user, among other information.

In some embodiments, the first device412may obtain information from another device connected to the network402that may be used by the first device412to access the network. Alternately or additionally, the first device412may obtain the information from another system. In these and other embodiments, the first device412may have previously provided the information to the system. Alternately or additionally, the system may include part or all of the information. In these and other embodiments, the first device412may provide identifying information, such as the SSID of the network or other information about the first device412to the other system. The other system may determine the remaining information for the first device412to access the network402and provide the remaining information to the first device412. In these and other embodiments, the first device412may communicate with the other system using a network, such as the first network102ofFIG.1, for example using dual-tone multi-frequency (DTMF) signaling over an analog voice network.

In some embodiments, the second device414may include a whitelist of device identifiers, such as a media access control (MAC) address, that the second device414may allow to access the network402. Thus, if a device does not include a device identifier on the whitelist, the second device414may deny the device access to the network402. In these and other embodiments, the first device412may include a device identifier that is on the whitelist to allow the first device412to access the network402. Alternately or additionally, the whitelist may only include a portion of the device identifiers. In these and other embodiments, in response to a device including the matching portion of the device identifier then the device may be allowed to join the network402. For example, multiple devices may be configured with MAC addresses that contain a first string (e.g. XX:XX:XX:XX, for example, “12:3D:C8:90”) that is shared among the devices and a second string (e.g. AA:BB) that is unique to the device, so that the full MAC address appears as, for example, 12:3D:C8:90:AA:BB. The second device414may grant devices access to the network402where the MAC address includes the first string (12:3D:C8:90). In these and other embodiments, the second device414may include the whitelist. Alternately or additionally, another system may include the whitelist. In these and other embodiments, the second device414may communicate with the other system before granting a device access to the network402.

In some embodiments, access to the network402may be controlled based on a pairing scheme. For example, the first device412and the second device414may be paired using a wired cable. During the wired pairing, the credentials for the network402may be shared and established. As another example, the first device412may host a network before the creation of the network402. The network may allow the second device414to join the network. The second device414may exchange information after the second device414joins the network. The information may include credentials to allow the second device414to verify the first device412. For example, the credentials may include any of the credentials discussed in this disclosure that may be used to allow access to the network. After verifying the first device412, the second device414may share credentials for the first device412to access the network402. For example, the second device414may provide the first device412a particular SSID, frequency range, or other information that may not be broadcast or available for other devices to discover or join the network402. The second device414may also provide the first device412credentials that may be used to join the network402after discovering the network.

In some embodiments, after sharing the information for the network402, the first device412may drop the network and the second device414may create the network402. The first device412may join the network402using the information shared while the first device412and the second device414communicated using the network hosted by the first device412.

Modifications, additions, or omissions may be made to the environment400and/or the components operating in the environment400without departing from the scope of the present disclosure. For example, other devices, such as the devices illustrated in the environment100ofFIG.1may be used in the environment400. Alternately or additionally, the configuration of the environment200ofFIG.2may be used in the environment400. Alternately or additionally, the configuration of the environment300ofFIG.3may be used in the environment400.

FIG.5is a flowchart of another example method500of communication of transcriptions. The method500may be arranged in accordance with at least one embodiment described in the present disclosure. The method500may be performed, in some embodiments, by a system, such as systems illustrated inFIG.1,FIG.2,FIG.3, orFIG.4, or another system. In these and other embodiments, the method500may be performed by a system based on the execution of instructions stored on one or more non-transitory computer-readable media. Although illustrated as discrete blocks, various blocks may be divided into additional blocks, combined into fewer blocks, or eliminated, depending on the desired implementation.

The method500may begin at block502, where audio data may be obtained at a first device during a communication session between the first device and a remote device. In some embodiments, the audio data may be obtained from a public switched telephone network.

At block504, the audio data may be directed from the first device to a second device over a short-range wireless network. In some embodiments, the second device may host the short-range wireless network. In some embodiments, the first device and second device may be clients on the short-range wireless network.

At block506, the audio data may be directed from the second device to a remote transcription system over a wireless cellular network.

At block508, transcript data at the second device may be obtained from the remote transcription system over the wireless cellular network. In some embodiments, the transcript data may include a transcription of the audio data.

At block510, data transmitted and received over the wireless cellular network as authorized by the second device may be limited to data associated with transcription of audio obtained by the first device over the public switched telephone network.

It is understood that, for this and other processes, operations, and methods disclosed herein, the functions and/or operations performed may be implemented in differing order. Furthermore, the outlined functions and operations are only provided as examples, and some of the functions and operations may be optional, combined into fewer functions and operations, or expanded into additional functions and operations without detracting from the essence of the disclosed embodiments.

For example, in some embodiments, limiting data transmitted and received over the wireless cellular network as authorized by the second device may include limiting an integrated circuit with credentials to access the wireless cellular network to use by the second device. In these and other embodiments, the integrated circuit may be removably coupled to the second device.

In some embodiments, limiting the integrated circuit with the credentials to access the wireless cellular network to use by the second device may include directing association of an identifier of the integrated circuit with a particular gateway identifier stored by the second device such that the wireless cellular network denies network access when receiving the identifier of the integrated circuit without the particular gateway identifier.

In some embodiments, limiting the integrated circuit with the credentials to access the wireless cellular network to use by the second device may include directing construction of a table indicating a correspondence between an identifier of the second device and the credentials of the integrated circuit and in response to the identifier of the integrated circuit being used to authenticate a device to access the wireless cellular network, providing for comparison of an identifier of the device to the identifier of the second device.

In some embodiments, in response to the identifier of the device not matching the identifier of the second device based on the comparison, performing one or more of the following: disabling the second device, directing disabling of the credentials of the integrated circuit, and restricting usage of the remote transcription system of a user associated with the first device and the second device.

In some embodiments, limiting data transmitted and received over the wireless cellular network as authorized by the second device to data associated with transcription of audio may include restricting, by the second device, access to the Internet to a single Internet protocol sub-domain or to a particular list of Internet protocol subdomains.

In some embodiments, limiting data transmitted and received over the wireless cellular network as authorized by the second device to data associated with transcription of audio includes directing restriction, by the wireless cellular network, of access to the Internet to a single Internet protocol sub-domain based on a particular gateway identifier stored by the second device and provided to the wireless cellular network.

In some embodiments, limiting data transmitted and received over the wireless cellular network as authorized by the second device to data associated with transcription of audio may include: monitoring an amount of data transmitted and received over the wireless cellular network, determining an estimated amount of data to be transmitted and received over the wireless cellular network based on an amount of audio data provided for transcription to the remote transcription system, determining a difference between or ratio of the amount of data and the estimated amount of data; and in response to the difference or ratio satisfying a threshold, performing one or more of the following: disabling the second device; directing disabling of credentials of an integrated circuit included in the second device, the credentials used by the second device to access the wireless cellular network; and restricting usage of the remote transcription system of a user associated with the first device and the second device.

In some embodiments, limiting data transmitted and received over the wireless cellular network as authorized by the second device to data associated with transcription of audio may include obtaining, by the second device, one or more device identifiers and restricting, by the second device, access to the short-range wireless network to devices that provide one of the one or more device identifiers.

In some embodiments, limiting data transmitted and received over the wireless cellular network as authorized by the second device to data associated with transcription of audio may include hosting, by the first device, a second short-range wireless network; accessing, by the second device, the second short-range wireless network; and in response to accessing the second short-range wireless network, negotiating a connection between the first device and the second device using the short-range wireless network hosted by the second device.

FIG.6illustrates an example system600that may be used during transfer of communication between devices as described in this disclosure. The system600may include a processor610, memory612, a communication unit616, a display device618, a user interface unit620, and a peripheral device622, which all may be communicatively coupled. In some embodiments, the system600may be part of any of the systems or devices described in this disclosure.

For example, the system600may be part of the environment100ofFIG.1and may be configured to perform one or more of the tasks described above with respect to the first device112. As another example, the system600may be part of the environment ofFIG.2and may be configured to perform one or more of the tasks described above with respect to the device210or the transcription system230.

Generally, the processor610may include any suitable special-purpose or general-purpose computer, computing entity, or processing device including various computer hardware or software modules and may be configured to execute instructions stored on any applicable computer-readable storage media. For example, the processor610may include a microprocessor, a microcontroller, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a Field-Programmable Gate Array (FPGA), graphics processing unit (GPU), vector or array processor, a SIMD (single instruction multiple data) or other parallel processor, or any other digital or analog circuitry configured to interpret and/or to execute program instructions and/or to process data.

Although illustrated as a single processor inFIG.6, it is understood that the processor610may include any number of processors distributed across any number of networks or physical locations that are configured to perform individually or collectively any number of operations described herein. In some embodiments, the processor610may interpret and/or execute program instructions and/or process data stored in the memory612. In some embodiments, the processor610may execute the program instructions stored in the memory612.

For example, in some embodiments, the processor610may execute program instructions stored in the memory612that are related to operations for generating transcriptions such that the system600may perform or direct the performance of the operations associated therewith as directed by the instructions.

The memory612may include computer-readable storage media or one or more computer-readable storage mediums for carrying or having computer-executable instructions or data structures stored thereon. Such computer-readable storage media may be any available media that may be accessed by a general-purpose or special-purpose computer, such as the processor610.

Computer-executable instructions may include, for example, instructions and data configured to cause the processor610to perform a certain operation or group of operations as described in this disclosure. In these and other embodiments, the term “non-transitory” as explained in the present disclosure should be construed to exclude only those types of transitory media that were found to fall outside the scope of patentable subject matter in the Federal Circuit decision of In reNuuten,500 F.3d 1346 (Fed. Cir. 2007). Combinations of the above may also be included within the scope of computer-readable media.

The communication unit616may include any component, device, system, or combination thereof that is configured to transmit or receive information over a network. In some embodiments, the communication unit616may communicate with other devices at other locations, the same location, or even other components within the same system. For example, the communication unit616may include a modem, a network card (wireless or wired), an infrared communication device, a wireless communication device (such as an antenna), and/or chipset (such as a Bluetooth device, an 802.6 device (e.g., Metropolitan Area Network (MAN)), a WiFi device, a WiMax device, cellular communication facilities, etc.), a telephone jack, and/or the like. The communication unit616may permit data to be exchanged with a network and/or any other devices or systems described in the present disclosure.

The display device618may be configured as one or more displays that present images, words, etc., like an LCD, LED, OLED, projector, or other type of display. The display device618may be configured to present video, text captions, user interfaces, and other data as directed by the processor610. For example, when the system600is included in the first device112ofFIG.1, the display device618may be configured to present transcriptions.

The user interface unit620may include any device to allow a user to interface with the system600. For example, the user interface unit620may include a mouse, a track pad, a keyboard, buttons, and/or a touchscreen, among other devices. The user interface unit620may receive input from a user and provide the input to the processor610. In some embodiments, the user interface unit620and the display device618may be combined.

The peripheral devices622may include one or more devices. For example, the peripheral devices may include a microphone, an imager, and/or a speaker, among other peripheral devices. In these and other embodiments, the microphone may be configured to capture audio. The imager may be configured to capture images. The images may be captured in a manner to produce video or image data. In some embodiments, the speaker may present audio received by the system600or otherwise generated by the system600by broadcasting the audio.

Modifications, additions, or omissions may be made to the system600without departing from the scope of the present disclosure. For example, in some embodiments, the system600may include any number of other components that may not be explicitly illustrated or described. Further, depending on certain implementations, the system600may not include one or more of the components illustrated and described.

As indicated above, the embodiments described herein may include the use of a special purpose or general purpose computer (e.g., the processor610ofFIG.6) including various computer hardware or software modules, as discussed in greater detail below. Further, as indicated above, embodiments described herein may be implemented using computer-readable media (e.g., the memory612ofFIG.6) for carrying or having computer-executable instructions or data structures stored thereon.

In some embodiments, the different components, modules, engines, and services described herein may be implemented as objects or processes that execute on a computing system (e.g., as separate threads). While some of the systems and methods described herein are generally described as being implemented in software (stored on and/or executed by general purpose hardware), specific hardware implementations or a combination of software and specific hardware implementations are also possible and contemplated.