# Patent

## Title
Dispersive storage area networks

## Abstract

A method for storing data from an electronic device at a plurality of storage devices of a dispersive storage area network includes communicating, from the electronic device via a virtual network connection, one or more packets to a splitting server. The method further includes splitting, at the splitting server, the data for storage on the dispersive storage area network, and communicating, from the splitting server to each of a plurality of storage servers over each of a plurality of virtual network connections, portions of the split data. The method further includes storing, at each of the storage servers, the received portions of the split data for later retrieval.

## Background
CROSS REFERENCE TO RELATED APPLICATIONS
The present application is a U.S. nonprovisional patent application of, and claims priority under 35 U.S.C. §119(e) to, U.S. provisional patent application Ser. No. 61/970,639, filed Mar. 26, 2014, which provisional patent application is hereby incorporated herein by reference.
The present application also incorporates herein by reference U.S. patent application Ser. No. 12/499,075, filed Jul. 7, 2009 and corresponding publication US 2010/0009758; U.S. patent application Ser. No. 12/253,926, filed Oct. 17, 2008, and corresponding publication US 2009/0106439 and U.S. Pat. No. 7,895,348, and U.S. patent application Ser. No. 13/007,595, filed Jan. 14, 2011 and corresponding publication US 2011/0179136 and U.S. Pat. No. 8,560,634 (the “Incorporated Patent Disclosures”). The Incorporated Patent Disclosures disclose and describe technologies that are utilized in connection with aspects, features, and embodiments of the invention, including virtual dispersive networking and virtual dispersive routing technologies. To the extent necessary, and where applicable if anywhere herein, these incorporated publications and patent are relied upon in satisfying 35 U.S.C. §112, ¶1 and ¶6.
The present application further hereby incorporates herein by reference the entire disclosure of Exhibit 1 attached hereto.


COPYRIGHT STATEMENT
All of the material in this patent document is subject to copyright protection under the copyright laws of the United States and other countries. The copyright owner has no objection to the facsimile reproduction by anyone of the patent document or the patent disclosure, as it appears in official governmental records but, otherwise, all other copyright rights whatsoever are reserved.
BACKGROUND OF THE INVENTION
The present invention generally relates to storage area networks, network routing, and network communications.
A storage area network (SAN) is a network created to interconnect one or more data storage devices to produce a system that provides access to consolidated block level data storage. SANs are used to enhance storage devices such as disk arrays (e.g. a RAID array, which is a Redundant Array of Independent Disks), and optical drives and tape libraries. The system is designed so that the storage looks like a local disk. Frequently, the SANs have their own disks that are not accessible to other local devices.
In a conventional implementation of a SAN, cloud-based storage and processing are utilized. However, the use of such cloud-based storage and processing can present significant security and information fidelity issues. For example, data to be transferred may not transfer due to an error with a server or a storage device, or a hacker may attempt to break in through a public access point, such as a website. Further, breaches may occur when employees are careless or malicious, thereby allowing data to be copied or stolen from a database, or, perhaps worse, allowing data to be changed, or other actions taken that may case additional harm. Further still, sometimes a storage area network may fail to transfer files because only one route is available, which can increase risk if communications are attempted multiple times. Encryption is sometimes utilized to protect data in a SAN, but, given enough processing power, such encryption alone may not be enough.
Thus, storing information in a network, such as in cloud storage, is subject to theft and hacking, both where information is stored and as it is being transferred over the network, allowing hackers to potentially collect sensitive and personal information, e.g. from devices and storage facilities, or from data in motion. For example, information can be stolen by copying data out of a database, monitoring data streaming in to a database, or taking data directly off an end user device. Companies can no longer rely on encryption as the only method to secure their data.
There exist needs for improvement in storage area networks. One or more of these needs is addressed by one or more aspects of the present invention.
SUMMARY OF THE INVENTION
The present invention includes many aspects and features. Moreover, while many aspects and features relate to, and are described in, the context of network routing and network communications associated with the Internet, the present invention is not limited to use only in conjunction with the Internet and is applicable in other networked systems not associated with the Internet, as will become apparent from the following summaries and detailed descriptions of aspects, features, and one or more embodiments of the present invention.
A first aspect relates to a method for storing data from a first electronic device at a plurality of storage devices of a dispersive storage area network. The method includes spawning, at the first electronic device, a first virtual machine that virtualizes network capabilities of the first electronic device such that a first virtual network connection is provided; spawning, at a first storage server, a second virtual machine that virtualizes network capabilities of the first storage server such that a second virtual network connection is provided; spawning, at a second storage server, a third virtual machine that virtualizes network capabilities of the second storage server such that a third virtual network connection is provided; spawning, at a third storage server, a fourth virtual machine that virtualizes network capabilities of the third storage server such that a fourth virtual network connection is provided; spawning, at a splitting server, a fifth virtual machine that virtualizes network capabilities of the splitting server such that a fifth virtual network connection is provided; communicating, from the first electronic device via the first virtual network connection, one or more packets for communication to the splitting server containing data for storage on the dispersive storage area network; receiving, at the splitting server via the fifth virtual network connection, the one or more packets containing data for storage on the dispersive storage area network; spawning, at a splitting server, a sixth virtual machine that virtualizes network capabilities of the splitting server such that a sixth virtual network connection is provided; spawning, at a splitting server, a seventh virtual machine that virtualizes network capabilities of the splitting server such that a seventh virtual network connection is provided; spawning, at a splitting server, an eighth virtual machine that virtualizes network capabilities of the splitting server such that an eighth virtual network connection is provided; splitting, at the splitting server, the data for storage on the dispersive storage area network; communicating, from the splitting server via the sixth virtual network connection, one or more packets for communication to the first storage server representing a first portion of the split data; receiving, at the first storage server via the second virtual network connection, the one or more packets representing a first portion of the split data; storing, at the first storage server, the first portion of the split data; communicating, from the splitting server via the seventh virtual network connection, one or more packets for communication to the second storage server representing a second portion of the split data; receiving, at the second storage server via the third virtual network connection, the one or more packets representing a second portion of the split data; storing, at the second storage server, the second portion of the split data; communicating, from the splitting server via the eighth virtual network connection, one or more packets for communication to the third storage server representing a third portion of the split data; receiving, at the third storage server via the fourth virtual network connection, the one or more packets representing a third portion of the split data; and storing, at the third storage server, the third portion of the split data.
In a feature of this aspect, the first electronic device comprises a mobile phone.
In a feature of this aspect, the first electronic device comprises a tablet.
In a feature of this aspect, the first electronic device comprises a computer.
In a feature of this aspect, the first electronic device comprises a laptop.
In a feature of this aspect, the first electronic device comprises a mobile electronic device.
In a feature of this aspect, the splitting server comprises a server.
In a feature of this aspect, the splitting server comprises a mobile electronic device.
In a feature of this aspect, the first storage server comprises a mobile phone.
In a feature of this aspect, the first storage server comprises a tablet.
In a feature of this aspect, the first storage server comprises a computer.
In a feature of this aspect, the first storage server comprises a laptop.
In a feature of this aspect, the first storage server comprises a mobile electronic device.
In a feature of this aspect, the first storage server comprises a first server at a first data center, and the second storage server comprises a second server at a second data center different from the first data center.
In a feature of this aspect, the first portion of the split data includes data overlapping with data from the second portion of the split data.
In a feature of this aspect, the splitting server comprises a plurality of physical servers at a first data center.
In a feature of this aspect, the splitting server comprises a plurality of physical servers at a plurality of data centers.
Another aspect relates to a method for storing data from a first electronic device at a plurality of storage devices of a dispersive storage area network. The method includes communicating, from a splitting server to a presence server, presence information for the splitting server; communicating, from a first storage server to the presence server, presence information for the first storage device; communicating, from a second storage server to the presence server, presence information for the second storage device; communicating, from a third storage server to the presence server, presence information for the third storage device; receiving, at the first electronic device from the presence server, presence information for the splitting server; spawning, at the first electronic device, a first virtual machine that virtualizes network capabilities of the first electronic device such that a first virtual network connection is provided; spawning, at the first storage server, a second virtual machine that virtualizes network capabilities of the first storage server such that a second virtual network connection is provided; spawning, at the second storage server, a third virtual machine that virtualizes network capabilities of the second storage server such that a third virtual network connection is provided; spawning, at the third storage server, a fourth virtual machine that virtualizes network capabilities of the third storage server such that a fourth virtual network connection is provided; spawning, at the splitting server, a fifth virtual machine that virtualizes network capabilities of the splitting server such that a fifth virtual network connection is provided; communicating, from the first electronic device via the first virtual network connection, one or more packets for communication to the splitting server containing data for storage on the dispersive storage area network; receiving, at the splitting server via the fifth virtual network connection, the one or more packets containing data for storage on the dispersive storage area network; receiving, at the splitting server from the presence server, presence information for the first storage server, second storage server, and third storage server; spawning, at a splitting server, a sixth virtual machine that virtualizes network capabilities of the splitting server such that a sixth virtual network connection is provided; spawning, at a splitting server, a seventh virtual machine that virtualizes network capabilities of the splitting server such that a seventh virtual network connection is provided; spawning, at a splitting server, an eighth virtual machine that virtualizes network capabilities of the splitting server such that an eighth virtual network connection is provided; splitting, at the splitting server, the data for storage on the dispersive storage area network; communicating, from the splitting server via the sixth virtual network connection, one or more packets for communication to the first storage server representing a first portion of the split data; receiving, at the first storage server via the second virtual network connection, the one or more packets representing a first portion of the split data; storing, at the first storage server, the first portion of the split data; communicating, from the splitting server via the seventh virtual network connection, one or more packets for communication to the second storage server representing a second portion of the split data; receiving, at the second storage server via the third virtual network connection, the one or more packets representing a second portion of the split data; storing, at the second storage server, the second portion of the split data; communicating, from the splitting server via the eighth virtual network connection, one or more packets for communication to the third storage server representing a third portion of the split data; receiving, at the third storage server via the fourth virtual network connection, the one or more packets representing a third portion of the split data; and storing, at the third storage server, the third portion of the split data.
In a feature of this aspect, the presence server comprises one or more servers disposed at different locations.
Another aspect relates to a method for storing data from a first electronic device at a plurality of storage devices of a dispersive storage area network. The method includes communicating, from a first storage server to a splitting server, presence information for the first storage device; communicating, from a second storage server to the splitting server, presence information for the second storage device; communicating, from a third storage server to the splitting server, presence information for the third storage device; spawning, at the first electronic device, a first virtual machine that virtualizes network capabilities of the first electronic device such that a first virtual network connection is provided; spawning, at the first storage server, a second virtual machine that virtualizes network capabilities of the first storage server such that a second virtual network connection is provided; spawning, at the second storage server, a third virtual machine that virtualizes network capabilities of the second storage server such that a third virtual network connection is provided; spawning, at the third storage server, a fourth virtual machine that virtualizes network capabilities of the third storage server such that a fourth virtual network connection is provided; spawning, at the splitting server, a fifth virtual machine that virtualizes network capabilities of the splitting server such that a fifth virtual network connection is provided; communicating, from the first electronic device via the first virtual network connection, one or more packets for communication to the splitting server containing data for storage on the dispersive storage area network; receiving, at the splitting server via the fifth virtual network connection, the one or more packets containing data for storage on the dispersive storage area network; receiving, at the splitting server from the presence server, presence information for the first storage server, second storage server, and third storage server; spawning, at a splitting server, a sixth virtual machine that virtualizes network capabilities of the splitting server such that a sixth virtual network connection is provided; spawning, at a splitting server, a seventh virtual machine that virtualizes network capabilities of the splitting server such that a seventh virtual network connection is provided; spawning, at a splitting server, an eighth virtual machine that virtualizes network capabilities of the splitting server such that an eighth virtual network connection is provided; splitting, at the splitting server, the data for storage on the dispersive storage area network; communicating, from the splitting server via the sixth virtual network connection, one or more packets for communication to the first storage server representing a first portion of the split data; receiving, at the first storage server via the second virtual network connection, the one or more packets representing a first portion of the split data; storing, at the first storage server, the first portion of the split data; communicating, from the splitting server via the seventh virtual network connection, one or more packets for communication to the second storage server representing a second portion of the split data; receiving, at the second storage server via the third virtual network connection, the one or more packets representing a second portion of the split data; storing, at the second storage server, the second portion of the split data; communicating, from the splitting server via the eighth virtual network connection, one or more packets for communication to the third storage server representing a third portion of the split data; receiving, at the third storage server via the fourth virtual network connection, the one or more packets representing a third portion of the split data; and storing, at the third storage server, the third portion of the split data.
Another aspect relates to a method for detecting corruption of data communicated via virtual dispersive routing which includes generating a first hash for data to be communicated to a destination; splitting that data for communication via virtual dispersive routing; recombining the split data at the destination; generating a second hash at the destination for the recombined data; and comparing the first hash to the second hash to determine whether the data has been corrupted.
Another aspect relates to a method for detecting corruption of data stored via a storage area network, the method comprising generating a first hash for data to be stored in a storage area network; storing the data in the storage area network; retrieving the data from the storage area network; generating a second hash for the retrieved data; and comparing the first hash to the second hash to determine whether the stored data has been corrupted.
Another aspect relates to a method for authenticating a device forming part of a storage area network by utilizing a fingerprint of stored data for such authentication.
Another aspect relates to a method for authenticating a device by using an authentication token derived from past connection information for a communication with that device.
Another aspect relates to a method for authenticating a device by using an authentication token derived from past connection path information for a communication with that device.
In addition to the disclosed aspects and features of the present invention, it should be noted that the present invention further encompasses the various possible combinations and subcombinations of such aspects and features. Thus, for example, any aspect may be combined with an aforementioned feature in accordance with the present invention without requiring any other aspect or feature.



BRIEF DESCRIPTION OF THE DRAWINGS
One or more preferred embodiments of the present invention now will be described in detail with reference to the accompanying drawings.
FIG. 1 illustrates components of a VDR software client loaded onto a client device in accordance with an embodiment of the present invention.
FIG. 2 illustrates how a VDR client gathers LAN routing information and queries an external network for backbone information and application-specific routing information in accordance with an embodiment of the present invention.
FIG. 3 illustrates how data is added to the payload of a packet on each of a plurality of hops in accordance with an embodiment of the present invention.
FIGS. 4A-C provide a simplified example of a VDR software response to a network attack in accordance with an embodiment of the present invention.
FIGS. 5A-C illustrate an exemplary VDR implementation in accordance with a preferred embodiment of the present invention.
FIG. 6 includes Table 1, which table details data stored by a node in the payload of a packet.
FIG. 7 illustrates a direct connection between two clients in accordance with one or more preferred implementations.
FIG. 8 illustrates an exemplary process for direct transfer of a file from a first client to a second client in accordance with one or more preferred implementations.
FIG. 9B illustrates an exemplary user interface for a Sharzing file transfer application in accordance with one or more preferred implementations.
FIG. 10 presents table 9, which illustrates potential resource reduction in accordance with one or more preferred implementations.
FIG. 11 illustrates client and server architectures in accordance with one or more preferred implementations.
FIGS. 12 and 13 illustrate exemplary processes for downloading of a file in accordance with one or more preferred implementations.
FIG. 14 illustrates the use of a dispersive virtual machine implemented as part of a software application that can be easily downloaded to a device such as a PC, smart phone, tablet, or server.
FIG. 15 illustrates a methodology in which data to be sent from a first device to another device is split up into multiple parts which are sent separately over different routes and then reassembled at the other device.
FIG. 16 illustrates how multiple packets can be sent over different deflects in a direct spreading of packets methodology.
FIG. 17 illustrates how multiple packets can be sent to different IP addresses and/or ports in a hopping IP addresses and ports methodology.
FIG. 18 illustrates an exemplary system architecture configured to allow clients in a task network to access the Internet through an interface server using virtual dispersive networking (VDN) spread spectrum protocols.
FIG. 19 illustrates an exemplary system architecture configured to enable a workstation with four independent connections to the internet to send traffic using virtual dispersive networking spread spectrum protocols to an interface server from each independent internet connection.
FIGS. 20-23 illustrate an exemplary scenario utilizing point of entry gateways.
FIGS. 24-27 illustrate a similar scenario as that illustrated in FIGS. 20-23, only one or more deflects utilized for some communications or connections.
FIG. 28 illustrates the overlapping of data by sending it to a mobile device via two different wireless networks.
FIG. 29 illustrates VDN routing from a first virtual thin client to another virtual thin client using two deflects that are configured simply to pass data through.
FIG. 30 illustrates a system in which deflects are configured to reformat data to another protocol.
FIG. 31A illustrates a first packet which includes data A, as well as a second packet which includes data B.
FIG. 31B illustrates a superframe which has been constructed that includes both data A and data B.
FIGS. 32-33 illustrate a process in which a superframe is sent from a first virtual thin client to a deflect.
FIG. 34 illustrates a superframe which itself includes a superframe (which includes two packets) as well as a packet.
FIG. 35 illustrates how communications are intercepted at the session layer and parsed out to a plurality of links.
FIG. 36 illustrates a plurality of data paths from a first end device to a second end device.
FIG. 37 illustrates several data paths that pass through multiple deflects.
FIG. 38 illustrates how a connection from a first VTC to a second VTC through a second deflect is still possible even though it is not possible to connect through a first or third deflect.
FIG. 39 illustrates the receipt by a device accessing data of a plurality of data streams from each of the devices any portion of the data is stored on.
FIGS. 41-44 illustrate exemplary systems including a plurality of storage servers.
FIG. 45 illustrates a scenario in which a user's mobile phone is allowed to access specific information that is “proper” for the user to access.
FIGS. 46-56 illustrate exemplary methodologies for detecting whether communicated data has been corrupted.
FIGS. 57-68 illustrate exemplary methodologies for determining whether data stored in a storage area network has been corrupted.
FIGS. 69A-76 illustrate an exemplary methodology for authentication utilizing a fingerprint of stored data.



DETAILED DESCRIPTION
As a preliminary matter, it will readily be understood by one having ordinary skill in the relevant art (“Ordinary Artisan”) that the present invention has broad utility and application. Furthermore, any embodiment discussed and identified as being “preferred” is considered to be part of a best mode contemplated for carrying out the present invention. Other embodiments also may be discussed for additional illustrative purposes in providing a full and enabling disclosure of the present invention. Moreover, many embodiments, such as adaptations, variations, modifications, and equivalent arrangements, will be implicitly disclosed by the embodiments described herein and fall within the scope of the present invention.
Accordingly, while the present invention is described herein in detail in relation to one or more embodiments, it is to be understood that this disclosure is illustrative and exemplary of the present invention, and is made merely for the purposes of providing a full and enabling disclosure of the present invention. The detailed disclosure herein of one or more embodiments is not intended, nor is to be construed, to limit the scope of patent protection afforded the present invention, which scope is to be defined by the claims and the equivalents thereof. It is not intended that the scope of patent protection afforded the present invention be defined by reading into any claim a limitation found herein that does not explicitly appear in the claim itself.
Thus, for example, any sequence(s) and/or temporal order of steps of various processes or methods that are described herein are illustrative and not restrictive. Accordingly, it should be understood that, although steps of various processes or methods may be shown and described as being in a sequence or temporal order, the steps of any such processes or methods are not limited to being carried out in any particular sequence or order, absent an indication otherwise. Indeed, the steps in such processes or methods generally may be carried out in various different sequences and orders while still falling within the scope of the present invention. Accordingly, it is intended that the scope of patent protection afforded the present invention is to be defined by the appended claims rather than the description set forth herein.
Additionally, it is important to note that each term used herein refers to that which the Ordinary Artisan would understand such term to mean based on the contextual use of such term herein. To the extent that the meaning of a term used herein—as understood by the Ordinary Artisan based on the contextual use of such term—differs in any way from any particular dictionary definition of such term, it is intended that the meaning of the term as understood by the Ordinary Artisan should prevail.
Furthermore, it is important to note that, as used herein, “a” and “an” each generally denotes “at least one,” but does not exclude a plurality unless the contextual use dictates otherwise. Thus, reference to “a picnic basket having an apple” describes “a picnic basket having at least one apple” as well as “a picnic basket having apples.” In contrast, reference to “a picnic basket having a single apple” describes “a picnic basket having only one apple.”
When used herein to join a list of items, “or” denotes “at least one of the items,” but does not exclude a plurality of items of the list. Thus, reference to “a picnic basket having cheese or crackers” describes “a picnic basket having cheese without crackers”, “a picnic basket having crackers without cheese”, and “a picnic basket having both cheese and crackers.” Finally, when used herein to join a list of items, “and” denotes “all of the items of the list.” Thus, reference to “a picnic basket having cheese and crackers” describes “a picnic basket having cheese, wherein the picnic basket further has crackers,” as well as describes “a picnic basket having crackers, wherein the picnic basket further has cheese.”
Further, as used herein, the term server may be utilized to refer to either a single server, or a plurality of servers working together.
Additionally, as used herein, “an open network connection” generally means a network pathway of router nodes that extends between two end-user devices whereby data is sent from one of the end-user devices to the other end-user device without connecting to a server, or an equivalent pathway where the data that is sent is neither stored nor forwarded by a server.
Referring now to the drawings, one or more preferred embodiments of the present invention are next described. The following description of one or more preferred embodiments is merely exemplary in nature and is in no way intended to limit the invention, its implementations, or uses.
VDR
Virtual dispersive routing (hereinafter, “VDR”) relates generally to providing routing capabilities at a plurality of client devices using virtualization. Whereas traditional routing calls for most, if not all, routing functionality to be carried out by centrally located specialized routing devices, VDR enables dispersed client devices to assist with, or even takeover, routing functionality, and thus is properly characterized as dispersive. Advantageously, because routing is performed locally at a client device, a routing protocol is selected by the client based upon connection requirements of the local application initiating the connection. A protocol can be selected for multiple such connections and multiple routing protocols can even be utilized simultaneously. The fragile nature of the routing protocols will be appreciated, and thus virtualization is utilized together with the localization of routing to provide a much more robust system. Consequently, such dispersive routing is properly characterized as virtual.
More specifically, preferred VDR implementations require that a VDR software client be loaded on each client device to help control and optimize network communications and performance. Preferably, VDR is implemented exclusively as software and does not include any hardware components. Preferably, the basic components of a VDR software client include a routing platform (hereinafter, “RP”); a virtual machine monitor (hereinafter, “VMM”); a dispersive controller (hereinafter, “DC”); and an application interface (hereinafter, “AI”). FIG. 1 illustrates each of these components loaded onto a client device. Each of these components is now discussed in turn.
The Routing Platform (RP) and Multiple Routing Protocols
Despite eschewing the traditional routing model utilizing central points of control, VDR is designed to function with existing routing protocols. Supported routing protocols, together with software necessary for their use, are included in the routing platform component of the VDR software, which can be seen in FIG. 1. For example, the RP includes software to implement and support the Interior Gateway Routing Protocol (“IGRP”), the Enhanced Interior Gateway Routing Protocol (“EIGRP”), the Border Gateway Protocol (“BGP”), the Open Shortest Path First (“OSPF”) protocol, and the Constrained Shortest Path First (“CSPF”) protocol. It will be appreciated that in at least some embodiments, a port will be needed to allow conventional routing software to run on a chip core (for example, a core of an Intel chip) at a client device. Preferably, multi-core components are used to allow routing protocols to be run on multiple cores to improve overall performance.
Moreover, it will be appreciated that the ability to support multiple routing protocols allows VDR to meet the needs of applications having varying mobility requirements. Applications can be supported by ad hoc algorithms such as pro-active (table driven) routing, reactive (on-demand) routing, flow oriented routing, adaptive (situation aware) routing, hybrid (pro-active/reactive) routing, hierarchical routing, geographical routing, and power aware routing. Further, the use of multiple protocols supports broadcasting, multi-casting, and simul-casting. It will be appreciated that the use of multiple protocols provides support for multi-threaded networking as well.
The Virtual Machine Monitor (VMM) and Virtualization
It will be appreciated that virtualization is known in some computing contexts, such as virtualization of memory and processing. Virtualization enables the abstraction of computer resources and can make a single physical resource appear, and function, as multiple logical resources. Traditionally, this capability enables developers to abstract development of an application so that it runs homogenously across many hardware platforms. Further, virtualization might allow applications to run seamlessly across multiple machines or simultaneously on a single machine. More generally, virtualization is geared to hiding technical detail through encapsulation. This encapsulation provides the mechanism to support complex networking and improved security that is required to enable routing at client devices.
More specifically, a virtual machine (hereinafter, “VM”) is a software copy of a real machine interface. The purpose of running a VM is to provide an environment that enables a computer to isolate and control access to its services. The virtual machine monitor (VMM) component is used to run a plurality of VMs on a real machine and interface directly with that real machine. As an example, consider a VMM on a real machine that creates and runs a plurality of VMs. A different operating system is then loaded onto each VM. Each VM provides a virtual interface that would appear to each operating system to be a real machine. The VMM runs the plurality of VMs and interfaces with the real machine.
Virtual machine technology enables hundreds of virtual machines to work together as well as provides the capability to migrate a running virtual machine to other computer hardware. A VM environment enables the testing of new operating systems, simultaneous execution of programs run by multiple operating systems, and server consolidation. Sometimes, however, virtual machines can be relatively slow. Significant delay can occur compared to an operating system accessing the hardware natively. However, advances using parallel thread execution and hardware specifically built for the support of VMs can significantly bridge this gap.
In a VDR implementation, a VMM is utilized to create a VM for each distinct connection. It is helpful to explain at this juncture that what comprises a connection can vary, but in general includes a transfer of data in the form of packets from a first end device to a second end device along a path (or route). It will be appreciated that a single application can require multiple connections, for example, an application may require multiple connections because of bandwidth application requirements and performance requirements; in this event each connection preferably interfaces with its own VM and each connection can utilize (sometimes referred to as being tied to) the same routing protocol or different routing protocols, even though the connections are themselves necessitated by the same application. Similarly, although two connections may at times travel along an identical path, the connections themselves are nevertheless distinct, and each will preferably still continue to interface with its own VM.
The Dispersive Controller (DC) and Optimizing Performance
In one or more preferred implementations, when a client is in need of a new connection, a dispersive controller located between an operating system and a driver that controls network hardware (such as a NIC card) intercepts the request for a new connection and tells the VMM to spawn a new VM associated with the desired connection. The DC then queries the application interface and utilizes any information obtained to select a routing protocol from among those supported by the RP. This selected routing protocol, however, is currently believed to be generally useless without knowledge of the surrounding network. To this end, the DC allows each client to find other clients, interrogate network devices, and utilize system resources. Thus, each VDR client is “network aware”, in that routing information is gathered and maintained at each client by the DC.
FIG. 2 illustrates how a VDR client 201 gathers LAN routing information and queries an external network for backbone information and application-specific routing information. In response to these queries, routing information is returned. This returned routing information is cached, processed, data mined, compared to historical data, and used to calculate performance metrics to gauge and determine the overall effectiveness of the network. This is possible because the resources available at a VDR client will typically be greater than those available at a conventional router.
In at least some embodiments, a VDR network functions in some ways similarly to a conventional network. In a conventional network, data, in the form of packets, is sent to a router to be routed according to a routing table maintained at the router. Similarly, in a VDR network, after utilizing gathered network information to generate a routing table, a client device utilizes this generated routing table to select a route and transmit a packet accordingly, which packet is then received by another client device and routed according to that client's routing table, and so on, until the packet reaches its destination.
However, rather than simply passing on received packets from client to client, in a manner akin to a traditional router, VDR, via the DC, instead takes advantage of the storage and processing resources available at each client, while still remaining compatible with existing network architecture, by attaching lower level protocol data to the payload of transmitted packets for subsequent client analysis.
More specifically, when a packet is received at a VDR client, a virtual machine intercepts the packet passed from the networking hardware (for example, a NIC card) and places it in memory. The VDR client then processes the packet data. When the data is subsequently passed on, this processed data is appended to the payload of the packet together with information relating to the VDR client for analysis at the destination. As can be seen in FIG. 3, the result of this process is that each hop causes additional information to be added to the payload of a packet, and thus results in a direct increase in payload size proportionate to the number of hops taken by the packet. Specifically, each hop is believed to result in an increase of 35 bytes for an IPv4 implementation, and 59 bytes for an IPv6 implementation. Table 1 of FIG. 6 details the information stored from each layer, along with the number of bytes allotted for each field. It will be appreciated that different or additional information could be stored in alternative embodiments.
Currently, 128-bit addressing provides support for IPv4 and IPv6 addressing, but support for additional addressing schemes is contemplated. It will be appreciated that for a typical communication over the Internet, i.e., one consisting of around 20 hops, the overhead appended to the payload will be around 700 bytes utilizing IPv4 and around 1180 bytes utilizing IPv6. It is believed that, in a worst case scenario, an extra IP datagram could be required for every datagram sent. Although some of this data may seem redundant at first blush, some repetition is tolerable and even necessary because network address translation (“NAT”) can change source or destination fields. That being said, it is contemplated that some implementations use caching to lower this overhead. Additionally, in at least some implementations, the VDR client utilizes application specific knowledge to tailor the information that is appended to the needs of a specific application.
Conventionally, when a packet is received at a router, routing information is typically stripped off each packet by the router and disregarded. This is because each router has limited memory and handles an enormous number of packets. When a packet is received at a destination VDR client, however, the destination client has sufficient resources to store and process the information delivered to it. Additionally, to the extent that client resources may be taxed, the VDR client need not always store this information in every packet received, as in at least some embodiments application knowledge provides the client with an understanding of which packets are important to applications running on the client. Regardless of whether some or all of this information delivered in the payload of each data packet is processed, the information that is processed is analyzed to create a “network fingerprint” of the nodes involved in the communication link. Thus, VDR software loaded on nodes along a path enables the nodes to append information regarding a path of a packet, which in turn enables the generation of a network fingerprint at the destination device, which network fingerprint represents a historical record that is stored and maintained for later forensic analysis. In addition to forensic analysis by the client, the maintenance of network information on the client enables forensic analysis by a server as well.
The Application Interface (AI) & Application Knowledge
One of the benefits of providing routing functionality at a client device is that the client is able to utilize its knowledge of the application initiating a connection to enhance routing performance for that application. This knowledge is provided to the DC via an application interface, as can be seen in FIG. 1. Utilizing application knowledge to enhance routing performance could be useful to a variety of applications, such, as for example, computer games including massively multiplayer online role playing games.
The virtualization of routing functionality at a client device, as described hereinabove, allows multiple routing protocols and algorithms to be run simultaneously on a client device. Thus, the DC utilizes the application interface to obtain required criteria for an application connection and then chooses from among the protocols and algorithms available via the RP.
For example, Application “A” may need to communicate very large amounts of data, and thus require a routing protocol that optimizes bandwidth, while Application “B” may only need to communicate very small amounts of data at very fast speeds, and thus require a routing protocol that minimizes latency irrespective of bandwidth. A traditional router cannot tell the difference between packets originating from Application “A” and those originating from Application “B”, and thus will utilize the same routing protocol for packets from each application. A VDR client, however, is aware of applications running locally, and thus can be aware, through the AI, of various connection criteria for each application. These connection criteria can then be utilized by the VDR client in selecting a routing protocol or algorithm. Furthermore, as described hereinabove, both the selected routing protocol and the originating application associated with a packet can be communicated to other client nodes via data appended to the payload of the packet. Thus, the protocol selected at a source client can be utilized to route the packet throughout its path to a destination client. Further, because virtualization allows multiple routing protocols to be run on a single client, each application can utilize its own routing protocol.
Moreover, a VDR client can utilize knowledge of the path of a specific connection to further optimize performance. Because a network fingerprint can be gathered detailing the nodes in a communication path, a VDR client running on a client device can analyze each network fingerprint to determine whether the associated connection satisfies the connection criteria of the application desiring to utilize the connection. If the connection does not satisfy the connection criteria, then the client can attempt to find a connection that does satisfy the criteria by switching to a different protocol and/or switching to a different first node in its routing table. Combinations utilizing various protocols and selecting a variety of first nodes can be attempted, and the resultant paths evaluated until a path is found that does satisfy connection criteria. Additionally, combinations utilizing various protocols and selecting a variety of first nodes can be utilized to create route redundancy. Such route redundancy can provide to an application both higher bandwidth and controllable quality of service.
Although connection criteria for source and destination clients will often be identical, there are many situations where this will not be the case. For example, if one client is downloading streaming video from another client, then the connection requirements for each client will likely not be identical. In this and other situations, connections between two clients may be asymmetrical, i.e., client “A” transmits packets to client “B” over path 1, but client “B” transmits packets to client “A” over path 2. In each case, because path information gleaned from the payload of packets is stored and processed at the destination client, the evaluation of whether the path meets the required connection criteria is made at the destination client. In the example above, client “B” would determine whether path 1 satisfies its application's connection criteria, while client “A” would determine whether path 2 satisfies its application's connection criteria.
Perhaps the epitome of a connection that does not satisfy connection criteria is a broken, or failed, connection. In the event of a connection break, VDR enjoys a significant advantage over more traditional routing. Conventionally, recognition of a connection break would require a timeout at an upper level application, with either the path being re-routed subsequent to the timeout or a connection failure message being presented to a user. A VDR client, however, is aware of generally how long it should take to receive a response to a transmitted communication, and can utilize this awareness to speed up route convergence for additional network connections to insure application robustness and performance requirements, performance requirements being defined as criteria that must be met to allow the application to run properly, i.e., video conferencing can't wait too long for packets to show up or else the audio “crackles” and the image “freezes.” For example, a VDR client may be aware that it should receive a response to a communication in 500 ms. If a response has not been received after 500 ms, the VDR client can initiate a new connection utilizing a different routing protocol and/or first node as outlined above with respect to finding a satisfactory connection path.
In addition to performance optimization, application knowledge can also be utilized to enhance network security. For example, an application may have certain security requirements. A VDR client aware of these requirements can create a “trusted network” connection that can be used to transfer information securely over this connection in accordance with the requirements of the application. A more traditional routing scheme could not ensure such a trusted connection, as it could not differentiate between packets needing this secure connection and other packets to be routed in a conventional manner.
But before elaborating on security measures that may be built in to a VDR implementation, it is worth noting that a VDR client is able to work in concert with an existing client firewall to protect software and hardware resources. It will be appreciated that conventional firewalls protect the flow of data into and out of a client and defend against hacking and data corruption. Preferably, VDR software interfaces with any existing client firewall for ease of integration with existing systems, but it is contemplated that in some implementations VDR software can include its own firewall. In either implementation, the VDR software can interface with the firewall to open and close ports as necessary, thereby controlling the flow of data in and out.
In addition to this firewall security, by utilizing application knowledge the VDR software can filter and control packets relative to applications running on the client. Thus, packets are checked not only to ensure a correct destination address, but further are checked to ensure that they belong to a valid client application.
One way VDR software can accomplish this is by utilizing “spiders” to thread together different layers of the protocol stack to enable data communication, thereby reducing delays and taking advantage of network topologies. Each spider represents software that is used to analyze data from different layers of the software stack and make decisions. These threaded connections can be used to speed data transfer in static configurations and modify data transfer in dynamic circumstances. As an example, consider a client device running a secure email application which includes a security identification code. Packets for this application include a checksum that when run will come up with this identification code. A spider would allow this upper level application security identification code to be connected to the lower layer. Thus, the lower layer could run a checksum on incoming packets and discard those that do not produce the identification code. It will be appreciated that a more complex MD5 hash algorithm could be utilized as well.
Moreover, because the VDR software is knowledgeable of the application requiring a particular connection, the software can adaptively learn and identify atypical behavior from an outside network and react by quarantining an incoming data stream until it can be verified. This ability to match incoming data against application needs and isolate any potential security issues significantly undermines the ability of a hacker to gain access to client resources.
Additionally, when such a security issue is identified, a VDR client can take appropriate steps to ensure that it does not compromise the network. Because a VDR client is network aware and keeps track of other clients that it has been communicating with, when a security issue is identified, the VDR client can not only isolate the suspect connection, the VDR client can further initiate a new connection utilizing a different routing protocol and/or first node as outlined above with respect to finding a satisfactory connection path. Alternatively, or additionally, the VDR client could simply choose to switch protocols on the fly and communicate this switch to each client with which it is in communication.
FIGS. 4A-C provide a simplified example of such action for illustrative effect. In FIG. 4A, VDR client 403 is communicating with VDR client 405 over connection 440. In FIG. 4B, external computer 411 tries to alter packet 491 transmitted from client 403 to client 405. Client 405 runs a hashing algorithm on the received packet 491 and identifies that it has been corrupted. Client 405 then quarantines packets received via connection 440 and, as can be seen in FIG. 4C, establishes a new connection 450 with client 403.
Upon discovery of an “attack” on a network or specific network connection, a VDR client can monitor the attack, defend against the attack, and/or attack the “hacker”. Almost certainly, a new, secure connection will be established as described above. However, after establishing a new connection, the VDR client can then choose to simply kill the old connection, or, alternatively, leave the old connection up so that the attacker will continue to think the attack has some chance of success. Because each connection is virtualized, as described hereinabove, a successful attack on any single connection will not spill over and compromise the client as a whole, as crashing the VM associated with a single connection would not affect other VMs or the client device itself. It is contemplated that a VDR client will attempt to trace back the attack and attack the original attacker, or alternatively, and preferably, communicate its situation to another VDR client configured to do so.
An Exemplary Implementation
Traditionally, wired and wireless networks have tended to be separate and distinct. Recently, however, these types of networks have begun to merge, with the result being that the routing of data around networks has become much more complex. Further, users utilizing such a merged network desire a high level of performance from the network regardless of whether they are connected wirelessly or are connected via a fixed line. As discussed hereinabove, VDR enables a client to monitor routing information and choose an appropriate routing protocol to achieve the desired performance while still remaining compatible with existing network architecture. VDR can be implemented with wired networks, wireless networks (including, for example, Wi-Fi), and networks having both wired and wireless portions.
FIG. 5A illustrates an exemplary local area network 510 (hereinafter, “LAN”) utilizing VDR. The LAN 510 includes three internal nodes 511,513,515, each having VDR software loaded onto a client of the respective node. The internal nodes 511,513,515 can communicate with one another, and further can communicate with edge nodes 512,514,516,518, each also having VDR software loaded onto a client of the respective node. The coverage area 519 of the LAN 510 is represented by a dotted circle. It will be appreciated that the edge nodes 512,514,516,518 are located at the periphery of the coverage area 519. The primary distinction between the internal nodes 511,513,515 and the edge nodes 512,514,516,518 is that the internal nodes 511,513,515 are adapted only to communicate over the LAN 510, while the edge nodes 512,514,516,518 are adapted to communicate both with the internal nodes 511,513,515 and with edge nodes of other LANs through one or more wide area networks (hereinafter, “WANs”). As one of the nodes 511,513,515 moves within the LAN 510 (or, if properly adapted, moves to another LAN or WAN), VDR allows it to shift to ad hoc, interior, and exterior protocols. This ability to shift protocols allows the node to select a protocol which will provide the best performance for a specific application.
FIG. 5B illustrates an exemplary path between node 513 in LAN 510 and node 533 in LAN 530. It will be appreciated that an “interior” protocol is utilized for communications inside each LAN, and an “exterior” protocol is utilized for communications between edge nodes of different LANs. Thus, it will likewise be appreciated that each edge node must utilize multiple protocols, an interior protocol to communicate with interior nodes, and an exterior protocol to communicate with other edge nodes of different LANs. Further, at any time an ad hoc protocol could be set up which is neither a standard interior nor exterior protocol.
In FIG. 5B, LAN 510 and LAN 530 are both using CSPF as an interior protocol, while LAN 520 and LAN 540 are utilizing EIGRP as an interior protocol. All edge nodes of each of the LANs 510,520,530 are connected to a WAN utilizing BGP to communicate between edge nodes.
The exemplary path between node 513 and node 533 includes node 515, edge node 518, edge node 522, node 521, node 523, node 525, edge node 528, edge node 534, and node 531. Further, because a particular protocol was not selected and propagated by the transmitting node, this connection utilizes CSPF for internal communications within LAN 510 and LAN 530, EIGRP for internal communications within LAN 520, and BGP for external communications between edge nodes. At one or both end nodes, the VDR software can analyze this information and determine whether the combination of protocols along this path is satisfactory for the communicating application. It will be appreciated that the VDR software can further analyze the information gathered and determine whether the path meets application requirements for throughput, timing, security, and other important criteria.
In a static environment, this path may represent a connection that meets application requirements and thus no further adjustment would be needed. However, if a network outage were to occur, a network or a node were to move, or another dynamic event was to occur, the path could need to be altered.
For example, if LAN 520 were to move out of range, node 533 might analyze the path information appended to a packet received after the movement and determine that increased latency resulting from this movement rendered this path unsuitable per application requirements. Node 533 would then attempt to establish a new connection utilizing a different route that would satisfy application requirements. FIG. 5C illustrates such a new connection, which remains between node 513 and node 533, but rather than being routed through LAN 520 as with the path illustrated in FIG. 5B, the path is instead routed through LAN 540.
It will be appreciated that the ability to influence path selection based on client application needs significantly enhances the performance, flexibility, and security of the network.
It will further be appreciated from the above description that one or more aspects of the present invention are contemplated for use with end, client, or end-client devices. A personal or laptop computer are examples of such a device, but a mobile communications device, such as a mobile phone, or a video game console are also examples of such a device. Still further, it will be appreciated that one or more aspects of the present invention are contemplated for use with financial transactions, as the increased security that can be provided by VDR is advantageous to these transactions.
Network Data Transfer
It will be appreciated that the transmission of data over the Internet, or one or more similar networks, often utilizes precious server processing, memory, and bandwidth, as the data is often delivered from, or processed at, a server. In implementations in accordance with one or more preferred embodiments of the present invention, some of this server load is mitigated by use of a direct connection between two end-user devices, such as, for example two end-user devices having virtualized routing capabilities as described hereinabove. Preferably, packets are then routed between the two end-user devices without passing through a conventional server.
Notably, however, although transferred data packets do not pass through a server, a server may still be utilized to establish, monitor, and control a connection, as illustrated in FIG. 7. Specifically, FIG. 7 illustrates two clients and an IP server which determines that the clients are authorized to communicate with one another, and which passes connection information to the clients that is utilized to establish a direct connection between the clients. Importantly, the IP server is not involved in this direct connection, i.e. data transferred via this direct connection is not routed through or processed by the IP server, which would require the use of additional resources of the IP server.
It will be appreciated that, in some networks, a firewall may be setup to prevent an end-user device from accepting connections from incoming requests. There are three basic scenarios that can occur. In a first case, there is no firewall obstruction. In the first case, either client can initiate the connection for the direct connect. In a second case, a single client has a firewall obstructing the connection. In this case, the client that is obstructed from accepting the connection is instructed by the IP Server to initiate the connection to the client that is unobstructed by the firewall. In a third case, both clients have firewalls obstructing the connection. In this case, a software router, or software switch, is used to accept the connection of the two clients and pass the packets through to the clients directly. Notably, this software router truly acts as a switch, and does not modify the payload as it passes the packet through. In a preferred implementation, a software router is implemented utilizing field programmable gate arrays (FPGAs) or other specific hardware designed to implement such cross-connect functionality.
A preferred system for such a described direct connection includes one or more end-user devices having client software loaded thereon, an IP server, or control server, having server software loaded thereon, and one or more networks (such as, for example Internet, Intranet or Extranet supported by Ethernet, Mobile Phone data networks, e.g. CDMA, WiMAX, GSM, WCDMA and others, wireless networks, e.g. Bluetooth, WiFi, and other wireless data networks) for communication.
In a preferred implementation, client software installed at an end-user device is configured to communicate with an IP server, which associates, for example in a database, the IP address of the end-user device with a unique identification of a user, such as an email address, telephone number, or other unique identification. The client then periodically “checks in” with the IP server and conveys its IP address to the server, for example by providing its IP address together with the unique identification of the user. This checking in occurs when the client is “turned on”, e.g. when the end-user device is turned on or when the client software is loaded, as well as when the IP address has changed, or upon the occurrence of any other network event that would change the path between the client and server, or in accordance with other configured or determined events, times, or timelines, which may be user-configurable.
By collecting, and updating, the current IP address of a user, other users may communicate with that user as the user moves from place to place. The IP server thus acts as a registry providing updated IP addresses associated with users. This capability also enables multiple device delivery of content to multiple end-user devices a user designates or owns.
Preferably, such functionality is utilized in combination with virtualized routing capability as described hereinabove. Specifically, it will be appreciated that, currently, Internet communications utilize sessions, and that upon being dropped, e.g. due to a lost connection, a new session must be initialized.
In a preferred implementation, however, rather than having to re-initiate a new session, for example upon obtaining a new IP address, a new session is created and data is transferred from the old session to the new session while maintaining the state of the old session. In this way, a near-seamless transition is presented to a user between an old session and a new session. For example, a user might be connected via their mobile device to a Wi-Fi connection while they are on the move. They might move out of range of the Wi-Fi connection, but still be in range of a cellular connection. Rather than simply dropping their session, a new session is preferably created, and data from the old session copied over, together with the state of the old session. In this way, although the end-user device is now connected via a cellular connection, rather than via a Wi-Fi connection, the user's experience was not interrupted.
One Client to One Client—File Transfer Implementation
In a preferred implementation, direct connections between end-user devices having virtualized routing capabilities are utilized in a file transfer context, such as, for example, with a file sharing application.
FIG. 8 illustrates an exemplary file transfer use scenario between two clients. As described above, each client is in communication with an IP server, for example to communicate its IP address to the IP server. Such communications are exemplified by steps 1010 and 1020.
In use, a first client communicates to an IP server a request to connect to a particular client, user, or end-user device at step 1030. The IP server, or control server, determines whether or not the other client, user, or end-user device is available, e.g. online, and, if so, looks up the current IP address or addresses associated with the specified client, user, or end-user device. If the client, user, or end-user device is either not online or has left the network, a connection failure message is sent. If the client, user, or end-user device is online, the IP server will take action based upon a pre-selected preference setting. Preferably, each user may choose to accept connection requests automatically, require a confirmation of acceptance, or require some other authentication information, such as an authentication certificate, in order to accept a connection request. If the connection request is accepted, either automatically or manually, the IP server enables the transfer, e.g. by communicating to a second client that the first client has a file for transfer, as exemplified by step 1040.
Preferably, the IP server notifies each client involved in the transfer of required security levels and protocols, such as, for example, hashing algorithms used to confirm that received packets have not been altered. The IP server also insures that the client software at each end-user device has not been tampered, altered, or hacked.
The clients complete a messaging “handshake”, and then begin transfer of a file. More specifically, the second client requests a connection with the first client at step 1050, the first client notifies the IP server of its status, e.g. that it is beginning a transfer, at step 1060, the first client grants the second client's request at step 1070, and the second client notifies the IP server of its status, e.g. that its connection request was accepted, at step 1080. The file transfer begins at step 1090.
Periodically, both clients will update the server on the status of the download, as illustrated by exemplary steps 1100 and 1110. The server will keep track of the file transfer and compare the information received from both clients for completeness and security. Once the file transfer is completed, at step 1120, a status is sent of each client is sent to the IP server at steps 1130 and 1140, and the connection is terminated at step 1150. The clients continue to update their availability with the IP server for future downloads, as illustrated by exemplary steps 1160 and 1170.
It will be appreciated that because one of the problems with the TCP/IP protocol is that significant timing delays can occur between communications, using a virtual machine advantageously allows messages to be sent at the lowest levels of the stack between virtual machines of different clients, thus helping insure that communications are not delayed. Further, the inclusion of local routing capabilities enables each client to setup another communication link, if needed, for example to continue a stalled download. Further still, as preferably both clients include such routing capability, either client can reinitiate a separate communication to the other client, thus helping insure that TCP/IP packet delay timeouts do not draw out the communication.
Additionally, to facilitate more robust transfers, one of the clients can instruct the other to open other TCP/IP connections independent of the server link. For example, a first client may receive an IP address for a second client via the IP server, and the second client could then communicate additional IP addresses to the first client and communicate duplicate packets via connections established with these additional IP addresses, thus increasing the reliability of the link. Additionally, the client could send multiple packets over separate IP addresses to insure a different starting point for transmission, and thus insure unique paths. It will be appreciated that this might advantageously allow for the continuing transfer of packets even if one of the connection paths fails. Notably, each path is closed upon completion of the transmission.
FIG. 9 illustrates a user interface for an exemplary file sharing application in accordance with a preferred implementation. To initiate a transfer, a user clicks on an application icon to open the user's Friend's List and a “Sharzing” window. Bold texted names identify on-line contacts, while grey texted names indicate off-line contacts. When the blades of the graphical connection representation on the right side of the window, i.e. the Sharzing, are shut, the Sharzing is inactive. Clicking on an on-line contact opens the blades and establishes a Sharzing connection. The user may then “drag and drop” a file onto the open Sharzing.
Once a Sharzing connection is established, multiple files can be transferred in either direction. Further, multiple Sharzings can be opened simultaneously to different users. Preferably, when a Sharzing is connected, wallpaper of the opposite PC that is being connected to is displayed. As a file is “dragged and dropped” on the Sharzing, the Sharzing displays the progress of the file transfer. Using a Sharzing skin, a Sharzing depiction can take on identities such as, for example, a futuristic StarGate motif. In the case where such a StarGate motif is used, flash wormhole turbulence may begin when a file is placed in the Sharzing, and, subsequently, an opening at the end of the wormhole may emerge to display an image of the file and/or the recipient's desktop wallpaper. Preferably, when the transferred file is visible on the destination desktop, the transfer is complete.
Many Clients to Many Clients—Video and Audio Conferencing Implementation
In another preferred implementation, direct connections between end-user devices having virtualized routing capabilities are utilized in a telecommunications context, such as, for example, in an audio and video conferencing application.
It will be appreciated that in traditional audio and video conferencing applications, one or more conventional servers act to collate and process audio and video streams from a plurality of clients, and then distribute the processed audio and video streams to the clients. By way of contrast, in a preferred implementation, an end-user device can instead establish a direct connection with another end-user device, and communicate audio and video directly to the other end-user device, rather communicating through a conventional server. In such implementations, this transmitted audio and video can be directly processed by either a communicating end-user device, a receiving end-user device, or both, rather than by a conventional server.
As described above, via the use of virtualization, a first end-user device can establish a direct connection with not just one other end-user device, but with multiple other end-user devices. The first end-user device provides each other end-user device with its video and audio stream, thus effectively acting as a server by “serving” its video and audio stream to each other end-user device. Each of the other end-user devices involved in a video conference will receive such video and audio streams served by this first end-user device; however, each other end-user device will additionally serve its own video and audio streams. Thus, each end-user device can be characterized as functioning as both a server and a client, possibly at the same time, i.e. as a multiplexed client/server.
Notably, however, although the end-user devices assume some functionality more traditionally assumed by a conventional server in video conferencing applications, a control server is preferably still used to oversee the establishment and maintenance of connections between end-user devices. Unlike in a traditional implementation, however, it is preferred that little to no audio or video processing is handled at this control server, and that the audio and video streams between end-user devices are not routed through the control server.
Instead, the control server primarily provides authentication and security functionality. Preferably, the control server keeps track of a unique identification of each end-user device, software loaded on each end-user device, and an IP address of each end-user device. Additionally, the control server preferably controls which end-user devices can communicate, and at what times they may communicate. For example, the control server preferably provides functionality allowing a moderator to “talk” over every other user at any given time.
Each end-user device preferably continually provides information to the control server, including: a status of the end-user device, whether the end-user device is receiving audio, whether the end-user device has lost its connection, an application status, application data, whether software at the end-user device has been tampered with, a rate of one or more communication links, and a packet error rate of one or more communication links.
Use with Conventional Servers—Media Server Implementation
In some preferred implementations, direct connections between end-user devices having virtualized routing capabilities are utilized in combination with one or more conventional file servers, such as, for example, in a media server application. Specifically, it will be appreciated that the conventional downloading of data, such as a video file, from a server is an intensive process that utilizes precious server processing, memory, and bandwidth. In preferred implementations, some of the strain of this process is offloaded from such a conventional server to one or more end-user devices having virtualized routing capabilities. This architecture decreases the processing, memory requirements and bandwidth loads on a media server. Table 2 of FIG. 10 shows the relationship for a media file that is being downloaded from a server when some of the strain of multiple download requests is transferred off of the media server in accordance with such preferred implementations.
In a preferred implementation, a plurality of end-user devices comprise VDR clients, and a control server comprises a VDR server, each respectively including the architecture illustrated in FIG. 11.
FIG. 12 illustrates an exemplary process for downloading media content to two VDR clients that was originally stored on a customer video server, i.e. a media server. Notably, the process involves not just the two VDR clients and the media server, but also a VDR server as well.
The process begins when the first VDR client requests download of media content from the media server at step 1210, followed by a corresponding TCP/IP handshake at step 1215. Subsequently, the media server alerts the VDR server of the download at step 1220. The VDR records the activity of the first VDR client along with necessary identification and contact information for the first VDR client. The media server follows the typical download procedure and begins the download to the first VDR client at step 1225.
Thereafter, a second VDR client requests the same media content from the media server at step 1230, followed by a corresponding TCP/IP handshake at step 1235. At step 1240, the media server alerts the VDR server to the download request by the second VDR client. The VDR server determines that a VDR client is active, gathers addressing information for the second VDR client, and notifies the media server that it will handle the download at step 1245. Notably, a VDR client is active as long as its connection is active. It will be appreciated that several methodologies may be used to determine how long a client stays active. In at least some implementations, a client is shut down, i.e. rendered inactive, immediately after a file is transferred, which may represent the most efficient use of resources. In a preferred implementation, a timer is utilized, and the client remains active a user-specified number of minutes following activity. Alternatively, a client's connection could be left open until the user wants to close it, or until a network timeout occurs.
At step 1250, the VDR server communicates to the first VDR client and configures it for download capability to the second VDR client, e.g. using the obtained addressing information for the second VDR client. The second VDR client initiates communication with the first VDR client for download of the media content from the first VDR client at step 1260, followed by a corresponding TCP/IP handshake at step 1265, and the download then begins at step 1270.
Notably, the first VDR client, like most clients, has bandwidth available on the uplink when downloading content. It is believed that a typical personal computer, as of the filing date of this application, can handle 3-5 uploads without significant burdening or performance degradation.
Communication between the first and second VDR clients is accomplished between “Thin Virtual Machines” (TVM) of each VDR client. Each TVM is characterized as a “thin” virtual machine, as each preferably generally includes only functionality necessary to support virtualized networking, and, preferably, optimizes the resources needed to support the virtualization of the Network Interface Card (NIC). As will be appreciated from the description hereinabove, each TVM enables each application to have a separate virtual interface to the NIC. This functionality enables customized security capabilities that can be added to each application interface individually.
At steps 1280 and 1285, the VDR clients convey status information, e.g. concerning the download, to the VDR server. At step 1290, the first VDR client completes its download of the media content from the media server. The first VDR client continues the download to the second VDR client, however. While the download continues, status information is sent to the VDR server from each VDR client as exemplified by step 1300. Further, the first and second VDR clients continue to communicate via the virtual machine interface to detect connection issues and reroute packets.
The download continues at step 1310. At step 1320, the second VDR client completes its download, and each VDR client notifies the server of such success, as exemplified by step 1330. The VDR server, in turn, notifies the media server that the download to the second VDR client was completed successfully at step 1340.
If, instead of being completed successfully, the second VDR client's download of the media content had not completed, the second VDR client would have contacted the VDR server for another download opportunity.
FIG. 13 illustrates another exemplary process where, rather than downloading media content from one other VDR client, media content is downloaded from a plurality of VDR clients, thus increasing the speed of download.
More specifically, a media file is broken into fragments, and each fragment is downloaded to a target VDR client from a different source VDR client using a different connection. In FIG. 13, the process begins when, at step 1410, a first VDR client communicates a download request to a media server, followed by a corresponding TCP/IP handshake at step 1415. At step 1420, the media server alerts the VDR server that a download has been requested. The VDR server determines that multiple VDR clients are available to download the requested media content from, and, at step 1430, the VDR server informs the media server that it will handle the download request. At steps 1440, 1450, and 1460, respectively, the VDR server communicates to second, third, and fourth VDR clients and passes addressing information corresponding to the first VDR client to each. The VDR server assigns each VDR client the portion of the media content that that VDR client will download to the first VDR client.
The first VDR client then downloads, at steps 1445, 1455, and 1465 respectively, the assigned portions of the media content from each of the other VDR clients. As exemplified by illustration of steps 1470, 1472, 1474 and 1476, each VDR client reports to the VDR server status information on any downloads it is a part of, to insure each download is progressing as planned. If a connection is lost, the VDR server can act to correct the problem. Once the first VDR client has completed the download of the media content, it communicates such completion to the VDR server and each other VDR client, as exemplified by illustration of step 1480. Subsequently, the VDR server notifies the media server that the download was completed at step 1490.
MMORPG Implementation
In another preferred implementation, direct connections between end-user devices having virtualized routing capabilities are utilized in a gaming context, such as, for example, in a massively multiplayer online role playing game application.
It will be appreciated that traditional MMORPGs handle the majority of processing for a game world at conventional servers. In a preferred implementation, some of this processing work is offloaded to end-user devices having virtualized routing capablities. For example, each end-user device preferably functions as a server for serving an avatar associated with a user to other end-user devices whose users are disposed, in the game world, in close proximity. In this way, the processing associated with such avatars is largely offloaded from the server.
This offloading, and other similar offloading, reduces the resources required by an MMORPG server. Notably, however, although the end-user devices assume some functionality more traditionally assumed by a conventional server in MMORPG applications, a control server is preferably still used to oversee the establishment and monitor connections between end-user devices.
The control server preferably provides authentication and security functionality. Preferably, the control server keeps track of a unique identification of each end-user device, software loaded on each end-user device, and an IP address of each end-user device. Additionally, the control server preferably controls what actions each client can take.
Each end-user device preferably continually provides information to the control server, including: a status of the end-user device, whether the end-user device has lost its connection, an application status, application data, whether software at the end-user device has been tampered with, a rate of one or more communication links, a packet error rate of one or more communication links, a game state, a character state, and coordinates of the character's location in the game world.
It will be appreciated that voice conferencing can be an important part of the massive multiplayer experience, and, in accordance with one or more preferred embodiments, functionality and implementation similar to that outlined in an audio conferencing context is utilized in a massively multiplayer gaming context as well.
Notably, in such implementations, a client both receives information from other clients, for example in the form of avatar information, and additionally receives information from a content server, which may also comprise control server functionality.
Security
Preferably, in secure implementations, clients at end-user devices are alerted by a control server of an impending transfer and utilize a secure protocol such as public key encryption, AES (Advanced Encryption Standard), or SSL (Secure Socket Layer). Packets to be transferred are preferably intercepted by a virtual machine of a first client, prior to being sent to the network interface of that client, and encrypted. Following receipt, the packets coming out of the network interface are then intercepted by a virtual machine of the other client and decrypted.
Preferably, strong security is achieved by employing a single encryption key that is passed between the two end-user devices controlled at layer 2 and 3 of the OSI (Open Source Interface) stack model. Regardless of whether the file is transported via Ethernet, WiFi, mobile phone data networks, or other wired or wireless technologies, the file is protected since it is decrypted at the router level of the destination before the data is passed to the application.
Although systems, methods, and apparatus are described herein largely in the context of end-user devices having virtualized routing capabilities, it will be appreciated that at least some implementations may be practiced in the absence of such virtualized routing capabilities.
Notably, virtualized routing capabilities, such as, for example, those presented by a VDR client, may be advantageous even in communicating with a client that does not enjoy such capabilities, e.g. a non-VDR client. In a preferred method, a VDR client in communication with a non-VDR client searches incoming packets for viruses or other anomalies, and, if such other anomalies are found, the VDR client can break off communications and re-establish a new connection.
Deflects and Spread Spectrum Networking
FIG. 14 illustrates the use of a dispersive virtual machine implemented as part of a software application that can be easily downloaded to a device such as a PC, smart phone, tablet, or server. In accordance with a preferred methodology, data to be sent from a first device utilizing such software to another device is split up into multiple parts which are sent separately over different routes and then reassembled at the other device.
FIG. 15 illustrates an exemplary such methodology utilizing one or more such exemplary software applications in which a message sent from a first user's (Joe's) computer to a second user's (Mary's) computer is split up into three parts, each part is transmitted to a different device also running such an exemplary software application, and each different device then retransmits such received part to the second user's (Mary's) computer. The message is then reassembled and displayed on the second user's (Mary's) computer. In this scenario, each of the three different devices that the message is communicated to for retransmission can be characterized as a “deflect”, in that rather than sending the message directly to the second user's (Mary's) computer, the message is first intentionally “deflected” through such different devices. Notably, although complete control of routing over one or more networks a message will pass through may not be available, by choosing to utilize one or more such deflects, multiple paths can be selected and utilized.
It will be appreciated that splitting a message into three parts and sending such parts over three separate routes makes it more difficult to intercept such message. Leveraging the deflect capability of virtual dispersive routing, packets can be sent independent routes from one another, thus ensuring packets cannot be captured by copying packets off the Internet from a single router.
Different parts of a message could be sent all at once over different network paths, or, in at least some preferred implementations, a network path could be changed over time, for example, a device could be configured to utilize a different deflect after a certain period of time or after a certain number of packets are communicated.
Additionally or alternatively, however, in one or more preferred implementations, rather than utilizing multiple deflects to send packets over multiple network paths and/or change network paths, network communications utilize one or more network addresses and/or ports. Preferably, this includes concurrent communication of packets to multiple network addresses and/or ports of another device, and/or changing or shifting of the network address and/or port that packets are communicated to. Such spreading of packets across multiple IP addresses and ports can be characterized as spread spectrum networking (SSN).
In one or more preferred implementations, by constantly changing the IP address and/or ports that a computer device utilizes to talk to another computing device (e.g. P2P (peer to peer) or V2V (virtual machine to virtual machine)), it becomes much more difficult to track the device. In one or more preferred implementations, virtual machines are utilized to provide signaling and measure delay between hops.
FIG. 16 illustrates how multiple packets can be sent over different deflects in a direct spreading of packets methodology, and FIG. 17 illustrates how multiple packets can be sent to different IP addresses and/or ports in a hopping IP addresses and ports methodology.
FIG. 18 illustrates an exemplary system architecture configured to allow clients in a task network to access the Internet through an interface server using virtual dispersive networking (VDN) spread spectrum protocols.
The exemplary system illustrated in FIG. 18 includes a task network with ten VDN enabled client devices, a dispersive presence server, four deflect servers, and an interface server. In a preferred implementation, the task network client machines and the interface server will be hosted by a first entity at a particular location or facility, and the presence server and deflects will be hosted by another entity at disparate geographic locations.
Each of the task network client machines has installed thereon VDN software that includes a Xen hypervisor with CentOS host operating system containing virtual dispersive networking components. Each client machine further includes two Windows guest operating systems. The VDN components are configured to provide connectivity for one of the guest operating systems to the Interface Server through multiple deflects. This interface server provides access to internet sites such as Google for one of the guest operating systems for each of the task network clients. The VDN components provide connectivity for the other guest operating system only to the internal task network.
The interface server has installed thereon VDN software that includes a Xen hypervisor with CentOS host operating system containing virtual dispersive networking components. The interface server further includes software configured to provide connectivity to the internet from the interface server. Dispersive presence server software and deflect server software is installed on geographically dispersed hosted servers.
All of the client machines and servers are configured to provide desired connectivity using virtual dispersive networking. Configuration of software is preferably adjusted as required based on performance metrics developed through testing.
FIG. 19 illustrates an exemplary system architecture configured to enable a workstation with four independent connections to the internet to send traffic using virtual dispersive networking spread spectrum protocols to an interface server from each independent internet connection.
The exemplary system illustrated in FIG. 19 includes a workstation configured with four independent connections to the internet and including VDN software configured to simultaneously utilize the independent connections. The system further includes an interface server, a dispersive presence server (DPS), and four deflect servers.
In this exemplary system, the servers are configured as described hereinabove with respect to FIG. 18, while the workstation is loaded with VDN software that includes a Xen hypervisor with CentOS host operating system containing Virtual Dispersive Networking components. The workstation also has loaded thereon guest operating systems. The VDN components provide connectivity for the guest operating systems to the Interface Server through multiple deflects and through each of the independent connections to the internet.
Point of Entry Gateways
In one or more preferred implementations, VDN systems use a DPS for connection processing and collecting network information on a client population. The connection processing on the DPS communicates with the virtual networking machines on the end clients to make connections between the two end-points of the segments that make up a VDN communication (that is, two end clients).
In one or more preferred implementations, however, some of the functionality handled by a DPS is spawned out to intermediate network computing points (e.g. servers), which can then be in communication with the DPS. In one or more preferred implementations, one or more point of entry gateways are utilized in this manner. These point of entry (PoE) gateways, as their name implies, serve as a point of entry for devices (such as end clients) seeking to communicate with the DPS, by receiving communications intended for the DPS and forwarding them on (either with or without processing at the PoE gateway).
In one or more preferred implementations, PoE gateways are utilized in combination with a DPS behind a firewall. That is, the DPS remains behind a firewall, while the PoE gateways are exposed. Thus, by spawning processes out to intermediate network computing points (e.g. the PoE gateways), this enables the database and call processing software control of the DPS to remain behind the firewall. The data needed by the PoE gateways will be specific to a particular VDN and also provide other generic PoE gateway devices to diversify the network connection.
FIGS. 20-23 illustrate an exemplary scenario utilizing PoE gateways.
An end client 2020 configured for VDN (behind a firewall 2022) seeks to establish a connection with another end client 2030 (behind a firewall 2032). The end client 2020 communicates a message requesting information for such a connection to a PoE gateway 2040 of a plurality of PoE gateways, as illustrated in FIG. 20. The PoE gateway 2040 then communicates the message on to the DPS 2010 (behind a firewall 2012), as illustrated in FIG. 21. Thereafter, the DPS 2010 communicates connection information to both the end client 2020 and the end client 2030, as illustrated in FIG. 22. The end clients 2020,2030 can utilize this information to set up a connection between one another, as illustrated in FIG. 23.
Although these communications and connections are illustrated as being generally direct (albeit preferably utilizing VDN, as described herein), in one or more preferred implementations, one or more deflects are utilized for any or all of these communications or connections. Specifically, in one or more preferred implementations, split traffic (e.g. VDN traffic with deflects) can be used between two network devices (e.g. DPS and PoE gateway or PoE gateway and VTC (Virtual Thin Client)). For example, FIGS. 24-27 illustrate the same scenario as outlined above, only with one or more deflects utilized for each communication or connection.
In one or more preferred implementations, such PoE gateways are utilized to ensure that all devices with important data and network information are behind a firewall. Further, it is believed that use of PoE gateways allows a DPS address to be obscured from network detection.
As illustrated in one or more preferred implementations, more than one PoE gateway can be utilized. In at least some preferred implementations, many PoE gateways can be used, reused and discarded easily.
The use of PoE gateways is further believed to allow system connections to be spread out over more computers, thus making a network or system harder to understand (and thus hack). Additionally, the use of PoE gateways is believed, in one or more preferred implementations, to alleviate throughput and connection limitations on a DPS, improve scaling, enable multiple points of entry, and provide points of entry that do not contain user data.
Specifically, with regard to this last point, as noted above, network attacks are a common occurrence in today's cyber environment, and computers that are not protected by firewalls are under constant attack. Servers are especially vulnerable due to the fact that they must keep a port open on a firewall to enable a connection to a client. Using computers or devices, such as PoE gateways, that do not have valuable information on them as interfaces is believed to be a useful way to protect user data.
Virtual Dispersive Hand-Off
Traditionally, network connections between different systems typically don't hand off connections smoothly or quickly. For example, as a mobile device with a WiFi connection moves from a first area, covered by a first WiFi network, to a second area, covered by a second WiFi connection, there is typically not a smooth transition from one network to the other, and instead connectivity will typically be disrupted as the first WiFi network is lost.
In one or more preferred implementations, however, VDN is utilized for a smooth hand-off. For example, with respect to the previously outlined scenario, the use of multiple virtual network connections would allow the device to connect to both WiFi networks, and enable a smooth transition as the device moves from the first area to the second area.
In one or more preferred implementations, in order to figure out which access points to connect to, several mechanisms are used. Several exemplary such mechanisms and methodologies will now be described, although it will be appreciated that this is not an exhaustive list.
In one or more preferred implementations, GPS is utilized to determine the speed and direction of a device and determine network devices in close proximity for connection.
In one or more preferred implementations, the device detects RF signal and connects to as many devices as feasible. Once connection is achieved, network presence is used to determine the connection point and move the network connection to the new access point. In one or more preferred implementations, devices can maintain a connection by using Spread Spectrum Protocol setups to “roll” the connection and continue streaming data while moving from access point to access point.
In one or more preferred implementations, by setting up deflects, routing paths and data can be forced to the next access point that a mobile device is moving toward. That is, deflects can be utilized to force traffic to a particular access point.
In some preferred implementations, data is overlapped (e.g. sent to or from the mobile device via multiple connections) to insure that communicated information has been or will be received (either by the mobile device or by a device it is being sent to by the mobile device), as illustrated in FIG. 28. In one or more preferred implementations, data intended for a mobile device can be preloaded to a deflect and extracted when the mobile device connects to the access point. In some preferred implementations, data is given a timeframe to exist on the deflect, and is removed or archived once this timeframe expires, so that the deflect is not overloaded with “old” data.
Such hand-off functionality is believed to allow for the use of WiFi devices to stream data to mobile devices while the mobile devices are moving, allow for the ability to increase the data throughput of a system, enable the use of inexpensive mobile carrier platforms (e.g. WiFi hotspots and public WiFi), maintain a connection for mobile devices across networks and access points, and force traffic (via the use of deflects) to an access point for connection to a mobile device.
Multi-Protocol Dispersion
In one or more preferred implementations utilizing VDN, a deflect simply passes data through without reformatting it. In some cases, then, VDN traffic can be detected and identified by tracking the data in and out of a deflect. In one or more preferred implementations, a deflect is configured to reformat data to another protocol (e.g. from UDP to a TCP connection) so as to obviate this potential issue. Such a change in protocol is believed to make it much more difficult for external hackers to detect VDN data and try to put it back together.
As an example, FIGS. 29 and 30 both illustrate exemplary scenarios utilizing a system which includes, inter alia, DPS 2110, PoE gateway 2140, two virtual thin clients (VTCs) 2120,2130, and two deflects 2150,2160. Specifically, FIG. 29 illustrates VDN routing from virtual thin client (VTC) 2120 to VTC 2130 using two deflects 2150,2160 that are configured simply to pass data through. In contrast to this, FIG. 30 illustrates a system in which the deflects 2150,2160 are configured to reformat data to another protocol. In the illustrated example, the deflect 2150 reformats data from HTTP to TCP, and the deflect 2160 reformats data from UDP to RTP.
This is believed to make it very difficult for a hacker or monitoring technology to detect VDN. Additionally, this allows traffic of one type to be made to look like another.
Superframes
It will be appreciated that one or more VDN methodologies disclosed herein can be characterized as resulting in VDN traffic that goes in and out of deflects in a 1:1 relationship. That is, in accordance with such a methodology, each packet received at a deflect is subsequently routed out of the deflect. Notably, however, such VDN traffic can be detected in and out of deflects due to the 1:1 nature of the traffic.
In one or more preferred implementations, “superframes” are utilized, which represent a single packet or communication that contains two packets or communications therein, optionally together with instructions as to where each packet is bound. In one or more preferred implementations, such a superframe further includes instructions as to what device should split a superframe up.
For example, FIG. 31A illustrates a first packet 3120 which includes data A, as well as a second packet 3130 which includes data B. FIG. 31B illustrates a superframe which has been constructed that includes both data A and data B. In one or more preferred implementations, such superframe also includes instructions to break apart this data, e.g. instructions as to where to send each set of data, and, preferably even instructions as to where this data should be broken apart (e.g. at a particular deflect). FIGS. 32-33 illustrate a process in which a superframe is sent from a first virtual thin client (VTC) 3220 to a deflect 3260. The second deflect breaks apart the superframe and communicates some data onward toward the second VTC 3230, and some data onward toward another deflect 3270. The deflect 3270 may then route the packet towards the second VTC 3230, or somewhere else. In one or more preferred implementations, a superframe includes instructions as to where the data contained therein is to be sent. Further, in one or more preferred implementations, a superframe includes instructions as to where it is to be broken apart.
Although in the illustrated example the data packets the superframe was broken into were communicated onward towards different devices, in one or more preferred implementations a superframe is broken up but both packets continue to be routed along the same path.
Further, although illustrated and described with reference to a superframe containing two packets or sets of data, in one or more preferred implementations a superframe may contain three or more packets or sets of data, which may be bound for different destinations or the same destination, and may travel the same route or path, or may travel different routes or paths. Further, in one or more preferred implementations, a superframe might include other superframes nested therein. For example, FIG. 34 illustrates a superframe 3410 which itself includes a superframe 3420 (which includes two packets 3430,3440) as well as a packet 3440.
Thus, a deflect can be used as a tool to split a large frame or pack into multiple packets and forward the split packets to other deflects and/or one or more final destination computing devices.
The use of superframes is believed to facilitate making it very difficult for a hacker or monitoring technology to detect VDN.
Additionally, superframes can be utilized to facilitate the broadcasting of data to other devices. For example, this could be utilized in support of one to many type applications.
Application Split Traffic
Typically, applications need to keep track of connection state to operate and suffer when network connections are poor. In one or more preferred implementations, virtualization is utilized to insulate an application from IP address and network connection duties, which enables the splitting of traffic over multiple links. Preferably, communications are intercepted at the session layer and parsed out to each link, as illustrated in FIG. 35. For example, traffic from an application can be split up and parsed out, at the session layer, to a plurality of different virtual connections. Data received over these connections can similarly be reconstructed and passed up to the application. Notably, a connection can be converted to other protocols for diversity.
This not only provides the ability to split traffic of a connection, but additionally provides the ability to setup channels to roll a VDN spread spectrum connection, as well as the ability to hide networking information.
Priority Through Time Measurement
Conventionally, priority of packets through a network is primarily accomplished by marking or labeling a packet high priority. Unfortunately, this does not guarantee a fast transfer of data from end to end. For example, not all routers are able to handle or have been setup to handle special packet markings.
In one or more preferred implementations, VDN is utilized to provide better end to end quality of service (QoS) without resorting to labeling or marking packets (although it will be appreciated that methodologies disclosed herein could be utilized in combination with labeling or marking packets).
In one or more preferred implementations, a system that can message at the lowest level in the stack can determine the time it takes for packets to move from end to end. For example, as illustrated in FIG. 36, first and second end devices 3610,3620 can determine that it takes 100 ms to communicate from one end to another through a first deflect, 600 ms to communicate from one end to another through a second deflect, and 500 ms to communicate from one end to another through a third deflect.
Thus, in this scenario, higher priority traffic from the first end device 3610 to the second end device 3620 could be given priority by being routed via the first deflect, while lower priority traffic could be routed via the second and third deflects.
More generally, if multiple paths are available, end devices can find network connections that give faster end to end throughput and use of such routes and connections can be allocated, prioritized, and/or reserved to devices that can be designated to require higher throughput, such as, for example, emergency management, police, fire, military or other high priority customers and decision makers. Users without as high of priority could have a threshold set of a mid-range time as a minimum thereby keeping the faster routes available for the higher priority calls but still enabling the system to enable connections. By choosing connections with shorter time to send and receive packets, the parallel connection can actually speed up data being sent between the end points.
In one or more preferred implementations, end devices are designated with a particular priority level, which might represent an arbitrary designation or could simply represent a minimum and/or maximum threshold time.
In one or more preferred implementations, an end device determines the time it takes packets to travel to a particular destination over several different routes, and selects a route in accord with its priority level. For example, returning to the example illustrated in FIG. 1, the end device 3610 might have a priority level setting a minimum threshold at 300 ms, and would accordingly limit its communications to use of the second and third deflects (at 600 ms and 500 ms respectively), thereby reserving use of the first deflect (corresponding to a 100 ms travel time) to higher priority devices/communications.
In one or more preferred implementations, priority designations or minimum or maximum thresholds may be set at an application or connection level rather than on a per device basis, and/or particular applications and/or connections may deviate from a device level priority designation or minimum or maximum threshold.
In one or more preferred implementations, priority provision based on time measurement is believed to provide the ability to give priority to packets without requiring a change to current packets, the ability to give service to lower priority connections without jeopardizing higher speed connections, the ability to dynamically set time thresholds, the ability to give individual devices extremely high priority, allow for measurement corresponding to end to end priority and quality of service rather than simply measuring the speed through an individual router.
Multi-Layer Deflects
Systems in which a dispersive presence server (DPS) downloads a spread spectrum protocol (SSP) to a plurality of virtual thin clients (VTCs) are disclosed herein. In exemplary such systems, a VTC can connect to a deflect that is either specified or chosen from a pool of deflects. Such a deflect can be behind or in front of a firewall. The deflect then connects to a destination or final VTC. Further, in one or more preferred implementations, a VTC can itself be a deflect (for example, a third VTC can be utilized as a deflect for communications from a first VTC to a second VTC).
In one or more preferred implementations, rather than simply using one deflect along any communication route from a source end point to a destination end point, a SSP setup calls out for multi-layers of deflects. For example, FIG. 37 illustrates several data paths that pass through multiple deflects, including a first communication path that passes through deflect device 1 and deflect device 3, and a second communication path that passes through deflect device 2 and deflect device 5. Although only two layers of deflects are illustrated, in one or more preferred implementations more than two layers of deflects may be utilized.
Moreover, multi-layer deflect implementations can utilize the same deflect multiple times. In one or more preferred implementations, a loop is even set up between two or more deflects whereby data is continually looped between such deflects. In one or more preferred implementations, data is stored in a network by being looped continuously between deflects. In theory, such data could be stored indefinitely in the network.
In preferred implementations, VTCs are utilized as deflects in order to make it more difficult to separate traffic originating or terminating at that VTC from traffic for which that VTC serves as a deflect.
Further, the use of deflects, and multi-layer deflects, is believed to facilitate obscuring of source and destination IP address information.
VDN Casting
Most communication paths and networks are not 100% reliable. Some communication paths will not be available all of the time. In one or more preferred implementations, VDN casting is utilized to find a way to reach a VTC over varied communication paths.
At times, a destination VTC may be in an area that has limited communication or sporadic communication. In this and similar situations, another VTC can test deflects for connection to the destination VTC. A virtual dispersive network (VDN) can be rather large, but since the members of a VDN keep track of connection information (even though a dispersive presence server may lose connectivity), the network can still communicate as long as the network has not change significantly and the destination VTC address had not changed.
FIG. 38 illustrates how a connection from a first VTC to a second VTC through a second deflect is still possible even though it is not possible to connect through a first or third deflect.
In one or more preferred implementations, VDN casting is believed to facilitate making a network delay tolerant, and allow network devices to be found at later points in time.
Storage Area Networking
As noted hereinabove, a storage area network (SAN) is a network created to interconnect one or more data storage devices, e.g. different forms of data storage devices, with one or more servers or other devices.
In one or more preferred implementations, virtual dispersive routing technology is utilized in a storage context to form a dispersive SAN.
In preferred implementations, data is dispersed by being distributed to, and stored at, a plurality of devices. Preferably, virtual dispersive routing is utilized to effect such dispersed distribution of data. For example, data may be dispersed, via virtual dispersive routing, from a mobile phone and stored at a laptop, a desktop, another mobile phone, and a server. Thus, data may be distributed to multiple, physically separate places. Hacking such data at its place of storage would thus require hackers to hack multiple different devices at multiple, different sites to gather all of the data.
Similarly, as the data is distributed utilizing virtual dispersive routing, multiple routes would have to be hacked to gather all of the data. Further, the security functionality of virtual dispersive routing described herein would render hacking of transferred data more difficult.
With respect to accessing data, a device accessing data preferably receives one or more data streams from each of the devices any portion of the data is stored on, as illustrated in FIG. 39. As illustrated in the figure, a device can receive a data stream from any device it is able to communicate with, e.g. using virtual dispersive routing. Such communications could occur over, for example, a public network, a private network, a wireless personal area network (WPAN), or a wireless local area network (WLAN). Preferably, the gaps between packets are controlled by virtual machine messaging so that timing of packets can be used as another mechanism to deter hacking, rerouting and other network attack techniques. Similarly, the sequence of data from each source and size of data transmitted is controlled by virtual machines, and by streaming data simultaneously from multiple sites, hacking can be further frustrated. By placing a signal on either side of a connection, virtual machines can signal to each other which route is the fastest and stripe data to be encoded across multiple sites. Further, direct connection between devices enables more efficient communications (e.g. with less overhead) and faster communications, and can minimize the need for authentication and data transfer via a server, unless an application specifies the use of a server, in which case it can supplement such use.
In dividing storage of data across multiple devices, in at least some implementations some storage overlap may be utilized in that some, or all, portions of data may be stored at multiple devices, so that if one device is offline such data may still be accessible from another device. Preferably, decisions on whether to send data can be directed by a client based on the presence of devices available to participate in an information transfer. Preferably, virtual machine messaging is utilized to keep track of communications to ensure quality of service and the ability to abstract networking from an application.
In at least some preferred implementations, remote storage devices are utilized for storage in a manner similar to how hard drives might be utilized in a redundant array of independent disks (RAID). Such remote storage devices might be utilized in a manner akin to any standard level of RAID, or even more exotic flavors of RAID, and even in a manner akin to nested RAID.
Exemplary SANs Implementations
In an exemplary preferred implementation of a dispersive SAN, data is dispersed for secure storage by being distributed to, and stored at, a plurality of devices, and virtual dispersive routing is utilized to effect such dispersed distribution of data. For example, data may be dispersed, via virtual dispersive routing, from a mobile phone and stored at a laptop, a desktop, another mobile phone, and a server. Thus, data may be distributed to multiple, physically separate places. Hacking such data at its place of storage would thus require hackers to hack multiple different devices at multiple, different sites to gather all of the data.
Similarly, as the data is distributed utilizing virtual dispersive routing, multiple routes would have to be hacked to gather all of the data.
With respect to accessing data, with reference to FIG. 39, a device 650 accessing data preferably receives a plurality of data streams from each of the devices 652,654,656,658 on which any portion of the data is stored using virtual dispersive routing. Such communications could occur over, for example, a public network, a private network, a wireless personal area network (WPAN), or a wireless local area network (WLAN). Preferably, the gaps between packets are controlled by virtual machine messaging so that timing of packets can be used as another mechanism to determine hacking, rerouting and other network attack techniques. Similarly, the sequence of data from each source and size of data transmitted is controlled by virtual machines, and by streaming data simultaneously from multiple sites, hacking can be further frustrated. By placing a signal on either side of a connection, virtual machines can signal to each other which route is the fastest and stripe data to be encoded across multiple sites. Further, direct connection between devices enables more efficient communications (e.g., with less overhead) and faster communications, and further obviates the need for authentication and data transfer via a server, unless an specific software application running on one of the devices specifies the use of authentication and data transfer via a server.
In dividing storage of data across multiple devices, in at least some implementations some storage overlap may be utilized in that some, or all, portions of data may be stored at multiple devices, so that if one device is offline such data may still be accessible from another device. Preferably, decisions on whether to send data can be directed by a client based on the presence of devices available to participate in an information transfer. Preferably, virtual machine messaging is utilized to keep track of communications to ensure quality of service and the ability to abstract networking from an application.
In at least some preferred implementations, remote storage devices are utilized for storage in a manner similar to how hard drives might be utilized in a redundant array of independent disks (RAID). Such remote storage devices might be utilized in a manner akin to any standard level of RAID, or even more exotic flavors of RAID, and even in a manner akin to nested RAID.
Thus, as described hereinabove, virtual dispersive routing can be utilized to form dispersive storage area networks (SANs), and such dispersive SANs can be utilized in a medical context to provide access to medical records and data stored at disparate dispersed locations.
For example, several hospitals (and doctor's offices, etc.) in a region may each have their own servers with medical records, and other data, stored thereon. In a preferred implementation, users would be able to access medical records stored at any hospital's server via virtual dispersive routing. Further, in at least some preferred implementations, medical records may be segmented and dispersed to multiple physical servers, or devices, for enhanced security or redundancy, as described hereinabove with reference to dispersive SANs, and in documents incorporated herein.
Preferably, such a system allows for the sharing of medical information while retaining storage of the information at its current location, e.g., a doctor's office storing patient records would not have to cede storage of such patient records to a central server or database just to ensure available access thereto by other users. Thus, as data can remain stored where it currently is, in some preferred implementations, no additional server or database infrastructure is needed to consolidate medical records or data.
Moreover, to address internal security issues, a dispersed SAN is used to enable specific access to certain segments of the data. By distributing data across multiple servers and only giving access to specific servers, information can be kept secure (servers can be physically located in different locations, separate physical devices or separated by virtual machines) and the ability to copy the information from the servers becomes impossible from a single site. To be able to maintain anonymity for researching medical information, certain fields can be separated from the data (i.e. name and address). A reference number is used in the record to identify and to reassemble the complete record. The networking virtual machines are given information on how to access the data. The access control determines which set of records a user has access to.
For example, with reference to FIG. 45, a user's mobile phone 670 is allowed to access specific information that is “proper” for the user to access. In this example, the user would be restricted to the servers 680,682,684 indicated by the white bar (that is, the top three servers). Similarly, a Researcher 672 is blocked from accessing certain information so he or she is only able to access the servers 684,686,686 indicated by the black bar (that is, the bottom three servers). A doctor would have access to the servers 682,684,686 indicated with a cross-hatched bar (that is, the middle three servers). In some preferred implementations, information can be duplicated on multiple servers and/or specific fields can be removed to improve privacy. The sites, where the information is stored, are encoded on a user device. To deter hacking and impersonation attacks (such as man-in-the-middle), a VM (Virtual Machine) can open separate simultaneous connections to each storage device (examples of storage devices are servers, desktop computers, mobile phones and other computing devices present on the network). To leverage Virtual Dispersive Networking (VDN), a server can use a VM to control networking. The use of VDN would enable deflection of routing through other servers and clients, e.g. using SWRT (SoftWare RouTer) technology.
Additionally, the data on the client devices (mobile phone, Doctor's PC and Researcher) can be backed up using standard backup methods.
Additional Exemplary SANs Implementations
In accordance with one or more preferred implementations, a plurality of electronic devices function as storage devices in a storage area network.
Spreading data across devices will make it much more difficult for hackers to steal all of the data. In one or more preferred implementations, arbitrarily choosing which devices to spread the data across provides a non-algorithmic way to store data and make it even more difficult to steal.
In one or more preferred implementations, these storage devices may be client or end user devices (such as mobile phones, computers, etc.), servers, multiple hard drives in a single server, multiple hard drives in multiple servers in a data center, multiple hard drives in multiple servers in different data centers, etc. Each of these devices can be characterized as a storage server. Despite use of the term “server”, a storage server can basically can be any device with a storage capacity in other configurations that is capable of having loaded thereon, or on an associated device, software for interfacing with other devices in a SANs network, e.g. Dispersive SANs software.
When data is spread over a plurality of storage servers, hackers would need to search each server and assemble the data.
A user device utilizes a SAN to store and retrieve data on the storage servers. In one or more preferred implementations, in order to determine availability of the storage devices for storage, a device is utilized as a presence server which maintains information related to the presence of storage servers. The presence server communicates with the storage servers and fosters communications between the devices. FIG. 40 illustrates an exemplary system including a plurality of storage servers and a presence server. If an address, such as an IP address, changes for a storage device/server, the presence server keeps track of the changes and relays these changes to devices needing to communicate with the device/server.
As illustrated in FIG. 40, the system further includes a device configured as a splitting server, which splits up data and disperses it to various storage servers for storage, as illustrated in FIG. 40. It will be appreciated that connections from the splitting server to the storage devices are independent of the user device which facilitates protection of the data. In one or more preferred implementations, a presence server may be a client or end user device (such as a mobile phone, computer, etc.), or server. Despite use of the term “server”, a storage server can basically can be any device that is capable of having loaded thereon software for interfacing with other devices in a SANs network, e.g. Dispersive SANs software. (It will be appreciated that in one or more preferred implementations a device wishing to store data may itself provide such splitting functionality locally.)
In one or more preferred implementations, all storage servers may not be available at all times, so a storage methodology is utilized that tolerates loss of data. In one or more preferred implementations, error correction algorithms are used to fill missing data. Preferably, the error correction is done independent of the actual storage of the data on the storage devices to ensure security and potentially reduce the data that must be transmitted over the network from a user device. This enables a spreading of data in a pseudo-random way that is based on arbitrary configurations downloaded to a splitting server.
In a RAID system, for example, the striping of data across multiple drives enables a drive to fail and the data to be replaced using error correction automatically. In accordance with one or more preferred implementations, a Dispersive SAN utilizes a similar process (or even this process) by networking the storage servers. In one or more preferred implementations, the error correction provides a methodology where if a storage device is not available, data can be recreated. Further, if a storage device is not available, a use of the system is still possible. Similarly, if the end user device is one of the storage devices, if the end user device is lost, the data can be recreated. Further still, a preferred methodology enables data to be moved by removing the storage device to be decommissioned or replaced and enables other devices to recreate the data.
Preferably, the solution is a complete software solution that uses standard hardware. In one or more preferred implementations, VDR (Virtual Dispersive Routing) provides functionality to connect devices together and create virtual networks, as illustrated in FIG. 41. An operating system on the devices (e.g. the user device) runs application software. The OS might be, for example, Mac OSX by Apple Corporation or Windows 7 or 8 by Microsoft Corporation. VDR can be built into a virtual machine host operating system or it can reside at a guest operating system as a driver.
In one or more preferred implementations, since presence server functionality can be provided by software, the presence software could reside in a separate server, in a storage server, in a splitting server, or at an end-user device. For example, FIG. 42 illustrates an exemplary implementation where presence functionality is provided at a splitting server.
Preferably, the only criteria is that the presence server needs to be able to communicate to all other devices in a Dispersive SANs system. In one or more preferred implementations, a presence server is located on the Internet (e.g. on a network cloud service like Microsoft Azure, Amazon Web services or at a network operation center). In one or more preferred implementations, a presence server can also help with the connection process if one or more devices are behind firewalls.
In one or more preferred implementations, since splitting server functionality can be provided by software, splitting software can be ported to an end user device, as illustrated in FIG. 43. This might, for example, provide more security, better quality of service, and faster data transfer to storage servers.
In one or more preferred implementations, traffic is split between devices (e.g. end user devices, splitting servers, storage servers and other computing and storage devices), for example via one or more deflects as illustrated in FIG. 44, making the data even more secure, and facilitating better quality of service and faster data transfer.
Although described herein generally as including a single presence server or splitting server, in one or more preferred implementations, multiple presence servers and/or splitting servers may be utilized.
In one or more preferred implementations, a device may utilize storage disposed at the device as a storage server for purposes of a dispersive SAN, storing a portion of data to be stored via a dispersive SAN locally.
In one or more preferred implementations, accessing data stored on a dispersive storage area network involves communicating an access request to a splitting server which retrieves portions of the requested data from the storage servers and communicates it to a requesting device. In one or more preferred implementations, a location of such portions may be communicated from the splitting server to the requesting device instead. In one or more preferred implementations, an access server separate from a splitting server may be utilized. In one or more preferred implementations, a user device may retrieve data directly from one or more storage servers or devices without needing to consult a splitting server.
In accordance with one or more preferred implementations, data is spread across servers so that information is harder to find and it is difficult to determine if all data has been collected making a hacker's goal of stealing data more difficult. One or more preferred implementations utilize methodologies that split data across servers (e.g. RAID technology and methodologies). One or more preferred implementations enable technologies like RAID to be reused across devices and data centers.
In one or more preferred implementations, the maintenance of presence utilizing a contact or buddy list speeds up the time for connections. For example, presence information might be maintained at a client or user device for other devices (or users utilizing those devices) contained in a contact list.
In one or more preferred implementations, presence functionality provides positive control of servers and the users allowed in the network. In one or more preferred implementations, using a contact or buddy list for presence also minimizes the ability of a rogue node to cause damage outside of its own contact list. In one or more preferred implementations, the use of presence information from multiple nodes enables faster recognition of a client having left a network. In one or more preferred implementations, presence information from a client can be utilized to update a presence server. In one or more preferred implementations, this capability provides faster and more accurate client status to the presence server enabling faster connections outside of a contact or buddy list.
In one or more preferred implementations, the split of data across servers increases reliability. In one or more preferred implementations, the split of data across servers decreases storage time.
In one or more preferred implementations, the use of algorithms like RAID independent of the storage process enables the data to be moved, and restored if a server is lost making the process more reliable. In one or more preferred implementations, the use of algorithms like RAID independent of the storage process enables less data to be written to a storage device, since a portion of the data can be recreated.
In one or more preferred implementations, if a user device becomes a storage device, a lost device can be replaced easily.
In one or more preferred implementations, if a user device becomes a storage device, a portion of the data never leaves the original device.
In one or more preferred implementations, a VM located on a client provides additional authentication after a connection is allowed but before data is allowed to flow to the application.
In one or more preferred implementations, a VM can communicate to firewall software and open a port for client-to-client communication.
In one or more preferred implementations, a VM enables switching of routing protocols for internal network (LAN communication) and external network (Extranet and Internet communication) communications.
In one or more preferred implementations, a browser is utilized in combination with a splitting server, such that the splitting server provides splitting functionality utilized via the browser.
Detecting Corruption of Communicated Data
In accordance with one or more preferred implementations, methodologies are utilized to detect corruption of data communicated via virtual dispersive routing. In an exemplary methodology, a hash is generated for data to be communicated to a destination and that data is then split for communication via virtual dispersive routing. The split data is recombined at the destination and a hash is generated for the recombined data. The original hash generated at the origin and the hash generated at the destination are compared to determine whether the data has been corrupted, e.g. through technical error or intentional hacking. This comparison may be carried out at the origin, at the destination, or at another location.
FIG. 46 illustrates an exemplary methodology for detecting whether communicated data has been corrupted. As illustrated in FIG. 47, at starting point 4001 a first device contains data A to be communicated to a second device. At step 4002, the first device generates a hash for data A, as illustrated in FIG. 48. At step 4003, the first device splits data A into portions B and C, as illustrated in FIG. 49. At step 4004, the first device communicates portion B to the second device over a first path and portion C to the second device over a second path, as illustrated in FIG. 50. It will be appreciated that although a single deflect is illustrated along each path for illustrative purposes, zero, two, or more deflects may be utilized for each path, and the paths may have one or more (or all) deflects or nodes in common.
At step 4005, the generated hash is communicated to the second device. This generated hash may be communicated over one of the paths the portions were communicated over, or over a different path, as illustrated in steps 4005a, 4005b, 4005c in FIGS. 51A-C.
At step 4006, the second device combines portions B and C to form data D, as illustrated in FIG. 52. At step 4007, the second device generates a hash for data D, as illustrated in FIG. 53. At step 4008, the second device compares the received hash for data A do the generated hash for data D, as illustrated in FIG. 54. This comparison is utilized to determine whether the received portions B and C were corrupted during communication to the second device.
FIG. 55 illustrates another exemplary method where a comparison takes place at an origin device rather than a destination device. As illustrated in FIG. 55, at starting point 5001 a first device contains data A to be communicated to a second device. At step 5002, the first device generates a hash for data A. At step 5003, the first device splits data A into portions A and B. At step 5004, the first device communicates portion B to the second device over a first path and portion C to the second device over a second path. At step 5005, the second device combines portions B and C to form data D. At step 5006, the second device generates a hash for data D. At step 5007, the second device communicates the generated hash for data D to the first device. At step 5008, the first device compares the received hash for data D to the generated hash for data A.
These exemplary methodologies involve hashing a piece of data prior to it being split, and then again upon being recombined, but it will be appreciated that hashing could be performed alternatively or additionally on portions of split data and comparisons made to determine potential data corruption. FIG. 56 illustrates such hashing on portions of split data.
Detecting Corruption of Stored Data
In accordance with one or more preferred implementations, methodologies are utilized to detect corruption of data stored via a storage area network. In an exemplary methodology, a hash is generated for data to be stored in a storage area network, and saved for future comparisons. When that data is later retrieved, a hash is generated for the retrieved data, and the new hash is compared to the original hash to determine whether the stored data has been corrupted. Data may be split and stored in portions on various storage devices. In this event, each portion may have its own individual hash and/or a hash may be used for the combined data. Communications for the storage area network during both storing and retrieving may utilize virtual dispersive routing, and further may utilize methodologies for detecting corruption of communicated data, as described hereinabove.
FIG. 57 illustrates an exemplary methodology for determining whether data stored in a storage area network has been corrupted. As illustrated in FIG. 58, at starting point 6001 a first device contains data A to be stored on a storage area network. At step 6002, the first device generates a hash for data A. At step 6003, the first device splits data A into portions B and C. At step 6004, the first device communicates portion B to a second device for storage, and portion C to a third device for storage, as illustrated in FIG. 59.
Subsequently, at step 6005, the first device retrieves portion B from the second device and portion C from the third device, as illustrated in FIG. 60. At step 6006, the first device combines portions B and C to form data D, as illustrated in FIG. 61. At step 6007, the first device generates a hash for data D. At step 6008, the first device compares the generated hash for data D to the original hash for data A, as illustrated in FIG. 62, in order to determine whether the retrieved data is corrupted.
FIG. 63 illustrates another exemplary methodology for determining whether data stored in a storage area network has been corrupted. As illustrated in FIG. 64, at starting point 7001 a first device contains data A to be stored on a storage area network. At step 7002, the first device splits data A into portions B and C. At step 7003, the first device generates a first hash for portion B and a second hash for portion C. At step 7004, the first device communicates portion B to a second device for storage and portion C to a third device for storage, as illustrated in FIG. 65.
Subsequently, at step 7005, the first device retrieves portion B from the second device and portion C from the third device, as illustrated in FIG. 66. At step 7006, the first device generates a third hash for retrieved portion B and a fourth hash for retrieved portion C, as illustrated in FIG. 67. At step 7007, the first device compares the generated third hash for retrieved portion B to the original first hash for original portion B, and compares the generated fourth hash for retrieved portion C to the original first hash for original portion C, as illustrated in FIG. 68, in order to determine whether the retrieved data is corrupted.
Authenticating Using a Fingerprint of Stored Data
In accordance with one or more preferred implementations, methodologies are utilized to authenticate devices forming part of a storage area network by utilizing a fingerprint of stored data for such authentication. This may be a hash of stored data, or other fingerprint or authentication token which is derived from or based on stored data.
In an exemplary methodology, a device having data for storage in a storage area network generates a hash using that data and then communicates the data for storage in a node in the storage area network. The device stores the hash in association with the node at which the data is to be stored. Subsequently, when the device wants to communicate with that node, the device requests an authentication token from that node. The node, in order to authenticate, generates a hash on the stored data it previously received from the device, and then communicates the generated hash to the device as an authentication token. The device compares the received authentication token to the hash it has stored in association with the node in order to authenticate the node.
In accordance with one or more preferred implementations, when data stored in a storage area network is accessed and updated by the device, this process is utilized, and the object to be used for authentication of each device in the storage area network is updated as well. In one or more preferred implementations, date or time information and other information is automatically included in the data to be stored as well, and the updating of such constantly changing information causes authentication objects to be updated upon accessing data in a storage area network even absent any further changes to the data.
FIGS. 69A-C illustrate an exemplary methodology for authentication utilizing a fingerprint of stored data. As illustrated in FIG. 70, at starting point 8001, a first device contains data A to be stored in a storage area network. At step 8002, the first device generates a hash for data A. At step 8003, the first device splits data A into portions B and C, and D. At step 8004, the first device determines it will send portion B to device 1, portion C to device 2, and portion D to device 3. At step 8005, the first device generates a hash for portion B and stores the hash in association with portion B and device 1, as illustrated in FIG. 71. At step 8006, the first device generates a hash for portion C and stores the hash in association with portion C and device 2. At step 8007, the first device generates a hash for portion D and stores the hash association with portion D and device 3.
At step 8008, the first device communicates portion B to device 1, as illustrated in FIG. 72. At step 8009, the first device communicates portion C to device 2. At step 8010, the first device communicates portion C to device 3.
Subsequently, at step 8011, the first device goes to retrieve data A and determines it needs to retrieve portions B, C, and D. At step 8012, the first device requests a hash from device 1 for authentication, as illustrated in FIG. 73. In accordance with one or more preferred implementations, this involves identifying the piece of data it is looking to retrieve and is seeking the hash for. At step 8013, in response to the request, device 1 generates a hash for portion B and communicates the generated hash to the first device. At step 8014, the first device authenticates device 1 by comparing the received hash to the stored hash for portion B, as illustrated in FIG. 74.
At step 8015, following authentication, the first device requests portion B from device 1, as illustrated in FIG. 75. At step 8016, in response to the request, device 1 sends portion B to the first device. At step 8017, the first device generates a hash for the received portion B, as illustrated in FIG. 76. At step 8018, the first device compares the newly generated hash to the stored, original hash for portion B, in order to determine whether the retrieved data is corrupted.
This process is repeated for the other portions C and D. At step 8019, the first device requests a hash from device 2 for authentication. At step 8020, in response to the request, device 2 generates a hash for portion C and communicates the generated hash to the first device. At step 8021, the first device authenticates device 2 by comparing the received hash to the stored hash for portion C. At step 8022, the first device requests portion C from device 2. At step 8023, in response to the request, device 2 sends portion C to the first device. At step 8024, the first device generates a hash for the received portion C. At step 8025, the first device compares the newly generated hash to the stored, original hash for portion C.
At step 8026, the first device requests a hash from device 3 for authentication. At step 8027, in response to the request, device 3 generates a hash for portion D and communicates the generated hash to the first device. At step 8028, the first device authenticates device 3 by comparing the received hash to the stored hash for portion D. At step 8029, the first device requests portion D from device 3. At step 8030, in response to the request, device 3 sends portion D to the first device. At step 8031, the first device generates a hash for received portion D. At step 8032, the first device compares the newly generated hash to the stored, original hash for portion D.
At step 8033, the first device combines portions B, C, and D to form data E. At step 8034, the first device generates a hash for data E. At step 8035, the first device compares the generated hash for data E to the stored hash for data A, in order to determine whether the retrieved data is corrupted.
Authenticating Using Path or Other Connection Information
In accordance with one or more preferred implementations, methodologies are utilized to authenticate devices, e.g. devices forming part of a storage area network, by utilizing authentication tokens based on or derived from path or other connection information for past communications with the devices.
In dispersive routing networks, communications can be characterized as having a connection path, e.g. over one or more deflects and nodes. In accordance with one or more preferred implementations, during communications between two devices, this connection path and other connection information is saved and stored at both devices for later use in authentication.
In an exemplary implementation, a first device communicates data for storage to a second device forming part of a storage area network over a network path comprising two deflects, and connection path information including an identifier for each of these deflects is stored at each device. Subsequently, when the first device wishes to retrieve the stored data from the second device, the first device requires the second device to authenticate using an authentication token based on or derived from this network path, and/or the second device requires the first device to authenticate using an authentication token based on or derived from this network path. For example, at the time of the previous communication, each node may generate a hash based on the identifiers of the deflects in the connection path and store it for future authentication. Alternatively, each device may store connection path information and later use it to generate an authentication token upon demand. In accordance with one or more preferred implementations, common connection information may be utilized to derive two different authentication tokens, one for use by a first device in authenticating with a second device, and one for use by the second device in authenticating with the first device. These authentication tokens may be derived in real time upon demand, e.g. derived based on stored connection path information and other information contained in an authentication request.
Storing Hack Fingerprints
Methodologies disclosed herein can be utilized to determine whether data has been corrupted. In accordance with one or more preferred implementations, a fingerprint or marker of corrupted data is saved upon such determination for future use and analysis. In accordance with one or more preferred implementations, information regarding a delta between original data and corrupted data is saved. In accordance with one or more preferred implementations, information regarding connection path information for corrupted data is saved.
Based on the foregoing description, it will be readily understood by those persons skilled in the art that the present invention is susceptible of broad utility and application. Many embodiments and adaptations of the present invention other than those specifically described herein, as well as many variations, modifications, and equivalent arrangements, will be apparent from or reasonably suggested by the present invention and the foregoing descriptions thereof, without departing from the substance or scope of the present invention. Accordingly, while the present invention has been described herein in detail in relation to one or more preferred embodiments, it is to be understood that this disclosure is only illustrative and exemplary of the present invention and is made merely for the purpose of providing a full and enabling disclosure of the invention. The foregoing disclosure is not intended to be construed to limit the present invention or otherwise exclude any such other embodiments, adaptations, variations, modifications or equivalent arrangements, the present invention being limited only by the claims appended hereto and the equivalents thereof.

## Claims

1. A method for storing data from a first electronic device at a plurality of storage devices of a dispersive storage area network comprising:
(a) spawning, at the first electronic device, a first virtual machine that virtualizes network capabilities of the first electronic device such that a first virtual network connection is provided;
(b) spawning, at a first storage server, a second virtual machine that virtualizes network capabilities of the first storage server such that a second virtual network connection is provided;
(c) spawning, at a second storage server, a third virtual machine that virtualizes network capabilities of the second storage server such that a third virtual network connection is provided;
(d) spawning, at a third storage server, a fourth virtual machine that virtualizes network capabilities of the third storage server such that a fourth virtual network connection is provided;
(e) spawning, at a splitting server, a fifth virtual machine that virtualizes network capabilities of the splitting server such that a fifth virtual network connection is provided;
(f) communicating, from the first electronic device via the first virtual network connection, one or more packets for communication to the splitting server containing first data for storage on the dispersive storage area network;
(g) receiving, at the splitting server via the fifth virtual network connection, the one or more packets containing first data for storage on the dispersive storage area network;
(h) spawning, at a splitting server, a sixth virtual machine that virtualizes network capabilities of the splitting server such that a sixth virtual network connection is provided;
(i) spawning, at a splitting server, a seventh virtual machine that virtualizes network capabilities of the splitting server such that a seventh virtual network connection is provided;
(j) spawning, at a splitting server, an eighth virtual machine that virtualizes network capabilities of the splitting server such that an eighth virtual network connection is provided;
(k) splitting, at the splitting server, the first data into a plurality of portions for storage on the dispersive storage area network, the plurality of portions including a first portion, a second portion, and a third portion of the split data;
(l) generating, at the splitting server, a first hash for the first portion of the split data;
(m) generating, at the splitting server, a second hash for the second portion of the split data;
(n) generating, at the splitting server, a third hash for the third portion of the split data;
(o) communicating, from the splitting server via the sixth virtual network connection, one or more packets for communication to the first storage server representing the first portion of the split data, and saving, at the splitting server, the first hash for the communicated first portion in association with the first storage server;
(p) receiving, at the first storage server via the second virtual network connection, the one or more packets representing the first portion of the split data;
(q) storing, at the first storage server, the first portion of the split data;
(r) communicating, from the splitting server via the seventh virtual network connection, one or more packets for communication to the second storage server representing the second portion of the split data, and saving, at the splitting server, the second hash for the communicated second portion in association with the second storage server;
(s) receiving, at the second storage server via the third virtual network connection, the one or more packets representing the second portion of the split data;
(t) storing, at the second storage server, the second portion of the split data;
(u) communicating, from the splitting server via the eighth virtual network connection, one or more packets for communication to the third storage server representing a third portion of the split data, and saving, at the splitting server, the third hash for the communicated third portion in association with the third storage server;
(v) receiving, at the third storage server via the fourth virtual network connection, the one or more packets representing the third portion of the split data;
(w) storing, at the third storage server, the third portion of the split data;
(x) receiving, at the splitting server from the first electronic device, a request to access the first data;
(y) communicating, from the splitting server to the first storage server, a first request for a hash for authentication of the first storage server;
(z) receiving, at the first storage server, the communicated first request for a hash for authentication, and, in response thereto, generating a fourth hash for the first portion of the split data, and communicating the generated fourth hash to the splitting server;
(aa) receiving, at the splitting server, the fourth hash communicated by the first storage server, and authenticating the first storage server by comparing the communicated fourth hash to the first hash stored in association with the first storage server;
(bb) following authentication of the first storage server, communicating from the splitting server to the first storage server, a second request for stored data, and receiving at the splitting server, in response thereto, the first portion of the split data;
(cc) communicating, from the splitting server to the second storage server, a third request for a hash for authentication of the second storage server;
(dd) receiving, at the second storage server, the communicated third request for a hash for authentication, and, in response thereto, generating a fifth hash for the second portion of the split data, and communicating the generated fifth hash to the splitting server;
(ee) receiving, at the splitting server, the fifth hash communicated by the second storage server, and authenticating the second storage server by comparing the communicated fifth hash to the second hash stored in association with the second storage server;
(ff) following authentication of the second storage server, communicating from the splitting server to the second storage server, a fourth request for stored data, and receiving at the splitting server, in response thereto, the second portion of the split data;
(gg) communicating, from the splitting server to the third storage server, a fifth request for a hash for authentication of the third storage server;
(hh) receiving, at the third storage server, the communicated fifth request for a hash for authentication, and, in response thereto, generating a sixth hash for the second portion of the split data, and communicating the generated sixth hash to the splitting server;
(ii) receiving, at the splitting server, the sixth hash communicated by the third storage server, and authenticating the third storage server by comparing the communicated sixth hash to the third hash stored in association with the third storage server;
(jj) following authentication of the third storage server, communicating from the splitting server to the third storage server, a sixth request for stored data, and receiving at the splitting server, in response thereto, the third portion of the split data;
(kk) combining, at the splitting server, data portions received from storage servers, including the first data portion received from the first storage server, the second data portion received from the second storage server, and the third data portion received from the third storage server, into the first data; and
(ll) communicating, in response to the request to access the first data, the combined first data from the splitting server to the first electronic device.

2. The method of claim 1, wherein the first electronic device comprises a mobile phone.

3. The method of claim 1, wherein the first electronic device comprises a tablet.

4. The method of claim 1, wherein the first electronic device comprises a computer.

5. The method of claim 1, wherein the first electronic device comprises a laptop.

6. The method of claim 1, wherein the first electronic device comprises a mobile electronic device.

7. The method of claim 1, wherein the splitting server comprises a server.

8. The method of claim 1, wherein the splitting server comprises a mobile electronic device.

9. The method of claim 1, wherein the first storage server comprises a mobile phone.

10. The method of claim 1, wherein the first storage server comprises a tablet.

11. The method of claim 1, wherein the first storage server comprises a computer.

12. The method of claim 1, wherein the first storage server comprises a laptop.

13. The method of claim 1, wherein the first storage server comprises a mobile electronic device.

14. The method of claim 1, wherein the first storage server comprises a first server at a first data center, and the second storage server comprises a second server at a second data center different from the first data center.

15. The method of claim 1, wherein the first portion of the split data includes data overlapping with data from the second portion of the split data.

16. The method of claim 1, wherein the splitting server comprises a plurality of physical servers at a first data center.

17. The method of claim 1, wherein the splitting server comprises a plurality of physical servers at a plurality of data centers.