Abstract:
Embodiments relate to systems and methods for the promotion of calculations to cloud-based computation resources. One or more applications, such as spreadsheet applications, can prepare the calculation of a relatively large-scale computation, such as running statistical reports on large (e.g., greater than 1000 by 1000 cell) spreadsheets or other data objects. If the pending calculation is determined to be greater than a computation threshold for instance in computation intensity or data size, a computation request can be sent to a promotion engine. The promotion engine can identify a set of computation resources located in a cloud or other network and transmit the data request and subject data to the set of computation resources, which afford greater computation speed than the local machine hosting the requesting application. A set of results is returned from the cloud to the requesting application, thereby creating higher bandwidth and faster calculation times for the user.

Description:
FIELD 
       [0001]    The present teachings relate to systems and methods for promotion of calculations to cloud-based computation resources, and more particularly to platforms and techniques for uploading computation-intensive spreadsheets or other calculations to cloud-based processing centers capable of efficiently completing and returning large-scale computation results to a requesting client. 
       BACKGROUND OF RELATED ART 
       [0002]    Consumer-level software applications have expanded in scope and capability in recent years. A variety of spreadsheet, database, and other computational software packages are available to the business consumer and other markets. However, despite the availability of software applications of a variety of types and capabilities, large-scale spreadsheet and other computation-intensive applications are not always an effective or feasible tool for some applications. Consumer spreadsheet applications, for example, can sometimes be bogged down or possibly be made to crash by large-scale spreadsheet or matrix calculations, for instance, on the order of a 1000 by 1000 cell spreadsheets or larger. This can be due to, for example, the fact that even multiple-core desktop processors may not present enough computing throughput to process the large-scale computation required, for example, by linear regression, Monte Carl simulation, or other calculations. In other cases, the storage media on a desktop machine may also not be able to transfer data to or from processor or memory quickly enough to avoid bogging down during such large-scale computational tasks. 
         [0003]    The advent of cloud-based computing resources has opened a new range of resources that computer users can subscribe to. Cloud-based networks permit users to arrange for the temporary usage of the collective networked assets of a set of resource servers from which processing, memory, software, or other resources may be extracted for a given period of time. In the case of machines attempting to execute a high-load application such as for instance a spreadsheet or data mining application, it may be desirable to provide methods and systems which permit an individual or small-scale client to promote the necessary computational load to a cloud-based network of highly scaled processing resources. 
     
    
     
       DESCRIPTION OF THE DRAWINGS 
         [0004]    The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments of the present teachings and together with the description, serve to explain the principles of the present teachings. In the figures: 
           [0005]      FIG. 1  illustrates an overall cloud system architecture in which various embodiments of the present teachings can be practiced; 
           [0006]      FIG. 2  illustrates an overall cloud system architecture including multiple cloud arrangements in which various embodiments of the present teachings can be practiced in another regard, according to various embodiments; 
           [0007]      FIG. 3  illustrates an overall system for the promotion of calculations to cloud-based computational resources, according to various embodiments of the present teachings; and 
           [0008]      FIG. 4  illustrates an exemplary hardware configuration for a system configured to promote computational tasks to cloud-based processing resources, according to various embodiments; and 
           [0009]      FIG. 5  illustrates a flowchart of overall cloud-based processing of promoted computational tasks, according to various embodiments. 
       
    
    
     DESCRIPTION OF EMBODIMENTS 
       [0010]    Embodiments of the present teachings relate to systems and methods for promotion of calculations to cloud-based computation resources. More particularly, embodiments relate to platforms and techniques for detecting high-load computations in a local spreadsheet or other application, and generating the transfer of the computational task to a set of cloud-based computation resources. A networked promotion engine can receive a request from, or generate a request for, a spreadsheet or other application to transmit and promote the computational load for a given calculation or report to the cloud. In embodiments, the request for promotion of the calculations to the cloud can be triggered based on a computation threshold or data-size threshold. The promotion engine can receive the subject spreadsheet or other data and transmit that data to a set of computing resources in the cloud. In embodiments, those resources can be or include, for instance, processor throughput in the form of processor cycles on a server, machine cluster, or other hardware network or set of computation resources. In general, the set of computation resources can represent a greater or higher-throughput processing capacity than the client machine hosting the requesting application. The set of computation resources can receive the data and computation request, and perform the calculations on the set of computation resources in the cloud. The set of computation resources can return a set of results to the requesting application on the client or other device. In embodiments, the user can subscribe to the set of computation resources in the cloud, for instance on an on-demand or other basis. These and other embodiments described herein address the various noted shortcomings in known application technology, and provide a user or network operator with enhanced computational power on a transparent, on-demand basis. 
         [0011]    Reference will now be made in detail to exemplary embodiments of the present teachings, which are illustrated in the accompanying drawings. Where possible the same reference numbers will be used throughout the drawings to refer to the same or like parts. 
         [0012]    Embodiments described herein can be implemented in or supported by a cloud network architecture. As used herein, a “cloud” can comprise a collection of resources that can be invoked to instantiate a virtual machine, process, or other resource for a limited or defined duration. As shown for example in  FIG. 1 , the collection of resources supporting a cloud  102  can comprise a set of resource servers  108  configured to deliver computing components needed to instantiate a virtual machine, process, or other resource. For example, one group of resource servers can host and serve an operating system or components thereof to deliver to and instantiate a virtual machine. Another group of resource servers can accept requests to host computing cycles or processor time, to supply a defined level of processing power for a virtual machine. A further group of resource servers can host and serve applications to load on an instantiation of a virtual machine, such as an email client, a browser application, a messaging application, or other applications or software. Other types of resource servers are possible. 
         [0013]    In embodiments, the entire set of resource servers  108  or other hardware or software resources used to support the cloud  102  along with its instantiated virtual machines is managed by a cloud management system  104 . The cloud management system  104  can comprise a dedicated or centralized server and/or other software, hardware, and network tools that communicate via network  106  such as the Internet or other public or private network with all sets of resource servers to manage the cloud  102  and its operation. To instantiate a new set of virtual machines, a user can transmit an instantiation request to the cloud management system  104  for the particular type of virtual machine they wish to invoke for their intended application. A user can for instance make a request to instantiate a set of virtual machines configured for email, messaging or other applications from the cloud  102 . The request can be received and processed by the cloud management system  104 , which identifies the type of virtual machine, process, or other resource being requested. The cloud management system  104  can then identify the collection of resources necessary to instantiate that machine or resource. In embodiments, the set of instantiated virtual machines or other resources can for example comprise virtual transaction servers used to support Web storefronts, or other transaction sites. 
         [0014]    In embodiments, the user&#39;s instantiation request can specify a variety of parameters defining the operation of the set of virtual machines to be invoked. The instantiation request, for example, can specify a defined period of time for which the instantiated machine or process is needed. The period of time can be, for example, an hour, a day, or other increment of time. In embodiments, the user&#39;s instantiation request can specify the instantiation of a set of virtual machines or processes on a task basis, rather than for a predetermined amount of time. For instance, a user could request resources until a software update is completed. The user&#39;s instantiation request can specify other parameters that define the configuration and operation of the set of virtual machines or other instantiated resources. For example, the request can specify an amount of processing power or input/output (I/O) throughput the user wishes to be available to each instance of the virtual machine or other resource. In embodiments, the requesting user can for instance specify a service level agreement (SLA) acceptable for their application. Other parameters and settings can be used. One skilled in the art will realize that the user&#39;s request can likewise include combinations of the foregoing exemplary parameters, and others. 
         [0015]    When the request to instantiate a set of virtual machines or other resources has been received and the necessary resources to build that machine or resource have been identified, the cloud management system  104  can communicate with one or more set of resource servers  108  to locate resources to supply the required components. The cloud management system  104  can select providers from the diverse set of resource servers  108  to assemble the various components needed to build the requested set of virtual machines or other resources. It may be noted that in some embodiments, permanent storage such as hard disk arrays may not be included or located within the set of resource servers  108  available to the cloud management system  104 , since the set of instantiated virtual machines or other resources may be intended to operate on a purely transient or temporary basis. In embodiments, other hardware, software or other resources not strictly located or hosted in the cloud can be leveraged as needed. For example, other software services that are provided outside of the cloud  102  and hosted by third parties can be invoked by in-cloud virtual machines. For further example, other non-cloud hardware and/or storage services can be utilized as an extension to the cloud  102 , either on an on-demand or subscribed or decided basis. 
         [0016]    With the resource requirements identified, the cloud management system  104  can extract and build the set of virtual machines or other resources on a dynamic or on-demand basis. For example, one set of resource servers  108  may respond to an instantiation request for a given quantity of processor cycles with an offer to deliver that computational power immediately and guaranteed for the next hour. A further set of resource servers  108  can offer to immediately supply communication bandwidth, for example on a guaranteed minimum or best-efforts basis. In other embodiments, the set of virtual machines or other resources can be built on a batch basis or at a particular future time. For example, a set of resource servers  108  may respond to a request for instantiation at a programmed time with an offer to deliver the specified quantity of processor cycles within a specific amount of time, such as the next 12 hours. 
         [0017]    The cloud management system  104  can select group of servers in the set of resource servers  108  that match or best match the instantiation request for each component needed to build the virtual machine or other resource. The cloud management system  104  can then coordinate the integration of the completed group of servers from the set of resource servers  108 , to build and launch the requested set of virtual machines or other resources. The cloud management system  104  can track the combined group of servers selected from the set of resource servers  108 , or other distributed resources that are dynamically or temporarily combined, to produce and manage the requested virtual machine population or other resources. 
         [0018]    In embodiments, the cloud management system  104  can generate a resource aggregation table that identifies the various sets of resource servers that will be used to supply the components of the virtual machine or process. The sets of resource servers can be identified by unique identifiers such as, for instance, Internet protocol (IP) addresses or other addresses. The cloud management system  104  can register the finalized group of servers in the set resource servers  108  contributing to an instantiated machine or process. 
         [0019]    The cloud management system  104  can then set up and launch the initiation process for the virtual machines, processes, or other resources to be delivered from the cloud. The cloud management system  104  can for instance transmit an instantiation command or instruction to the registered group of servers in set of resource servers  108 . The cloud management system  104  can receive a confirmation message back from each participating server in set of resource servers  108  indicating a status regarding the provisioning of their respective resources. Various sets of resource servers may confirm, for example, the availability of a dedicated amount of processor cycles, amounts of electronic memory, communications bandwidth, or applications or other software prepared to be served. 
         [0020]    As shown for example in  FIG. 2 , the cloud management system  104  can then instantiate one or more than one set of virtual machines  116 , or other processes based on the resources supplied by the registered set of resource servers  108 . In embodiments, the cloud management system  104  can instantiate a given number, for example, 10, 500, 1000, or other numbers of virtual machines to be made available to users on a network  114 , such as the Internet or other public or private network. Each virtual machine can be assigned an instantiated machine ID that can be stored in the resource aggregation table, or other record or image of the instantiated population. Additionally, the cloud management system  104  can store the duration of each virtual machine and the collection of resources utilized by the complete set of instantiated virtual machines  116 . 
         [0021]    In embodiments, the cloud management system  104  can further store, track and manage a user&#39;s identity and associated set of rights or entitlements to software, hardware, and other resources. Each user that populates a set of virtual machines in the cloud can have specific rights and resources assigned and made available to them. The cloud management system  104  can track and configure specific actions that a user can perform, such as provision a set of virtual machines with software applications or other resources, configure a set of virtual machines to desired specifications, submit jobs to the set of virtual machines or other host, manage other users of the set of instantiated virtual machines  116  or other resources, and other privileges or actions. The cloud management system  104  can further generate records of the usage of instantiated virtual machines to permit tracking, billing, and auditing of the services consumed by the user. In embodiments, the cloud management system  104  can for example meter the usage and/or duration of the set of instantiated virtual machines  116 , to generate subscription billing records for a user that has launched those machines. Other billing or value arrangements are possible. 
         [0022]    The cloud management system  104  can configure each virtual machine to be made available to users of the network  114  via a browser interface, or other interface or mechanism. Each instantiated virtual machine can communicate with the cloud management system  104  and the underlying registered set of resource servers  108  via a standard Web application programming interface (API), or via other calls or interfaces. The set of instantiated virtual machines  116  can likewise communicate with each other, as well as other sites, servers, locations, and resources available via the Internet or other public or private networks, whether within a given cloud  102  or between clouds. 
         [0023]    It may be noted that while a browser interface or other front-end can be used to view and operate the set of instantiated virtual machines  116  from a client or terminal, the processing, memory, communications, storage, and other hardware as well as software resources required to be combined to build the virtual machines or other resources are all hosted remotely in the cloud  102 . In embodiments, the set of virtual machines  116  or other resources may not depend on or require the user&#39;s own on-premise hardware or other resources. In embodiments, a user can therefore request and instantiate a set of virtual machines or other resources on a purely off-premise basis, for instance to build and launch a virtual storefront or other application. 
         [0024]    Because the cloud management system  104  in one regard specifies, builds, operates and manages the set of instantiated virtual machines  116  on a logical level, the user can request and receive different sets of virtual machines and other resources on a real-time or near real-time basis, without a need to specify or install any particular hardware. The user&#39;s set of instantiated machines  116 , processes, or other resources can be scaled up or down immediately or virtually immediately on an on-demand basis, if desired. In embodiments, the various sets of resource servers that are accessed by the cloud management system  104  to support a set of instantiated virtual machines  116  or processes can change or be substituted, over time. The type and operating characteristics of the set of instantiated virtual machines  116  can nevertheless remain constant or virtually constant, since instances are assembled from abstracted resources that can be selected and maintained from diverse sources based on uniform specifications. 
         [0025]    In terms of network management of the set of virtual machines  116  that have been successfully configured and instantiated, the cloud management system  104  can perform various network management tasks including security, maintenance, and metering for billing or subscription purposes. The cloud management system  104  of a given cloud can  102 , for example, install or terminate applications or appliances on individual machines. The cloud management system  104  can monitor operating virtual machines to detect any virus or other rogue process on individual machines, and for instance terminate the infected application or virtual machine. The cloud management system  104  can likewise manage an entire set of instantiated clients  116  or other resources on a collective basis, for instance, to push or delivery a software upgrade to all active virtual machines. Other management processes are possible. 
         [0026]    In embodiments, more than one set of virtual machines can be instantiated in a given cloud at the same, overlapping or successive times. The cloud management system  104  can, in such implementations, build, launch and manage multiple sets of virtual machines based on the same or different underlying set of resource servers  108 , with populations of different instantiated virtual machines  116  such as may be requested by different users. The cloud management system  104  can institute and enforce security protocols in a cloud  102  hosting multiple sets of virtual machines. Each of the individual sets of virtual machines can be hosted in a respective partition or sub-cloud of the resources of the main cloud  102 . The cloud management system  104  of a cloud can for example deploy services specific to isolated or defined sub-clouds, or isolate individual workloads/processes within the cloud to a specific sub-cloud. The subdivision of the cloud  102  into distinct transient sub-clouds or other sub-components which have assured security and isolation features can assist in establishing a multiple user or multi-tenant cloud arrangement. In a multiple user scenario, each of the multiple users can use the cloud platform as a common utility while retaining the assurance that their information is secure from other users of the overall cloud system. In further embodiments, sub-clouds can nevertheless be configured to share resources, if desired. 
         [0027]    In embodiments, and as also shown in  FIG. 2 , the set of instantiated virtual machines  116  generated in a first cloud  102  can also interact with a set of instantiated virtual machines or processes generated in a second, third or further cloud  102 . The cloud management system  104  of a first cloud  102  can interface with the cloud management system  104  of a second cloud  102 , to coordinate those domains and operate the clouds and/or virtual machines or processes on a combined basis. The cloud management system  104  of a given cloud  102  can track and manage individual virtual machines or other resources instantiated in that cloud, as well as the set of instantiated virtual machines or other resources in other clouds. 
         [0028]    In the foregoing and other embodiments, the user making an instantiation request or otherwise accessing or utilizing the cloud network can be a person, customer, subscriber, administrator, corporation, organization, or other entity. In embodiments, the user can be or include another virtual machine, application or process. In further embodiments, multiple users or entities can share the use of a set of virtual machines or other resources. 
         [0029]      FIG. 3  illustrates an overall network in which systems and methods for the promotion of calculations to cloud-based computation resources can operate, according to various embodiments. In embodiments as shown, a set of applications  112  can communicate with a promotion engine  126  via a set of promotion application programming interfaces (APIs)  124 . The set of applications  112  can, for instance, be or include one or more spreadsheet applications. The set of applications  112  can in addition or instead include other numerical or quantitative applications, such as, for example, database applications, statistical applications, modeling applications, or other applications or software. The set of promotion APIs  124  can permit any application in set of applications  112 , and/or the operating system of any local machine hosting set of applications  112 , to communicate with promotion engine  126  and other resources. Promotion engine  126  can in turn communicate with a cloud  102 , including a set of computation resources  118 . Set of computation resources  118  can be or include a set of servers, personal computers, or other devices, machines, or networks representing comparatively greater computational power than that available on any local client hosting set of applications  112 . For instance, set of computation resources  118  can be or include one or more servers or other processors, or clusters of processors, which together represent a comparatively high-throughput computation engine or resource. 
         [0030]    More particularly, a requesting application in set of applications  112  can transmit a computation request  114  to promotion engine  126  when a local computational burden in one or more local application operating on data  122  meets or exceeds a computation threshold  120 . In embodiments, computation threshold  120  can be a predetermined computational threshold. Computation threshold  120  can, for example, a threshold based on computation time, computation throughput, or the size of data  122 . For example, computation threshold  120  can be set to a computation time on the user&#39;s local machine of 15 minutes, or to a size of at least 1000 by 1000 cells in data  122 . In embodiments, computation threshold  120  can be manually configured by the user of set of applications  112 . In embodiments, computation threshold  120  can be automatically or dynamically set by set of applications  112  themselves or by other logic, for instance, based on deviations from average computation times or data sizes for recent execution runs. Other types and values of computation threshold  120  can be used. In embodiments, set of applications  112  themselves can detect the reaching of computation threshold  120 . In embodiments, promotion engine  126  can monitor processing conditions in set of applications  112  and detect the reaching of computation threshold  120 . 
         [0031]    When triggered by the reaching of computation threshold  120 , a computation request  114  can be transmitted by one or more requesting application in set of applications  112  to promotion engine  126 , along with data  122 . Computation request  114  can specify parameters for the execution of the processing to be carried out, for example, the precision or accuracy of the desired calculations, the format of the data  122 , a time for delivery of any results, or other parameters. Promotion engine  126  can transmit computation request  114  and data  122  to set of computation resources  118  via one or more networks  106 . Set of computation resources  118  can be identified, for example, by promotion engine  126  and/or the management engine  128  of cloud management system  104 , which can be used to assemble computation resources available to the user of set of applications  112 . For example, the user can be a subscriber to virtual machines or other computation resources in cloud  102 . The computation resources  118  can, in embodiments, be instantiated on demand by the user when a computation request  114  is received. 
         [0032]    After receipt of computation request  114  and data  122 , the set of computation resources can perform the processing, calculation, or computation requested in computation request  114  and generate a set of results  140  as a result of that processing. In embodiments, set of results  140  can include, for example, a spreadsheet calculation, database sort or other calculation, a statistical or modeling calculation, or other calculations, processing, or output. Set of computation resources  118  can then transmit set of results  140  to the requesting application(s) via promotion engine  126 , or directly via one or more networks  106 . Set of applications  102  can store the set of results  140  and present those results to the user, as appropriate. In embodiments, the set of results  140  can be transparently incorporated into the user&#39;s view of the requesting application(s), without an indication that the calculations were transmitted offsite to remote computation resources. In embodiments, the user can be notified of the generation of set of results  140  via cloud  102  or other networked resources. 
         [0033]      FIG. 4  illustrates an exemplary configuration of a system  142  that can host, support or execute promotion engine  126 , according to various embodiments. In embodiments as shown, system  142  can comprise a processor  130  communicating with memory  132 , such as electronic random access memory, operating under control of or in conjunction with operating system  136 . Operating system  136  can be, for example, a distribution of the Linux™ operating system, the Unix™ operating system, or other open-source or proprietary operating system or platform. Processor  130  also communicates with data store  138 , such as a database stored on a local hard drive. Processor  130  further communicates with network interface  134 , such as an Ethernet or wireless data connection, which in turn communicates with one or more networks  106 , such as the Internet or other public or private networks. Processor  130  also communicates with promotion engine  126 , to execute control logic and control the distribution of promoted computational tasks to the computing resources in cloud  102 . Other configurations of promotion engine  126 , associated network connections, and other hardware and software resources are possible. 
         [0034]      FIG. 5  illustrates an illustrative flowchart of overall promotion processing to communicate a processing task from set of applications  112  to cloud  102 . In  502 , processing can begin. In  504 , set of applications  112  can be initiated, for instance, on a personal computer, network-enabled cellular telephone, or other client or device. In embodiments, set of applications  112  can include one or more spreadsheet applications. In embodiments, set of applications  112  can in addition or instead also include database applications, modeling applications, statistical applications, or other quantitative, numerical, or computational software or applications. 
         [0035]    In  506 , a computation threshold  120  can be detected to trigger the promotion of a computation task to set of computation resources  118  in cloud  102 , for example, by an application in set of applications  112  that is preparing to execute a set of calculations, or by promotion engine  126 . In embodiments, computation threshold  120  can be a predetermined threshold, for example, a threshold based on computation time, computation throughput, or the size of data  122 . For example, computation threshold  120  can be set to a computation time on the user&#39;s local machine of 15 minutes, or to a size of at least 1000 by 1000 cells in data  122 . Other types and values of computation threshold  120  can be used. 
         [0036]    In  508 , one or more requesting application in set of applications  112  can transmit a computation request  114  and data  122  to promotion engine  126 . In embodiments, computation request  114  can specify parameters for the requested calculation or computation, such as the format of the data  122 , the precision or accuracy of the desired output of the computation, the time at which the set of results  140  are desired, and/or other settings or parameters. In embodiments, data  122  can be or include spreadsheet data, database data such as online analytical processing (OLAP) multi-dimensional data, relational database tables, or data encoded in other formats or schema. 
         [0037]    In  510 , promotion engine  126  can identify set of computation resources  118  in cloud  102  that is available to the user of the requesting application to carry out enhanced calculations. In embodiments, set of computation resources  118  can be or include a set of servers, personal computers, or other devices, machines, or networks representing comparatively greater computational power than that available on the local client hosting set of applications  112 . For instance, set of computation resources  118  can be or include one or more processors, or clusters of processors, which together represent a comparatively high-throughput computation engine or resource. In embodiments, promotion engine  126  can scale the set of computation resources  118  to match the size and type of computation request  114  and/or data  122 . 
         [0038]    In  512 , promotion engine  126  can transmit the computation request  114  and data  122  to the set of computation resources  118  in cloud  102 . In  514 , the set of computation resources  118  can perform or executed the requested calculations or other processing to generate a set of results  140 . In  516 , the set of computation resources  118  can transmit the set of results  140  to the requesting application(s) in set of applications  112  via promotion engine  126 , or directly to that application(s). In  518 , the requesting application(s) and/or promotion engine  126  or other logic can store the set of results, for instance in the local computer hosting set of applications  112 , or to another location. In  520 , processing can repeat, return to a prior processing point, jump to a further processing point, or end. 
         [0039]    The foregoing description is illustrative, and variations in configuration and implementation may occur to persons skilled in the art. For example, while embodiments have been described in which a computation request  114  is transmitted to a set of computation resources  118  hosted or embedded in a cloud  102 , in embodiments, the computation request  114  can in addition or instead be transmitted to other types of computation resources. For example, in embodiments the computation request  114  can be transmitted to a database server, to a highly parallel machine or other computation cluster or network, or to other computation resources. For further example, while embodiments have been described in which the calculations in response to computation request  114  are performed in a single processing operation, in embodiments, the processing initiated by computation request  114  can be carried out in stages, or be shared between multiple sets of computation resources  118 . Other resources described as singular or integrated can in embodiments be plural or distributed, and resources described as multiple or distributed can in embodiments be combined. The scope of the present teachings is accordingly intended to be limited only by the following claims.