Hybrid processing interface

A system includes a computing device that includes a memory configured to store instructions. The computing device also includes a processor configured to execute the instructions to perform a method that includes defining a first portion of a display as a workspace for presenting graphical elements that represent processing operations that define properties of an object. The method also includes defining a second portion of the display, different from the first portion, for presenting a graphical stack that uses the properties from the processing operations to define layers associated with the object. The method also includes simultaneously presenting the first and the second portion on the display.

TECHNICAL FIELD

This document relates to systems and methodologies that use a hybrid interface technique to graphically represent processing operations and define a multi-layered structure, for example, to simulate the physics of layered materials.

BACKGROUND

With ever-increasing computational power and resources, increasingly complex calculations can be efficiently computed in smaller and smaller periods of time. While quickly computable, the underlying processing operations can reach levels of complexities that may become difficult to comprehend at both micro and macro levels. For example, hundreds or thousands of processing operations may be used for simulating objects such as one or more materials and their appearance (e.g., a rusted, slightly dented, blue painted car). However, such large numbers of processing operations and their interactions (e.g., to simulate the appearance of a complex material) may be difficult to track let alone modify (e.g., add a layer of snow onto the rusted, blue painted car).

SUMMARY

The described systems and techniques provide a user interface that implements a hybrid technique to graphically represent processing operations (e.g., for simulating the appearance of a material) and graphically represent layers of an object (e.g., the simulated material). Along with allowing a user to produce such simulations or other types of processing results, the graphical representations allow for efficient review and modifying of the operations and the layers (e.g., adjust a processing operation, add one or more layers to further define the appearance of a simulated material), etc.

In one aspect, a computer-implemented method includes defining a first portion of a display as a workspace for presenting graphical elements that represent processing operations that define properties of an object. The method also includes defining a second portion of the display, different from the first portion, for presenting a graphical stack that uses the properties from the processing operations to define layers associated with the object. The method also includes simultaneously presenting the first and the second portion on the display.

Implementations may also include any or all of the following features. The computer-implemented method of claim1may further include adding a layer onto the graphical stack for introducing one or more properties to the object. Adding the layer may include appending the layer to the graphical stack, inserting the layer into the graphical stack or other similar operation. Graphical representations may be used to represent a connection between a layer represented in the graphical stack and a corresponding graphical element that represents a processing operation associated with the connected layer. The connection may be established based upon a naming convention used by an input to the layer represented in the graphical stack and a data source. The connection may be established based upon a priority associated with the processing operation. The graphical elements may include processing nodes of a network. Adjustable parameters may be associated with the processing operations. The graphical elements may be visually compressed. The graphical elements may be expanded from a visually compressed version of the graphical elements. The object is a simulated material or other type or matter.

In another aspect, a system includes a computing device that includes a memory configured to store instructions. The computing device also includes a processor configured to execute the instructions to perform a method that includes defining a first portion of a display as a workspace for presenting graphical elements that represent processing operations that define properties of an object. The method also includes defining a second portion of the display, different from the first portion, for presenting a graphical stack that uses the properties from the processing operations to define layers associated with the object. The method also includes simultaneously presenting the first and the second portion on the display.

Implementations may also include any or all of the following features. The processor may be configured to execute the instructions to add a layer onto the graphical stack for introducing one or more properties to the object. Adding the layer may include appending the layer to the graphical stack, inserting the layer into the graphical stack or other similar operation. Graphical representations may be used to represent a connection between a layer represented in the graphical stack and a corresponding graphical element that represents a processing operation associated with the connected layer. The connection may be established based upon a naming convention used by an input to the layer represented in the graphical stack and a data source. The connection may be established based upon a priority associated with the processing operation. The graphical elements may include processing nodes of a network. Adjustable parameters may be associated with the processing operations. The graphical elements may be visually compressed. The graphical elements may be expanded from a visually compressed version of the graphical elements. The object is a simulated material or other type or matter.

In another aspect, a computer program product tangibly embodied in an information carrier and comprising instructions that when executed by a processor perform a method that includes defining a first portion of a display as a workspace for presenting graphical elements that represent processing operations that define properties of an object. The method also includes defining a second portion of the display, different from the first portion, for presenting a graphical stack that uses the properties from the processing operations to define layers associated with the object. The method also includes simultaneously presenting the first and the second portion on the display.

Implementations may also include any or all of the following features. The computer program product may further including instructions that when executed by the processor perform a method that includes adding a layer onto the graphical stack for introducing one or more properties to the object. Adding the layer may include appending the layer to the graphical stack, inserting the layer into the graphical stack or other similar operation. Graphical representations may be used to represent a connection between a layer represented in the graphical stack and a corresponding graphical element that represents a processing operation associated with the connected layer. The connection may be established based upon a naming convention used by an input to the layer represented in the graphical stack and a data source. The connection may be established based upon a priority associated with the processing operation. The graphical elements may include processing nodes of a network. Adjustable parameters may be associated with the processing operations. The graphical elements may be visually compressed. The graphical elements may be expanded from a visually compressed version of the graphical elements. The object is a simulated material or other type or matter.

DETAILED DESCRIPTION

FIG. 1illustrates a computational system100for executing complex operations such as simulating the appearances of one or more materials (e.g., a slightly rusted metallic material of an automobile that is painted red). To layout and execute such operations, the computing system100implements a hybrid technique in which processing operations, e.g., to define the simulated appearance, are graphically represented (e.g., with one or more networks of processing nodes). Further, layers are graphically represented, e.g., to define layers associated with the appearance of the simulated material. For example, distinct visual portions (e.g., rust, red paint, metallic material, etc.) of the simulated object are graphically represented as layers in a stack (e.g., an aligned graphical representation of a collection of the layers). Along with providing a user with a relatively intuitive representation of the material appearance simulation, the graphical representations of the operations and the material appearance layers allow a user to adjust the processing operations and layers along with modifying associated parameters.

In this particular example, the system100includes a computing device (e.g., a computer system102) that is used for designing complex processing operations (e.g., to simulate the appearance of an object) by allowing a user to graphically represent and edit the operations. Additionally, a stack structure is used to define layers associated with the object (e.g., layers of different materials). As illustrated in the figure, a display104(connected to the computer system102) presents an image106that includes a simulated ball108that appears to hover in the scene. In this example, the simulated ball108is defined by layers of material such as an inner metallic layer that forms the base of the ball. Layers of paint and rust are also included, for example, such that the ball108is perceived as being weathered and old. Layers also may also appear to change the geometry of an object, for example, a layer may be applied to the ball108to simulate scratches, dimples, pox marks or other types of blemishes. To provide such multi-layered representation of materials, a significant number of operations may need to be designed and executed for each layer. Additionally, one or more of the layers may need to be adjusted such that a desired overall look of the ball108is appropriately presented to viewers. Along with representing such a significant number of operations (e.g., hundreds, thousands, etc.) and the layers in an easily comprehensible layout, representing the operations and layers for easy access (e.g., for making adjustments or further development) by a user (e.g., a designer, animator, etc.) may be a challenge with the ever-increasing complexity (e.g., to provide more realistic simulations).

Referring toFIG. 2, an example graphical user interface (GUI)200includes distinct regions for graphically laying out and executing complex processing operations and representing different layers (e.g., material layers). One or more techniques and methodologies may be implemented to provide such layout capabilities. For example, a hybrid technique may be implemented that uses a stack structure to define multiple layers (e.g., material layers) associated with a node-based graph layout that defines operations associated with the layers included in the stack. For example, each layer included in a stack may represent a different layer of a material to be represented (e.g., a paint layer, a rust layer, a scratched surface layer, etc.) and a node-based graph may be used to define operations for producing data associated with the layers (e.g., input data values for paint colors, rust textures, scratch patterns, etc.). By combining these two techniques, a single interface may be provided that can represent a significant amount of processing operations in a graphical layout that can be easily comprehended by a user (and interacted with by the user). Further, by appropriately representing the processing operations in the graphical node-based layout, a user can quickly navigate to regions of interest for easy adjustments without needing to redesign other portions of the layout that may define other unrelated operations. By separately representing layers (e.g., material layers) in such stack structures, a relatively small amount of GUI real estate is needed to provide a significant and potentially complex amount of information. In one illustrative example (as shown in the figure), the GUI200includes distinct regions for representing a stack structure and a portion for a node based graph, which represents operations associated with the layers of the stack (e.g., for calculating respective data input values for the layers). In this implementation, a rectangular shaped portion202is allocated for representing one or more multi-layer stack structures. For example, an illustrated stack may represent layers of a complex material for representing the appearance of the material. Another portion of the GUI200(labeled workspace204) is relatively larger than the portion202of the GUI and is allocated for presenting a workspace that represents one or more editable node based graphs that define operations that are typically associated with material layers represented in the stack (e.g., to calculate input data values associated with material layers such a material properties). In this example, another portion of the GUI200provides an area206for representing data sources that provide data for the operations executed by the node based graph, for the stack layers, etc. For example, images, numerical data sets and other type of information may be represented in the area206of the GUI200and used in operations (e.g., represented in the workspace204) to produce the input data (e.g., property values) for one or more stack layers or directly provided to the stack layers represented in the portion202.

Additional information may also be represented and presented in the GUI200. For example, various parameters associated with inputs, outputs, data sources, operations (e.g., effect trees), stack layers etc. may be graphically represented in an adjustable form. Sliding scales, data entry fields, radio buttons and other types of graphical objects may be used to represent and change parameter values and other information related to data sources, processing operations, stack layers, etc. As illustrated in the figure, a portion208of the GUI200contains a number of fields and other graphical objects for representing such parameters. In general, the area206(that represents data sources), the workspace204and the portion202(for representing a multi-layer stack) are arranged in the GUI200such that data generally flows from the viewer's left to right. However, data flows in one or more other directions may also be implemented. In addition to using a single GUI (such as GUI200), multiple GUIs may be implemented for presenting multiple stacks (e.g., that each contains multiple material layers) and corresponding graphs (e.g., referred to as effect trees in some instances) for executing associated operations. In one arrangement, multiple GUIs may share a common stack. For example, multiple GUIs may be used for providing comprehensible and easily adjustable multi-dimensional stacks (e.g., two-dimensional, three-dimensional stack, etc.) (e.g., with multiple layers) and corresponding node based graphs of associated operations (e.g., effect trees).

Referring toFIG. 3, portions of a GUI300(similar to the GUI200shown inFIG. 2) are populated with graphical elements to represent a relatively simplistic node graph and stack structure. For illustrative purposes, the stack structure is represented by a single-layer stack container302in one portion of the GUI (that corresponds to the portion202shown inFIG. 2). In this example, the stack container302includes a material layer303that includes multiple inputs for representing the appearance of a material (e.g., a car paint material). Two of the inputs304,306(identified as diffuse gain and refection color) are associated with two parameters for defining the appearance of the material layer. Such parameters may be represented by one or more quantities, functions, etc. As represented in portion308of the GUI, two respective data sources are represented (with graphical icons310,312) as having been retrieved, for example, from a data library. To layout processing operations for calculating data values for the inputs302,304included in the stack layer, graphical icons314,316are presented in a workspace318(that is similar to the workspace204shown inFIG. 2), that correspond to the icons310,312in the GUI portion308. In this particular example, each of the data sources map directly to the respective inputs of the single material layer303(e.g., labeled “car paint mat”) included in the stack. Respectively, two dashed lines320,322graphically represent the established direct connections between the icons314,316and corresponding inputs304,306of the single layer of the stack302. In this example, connectivity between the data sources and inputs is established such that name of a data source (e.g., “difGain” of icons314, and, “reflCol” of icons316) is directly connected to an input that has a similar or equivalent name (e.g., “diffuse gain” of input304, and, “reflection color” of input306). As such, connections can be automatically established based upon names and naming conventions. Further, by using names to establish connections, sources and/or inputs can be relatively quickly swapped out by adjusting data source and input names rather than laboriously re-wiring connections between icons representing newly introduced data sources and stack inputs, thereby reducing development time and allowing for efficient editing cycles. While the operations illustrated in the workspace318of GUI300may be considered relatively simplistic, the workspace and the stack (and interactions between the two) can be used for more complex layout and processing schemes (e.g., to simulate the appearance of materials). Further, while this example illustrates six inputs being associated with the single material layer of the stack302, more or less inputs may be used with the single layer or more layers added to the stack.

Referring toFIG. 4, a GUI400is illustrated that includes portions (e.g., a workspace402, a single-layer stack structure404, a portion406for presenting data sources, etc.) similar to the GUI300(shown inFIG. 3). In this particular example, the workspace402illustrates three icons that represent data sources that are also represented in the portion406of the GUI and are used for representing the appearance of a material (e.g., car paint). One icon408(labeled “reflGain”) represents a reflective gain data set while another icon410(labeled “specBW”) represents specular bandwidth data and a third icon412(labeled “specCol”) is associated with specular color. In this example, each of the three data sources is used to provide data to corresponding inputs of the single layer represented in the stack404(similar to the data provided to the stack302shown inFIG. 3). However, rather than establishing a direct link between the icons408,410,412and the inputs represented in the stack404(namely inputs436,438,440), a node based graph414is included in the workspace402to represent a series of operations for processing the source data (represented by the icons408,410,412) prior to being provided as inputs to the stack. In this particular example, each of the icons408,410,412are respectively connected to input nodes416,418,420of the graph414. In some instances input nodes may be considered as resolved connections, for example, the input node416is used for resolving “reflGain” data and establishes a connection with the icon408(that corresponds to the “reflGain” data source). Processing of each data set includes a series of additional operations (as represented by graphical elements422,424,426,428and referred as effect operators in some instances). In general, connections included in the graph414can be considered explicit and not resolved (e.g., a direct connection). Such explicit connections are represented with solid lines, in this example, while dashed lines represent resolved connections. To illustrate the use of a constant value, inputs for some of the graphical elements422,426,428are represented as being unconnected, while inputs for one graphical element424are both connected to input data sets to represent the use of data that may not be invariant. Name resolved connections are illustrated as being established (as represented by dashed lines430,432,434) between corresponding outputs of the graphical elements424,426,428and inputs436,438,440(that respectively represent quantities labeled “reflection gain”, “spec gain”, and “spec color”) of the single layer represented in the stack404. For example, input436is used for resolving the “reflGain” data and establishes a connection with a corresponding output (labeled “reflGain”) of the graph414. While a relatively simple operator (e.g., an addition operator) is used in a few instances in this example, various other types of operators may also be used separately or in combination with the presented operators. For example, other mathematical operators (e.g., subtraction, multiplication, division, etc.), statistical operators (e.g., mean, standard deviation, variance, etc.) and other types of processing operators (e.g., logical operators, domain transformations, etc.) may be used for preparing data for the inputs of the layer represented in the stack404. As can be imagined, as the number of layers increase (e.g., to simulate a large number of material layers), the size of the stack may become visually cumbersome and even distracting for a user. One or more techniques may be used to reduce the visual distractions of an overly complex stack. For example one or more nesting techniques may be implemented for segmenting the stack (to compartmentalize the different layers of a material). Further, by allowing the layers of the stack to expand (and alternatively collapse), the user may be able to adjust the information being presented by the GUI and provide a navigable interface that is less distracting and more efficiently laid out for a user to identify and focus upon a particular portion of graphically represented processing operations and stack layers. Along with manipulating and adjusting the stack to provide easily identifiable and comprehensible layers (e.g., a material layer to be represented), graphical elements represented in the workspace may also be adjustable to provide a more efficient interface for the user. For example, as layers of the stack are expanded and collapsed, presentations of corresponding node-based graphs or graph portions may adjusted for efficient use of the GUI and to provide a more digestible view to a user.

Referring toFIG. 5, another GUI500is presented that illustratively demonstrates collapsible and expandable portions of the interface. For example, two or more graphs may be combined to produce a single graph that may reduce the amount of GUI real estate needed while providing functionality that is equivalent to each of the individual graphs. In this example a graph502is presented that is combines two separate graphs. As highlighted by a dashed-line box504, one portion of the graph502contains graphical elements of the graph414(shown inFIG. 4) and a second dashed-line box506contains additional graph elements for operations associated with other inputs to a layer (e.g., car paint layer) of a stack508that also includes other material layers (e.g., labeled “scratches mat” and “bump mat”). In this example, the graph highlighted by box504provides operations for three inputs (e.g., labeled “reflection gain”, “spec gain”, and “spec color”) to the car paint material layer of the stack508, as represented by three dashed lines510,512,514. Along with corresponding to the dashed lines430,432,434shown inFIG. 4, the dashed lines510,512,514also represent the associated connections are based on resolved names (e.g., output of graph504labeled “specGain” is connected to input523that is labeled “spec gain”, and, the graph output labeled “specCol” is connected to input525that is labeled “spec color”). Similarly, as illustrated with dashed lines516,518, the newly added upper portion of the graph502establishes named resolved connections with two other inputs to the car paint layer included in the stack508. In this particular example, the newly established name-resolved connections provide data to respective layer inputs520,522labeled “reflection color” (as represented with dashed line518) and “diffuse color” (represented dashed line516) from corresponding outputs of the graph502labeled “reflCol” and “difCol”. Along with establishing additional name-resolved connections to the graph502, another input524(labeled “diffuse gain”) for the car paint layer included in the stack establishes a name-resolved connection to a data source526names “difGain” by directly docking an icon that represents the data source to the input. As such, name resolved data sources may be directly provided to one or more inputs of layers (e.g., material layers) included in a stack without being processed by operations represented in a graph. Along with establishing additional connections for providing more inputs to a layer included in a stack (e.g., the stack508), additional layers may be added to a stack. For example, layers may be appended to a stack (e.g., the top of the stack, the bottom of the stack), inserted between current layers, etc. Other types of stack based operations may also be executed (e.g., as directed by a user), for example, a stack layer may be deleted, replaced with another layer, combined with one or more other layers, moved to be nested under another layer, etc. In the illustrated example, two additional material layers have been added to the stack508compared to the stack404presented inFIG. 4. Along with one material layer528associated with defining a scratch layer within the overall material stack, another layer530defines a bump layer (e.g., to provide a pox marked appearance to the material defined by the stack). As shown in the figure, both of these added layer528,530are presented as closed representations and do not present any corresponding data inputs for the layers. However, by selecting either (or both) of the material layers (e.g., with a pointing device), the representation may be expanded to expose corresponding input or inputs, e.g., for defining properties associated with the respective material layer (e.g., scratch patterns, average bump height and distribution, etc.). By allowing the various layers and layer inputs to be somewhat hidden, less GUI real estate is used until a user decides to expose the inputs for inspection and other actions (e.g., to establish connections with one or more graphs).

Along with conserving GUI real estate by presenting a stack508(and/or portions of a stack) capable of being expanded and compressed (e.g., as directed by a user pointing device), other graphical elements represented in the GUI500may also be presented in forms for saving space and reduce visual clutter. For example, sources that provide data to graphs and other elements (e.g., input to layers of the stack508) presented in the GUI500may be represented with a reduced graphical footprint. In this illustration, each of data sources530-540connected with docked connections to the graph502are shown with reduced size icons. Similarly, the workspace includes four other sources542-548that provide data that represent distinct colors (e.g., red, green, blue, no. 18 grey) that provide an invariant color to any portion of a surface to which the color is applied. Being represented by such a reduced size footprints, the sources can be manipulated relatively easily for being placed in various locations of the workspace. For example, the sources542-548may be directly connected to the graph502for providing data that represents the respective colors for processing by operators included in graph.

Referring toFIG. 6, a graphical layout600that includes multiple graph instances (e.g., effect tree)602,604,606and a multi-layer stack608is presented for simulating the appearance of a material. Included with the multiple graph instances602-606presented in the layout600is the graph500shown inFIG. 5. Along with the layers and associated inputs included in the stack508shown inFIG. 5(e.g., a scratched material layer, a bumpy material layer, a car paint layer), the stack608also includes some additional layers (e.g., a rust material layer, a dirt material layer and a bullet impact layer) and correspondingly nested inputs (e.g., in which the inputs to a material layer may number in the hundreds). Without considerably disrupting other layers in the stack602, these newly introduced layers may be efficiently appended, inserted, etc. into the stack. Further, in some arrangements, outputs of an effect tree may be consumed by several effect tree inputs (e.g., of different or the same tree), a number of material layer inputs, combinations of effect tree inputs and material layer inputs, etc. Once residing in the stack608, connections can be established between the additional layers and the appropriate graph instances (e.g., effect trees) as represented with dashed lines. Various types of conventions may be used to form such connections between graphs and stacks. For example, similar naming conventions between graph outputs and stack inputs may be used to establish connections. By assigning similar names (e.g., names that match) to outputs of a graph and inputs of an associated material layer, an established connection may be used to direct data values calculated by graph to the appropriate material layer input. As such, connections may be established in a relatively automatic manner, and a pointing device (or through another type of user directed technique) is not needed to extend the connection from the graph output to the material layer input. By using such conventions, connections between graphs and stacks can be considered as not being fixed, but considered resolved since modification can be applied at different stages during the creative cycle (e.g., resolved “just-in-time”). As such, graphs may be replaced with other graphs so long as the graph output/material layer input naming convention is followed. For example, one graph (that includes one set of operators) may be replaced with another graph (that includes a different set of operators) without adjusting connections to a stack so long as the output(s) of the new graph follow the naming convention of the output(s) of the graph being replaced. In some arrangements, such replacements may be based upon one or more types of rules. For example, the version of a graph (e.g., effect tree), data source, etc. used to connect to a stack may be based upon a predefined priority. As such, a graph, data source, etc. assigned a higher priority (compared to similar graphs, data sources, etc.) may be identified for insertion and connecting with a stack. As such, similar to being able to efficiently add, delete, and replace layers included in a stack, graphs may also be efficiently added, deleted and replaced without needing to painstakingly re-establish connections between the newly introduced graphs and appropriate layer(s) included in the stack.

Along with storing individual graphs and stacks (e.g., to produce a library) for later retrieval and use, individual material layers and effect trees may also be stored as assets. Further, a combination of a layer and an associated effect tree (that provides calculated output data for the input of the layer) may be stored as an asset. As such, the asset (e.g., combination layer and effect tree) may be appropriately inserted for providing a stack layer and corresponding graph for use in other applications (e.g., to insert another material layer in another material appearance simulation). For example, a dirt material layer may be applied over a metallic material, later; the same dirt material layer may be applied over a wood layer.

The stack608provides a significant amount of visual information for digitally representing the appearance of a material while not needing a considerable amount of real estate (of a GUI). Further, combined with the functionality provided by the processing operations of the graphs, the layout608is presented in an organized two-dimensional form that may allow for quick inspection by a user, e.g., for efficiently identifying one or more areas in need of attention (e.g., adjustment, further development, etc.). Further, by implementing a stack and graph in concert, each may considerably complement the other while significantly reducing layout need by either individually to digitally represent the appearance of a material.

Referring toFIG. 7, a flowchart700represents operations of a computing device such as the computer system102(shown inFIG. 1) to produce a graphical user interface that includes a navigable workspace for laying out graphs and associated graphical elements that represent operational components for processing data sources. A multi-layer stack is also represented in the interface for defining layers of an object such as a simulated material that uses the data processed by the graphs. Such operations are typically executed by components (e.g., one or more processors) included in a computing device, however, operations may be executed by multiple computing devices. Along with being executed at a single site (e.g., at the location of the computing device), operations execution may be distributed among two or more locations.

Operations of the computing device may include defining702a portion of a display for presenting graphical elements that represent processing operations to define properties of an object. For example, one or more graphs may be presented that represent processing operations for defining properties for simulating the appearance of one or more materials. Operations may also include defining704a portion of the display for a graphical stack that uses the properties to define layers (e.g., material layers) associated with the object. For example, the stack may define individual layers and layer sets for defining different portions of the material being simulated. Paint and rust layers may be defined along with layers to provide patterns of scratches and bumps. Some layers may even use properties (e.g., colors, specular patterns, etc.) for defining layers associated with the environment in which the simulated material is located (e.g., define a layer of dirt or snow to be positioned upon the simulated material). Operations may also include simultaneously presenting706the graphical elements and the graphical stack on the display. By presenting both, a user interface may provide a single organized view of a potentially complex collection of processing operations and the relationship of layers of an object that are defined by the operations. Along with simulating the appearance of materials, various other types of applications may implement one or more of these techniques. For example, other types of presentations that include significant amounts of detailed information that can be organized into layers may be processed by one or more operational graphs and incorporated into one or more multi-layer stacks.

FIG. 8is a block diagram of computing devices that may be used and implemented to perform operations associated with producing and presenting editable user interfaces that include multi-layer stacks and graphs that represent processing operations. As such, the computing devices may provide operations similar to computer systems, servers, etc. Computing device800can also represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers.

Computing device800includes a processor802, memory804, a storage device806, a high-speed interface808connecting to memory804and high-speed expansion ports810, and a low speed interface812connecting to low speed bus814and storage device806. Each of the components802,804,806,808,810, and812, are interconnected using various busses, and can be mounted on a common motherboard or in other manners as appropriate. The processor802can process instructions for execution within the computing device800, including instructions stored in the memory804or on the storage device806to display graphical information for a GUI on an external input/output device, such as display816(e.g., a touch screen, a multi-touch screen) coupled to high speed interface808. In other implementations, multiple processors and/or multiple buses can be used, as appropriate, along with multiple memories and types of memory. Also, multiple computing devices800can be connected, with each device providing portions of the necessary operations (e.g., as a server bank, a group of blade servers, or a multi-processor system).

The memory804stores information within the computing device800. In one implementation, the memory804is a computer-readable medium. In one implementation, the memory804is a volatile memory unit or units. In another implementation, the memory804is a non-volatile memory unit or units.

The storage device806is capable of providing mass storage for the computing device800. In one implementation, the storage device806is a computer-readable medium. In various different implementations, the storage device806can be a floppy disk device, a hard disk device, an optical disk device, or a tape device, a flash memory or other similar solid state memory device, or an array of devices, including devices in a storage area network or other configurations. In one implementation, a computer program product is tangibly embodied in an information carrier. The computer program product contains instructions that, when executed, perform one or more methods, such as those described above. The information carrier is a computer- or machine-readable medium, such as the memory804, the storage device806, memory on processor802, or the like.

The high speed controller808manages bandwidth-intensive operations for the computing device800, while the low speed controller812manages lower bandwidth-intensive operations. Such allocation of duties is exemplary only. In one implementation, the high-speed controller808is coupled to memory804, display816(e.g., through a graphics processor or accelerator), and to high-speed expansion ports810, which can accept various expansion cards (not shown). In the implementation, low-speed controller812is coupled to storage device806and low-speed expansion port814. The low-speed expansion port, which can include various communication ports (e.g., USB, Bluetooth, Ethernet, wireless Ethernet) can be coupled to one or more input/output devices, such as a keyboard, a pointing device, a scanner, tablet input, spatial input device, or a networking device such as a switch or router, e.g., through a network adapter.

The computing device800can be implemented in a number of different forms, as shown in the figure. For example, it can be implemented as a standard server820, or multiple times in a group of such servers. It can also be implemented as part of a rack server system824. In addition, it can be implemented in a personal computer such as a laptop computer822. Alternatively, components from computing device800can be combined with other components in a mobile device (not shown). The computing device800may also be implemented for network based (e.g., web based) operations such as for cloud computing.