Source: http://www.google.com/patents/US20070094607?dq=6519629
Timestamp: 2017-04-26 10:23:05
Document Index: 224534146

Matched Legal Cases: ['art 300', 'art 300', 'art 300', 'art 300', 'art 300', 'art 300', 'art 300']

Patent US20070094607 - Integration of composite objects in host applications - Google PatentsSearch Images Maps Play YouTube News Gmail Drive More »Sign inPatentsA graphical object is generated according to a first application in a document of a second application. The graphical object is constructed as a composite, data-driven object. The graphical object's data is organized so that the semantic data (e.g., relationship among individuals on an organizational...http://www.google.com/patents/US20070094607?utm_source=gb-gplus-sharePatent US20070094607 - Integration of composite objects in host applicationsAdvanced Patent SearchTry the new Google Patents, with machine-classified Google Scholar results, and Japanese and South Korean patents.Publication numberUS20070094607 A1Publication typeApplicationApplication numberUS 11/228,867Publication dateApr 26, 2007Filing dateSep 15, 2005Priority dateSep 15, 2005Also published asUS7721205Publication number11228867, 228867, US 2007/0094607 A1, US 2007/094607 A1, US 20070094607 A1, US 20070094607A1, US 2007094607 A1, US 2007094607A1, US-A1-20070094607, US-A1-2007094607, US2007/0094607A1, US2007/094607A1, US20070094607 A1, US20070094607A1, US2007094607 A1, US2007094607A1InventorsAshley Morgan, Barn-Wan Li, Ke-Cheng Huang, Michael Kim, Sissie Hsiao, Robert Parker, Amit KumarOriginal AssigneeMicrosoft CorporationExport CitationBiBTeX, EndNote, RefManPatent Citations (19), Referenced by (26), Classifications (8), Legal Events (3) External Links: USPTO, USPTO Assignment, EspacenetIntegration of composite objects in host applications
US 20070094607 A1Abstract
A graphical object is generated according to a first application in a document of a second application. The graphical object is constructed as a composite, data-driven object. The graphical object's data is organized so that the semantic data (e.g., relationship among individuals on an organizational chart) is persisted separately from presentation data (e.g., the layout and style of shapes and connectors for visualizing the organizational chart). The semantic data and presentation data are combined to provide the rendered view of the graphical object within the document. The graphical object displays and functions equivalently to when the graphical object is rendered by the first application. Images(8) Claims(20)
1. A computer-implemented method for integrating a graphical object generated according to a first application in a document of a second application, the method comprising: constructing the graphical object as a composite object, wherein semantic data corresponding to the graphical object is persisted separately from presentation data corresponding to the graphical object; and including the graphical object in a rendered view of the document, wherein the semantic data and presentation data of the graphical object are combined to provide the rendered view of the graphical object within the rendered view of the document and the graphical object displays and functions equivalently to when the graphical object is rendered by the first application. 2. The computer-implemented method of claim 1, wherein constructing the graphical object as a composite object further comprises reading a description of the document to locate an anchor within the description that corresponds to the graphical object. 3. The computer-implemented method of claim 1, wherein constructing the graphical object as a composite object further comprises selecting a composite object server for managing the composite object. 4. The computer-implemented method of claim 1, wherein constructing the graphical object as a composite object further comprises passing the graphical object to a composite object server so that the composite object server parses the graphical object according to the semantic data and the presentation data. 5. The computer-implemented method of claim 1, wherein including the graphical object in a rendered view of the document further comprises generating a view interface that combines the semantic data and presentation data into a view element. 6. The computer-implemented method of claim 5, wherein the view element includes a shape property bag that describes properties of shapes included in the graphical object. 7. The computer-implemented method of claim 1, wherein including the graphical object in a rendered view of the document further comprises applying customizations to the rendered view of the document that are specific to the rendered view. 8. The computer-implemented method of claim 1, further comprising configuring the graphical object as an editable graphical object while embedded within the second application. 9. The computer-implemented method of claim 8, wherein editing the graphical object further comprises determining whether a received user event corresponds to the rendered view of the document. 10. The computer-implemented method of claim 9, wherein editing the graphical object further comprises determining whether an editor has been previously generated for handling the received user event when the received user event corresponds to an edit to the graphical object. 11. The computer-implemented method of claim 10, further comprising generating the editor when the editor was not previously generated, wherein the editor is generated by a view interface provided by a composite object server that corresponds to the graphical object. 12. The computer-implemented method of claim 9, further comprising generating a selection in response to the received user event, wherein the selection is implemented by the generated editor. 13. The computer-implemented method of claim 12, wherein the selection corresponds to the aggregate of information related to the received user input, the generated editor, and hit testing data. 14. The computer-implemented method of claim 12, further comprising generating a selection view element that corresponds to the selection, wherein the selection view element provides visualization information of selection when providing the rendered view. 15. The computer-implemented method of claim 1, wherein the rendered view is arranged such that the composite object is displayed and functions equivalently while embedded in the second application as when the composite object is rendered in the first application. 16. A computer-readable medium having stored thereon instructions that when executed implements the computer-implemented method of claim 1. 17. A system for integration of an embedded graphical object with a host application document, comprising: a composite object that corresponds to separated semantic data and presentation data of the embedded graphical object; a composite object server configured to store the composite object; and an interface that is configured to combine the semantic data and presentation data for outputting a rendered view of the document, wherein the rendered view is arranged such that the composite object is displayed and functions equivalently while embedded in the host application as when the composite object is rendered in its native application. 18. A computer-readable medium having stored thereon instructions that when executed implements the system of claim 17. 19. A computer-readable medium having stored thereon a data structure corresponding to a composite object embedded in a host application document such that the composite object is displayed and functions equivalently while embedded in the host application as when the composite object is rendered in its native application., comprising: a first data field containing data representing semantic data of a graphical object; a second data field containing data representing presentation data of a graphical object, wherein the semantic data is persisted separately from the presentation data; and a third data field containing data that identifies the data structure, such that the data structure is identifiable when embedded in the host application document. 20. The computer-readable medium of claim 19, wherein the data structure is further arranged such that the data structure is editable while embedded in the host application.
BACKGROUND [0001] As the number of applications available for performing tasks on a computing device increases, the need for integration among these applications also increases. For a number of applications, such as word processor applications, spreadsheet applications, graphical applications, and presentation applications, some integration is already available. For example, certain applications allow objects from one or more of the other applications to be embedded within the documents that the application creates. For example, a table generated by a spreadsheet application may be embedded directly amongst text in a word processor document created by a word processor application. The variety of embedding solutions available result in a variety of advantages and disadvantages associated with each solution. SUMMARY [0002] Aspects of the system and methods described herein are generally related to providing integration of a graphical object in a host application where the graphical object is a composite, data-driven object that distinguishes the semantic data related to the object from the presentation data. These composite objects have distinct advantage over other embedded objects in that the composite objects interact as expected with the host application's functionality. Other embedded objects are often translated to an image that is embedded as the object in the host application document. Embedding an object as an image prevents the object from being editable inside the host application document. Formatted as an image, the embedded object does not allow access to the full range of features provided by the original application in which the object was created. Embedded images are also associated with large file sizes, generating large documents that are cumbersome to use. [0003] In contrast, a composite object as described herein may be stored according to its semantic data and then rendered according to its presentation properties at runtime. For example, an organizational chart is composed of relationships between positions in an organization. The organizational chart is typically shown in a series of shapes with connectors that illustrate the hierarchy of the organization. These organizational charts are often embedded into presentations written in another application for presentation to groups in the organization. The shapes used in the organizational chart are typically the same (e.g., boxes with text). Instead of storing the data for the organizational chart as a picture of the chart, composite objects store the chart data separated into semantic data and presentation data. The relationship of nodes or hierarchy of the organizational chart is stored as the semantic data. The shape properties for generating the boxes and connectors are stored as the presentation data. At runtime, the semantic data and presentation data are combined to display the content of the composite object. The composite object's separation of semantic data and presentation data provides an opportunity to reduce and/or eliminate the storage of repeated presentation data. Also the organizational chart's native functionality of the application in which it was created is available while embedded in the presentation application document. A copied organizational chart into the host application displays and functions equivalently to the chart as it appears in its native application. Furthermore, by separating out the semantic data, the composite object framework ensures that the data is not hidden amongst opaque properties associated with one or more shapes of a composite object. [0004] This Summary is provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description. This Summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used as an aid in determining the scope of the claimed subject matter.
BRIEF DESCRIPTION OF THE DRAWINGS [0005] Non-limiting and non-exhaustive embodiments of the present invention are described with reference to the following figures, wherein like reference numerals refer to like parts throughout the various views unless otherwise specified. [0006] FIG. 1 illustrates an exemplary computing device that may be used in one exemplary embodiment; [0007] FIG. 2 shows a block diagram of an exemplary system for integrating a composite object in a host application; [0008] FIG. 3 illustrates a screenshot of an exemplary embedded composite object that corresponds to an organizational chart; [0009] FIG. 4 shows a functional block diagram for an exemplary composite object storage structure that corresponds to an organizational chart; [0010] FIG. 5 illustrates a logical flow diagram of an exemplary process for loading a composite object in a host application document; [0011] FIG. 6 shows a logical flow diagram of an exemplary process for rendering a composite object in a view of a host application document; and [0012] FIG. 7 illustrates a logical flow diagram of an exemplary process for editing a composite object in a view of a host application document, in accordance with one embodiment of the present invention.
DETAILED DESCRIPTION [0013] Embodiments of the present invention are described more fully below with reference to the accompanying drawings, which form a part hereof, and which show specific exemplary embodiments for practicing the invention. However, embodiments may be implemented in many different forms and should not be construed as limited to the embodiments set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art. Embodiments of the present invention may be practiced as methods, systems or devices. Accordingly, embodiments of the present invention may take the form of an entirely hardware implementation, an entirely software implementation or an implementation combining software and hardware aspects. The following detailed description is, therefore, not to be taken in a limiting sense. [0014] The logical operations of the various embodiments of the present invention are implemented (1) as a sequence of computer implemented steps running on a computing system and/or (2) as interconnected machine modules within the computing system. The implementation is a matter of choice dependent on the performance requirements of the computing system implementing the invention. Accordingly, the logical operations making up the embodiments of the present invention described herein are referred to alternatively as operations, steps or modules. [0000] Illustrative Operating Environment [0015] With reference to FIG. 1, one exemplary system for implementing the invention includes a computing device, such as computing device 100. Computing device 100 may be configured as a client, a server, mobile device, or any other computing device. In a very basic configuration, computing device 100 typically includes at least one processing unit 102 and system memory 104. Depending on the exact configuration and type of computing device, system memory 104 may be volatile (such as RAM), non-volatile (such as ROM, flash memory, etc.) or some combination of the two. System memory 104 typically includes an operating system 105, one or more applications 106, and may include program data 107. In one embodiment, application 106 includes a composite object integration application 120 for implementing the system of the present invention. This basic configuration is illustrated in FIG. 1 by those components within dashed line 108. [0016] Computing device 100 may have additional features or functionality. For example, computing device 100 may also include additional data storage devices (removable and/or non-removable) such as, for example, magnetic disks, optical disks, or tape. Such additional storage is illustrated in FIG. 1 by removable storage 109 and non-removable storage 110. Computer storage media may include volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information, such as computer readable instructions, data structures, program modules, or other data. System memory 104, removable storage 109 and non-removable storage 110 are all examples of computer storage media. Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can be accessed by computing device 100. Any such computer storage media may be part of device 100. Computing device 100 may also have input device(s) 112 such as keyboard, mouse, pen, voice input device, touch input device, etc. Output device(s) 114 such as a display, speakers, printer, etc. may also be included. [0017] Computing device 100 also contains communication connections 116 that allow the device to communicate with other computing devices 118, such as over a network. Communication connection 116 is one example of communication media. Communication media may typically be embodied by computer readable instructions, data structures, program modules, or other data in a modulated data signal, such as a carrier wave or other transport mechanism, and includes any information delivery media. The term “modulated data signal” means a signal that has one or more of its characteristics set or changed in such a manner as to encode information in the signal. By way of example, and not limitation, communication media includes wired media such as a wired network or direct-wired connection, and wireless media such as acoustic, RF, infrared and other wireless media. The term computer readable media as used herein includes both storage media and communication media. [0000] Illustrative Embodiments for Integrating Composite Objects in Host Applications [0018] Embodiments of the present invention relate to integrating composite objects into a host application, wherein the composite objects differentiate between semantic data and presentation data associated with the object. One standard for embedding an object in document of another application is referred to as the Object Linking and Embedding (OLE) standard. OLE is a compound document standard developed by the Microsoft® Corporation of Redmond, Wash. OLE enables a developer to create objects with one application and then link or embed them in a second application. Embedded objects retain their original format and links to the application that created them. Accordingly, when the document linked to the object is edited and updated, the object itself is also updated. However, OLE has distinct disadvantages since it often stores the embedded object as an image, creating large files and objects that can't be edited inline. Instead, embodiments of the present invention take advantage of composite, data-driven objects that separate the types of data associated with the object to provide a framework for embedding editable objects in a host application document. The present invention provides a logical description of shapes that may be used to provide a sequence/set of effects for rendering. In one embodiment, the set of effects is associated with a rendering abstraction layer that sits on top of a graphical application program interface (API) that is used to ultimately render the image. Generally, the use of the composite objects produce these abstraction layer effects not by directly creating and arranging the effects themselves, but rather by creating a hierarchy of ‘shapes’, ‘group shapes’, and ‘text boxes’. The shapes and group shapes are described by a set of properties (e.g., shape properties that apply to a particular shape or group shape properties that apply to a group of shapes). The shape properties are a more logical, high-level way of describing shapes or groups of shapes than provided according to the lower-level abstraction layer effects. These shape properties and group shape properties are then ‘translated’ into the actual effects that are rendered to the screen. In an alternative embodiment, some composite objects do create these effects directly, when the visual/presentation data required is not easily expressible as a hierarchy of ‘shapes’ and ‘group shapes’. [0019] FIG. 2 shows a block diagram of an exemplary system for integrating a composite object in a host application in accordance with one embodiment of the present invention. System 200 includes host application document 202, composite object server 210, view interface 222, view 230, commands module 250, rendering layer 254, and external messaging input 246. [0020] Host application document 202 includes anchor 204. Anchor 204 is a placeholder that designates the presence of a composite object (e.g., 212). In one embodiment, the application document is written in an extensible markup language (XML) and the anchor is a tag in the XML that references the composite object. Anchor 204 is defined in a format of the host application and is owned by host application document 202. Anchor 204 designates the placement and positioning of the composite object in host application document 204 when the host application document is rendered. Additional embodiments include additional anchors referenced in host application document 204, where additional composite object servers and additional composite objects may be associated with these anchors. Rendering of the composite objects included in a particular host application is discussed further below with reference to FIG. 5. [0021] Composite object server 210 is a server that is called for loading a composite object shown as composite object 212. Composite object 212 further comprises semantic data 214 and presentation data 216. In one embodiment, semantic data 214 corresponds to the underlying data that provides the relationship between the shapes of composite object 212. For example, for a composite object that corresponds to an organizational chart, semantic data 214 corresponds to the hierarchy of positions within the organization. Generally, semantic data 214 includes the information that distinguishes one instance of a composite object from another instance of that same composite object. In contrast, presentation data 216 may be the same for different instances of the same composite object. Some examples of semantic includes a data series (i.e. rows and columns of data) for a chart composite object, a sequence or hierarchy of text (i.e. a multi-level outline) for a diagram composite object, a set of rows, columns, and text for a table composite object, and the like. Depending on the particular composite object, the logic that creates the hierarchy of shapes/group shapes from semantic data 214 may be wholly contained in the runtime code or it may read some parameters from the persisted data. System 200 therefore allows the composite objects to store data other than just that hierarchy of shapes or group shapes. In contrast to semantic data 214, presentation data 216 correspond to the layout data of the composite object. In the organizational chart example, presentation data 216 corresponds to the layout and style of the shapes. A more detailed description of a composite object is discussed further below with regard to FIG. 4. [0022] Composite object server 210 implements view interface 222 in response to a query from view 230 when anchor 204 is discovered while creating view 230 for host application document 202. Once view interface 222 is created, it is then owned by view 230. View interface 222 creates the view elements (e.g., 234) and the editors (e.g., 240) associated with view 230 so that the view may be rendered and edited. In one embodiment, the view elements and editors are generated on an “on demand” basis. Generating the view elements and editors “on demand” refers to creating them when needed, and generally not significantly before they are needed. [0023] View 230, as shown, includes view tree 232, editor 240, selection view element 244, message handler 248, and customizations module 252. View tree 232 may include one or more view elements (e.g., 234, 236, 238) that are aggregated to form a renderable view of host application document 202. In one embodiment, each view element (e.g., 234, 236, 238) may include one or more shape property bags (SPBs) that describes the hierarchy of visual shapes included in view 230. Each view element includes information about that element, including the content, bounds, and positioning of the element. Customizations module 252 may be used to add visual customizations to the view elements (e.g., a customization that presents the view elements in black-and-white). [0024] Editor 240 owns one or more selections (e.g., 242). A selection corresponds to the range of text, objects, or other elements of the rendered document which the user desires to edit. In one embodiment, the selection of or within the composite object corresponds to the semantic data of the composite object (e.g., bars in a bar chart, row of cells in a table, etc.) Selection 242 is created in response to external messages provided by external messaging 246 that correspond to mouse events, keyboard entries, and other external events corresponding to user inputs that edit composite object 212. Editor 240 decides whether or not to consume events, and if so, passes them to message handler 248 for this purpose. Message handler 248 decides which portion of view 230, if any, is responsible for handling the event from external messaging 246. The decision is based on hit testing data received from hit testing output 256 (described below). When editor 240 is responsible for consuming the event, editor 240 generates selection 242. [0025] Each selection (e.g., 242) corresponds to the change to semantic data 214 or possibly presentation data 216 of composite object 212. In response to implementing selection 242, editor 240 provides an output corresponding to selection information to commands module 250. Commands module 250 interprets the editor output and performs an operation back onto composite object 212 that implements any changes to the content of composite object 212. [0026] Editor 240 also generates selection view element 244. Selection view element 244 corresponds to the rendered representation of selection 242. Selection view element 244 may correspond to the highlighting of the text, the dots surrounding a shape, or other indicia that an element has been selected for editing. Similar to the view elements (e.g., 234, 236, 238), customizations (e.g., 252) may be applied to selection view element 244 prior to the rendering of view 230. [0027] View 230 may be used to pass instructions to rendering layer 254 to render the view elements (e.g., 234, 236, 238) and any selection view elements (e.g., 244). Rendering layer 254 also includes hit testing output 256. Hit testing output 256 is queried by the view elements and selection view elements to determine whether the element was hit in response to an event from external messaging 246. From the hit testing data, an editor of view 230 is selected for handling the event. The chosen editor is then able to use the hit testing data corresponding to the elements to determine how to render view 230 with the changed made. In the case where no editor consumes the event, message handler 248 may export the event to other processes external to view 230 for handling. [0028] Despite that system 200 is illustrated with functional blocks where only one functional block is shown (e.g., one anchor, 204), it is appreciated that multiples of the functional blocks may be included without departing from the spirit or scope of the invention. For example, multiple anchors may be included within a host application document that references multiple composite objects. Each of these composite objects may correspond to one or more composite object servers. Additionally, multiple editors and view elements may correspond to the composite objects when generating a view of the composite object in the host application document. These additional embodiments are similarly configured to provide integration of composite, data-driven objects within host applications. [0029] FIG. 3 illustrates a screenshot of an exemplary embedded composite object that corresponds to an organizational chart in accordance with one embodiment of the present invention. Chart 300 is a type of graphical object that may be integrated in a host application as a composite object. The organizational chart example is a simple example that illustrates that difference between the semantic data of the object and the presentation data. The presentation data corresponds to the layout of the node elements (e.g., 302), or blocks, and the connectors (e.g., 304). The semantic data is the data included in the node elements and the relationship of the data. For example, the semantic data includes that the root node corresponds to the President, Jane Doe, while the other nodes correspond to other individuals that are child elements of the root node. The root/child relationship of the nodes is indicative of the hierarchical relationship of the individuals listed. Accordingly, the semantic data is data-driven, providing the relationship between individuals in the organization, while the presentation data concentrates on the layout and style used to display the relationship. With repeated shapes in the chart, much of the presentation data may be consolidated, with each node of chart 300 being linked to a single description of a shape that corresponds to all nodes and a description of single connector type. Previously, for some embedded object designs, an embedded object would simply be stored as an image. If a similar organizational chart included fifty nodes, then an image that corresponds to the data of all 50 nodes and 50 connectors would be stored. The file size of the embedded object could increase such that it is no longer usable depending on the amount of information included in the embedded object. By allowing composite objects to separate their persisted semantic data from the presentation data, the present invention allows the storage requirements for some particular composite objects to be significantly reduced when the composite objects have repeated shapes. There is also some possible size reduction with regard to style and richer graphic elements. For example, creating gradients, drop shadows, glow effects may have much smaller associated file sizes. Storage of the data corresponding to a composite object is described in greater detail below with relation to FIG. 4. [0030] Chart 300 provides a simple example of one type of graphical object that lends itself to storage a composite object. Other object that take advantage of the composite object structure are bar charts, diagrams, tables, and other objects that may be described by a combination of shapes and text. [0031] Chart 300 also shows tab selector 310 that directs a user viewing the chart to a set of chart tools that are available for editing the chart. In one embodiment, tab selector 310 appears when a user has selected chart 300 in the host application document for editing or other manipulation. The chart tools option provides the user with the functionality of the application that the chart was originally created in while in the host application. Accordingly, despite being located in another application document, a full range of composition options may be presented to the user for editing chart 300 directly in the host application. [0032] FIG. 4 shows a functional block diagram for an exemplary composite object storage structure that corresponds to an organizational chart in accordance with one embodiment of the present invention. Storage structure 400 includes both the stored semantic data and the stored presentation data. Storage structure 400 includes data source 410, styles table 420, and layout logic 430. [0033] Data source 410 includes a listing of the nodes of an organizational chart (e.g., chart 300 of FIG. 3) and describes the parent/child relationship between the nodes. Data source 410 corresponds to the persisted, semantic data of the composite object. The structure of data source 410 is provided by way of example only, and the semantic data of the composite object may be stored in alternative formats such as multi-dimensional data structures, structured lists, or the like. [0034] Styles table 420 and layout logic 430 provide presentation for the composite object. Styles table 420 illustrates that the style of the nodes and connectors is defined according to a shapestyle definition that is pointed to by styles table 420. In one embodiment, depending on the type of object, a user may be limited in the changes that can be performed to a style. Layout logic 430 provides a description of the layout of the nodes in the organizational chart. The structures of styles table 420 and layout logic 430 are provided by way of example only, and the presentation data of the composite object may be stored in alternative formats such as multi-dimensional data structures, structured lists, or the like. [0035] In an additional embodiment, the composite object additionally includes a header that includes general information about the composite object. In accordance with one aspect of the present invention, the header includes a uniform resource identifier (URI) for the composite object that describes the type of composite object and may therefore be used as a key to determine which composite object server should be invoked to load and handle the object data. [0036] In still a further embodiment, the composite object includes a GVML or shapes XML description of the shapes of the composite object that provides a minimum visual tree of the composite object's shapes in case decomposing the data of the composite object fails. [0037] FIG. 5 illustrates a logical flow diagram of an exemplary process for loading a composite object in a host application document in accordance with one embodiment of the present invention. Process 500 starts at block 502 where one or more anchors that reference composite objects are included in the definition of a document in a host application. Process continues at block 504. [0038] At block 504, the document definition is read. The document definition may be written in XML or another language that may be used to describe a document. The document may be read to load the document into memory or output/render the document to an output device such as a monitor or printer. As the document definition is read, processing continues to decision block 506. [0039] At decision block 506, a determination is made whether an anchor that represents a composite object is encountered in the document definition. The anchor acts as a placeholder, defining the position of the composite object in the document. If no anchor is encountered, processing continues to block 516 where process 500 ends and the document may be loaded without any composite objects and/or processing may move on to other tasks. However, if an anchor is encountered, processing continues at block 508. [0040] At block 508, a server is selected that provides support for generating and storing the composite objects. The server refers to any computing device that is capable of processing the composite object, including the computing device storing the host application and document. In one embodiment, the server is identified according to a uniform resource identifier (URI) included in a header portion of the composite object. In an additional embodiment, the schema representing the composite object is also examined to determine an appropriate server. Processing continues at decision block 510. [0041] At decision block 510, a determination is made whether the selected server is found or located for processing the composite object. If the server for the composite object is not located, processing moves to block 512 where the loading of the composite object falls back to a GVML description, or basic tree description, of the shapes so at least a basic version of the object is loaded. In an alternative embodiment, the GVML is not provided as a fallback, but is instead included for composite objects that decide for themselves whether to leverage alternate content block features for providing GVML along with the full composite object structure. Stated differently, maintaining a GVML representation is not a requirement of a composite object, but an option left up to the composite object to select. Also, instead of designating a specific place to store GVML as part of the schema describing the composite object, a file format feature is provided to supply multiple representations of the object. If the composite object server is located, processing continues to block 514. [0042] At block 514, a load method is called on the composite object that passes to the composite object server the data corresponding to a definition of the composite object (e.g., an XML definition of the composite object). The passed data is parsed into to the semantic data and the presentation data for those composite objects that may separate their data accordingly. Once the data is parsed, processing continues to block 516, where process 500 ends and processing may move on to rendering a view of the composite object in the host application document or other tasks. [0043] FIG. 6 shows a logical flow diagram of an exemplary process for rendering a composite object in a view of a host application document in accordance with one embodiment of the present invention. Process 600 starts at block 602 where a composite object is loaded and a view is in the process of being generated for rendering the host application document as an output to a display, printer, or other output device. Processing continues at block 604. [0044] At block 604, a view interface (e.g., view interface 222 in FIG. 2) is implemented by the composite object server (e.g., composite object server 210. Once implemented, the view interface is then owned by the view and may be used by the view for generation of view elements and editors corresponding to the composite object. Once the view interface is generated, processing continues at block 606. [0045] At block 606, the view elements corresponding to the host application and the composite objects within the host application are generated for rendering the view. In accordance with one embodiment, the view elements include one or more view elements related to composite objects included in the host application document. The view elements are organized in a hierarchical tree structure that corresponds to the structure of the host application document. In an additional embodiment, the view elements are generated by the view interface by combining the presentation and semantic data of the composite object into the view element. Once the view elements are generated, including any view elements corresponding to composite objects, processing continues at block 608. [0046] At block 608, any target-specific parameters, or other customizations associated with that particular view, are applied to the view. For example, the view rendering may be dependent on the output device or other view data (e.g., currently zoomed, etc.). Other customizations may include rendering one or more of the view elements in black-and-white, or a variety of other selections corresponding to the view. Once the customizations are applied, processing continues to block 610. [0047] At block 610, the view is rendered. In one embodiment, the shape properties of the view are translated into lower level graphics primitives. In a further embodiment, the lower level graphic primitives correspond to GEL (Graphics Effects Layer) paths generated from the translation. A GEL factory then creates a meta-object that corresponds to the composite object embedded in the rendered view. In one embodiment, for rendering, the translated data is output to a target device (e.g., display screen, printer) using graphic services provided in accordance with the operating system (e.g. GDI+). Once the view is rendered, processing continues to block 612 where process 600 ends and processing can move to editing a composite object or other tasks. [0048] FIG. 7 illustrates a logical flow diagram of an exemplary process for editing a composite object in a view of a host application document in accordance with one embodiment of the present invention. Process 700 starts at block 702 where a view of the host application document has been rendered and has been presented to the user on a screen or using another output. Processing continues at decision block 704. [0049] At decision block 704, a determination is made whether a user event has been received that may cause a selection, change, or other edit to occur to one of the view elements of the view. The user event may correspond to keystrokes, mouse clicks, or other user inputs related to the host application document. If such a user event is not received, processing returns to decision block 704 to await the receipts of a user event. In contrast, if a user event is received, processing continues at decision block 706. [0050] At decision block 706, a determination is made whether the event that is received is intended to be routed to the view for handling. In certain cases, the user event may be unrelated to the host application document or any of the composite objects. If the user event is not intended for handling by the view, then processing returns to decision block 704 to await the receipt of another user event. However, if the user event is meant to be handled by the view, processing continues at decision block 708. [0051] At decision block 708, a determination is made whether an editor has been generated to handle the edit when the edit corresponds to one of the composite objects in the host application document. In one embodiment, the view interface generates the editors for the composite objects on an “on demand” basis where the editor is not generated until needed. If the editor has not already been generated for the composite object being edited, processing moves to block 710. [0052] At block 710, the editor is generated by the view interface for editing the composite object. With the editor generated, or if the editor was previously generated, processing continues at block 712. [0053] At block 712, a selection is generated that corresponds to the editor created. The selection corresponds to aggregation of editor information with user event information. In an additional embodiment, the editor also aggregates hit testing data with the other information to provide a more accurate determination of the objects in the rendered view being edited. Once the information is aggregated and the selection is generated, processing continues at block 714. [0054] At block 714, commands or provided to the composite object server for editing the composite object. The aggregated information corresponding to the selection is communicated to a command module that generates a set of commands for editing the composite object in response to the user event. These commands are then forward for operation on the composite object. With the composite object updated, processing continues to block 716. [0055] At block 716, a selection view element is generated that corresponds to the selection that was generated by the editor. The selection view element corresponds to any visualizations that correspond to the selection by the user within the composite object. For example, the user may have highlighted a string of text for editing. Selection view element is generated to provide the information for rendering the highlight of the text. Selection view element is complimentary to the other view elements of the view, but may not be necessary depending on the type of editing performed by the user. Once the selection view element is generated, processing continues at block 718. [0056] At block 718, any target-specific parameters, or other customizations associated with that particular view, are applied to the view. For example, the view rendering may be dependent on the output device or other view data (e.g., currently zoomed, etc.). Other customizations may include rendering one or more of the view elements in black-and-white, or a variety of other selections corresponding to the view. In one embodiment, the customizations are applied to both the view elements and any selection view elements generated. Once the customizations are applied, processing continues to block 720. [0057] At block 720, the view is re-rendered to include the editing to the composite object. The rendering is similar to the rendering described with relation to block 610 of FIG. 6 above. In one embodiment, the re-rending of the view is similar to the original rendering of the view with the addition that the view now corresponds to the aggregate of any view elements, any changes to content of the composite object, and any selection view elements created. Once the view is rendered, processing continues to block 722 where process 700 ends and processing can move to editing a composite object or other tasks. [0058] The processes described in FIGS. 5-7 may be repeated as necessary, and may have their process steps rearranged, certain process steps deleted, or additional process steps added without departing from the spirit or scope of the invention. [0059] Although the invention has been described in language that is specific to structural features and/or methodological steps, it is to be understood that the invention defined in the appended claims is not necessarily limited to the specific features or steps described. Rather, the specific features and steps are disclosed as forms of implementing the claimed invention. Since many embodiments of the invention can be made without departing from the spirit and scope of the invention, the invention resides in the claims hereinafter appended. Patent CitationsCited PatentFiling datePublication dateApplicantTitleUS4498145 *Jun 30, 1982Feb 5, 1985International Business Machines CorporationMethod for assuring atomicity of multi-row update operations in a database systemUS5682468 *Jan 23, 1995Oct 28, 1997Intergraph CorporationOLE for design and modelingUS5850507 *Mar 19, 1996Dec 15, 1998Oracle CorporationMethod and apparatus for improved transaction recoveryUS6374251 *Mar 17, 1998Apr 16, 2002Microsoft CorporationScalable system for clustering of large databasesUS6380954 *Feb 8, 1999Apr 30, 2002Reuters, Ltd.Method and system for layout of objects within a perimeter using constrained interactive searchUS6654757 *Jun 23, 2000Nov 25, 2003Prn CorporationDigital SystemUS6711577 *Oct 24, 2000Mar 23, 2004Battelle Memorial InstituteData mining and visualization techniquesUS6725421 *Sep 7, 1999Apr 20, 2004Liberate TechnologiesMethods, apparatus, and systems for storing, retrieving and playing multimedia dataUS6732090 *Dec 5, 2001May 4, 2004Xerox CorporationMeta-document management system with user definable personalitiesUS6772170 *Nov 16, 2002Aug 3, 2004Battelle Memorial InstituteSystem and method for interpreting document contentsUS6778979 *Dec 5, 2001Aug 17, 2004Xerox CorporationSystem for automatically generating queriesUS6820075 *Dec 5, 2001Nov 16, 2004Xerox CorporationDocument-centric system with auto-completionUS7499955 *Mar 30, 2005Mar 3, 2009Microsoft CorporationSystem and method for undoing application actions using inverse actions with atomic rollbackUS20030078913 *Mar 2, 2001Apr 24, 2003Mcgreevy Michael W.System, method and apparatus for conducting a keyterm searchUS20030078935 *May 16, 2002Apr 24, 2003Yoav ZibinMethod of encoding a datasetUS20040230888 *May 13, 2003Nov 18, 2004Microsoft CorporationMethod and system for selectively enforcing presentation themesUS20050015729 *Aug 12, 2004Jan 20, 2005Microsoft CorporationBinary cache file format for themeing the visual appearance of a computer systemUS20050171967 *Jan 30, 2004Aug 4, 2005Paul YuknewiczSystem and method for exposing tasks in a development environmentUS20060230311 *Mar 30, 2005Oct 12, 2006Microsoft CorporationSystem and method for undoing application actions using inverse actions with atomic rollback* Cited by examinerReferenced byCiting PatentFiling datePublication dateApplicantTitleUS7721205Sep 15, 2005May 18, 2010Microsoft CorporationIntegration of composite objects in host applicationsUS7783971Jun 30, 2006Aug 24, 2010Microsoft CorporationGraphic object themesUS8001526 *Sep 15, 2005Aug 16, 2011Microsoft CorporationHierarchical property storageUS8078955 *May 2, 2006Dec 13, 2011Adobe Systems IncorportaedMethod and apparatus for defining table stylesUS8219991May 6, 2008Jul 10, 2012International Business Machines CorporationConsolidated launching of multiple tasksUS8302073Jun 15, 2006Oct 30, 2012International Business Machines CorporationMoving and copying dependencies along with source codeUS8423956 *May 5, 2008Apr 16, 2013International Business Machines CorporationSharing resources among hierarchical containers of resourcesUS8560942 *Dec 15, 2005Oct 15, 2013Microsoft CorporationDetermining document layout between different viewsUS8631347Nov 15, 2004Jan 14, 2014Microsoft CorporationElectronic document style matrixUS8930812 *Feb 14, 2007Jan 6, 2015Vmware, Inc.System and method for embedding, editing, saving, and restoring objects within a browser windowUS20060107203 *Nov 15, 2004May 18, 2006Microsoft CorporationElectronic document style matrixUS20070061343 *Sep 15, 2005Mar 15, 2007Microsoft CorporationHierarchical property storageUS20070061349 *Sep 15, 2005Mar 15, 2007Microsoft CorporationHierarchically describing shapesUS20070061351 *Jun 30, 2006Mar 15, 2007Microsoft CorporationShape object textUS20070143668 *Dec 15, 2005Jun 21, 2007Microsoft CorporationDetermining document layout between different viewsUS20070174307 *Jun 30, 2006Jul 26, 2007Microsoft CorporationGraphic object themesUS20070294667 *Jun 15, 2006Dec 20, 2007International Business Machines CorporationMethod for moving and copying dependencies along with source codeUS20080209432 *May 5, 2008Aug 28, 2008Guruduth Somasekhara BanavarComputer implemented method and system for sharing resources among hierarchical containers of resourcesUS20080250410 *May 6, 2008Oct 9, 2008Danny SorokerMethod for consolidated launching of multiple tasksUS20080300952 *Jun 1, 2007Dec 4, 2008International Business Machines CorporationStoring and depicting organizations that are subject to dynamic event driven restructuringUS20090094514 *Feb 14, 2007Apr 9, 2009Ross DargahiSystem and method for embedding, editing, saving, and restoring objects within a browser windowUS20090119607 *Nov 2, 2007May 7, 2009Microsoft CorporationIntegration of disparate rendering platformsUS20110246913 *Mar 30, 2010Oct 6, 2011Microsoft CorporationAutomated User Interface GeneratorUS20130346842 *Mar 2, 2011Dec 26, 2013Mitsubishi Electric CorporationProgrammable display device and drawing-data creation methodCN102483681A *Aug 20, 2010May 30, 2012奥西索夫特有限公司Interactive user interface by embedding a document into standardized object containerCN103403793A *Mar 2, 2011Nov 20, 2013三菱电机株式会社Programmable display apparatus and image data creation method* Cited by examinerClassifications U.S. Classification715/762, 717/104, 707/999.102International ClassificationG06F3/00, G06F9/44, G06F7/00Cooperative ClassificationG06F17/211European ClassificationG06F17/21FLegal EventsDateCodeEventDescriptionNov 7, 2005ASAssignmentOwner name: MICROSOFT CORPORATION, WASHINGTONFree format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:MORGAN, ASHLEY L.;LI, BARN-WAN;HUANG, KE-CHENG;AND OTHERS;REEL/FRAME:016740/0858;SIGNING DATES FROM 20050831 TO 20050908Owner name: MICROSOFT CORPORATION,WASHINGTONFree format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:MORGAN, ASHLEY L.;LI, BARN-WAN;HUANG, KE-CHENG;AND OTHERS;SIGNING DATES FROM 20050831 TO 20050908;REEL/FRAME:016740/0858Oct 11, 2013FPAYFee paymentYear of fee payment: 4Dec 9, 2014ASAssignmentOwner name: MICROSOFT TECHNOLOGY LICENSING, LLC, WASHINGTONFree format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:MICROSOFT CORPORATION;REEL/FRAME:034543/0001Effective date: 20141014RotateOriginal ImageGoogle Home - Sitemap - USPTO Bulk Downloads - Privacy Policy - Terms of Service - About Google Patents - Send FeedbackData provided by IFI CLAIMS Patent Services