# Patent

## Title
Scaling icons for representing files

## Abstract

A method and system are provided for displaying icons in accordance with user preferences. The method includes providing a user with a size selection mechanism for selecting an icon size from a range of sizes. The method additionally includes searching a set of stored resources related to the underlying file and generating the icon in the selected size based upon the stored resources. The method may additionally include selecting an icon type including one of an image icon, a detail icon and a generic icon based on at least one of the user's size selection and the represented file. Furthermore, the icon display system of the invention positions labels and overlays in the vicinity of the icon based upon the selected size of the icon.

## Background
CROSS-REFERENCE TO RELATED APPLICATIONS
This application is a continuation-in-part of copending U.S. patent application Ser. No. 10/831,145, filed Apr. 26, 2004, and entitled “System and Method for Scaling Icons.”


BACKGROUND
Icons have been used for many years in computer systems to display information to users. Icons are images that are used to represent items such as files, folders, shortcuts, applications, documents, tasks, and commands throughout a computer operating system such as MICROSOFT WINDOWSTM, a product of the Microsoft Corporation of Redmond, Wash. Icons are currently used in toolbars, dialog boxes, menus, and numerous other locations in file management systems such as Windows Explorer, also a product of the Microsoft Corporation. Icons are usually stored as static bitmaps, but dynamic icon handlers may also be written to generate icons dynamically.
Currently, two types of icons are used to represent items. These two types include traditional icons and thumbnail icons. Whereas traditional icons are typically shared across files and are determined per type, thumbnails are determined per item and are not shared across files. A traditional icon is composed of two components including an icon image and a status overlay. The icon image forms the basis of the traditional icon. The status overlay is used to convey status information about the item. It is used, for example, to display the shortcut overlay.
A thumbnail icon is a particular type of icon displaying an image generated based on the contents of the underlying item. For example, an icon for an image file that actually looks like the image itself is a thumbnail of the image file. Thumbnail icons may also include an overlay. Thumbnail icons may be dynamically generated by code run on a user computer, although the generated image may be cached.
Although existing operating systems offer thumbnails, these thumbnails are not well integrated into existing file management systems such as Windows Explorer. As a result, the thumbnail feature is not as useful as it could be. A user has to go to a special “thumbnails view” to see thumbnail icons today, even for objects having thumbnail icons that would be visually effective at a smaller size, such as photographs. When in the thumbnails view of existing systems, icons for objects without thumbnails appear small and inadequate. The user typically cannot see extra information about each file in thumbnails view as the user can in other views such as tile view or details view. Accordingly, the user is often forced to choose between viewing thumbnails and viewing other important information.
Because the thumbnails feature is remote and not extensively utilized, little incentive exists for Independent Software Vendors (ISVs) to write thumbnail generators, When ISVs do write the thumbnail generators, they are unlikely to invest in making the thumbnail generators powerful. As a result, many existing application produce thumbnails of poor quality. Generally, since thumbnails are pictures, it is difficult to determine what type of item underlies a thumbnail icon. Furthermore, while traditional icons appear instantly, thumbnail icons are typically noticeably slow to appear because they were not generated in advance.
With traditional icons, overlays are often used as a primary or only indication of information about an item underlying an icon. However, overlays do not reliably appear. If multiple states need to be shown, overlays will only show the highest priority state and will ignore others since no more than one overlay may be shown at a time. Overlays are difficult to recognize at small icon sizes, such as the sizes generally used in list or details mode. Overlays have additional drawbacks including the ability to be readily imitated and used in an unauthorized manner. A further limitation is the inaccessibility of overlays to the visually-impaired. A user navigating with the keyboard and using a narrator hears a name and type of each file as the file is selected, but is not given any information about a state that the overlay represents. Additionally, overlays are used inconsistently to convey information about the state of a file.
BRIEF SUMMARY
Features described herein are directed to a method for displaying an icon representing an underlying file on a user interface. The method may include providing a user with a size selection mechanism for selecting an icon size from a range of sizes. The method may further include searching a set of stored resources related to the underlying file and generating the icon in a user selected size based upon the stored resources.
In another aspect, a method is provided for enhancing display of icons on a user interface. The method may provide a user selection component for allowing a user to select an icon size for an icon representing a file. The method may additionally include selecting an icon type including one of a traditional icon and a thumbnail icon based on at least one of the size selection and the represented file. The method may additionally include generating the selected icon having the selected size and icon type.
In yet an additional aspect, a system is provided for enhancing icon display. The system may include a user icon scaling module for allowing a user to select an icon size for an icon representing an underlying file. The system may additionally include a resource selection module for selecting an image resource for generating the icon based on the size selection. The resource selection module may, in some aspects, proceed through three levels of potential icons: one having an image representing the contents of the displayed object, one having an image that displays details of the current object, and one having a generic image common to multiple objects.
In yet a further aspect, a system is provided for enhancing icon display. The system may include a user icon scaling module for allowing a user to select an icon size for an icon representing an underlying file. The system may additionally include a type selection module for selecting a type of icon including at least one of a traditional icon and a thumbnail icon, the type selection based on at least one of the size selection and the underlying file.



BRIEF DESCRIPTION OF THE DRAWINGS
The features described in detail below are described with reference to the attached drawings figures, wherein:
FIG. 1 is a block diagram illustrating a computerized environment in which features described herein may be implemented;
FIG. 2 is a block diagram illustrating an icon scaling system in accordance with several features described herein;
FIGS. 3A-3G are samples or different types and sizes of icons;
FIG. 4 is a block diagram illustrating an icon configuration;
FIG. 5 illustrates several thumbnail icon configurations;
FIGS. 6A-6C illustrate multiple embodiments of visual effects for icons;
FIG. 7 illustrates a user scale for allowing a user to scale icons;
FIG. 8 is a flow chart illustrating a process for determining what type of icon to use;
FIG. 9 is a flow chart illustrating a process for accessing image resources; and
FIG. 10 is a flow chart illustrating an example process by which an icon may be selected for representing objects in a display.
FIG. 11 is a table showing example icon size relationships.



DETAILED DESCRIPTION
I. System Overview
Features described herein include a method and system for enabling scaling of icons to enhance a user experience. Icon scaling enables users to resize the icons in file management systems, such as Microsoft Windows Explorer, to any size in a range from a small size appropriate for looking at a long list of items to a very large size appropriate for looking at a small number of thumbnails within a single view. As an icon is resized, the appearance and layout of the icon may change to best accommodate its new size.
FIG. 2 illustrates an icon scaling module 200. The icon scaling module 200 may be implemented as one or more program modules in a computerized environment as described below with reference to FIG. 1. The icon scaling module 200 may include a resource selection module 210, an overlay selection module 220, a type selection module 230, a label placement module 240, and a user scaling module 250. Through the user scaling module 250, a user is able to select an icon size. Based on the user scaling selection, the type selection module 230 may select a type of icon such as a thumbnail or traditional icon. The resource selection module 210 may also select a particular image resource for scaling based on the scaling selection. Similarly, in some aspects, the overlay selection module 220 may select, scale, and/or position a status overlay and/or a type overlay based on the scaling selection, and the label placement module 240 may determine an appropriate location for a label associated with the icon based on the scaling selection.
Icons may be authored using a predetermined set of sizes, such as 16×16 pixels and 32×32 pixels. When a user chooses to view an icon at a size that is not one of the predetermined sizes, the scaling module 200 may interpolate to determine what image to show the user. When the size of an icon is changed, variables including the type of icon, the image resource, label placement, and/or overlay configuration may be affected as set forth herein.
II. Exemplary Operating Environment
FIG. 1 illustrates an example of a suitable computing system environment 100 on which the features described herein may be implemented. The computing system environment 100 is only one example of a suitable computing environment and is not intended to suggest any limitation as to the scope of use or functionality of the features described herein. Neither should the computing environment 100 be interpreted as having any dependency or requirement relating to any one or combination of components illustrated in the exemplary operating environment 100.
The features herein are described in the general context of computer-executable instructions, such as program modules, being executed by a computer. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform particular tasks or implement particular abstract data types. The features may be practiced with other computer system configurations, including hand-held devices, multiprocessor systems, microprocessor-based or programmable consumer electronics, minicomputers, mainframe computers, and the like. The features may also be practiced in distributed computing environments, where tasks may be performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote computer storage media including memory storage devices.
With reference to FIG. 1, the exemplary system 100 may include a general purpose-computing device in the form of a computer 110, which may include a processing unit 120, a system memory 130, and a system bus 121 that couples various system components including the system memory to the processing unit 120.
Computer 110 may include a variety of computer readable media. By way of example, and not limitation, computer readable media may comprise computer storage media and communication media. The system memory 130 includes computer storage media in the form of volatile and/or nonvolatile memory such as read only memory (ROM) 131 and random access memory (RAM) 132. A basic input/output system 133 (BIOS), containing the basic routines that help to transfer information between elements within computer 110, such as during start-up, is typically stored in ROM 131. RAM 132 typically contains data and/or program modules that are immediately accessible to and/or presently being operated on by processing unit 120. By way of example, and not limitation, FIG. 1 illustrates operating system 134, application programs 135, other program modules 136, and program data 137.
The computer 110 may also include other removable/nonremovable, volatile/nonvolatile computer storage media. By way of example only, FIG. 1 illustrates a hard disk drive 141 that reads from or writes to nonremovable, nonvolatile magnetic media, a magnetic disk drive 151 that reads from or writes to a removable, nonvolatile magnetic disk 152, and an optical disk drive 155 that reads from or writes to a removable, nonvolatile optical disk 156 such as a CD ROM or other optical media. Other removable/nonremovable, volatile/nonvolatile computer storage media that can be used in the exemplary operating environment include, but are not limited to, magnetic tape cassettes, flash memory cards, digital versatile disks, digital video tape, solid state RAM, solid state ROM, and the like. The hard disk drive 141 may be connected to the system bus 121 through a non-removable memory interface such as interface 140, and magnetic disk drive 151 and optical disk drive 155 may be connected to the system bus 121 by a removable memory interface, such as interface 150.
The drives and their associated computer storage media discussed above and illustrated in FIG. 1, provide storage of computer readable instructions, data structures, program modules and other data for the computer 110. In FIG. 1, for example, hard disk drive 141 is illustrated as storing operating system 144, application programs 145, other program modules 146, and program data 147. Note that these components can either be the same as or different from operating system 134, application programs 135, other program modules 136, and program data 137. Operating system 144, application programs 145, other program modules 146, and program data 147 are given different numbers here to illustrate that, at a minimum, they are different copies. A user may enter commands and information into the computer 110 through input devices such as a keyboard 162 and pointing device 161, commonly referred to as a mouse, trackball or touch pad. Other input devices (not shown) may include a microphone, joystick, game pad, satellite dish, scanner, or the like. These and other input devices may be connected to the processing unit 120 through a user input interface 160 that is coupled to the system bus, but may be connected by other interface and bus structures, such as a parallel port, game port or a universal serial bus (USB). A monitor 191 or other type of display device may also be connected to the system bus 121 via an interface, such as a video interface 190. In addition to the monitor, computers may also include other peripheral output devices such as speakers 197 and printer 196, which may be connected through an output peripheral interface 195.
The computer 110 may operate in a networked environment using logical connections to one or more remote computers, such as a remote computer 180. The remote computer 180 may be a personal computer, and typically includes many or all of the elements described above relative to the computer 110, although only a memory storage device 181 has been illustrated in FIG. 1. The logical connections depicted in FIG. 1 include a local area network (LAN) 171 and a wide area network (WAN) 173, but may also include other networks.
When used in a LAN networking environment, the computer 110 may be connected to the LAN 171 through a network interface or adapter 170. When used in a WAN networking environment, the computer 110 may include a modem 172 or other means for establishing communications over the WAN 173, such as the Internet. The modem 172, which may be internal or external, may be connected to the system bus 121 via the user input interface 160, or other appropriate mechanism. In a networked environment, program modules depicted relative to the computer 110, or portions thereof, may be stored in the remote memory storage device. By way of example, and not limitation, FIG. 1 illustrates remote application programs 185 as residing on memory device 181. It will be appreciated that the network connections shown are exemplary and other means of establishing a communications link between the computers may be used.
Although many other internal components of the computer 110 are not shown, those of ordinary skill in the art will appreciate that such components and the interconnection are well known.
III. Sample Icons
FIGS. 3A-3G illustrate a sampling of icons in various sizes. FIG. 3A illustrates a sampling of document icons 302, 304, 306, 308, 310, 312, 314, 316, and 318. The document icons 302, 304, 306, 308, 310, and 312 each include respective document images 302a, 304a, 306a, 308a, 310a, and 312a. Each of the aforementioned document icons additionally includes a type overlay 302b, 304b, 306b, 308b, 310b, and 312b. These type overlays indicate a type of the underlying document (e.g., word processing file, picture file, video file, audio file, spreadsheet, etc.). The document icon 302 is shown as having a 256×256 pixel overall icon size and a 60×60 pixel type overlay portion. The images and overlays may be scaled independently of one another, such that the image 304a is scaled between the images 302a and 306a and the overlay 304b is scaled between the overlays 302b and 306b. In the depicted example, document icon 306 is the next available document size. The overall size of icon 306 is 128×128 pixels and the overlay portion is 32×32 pixels. Document icon 304 is an icon scaled between the standard sized icons 302 and 306. Similarly, document icon 308 is scaled between the document icon 306 and the document icon 310, which includes a 64×64 overall icon size and an 18×18 pixel overlay portion 310b. Document icon 314 is a 32×32 pixel icon that includes only an overlay portion because its size is too small to clearly display both an overlay and a document image. Document icon 312, which is scaled between document icon 310 and 314 show both the document image portion 312a and the type overlay portion 312b. Smaller icons 314, 316 and 318 show only the type overlay portion of the item. The respective type overlays may include an icon, image, symbol, letter, number, etc. to indicate the type of document such as a MICROSOFT WORDTM document. The document icons may be provided in many sizes, including 16×16, 24×24, 32×32, 48×48, 128×128, and 256×256 pixels. Alternatively, some of these sizes may be omitted and/or additional sizes may be included.
FIG. 3B illustrates a set of MICROSOFT POWERPOINTTM Icons 320, 322, 324, 326, and 328. The Icons 320, 322, and 324 include an image portion 320a, 322a, and 324a, which may be an image of the first slide in a presentation. The icons 320, 322, and 324 also include overlay portions 320b, 322b, and 324b. The icons 326 and 328 are too small to be displayed with both portions. Accordingly these icons include only a thumbnail image. The decision to show a thumbnail image or an overlay may be made on a per type basis.
FIG. 3C also includes a set of icons 330, 332, 334, 336, and 338. The icons 330, 332, and 334 include respective image portions 330a, 332a, and 334a, which may be an image of a first page of a document, and overlay portions 330b, 332b, and 334b indicating that the document is an .mht document. Icons 336 and 338 are too small to adequately display both portions, and therefore include only the type overlay portion to indicate the type of underlying document.
FIG. 3D illustrates a plurality of scaled photo icons 340, 342, 344, 346, and 348. These icons are preferably thumbnail icons that include a photograph or image from within the underlying file. The thumbnail icons shown display useful information and include no overlay portion.
FIG. 3E illustrates a set of video icons 350, 352, 354, 356, and 358. The icons 350, 352, and 354 each include a respective image portion 350a, 352a, and 354a. The included images may be thumbnail images, such as a still image or portion thereof of a video. The icons 350, 352, and 354 each also include a respective type overlay portion 350b, 352b, and 354b. The icons 356 and 358 include only the image portion, which may be a thumbnail image, as the icons are too small to include both portions.
FIG. 3F illustrates a set of contact icons 360, 362, 364, 366, 368, and 370, which may be used in conjunction with an email and/or address book. The icons 360 and 362 each include a respective image portion 360b and 362b, which may be a thumbnail image, and a respective informational portion 360a and 362a. Icons 364, 366, and 368 include only an image portion, as the icons are too small to show both the image and informational portion. Icon 370 illustrates a generic image that may be shown if a thumbnail image is unavailable.
FIG. 3G illustrates a generic contact icon 372 that may be used when no photograph is available for the contact. The icon 372 includes a generic image 372b and an informational portion 372a. 
As illustrated by these examples, scaled icons may differ in terms of their relative size. The scaling may be done beforehand, in which case multiple versions of the icon, at different scales, may be generated in advance and stored in a system memory. Scaling may also be performed dynamically, in which a new scale version of an icon is generated at the time it is needed. The different scale versions of icons may differ in other respects as well. For example, larger scale icons may have more graphical space available for additional elements, such as additional overlays, user interface elements, more detailed images, etc., and may be more complex than the smaller scale versions by including those additional features. Conversely, a smaller scale icon might omit some of these features, and may be simpler by comparison.
IV. Overlays
As set forth above, the different icon sizes may also include different overlay sizes. As set forth above with respect to FIG. 2, the selection and placement of overlays may be based on user-selected scaling. The overlay selection module 220 determines an overlay configuration based on user scaling input.
Two kinds of overlays include status overlays and type overlays. The overlays shown above with respect to FIGS. 3A-G are type overlays that indicate a type. The type overlay may be used for thumbnail icons to convey what type of object the thumbnail image portrays. The type overlays appear in a lower right-hand corner of the image. Status overlays serve as a visual cue to help a user quickly identify some piece of relevant information about an item being viewed. Status overlays may appear in a lower left hand corner of an image.
One use of a status overlay includes alerting the user of a transitional or temporary state of a file upon which a user may wish to act. An example would be putting a “new” overlay on a file that has just recently been created. Another possible use for a status overlay is indicating relevant context sensitive information upon which a user may wish to act. An example would be putting an “error” overlay on a file in the download manager that could not complete downloading. In general, information that is being conveyed through a status overlay should also be a property that can be used for any purpose by the user, such as sorting, grouping, stacking, filtering, and searching. The information can also help the user make an informed decision as to what they want to/can do with a file. For example, an overlay might indicate that the file was downloaded from the Internet and has not been checked for viruses. Such an overlay would help the user decide whether to open the file, or whether to first run a virus scan on it. As another example, an overlay might indicate whether the associated file is available locally or if it is available remotely (such as from an Internet site). A file that is not available locally might take longer to open, and the user might factor that in the decision as to whether to open the file.
Table 1 describes size overlays that may be displayed on icons of different sizes.










TABLE 1







Icon Size
Corresponding Overlay Size









256 × 256
48 × 48



128 × 128
32 × 32



48 × 48
24 × 24



32 × 32
16 × 16



16 × 16
 8 × 8 










The overlays may scale independently from the icons. Between each defined icon snap size such as 256×256, 128×128, 64×64, 32×32, and 16×16, the overlays may scale linearly between the two overlay sizes. Table 2, shown in FIG. 11, shows one embodiment of the overlay sizes relative to icon sizes along a continuous range.
V. Icon Types and Layouts
FIG. 4 illustrates a traditional icon 400 including an icon image 401 and a status overlay 402. The icon image 401 may be stored as a bitmap or may be dynamically generated. The status overlay 402 is used to convey status information about an item. The status overlay may also be dynamically generated or may be stored as a bitmap. In the displayed embodiment, the icon image 401 has dimensions of width=height=X. In some aspects, the status overlay 402 is drawn at the bottom left corner of the image so that the bottom edge of the overlay 402 is aligned with the bottom edge of the icon 400 and the left edge of the overlay 402 is aligned with the left edge of the icon 400. Alternatively, the layout may be configured differently.
FIG. 5 illustrates possible layouts for a thumbnail icon. A row 500 illustrates bottom aligned thumbnail icons 510 and 520. A row 530 illustrates centrally aligned thumbnail icons 540 and 550. The bottom-aligned thumbnail icon 510 includes an image portion 512, a status overlay 514, and a type overlay 516. The bottom-aligned thumbnail icon 520 includes an image portion 522, status overlay 524, and a type overlay 526. The thumbnail icon 540 includes an image portion 542, a status overlay 544, and a type overlay 546. The thumbnail icon 550 includes an image portion 552, a status overlay 554, and a type overlay 556. In general, the image within each icon is denoted by (A), the status overlay by (B), and the type overlay by (C). The thumbnail icon itself is a square with a width and height equal to X. The thumbnail image (A) is scaled so that its longest dimension is at most equal to X.
As illustrated in FIG. 5, in all of the displayed configurations, the thumbnail image (A) is drawn horizontally centered within the thumbnail icon. The vertical placement of the thumbnail image (A) may be determined by the type of view. If a current view has text labels placed below the icon then the bottom edge of the thumbnail image (A) may lie along the bottom edge of the thumbnail icon. If the current view has text labels placed to the side of the icon, then the thumbnail image (A) may be vertically centered within the thumbnail icon.
The placement of the status overlay (B) may depend on the placement of the thumbnail image (A) within the thumbnail icon. The depicted status overlay (B) fits within the boundaries of the thumbnail icon. Horizontally, the status overlay (B) may be centered around the left edge of the thumbnail image (A), but may be moved to the right when necessary, to avoid extending over a left boundary of the thumbnail icon itself.
The placement of the type overlay (C) may depend on the placement of the thumbnail image (A) within the thumbnail icon. Vertically, like the status overlay (B), the bottom edge of the type overlay (C) may lie along the bottom edge of the thumbnail image such that the type overlay (C) fits within the boundaries of the thumbnail icon when the thumbnail image (A) is bottom-aligned. Horizontally, like a mirror of the status overlay (B), the type overlay (C) may be centered around the right edge of the thumbnail image (A), but may be moved to the left when necessary, to avoid extending over the right boundary of the thumbnail icon itself.
For certain predefined icon sizes, such as icons between 16×16 and 47×47 pixels, the label placement module 240 may position the filename beside the icon. For example, for sizes 32×32 to 47, the label placement module 240 may provide additional tile information beside the icon. For sizes 48×48 and larger, the label placement module 240 may place the filename below the icon.
In a default mode, type overlays may be shown on a thumbnail icon if and only if it is within the document library. In some instances, type overlays will not be shown on photographs or video by default. A setting in the view options may be available to enable users to turn on or off the type overlays on documents. A mechanism such as an application program interface (API) may be provided that allows applications to associate a type overlay with each file type they own.
VI. Visual Enhancements
FIGS. 6A-6C illustrate visual enhancements that may be applied to thumbnail icons. There are several types of visual treatments that can be applied to thumbnail images and some of these treatments may further scale down an image.
FIG. 6A illustrates a thumbnail image 600 and a type overlay 602. A border 604 is applied and the icon may be registered to receive such a treatment. For example, MICROSOFT WORDTM documents may be registered to have this treatment applied to them. The border may be applied solely to the thumbnail image 600 and not to the entire bounding box of the thumbnail icon.
FIG. 6B illustrates a thumbnail image 610 having a photo paper border 612. The photo paper border 612 may be applied to a thumbnail if the underlying file is an “image” type and the icon size meets requirements. A photo paper border may be applied to the thumbnail image if the thumbnail image is an image type and it is of a suitable predetermined size, such as 256, 128, 48 or 32 pixels. In this example, no photo paper border is applied at size 16.
Table 3 describes the photo paper border width at each thumbnail icon size in this example.








TABLE 3





Icon Size
Photo Paper Border Width







256
5


128
3


 48
2


 32
1


 16
No photo paper border.









The width may be interpolated between the displayed sizes in a similar manner to the overlays shown in Table 2.
FIG. 6C illustrates a thumbnail image 620 having sprockets 622 and a type overlay 624. The sprockets may be applied to the thumbnail image 620, which may be a still image from a movie, to convey that it is a movie type. The sprockets include two images placed along the top and bottom of the thumbnail image 620 to make it look like a piece of film strip. A pair of sprockets may be applied to the thumbnail image if it is a perceived video type, and if the thumbnail icon size is of a predetermined size, such as 256, 128, 48, or 32 pixels. Again, in this example, no sprockets are applied at size 16. Table 4 describes the sprocket size at each thumbnail icon size in this example.








TABLE 4





Icon Size
Sprocket Height







256
18


128
10


 48
 6


 32
 4


 16
No sprockets.









The top sprocket may be placed so that its bottom edge aligns with the top edge of the thumbnail image, and the bottom sprocket may be placed so that its top edge aligns with the bottom edge of the thumbnail image. If the thumbnail image has a height large enough to make the thumbnail image with the sprockets higher than X pixels, then the two sprockets may be moved closer to one another. The top sprocket may be moved down and the bottom sprocket may be moved up until the thumbnail image with the applied sprockets is no taller than the height X.
Other effects may include a gradient effect that may be applied to thumbnail image to make it more attractive. Furthermore, a shine effect may be applied to the thumbnail image if the object type has been registered to receive such a treatment. For example, POWERPOINTTM types may be registered to have this treatment applied to them. A thumbnail icon may also include a drop shadow effect or other visual effect.
VII. Using the Scaling Mechanism
As set forth above, and as illustrated in FIG. 2, a user scaling module 250 receives user input, such as through a graphical user interface, for scaling. FIG. 7 illustrates a user scale for allowing a user to scale icons. Users can scale icons to certain predetermined sizes, such as between 16×16 and 256×256 pixels. An icon size slider 702 may be provided in a view pane. A view mode control 700 allows a user to switch between an icon mode and a details mode. A user can move the icon slider 702 to adjust the icon size. The icon size slider 702 may have snap points around sizes 16, 32, 48, 128, and 256. If the slide control indicates a size within a few pixels of one of the snap sizes, the icons will snap to that size. In some aspects, if the slider control is within four pixels in either direction of a snap size, the selected icons will be set at the snap size.
Additionally, a view menu may have an item labeled “Icon Size,” with the following choices appearing off a submenu: Tiny, Small, Medium, Large, and Huge, or similar selections that correspond to icon sizes such as 16, 32, 48, 128, and 256. For example, the view menu may be a pull-down menu listing selectable options, and the listed menu options may be selected by clicking, right-clicking, etc.
As with others of the inputs described above, such inputs may be entered using a graphical element, such as a slider bar. Furthermore, users may be able to scale icons using a hardware input, such as a scroll wheel found on many mice. Moving the scroll wheel forward while holding down the CTRL key can increase the size of the icon and moving the scroller wheel backward while holding down the CTRL key can decrease the size of the icon.
In absence of user scaling, the icons may have default sizes. The following Table 5 describes example default sizes of icons in various folder locations.











TABLE 5







Place
Default Icons Size
Default Details Size









Document Library
 48
16



Photo/Video
128
16



Library



Music/Radio
 48
16



Library



Contact Library
 48
48










If the user selection requires that the icon be scaled between snap sizes, the system utilizes a scaling mechanism including a mechanism for converting the icons to an appropriate format, such as a graphical texture provided by MICROSOFT DIRECTXTM graphics technology. A hardware accelerated scaling mechanism may implement a bilinear filter or other known mechanism to perform the actual icon scaling while maintaining visual fidelity of the image. The scaling may occur in real-time by the icon scaling system 200. The real-time scaling can occur at draw time or optionally at other times.
VIII. Type Selection Process
FIG. 8 is a flow chart illustrating a process implemented by the type selection module 230, shown in FIG. 2, for determining which type of icon should be used after a user has selected a particular icon size as explained above with respect to FIG. 7. As set forth above with regard to FIG. 2 the selection of a thumbnail icon or traditional icon typically depends upon the scaling selection of the user.
In step A02, the system compares the icon size and a pre-set size cutoff. If the icon size is above the pre-set size cutoff in step A04, the system seeks a thumbnail icon in step A10. If the icon is not above the size cutoff in step A04, the system selects and shows a traditional item in step A14.
In step A10, the system seeks a thumbnail icon. If a thumbnail icon is not cached in step A12, the system attempts to extract it in step A06. If the thumbnail is not cached in step A12, or if the extraction is successful in step A08, the system selects and shows the thumbnail icon in step A16. If the extraction is unsuccessful in step A08, the system selects and shows the traditional icon in step A14.
Exemplary icon size cutoffs are illustrated in Table 6 below.










TABLE 6







Perceived Item Type
Thumbnail/Icon Cutoff









Document
32



Folder
32



Picture
Always thumbnail



Video
Always thumbnail



Stack (Phodeo)
Always thumbnail



Song
Always thumbnail



Stack (Album)
Always thumbnail



Stack (Artist)
Always thumbnail



People
Always thumbnail



Groups
Always thumbnail



Devices
Always thumbnail



Internet Shortcuts
16










IX. Resource Selection and Scaling Process

FIG. 9 illustrates a process for selection of an image resource by the resource selection module 210, illustrated in FIG. 2, after a user has scaled a selected icon.
As set forth above, the system may provide image snap sizes. The sizes might include for example 16, 32, 48, 128, and 256 pixels. For every item Y at any size X the system may choose the image at the best available size for Y. In step B02, the system searches for the appropriate sized image X. If X is a snap size and an image for Y is available at size X in step B04, then the system uses the available image at size X in step B20. If an image for Y is not available in size X, in step B04, then the system determines if the largest size was searched in step B06. If the largest size was not searched in step B06, the system searches the next largest size in step B08. If the next largest image is available in step B10, the system uses the available icon in step B20. If the image is not available in step B10, the system continues the search until the largest image has been searched.
Subsequently, in step B12, if the search for larger images representing Y was unsuccessful, the system determines if the smallest size has been searched. If the smallest size has not been searched, the system continues to search for the next smallest size in step B14. If the image is available in step B16, the system uses it in step B20. If the icon is not available and the smallest size has been searched in step B12, the system uses a generic image in step B18. If and only if no image can be found at any size, the system will show a generic image. Although the process above is described as considering larger images prior to smaller images, the reverse process is also encompassed.
If the user selection requires that the image be scaled between snap sizes, the system utilizes a scaling mechanism including a mechanism for converting the images to an appropriate format, such as DX9 textures. A hardware accelerated scaling mechanism may implement a bilinear filter to perform the actual image scaling. In addition to scaling the retrieved image, the system also attempts to re-extract at the correct size. The system uses the closest stored image it can find in the interim time. Once the system re-extracts, it displays the correctly sized image and also stores the new correctly sized image into a cache for subsequent retrieval. This extraction, display, store-into-cache sequence also occurs if the cache is empty and first displays the traditional icon.
The resource selection and/or scaling process may also use a variety of different types of icons depending on resource availability. For example, FIG. 10 depicts an example process in which the resource selection module 210 may select an appropriate icon for display. First, in step 1001, the system may receive an icon scaling size to be used for the icons appearing in the display. This may be based on a user preference, such as the scaling mechanism described above, or it may be done automatically by the system as a default or user setting from hardware and/or software inputs.
Once the icon scaling size is determined, the system may then proceed to step 1002, in which the next (or first) object to be displayed may be considered. The objects may be, for example, the various files, documents, data, etc. that are to be represented by the icons in the display. In step 1003, the system may check to see whether an imaging icon, having a reduced-size image displaying the current object's contents, is available for the current object. This may be accomplished using, for example, the resource selection process described above and shown in FIG. 9. Other approaches may also be used. For example, the system may make the determination based on whether a predefined imaging icon already exists for the current object. Alternatively, the system may make the determination based on the object type, or its data contents, to decide whether a suitable imaging icon may be generated for the display.
If, in step 1003, the system determines that a suitable imaging icon is available, the process may move to step 1004, in which that suitable imaging icon may be retrieved and/or generated, and used for the display of the current object. If, however, the system determines that no suitable imaging icon is available, the process may move to step 1005.
In step 1005, the system may check to see if a suitable detail icon is available for the object. A detail icon may be any displayable image whose appearance depends on the contents of the current object, but which falls short of an image of the object's contents. For example, the detail icon might not include a display showing the object's contents in visual form (e.g., a miniature image of a picture file), but it may include some indicia of a type (e.g., whether it is a word processing document, a text document, a spreadsheet, an audio file, a video file, etc.), status (e.g., whether it is editable, its age, when it was last edited, etc.), or other characteristic of the object. Although the detail icon does not have an image representation of the object's contents, the detail icon may still include helpful information identifying the current object. For example, some or all of the overlay information described above may be incorporated or added into the detail icon, such that the detail icon conveys information identifying one or more characteristics (e.g., object type, status, contents, etc.) of the object. For example, if the object is a word processing document (e.g., a MICROSOFT WORDTM document), but the system decided against displaying an image of the object's contents (perhaps the document text was too dense to be adequately represented as a thumbnail), the detail icon might display a symbol representing the fact that the object is a word processing document. The detail icon may include, for example, a type overlay identifying the document type, such as overlay 302b. Other object characteristics and/or overlay data may also be displayed in the detail icon.
The step 1005 determination may follow the same process used in the step 1003 determination, and may check to see if a suitable detail icon can be retrieved and/or generated for the current object. Alternatively, the system may be configured to avoid trying to generate detail icons, and may instead simply check to see if a predetermined detail icon (e.g., a preconfigured bitmap image) already exists in the system. Simplifying this step may lead to faster performance.
If, in step 1005, the system determines that a suitable detail icon is available for the object, the system moves to step 1006, and uses that suitable detail icon in the display for the current object. However, if no suitable detail icon is available, then the system may move to step 1007.
In step 1007, the system has determined that no suitable imaging or detail icons are available, and may use a generic icon to represent the current object in the display. A generic icon may be an image that identifies the existence of an object, but which provides minimal information regarding the file (or none at all). For example, a generic icon might be a plain shape, such as a square, or a blank sheet of paper, to represent the existence of an object. A generic icon may be a predefined image that is common to multiple objects, and in some instances, may have a constant appearance that does not vary with the object contents, type, status, etc. For example, a single generic icon may be defined for use with all objects of unknown file type to the system.
By step 1008, the system will have determined whether to use an imaging icon, a detail icon, or a generic icon for the current object, and may then check to see if any other objects are to be displayed. For example, if the FIG. 10 process is occurring in order to display the contents of a particular project folder, the step 1008 check may determine whether it has identified the appropriate icon (e.g., imaging, detail, or generic) for all objects to be displayed. If additional objects remain to be processed, the system may return to step 1002 to retrieve the next object and loop through the steps described above to identify an appropriate icon for the next object.
If no further objects remain to be processed, then the system may terminate the resource selection process in step 1009.
X. Conclusion
Using one or more of the features described above, various icon images may be generated. A different type of icon image may be selected based on the location of the file represented by the icon (e.g., files in a particular folder on the system all share a common icon) and/or the characteristics of the file (e.g., its metadata, type, how recently it was accessed and/or edited etc.). Additionally, icon images may be selected using contents of the file (e.g., a shortcut icon might retrieve the contents of the underlying file to determine the icon to be displayed).
Thus, icon scaling enables users to resize icons to any size in a range from a small size to a very large size, depending upon user preference. As an icon is resized, the appearance of the icon and the layout of the icons changes to best accommodate its new size.
Users can, in real-time, scale icons across the continuous range of possible sizes, and the scaling is visually appealing. Thumbnail icons may consistently convey what type of object they represent (e.g. Word Document, PowerPoint deck, video clip, etc.) even for thumbnail extractors written by ISVs. Overlays may be used in a consistent and reliable way as visual cues conveying some information about an item.
While particular features have been illustrated and described in detail herein, it should be understood that various changes and modifications might be made without departing from the scope and intent of the description herein. The features described herein are intended in all respects to be illustrative rather than restrictive. Alternatives will become apparent to those skilled in the art. For example, the scaling processes described above may work sufficiently well when scaling up and scaling down the icon size. As another example, although the description above refers to icons for underlying files, the system is not limited to representing files, and can be used for icons representing any item on a computing system, such as directories, shortcuts, etc.
From the foregoing it will be seen that the features described herein well adapted to attain some or all of the ends and objects set forth above. It will also be understood that certain features and sub-combinations may be employed without reference to other features and sub-combinations. For example, the steps in the processes described above may be rearranged and/or omitted as desired.

## Claims

1. A method for displaying an icon representing an underlying item on a user interface of a computing system having a processor and memory, comprising the steps of:
receiving an indication from a user of a user-requested icon size to use for the interface;
for a first icon, employing a three-tier selection process to identify an icon for representing a first underlying item in the user interface, the three tier selection process is comprised of:
determining, based on the user-requested icon size, whether an imaging icon is available for an underlying item for which the three-tier selection process is being employed, wherein the imaging icon is comprised of a reduced-sized image displaying the content of the underlying item, and displaying said imaging icon if it is available at the user-requested icon size;
when said step of determining determines that the imaging icon is not available at the user-requested icon size, determining, based on the user-requested icon size, whether a detail icon is available, wherein the detail icon is comprised of an image whose appearance depends on the content of the underlying item, but which falls short of an image of the contents of the underlying item, and displaying said detail icon if it is available at the user-requested icon size; and
when said steps of determining determines that no imaging icon is available at the user-requested icon size and no detail icon is available at the user-requested icon size, displaying a generic icon for said item, wherein the generic icon is comprised of an image that identifies the existence of the underlying item, but which provides minimal information regarding the underlying item;

for a second icon, employing the three-tier selection process to identify an icon for representing a second underlying item in the user interface; and
displaying the first icon and the second icon concurrently in a common folder of a file management system represented by the user interface.

2. The method of claim 1, further comprising the step of providing the user with a list of predetermined icon sizes, and said indication is a user selection of one of said predetermined icon sizes.

3. The method of claim 1, further comprising searching a set of stored image resources that includes a set of images having a number of discrete sizes.

4. The method of claim 3, further comprising interpolating between discrete sizes to generate an icon between discrete sizes.

5. The method of claim 1, further comprising selecting and positioning an overlay in the vicinity of the first displayed icon based upon the selected size.

6. The method of claim 5, wherein an appearance of said overlay is based on a type of said first underlying item.

7. The method of claim 5, wherein an appearance of said overlay is based on a status of said first underlying item.

8. The method of claim 5, further comprising scaling the selected overlay based upon the user-requested icon size.

9. The method of claim 1, wherein said first icon is a predetermined icon retrieved from storage.

10. The method of claim 1, wherein said first icon is dynamically generated.

11. The method of claim 1, wherein said first underlying item is a file.

12. One or more computer storage media storing computer-executable instructions for performing the following steps:
receiving a user indication of a particular user-requested icon size for a user interface;
employing a first instance of a three-tier selection process to identify an icon for representing a first underlying item in said user interface based on the particular user-requested icon size, the first instance of the three-tier selection process first considering imaging icons that display contents of the first underlying item; second considering detail icons that do not display the contents of the first underlying item, but whose appearance varies depending on a characteristic of the first underlying item; and third considering generic icons;
generating a first icon for representing said first underlying item in the user interface based on results of said first instance of the three-tier selection process;
employing a second instance of a three-tier selection process to identify an icon for representing a second underlying item in said user interface based on the particular user-requested icon size, the second instance of the three-tier selection process first considering imaging icons that display contents of the second underlying item; second considering detail icons that do not display the contents of the second underlying item, but whose appearance varies depending on a characteristic of the second underlying item; and third considering generic icons;
generating a second icon for representing said second underlying item in said user interface based on results of said second instance of the three-tier selection process; and
displaying the first icon and the second icon concurrently in a common folder of a file management system represented by the user interface.

13. The one or more media of claim 12, wherein said instructions for performing said step of generating the first icon includes computer-executable instructions for retrieving a predefined icon image.

14. The one or more media of claim 13, wherein said instructions for performing said step of generating the first icon further includes computer-executable instructions for modifying said predefined icon image based on a characteristic of the first underlying item.

15. The one or more media of claim 12, wherein said first underlying item is an image file storing data for a visual image, and wherein said instructions for said step of generating the first icon further includes computer-executable instructions for retrieving contents of said image file, and including a display version of said visual image with said first icon.

16. The one or media of claim 15, wherein said instructions for performing said step of generating the first icon further includes computer-executable instructions for adding a border element to said image.

17. The one or more media of claim 12, further comprising instructions for including a type overlay with said first icon.

18. The one or more media of claim 12, further comprising instructions for including a status overlay with said first icon.

19. The one or more media of claim 12, wherein said first underlying item is a file.

20. One or more computer storage media storing computer-executable instructions for performing the following steps:
receiving a user indication of a user-requested icon size for a user interface;
employing a three-tier selection process to identify an icon for representing an underlying item in said user interface based on the user-requested icon size, the selection process first considering imaging icons that display contents of the underlying item; second considering detail icons that do not display the item's contents, but whose appearance varies depending on a characteristic of the item; and third considering generic icons;
identifying a first identified icon for basing a first icon on, the first icon representing a first underlying item utilizing the three-tier selection process, wherein the identification includes,
(a) determining if a first imaging icon is available at the user-requested icon size, if the first imaging icon is available at the user-requested icon size, the first imaging icon is the first identified icon,
(b) if the first imaging icon is not available at the user-requested icon size, determining if a first detail icon is available as the user-requested icon size, if the first detail icon is available at the user-requested icon size, the first detail icon is the first identified icon,
(c) if the first detail icon is not available at the user-requested icon size, a first generic icon is the first identified icon,
generating the first icon for representing said first underlying item based on the first identified icon, wherein said step of generating the first icon further includes a step of dynamically scaling an image for said first icon in accordance with said user-requested icon size; and
identifying a second identified icon for basing a second icon on, the second icon representing a second underlying item utilizing the three-tier selection process, wherein the identification includes,
(a) determining if a second imaging icon is available at the user-requested icon size, if the second imaging icon is available at the user-requested icon size, the second imaging icon is the second identified icon,
(b) if the second imaging icon is not available at the user-requested icon size, determining if a second detail icon is available as the user-requested icon size, if the second detail icon is available at the user-requested icon size, the second detail icon is the second identified icon,
(c) if the second detail icon is not available at the user-requested icon size, a second generic icon is the second identified icon,
generating the second icon for representing said second underlying item based on the second identified icon, wherein said first icon and said second icon are displayed concurrently in a common folder of a file management system represented by the user interface, further wherein said step of generating the second icon includes a step of dynamically scaling an image for said second icon in accordance with said user-requested icon size.