Patent Publication Number: US-9836439-B2

Title: Efficient size optimization of visual information or auditory information

Description:
AUDITORY INFORMATION 
     This application is a Continuation of and claims benefit from U.S. patent application Ser. No. 13/472,567 that was filed May 16, 2012, and that is a Continuation of U.S. Pat. No. 8,204,964, issued Jun. 19, 2012, each of which is incorporated herein by reference in its entirety. 
    
    
     BACKGROUND 
     Websites are designed to favorably impress viewers by providing interactive visual, as well as auditory, experiences. When building a website, a website designer considers an amount of visual data, as well as auditory data, to be transferred. A large amount of data may cause a web page to load slowly, thereby degrading a user&#39;s website experience. A large amount of data may also increase storage costs and bandwidth consumption. 
     Some website designers have increased compression ratios for visual assets to be presented by the website. As a result, a user may observe jagged edges around presented visual data, posterization, or other noticeable loss in image quality. Increasing compression ratios for auditory assets by the website may cause a noticeable loss in audio quality. As a result, a user&#39;s website experience may be negatively affected. 
     SUMMARY 
     This Summary is provided to introduce a selection of concepts in a simplified form that is further described below in the Detailed Description. This Summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used to limit the scope of the claimed subject matter. 
     In a first embodiment consistent with the subject matter of this disclosure, a processing device may identify respective portions of a file, including visual information or audio information, suitable for compressing and saving at different bit rates. Component files may be created, based on the identified respective portions, and compressed and saved at the different bit rates. A second processing device may request a copy of the compressed and saved component files. The second processing device may render, or produce, a reasonable facsimile of the file based on the compressed and saved component files. 
     In some embodiments, a processing device may create network page, including a reference to the file. The reference to the file may include information indicating a location from which a copy of the file may be obtained. The processing device may replace the reference to the file with references to the compressed and saved component files. The references to the compressed and saved component files may include information indicating one or more locations from which copies of the compressed and saved component files may be obtained. The network page may then be saved. A processing device of a user may request a copy of the network page and the compressed and saved component files. The copy of the network page and the compressed and saved component files may be transferred to the processing device of the user via a network. The processing device of the user may render, or produce, a reasonable facsimile of the file based on the compressed and saved component files. 
    
    
     
       DRAWINGS 
       In order to describe the manner in which the above-recited and other advantages and features can be obtained, a more particular description is described below and will be rendered by reference to specific embodiments thereof which are illustrated in the appended drawings. Understanding that these drawings depict only typical embodiments and are not therefore to be considered to be limiting of its scope, implementations will be described and explained with additional specificity and detail through the use of the accompanying drawings. 
         FIG. 1  illustrates an exemplary operating environment for embodiments consistent with the subject matter of this disclosure. 
         FIG. 2  illustrates a functional block diagram of an exemplary processing device, which may be used to implement embodiments consistent with the subject matter of this disclosure. 
         FIG. 3  is a flowchart that illustrates an exemplary process for creating compressed component files from an uploaded file and replacing, within a network page, a reference to the uploaded file with references to the compressed component files. 
         FIG. 4  is a flowchart that illustrates an exemplary process for creating component files from an uploaded file and compressing and saving the component files at particular bit rates 
         FIG. 5  is a flowchart that illustrates an exemplary process for creating component image files from an image. 
         FIGS. 6-8  illustrate an original image, a low-bitrate compressed image, and a high-bit rate compressed image, respectively, consistent with the subject matter of this disclosure. 
         FIG. 9  is a flowchart that illustrates an exempla process for creating component audio files from an audio file. 
         FIG. 10  is a flowchart that illustrates an exemplary process for reproducing a reasonable facsimile of visual information or auditory information from compressed component files which were created from a file including the visual information or the auditory information. 
     
    
    
     DETAILED DESCRIPTION 
     Embodiments are discussed in detail below. While specific implementations are discussed, it is to be understood that this is done for illustration purposes only. A person skilled in the relevant art will recognize that other components and configurations may be used without parting from the spirit and scope of the subject matter of this disclosure. 
     Overview 
     A method and a system are provided for efficiently optimizing a size of visual information or auditory information. A number of component files may be created from a file including the visual information or the auditory information. Each of the components files may include only a portion of content of the file and may be compressed using a different compression method. A reasonable facsimile of the file may be reproduced based on an aggregate of the compressed component files. 
     In one embodiment, a file may include an image. Portions of the image may be identified as portions capable of being compressed and saved at respective bit rates, such that a reasonable facsimile of the respective portions of the image may be reproduced from compressed portions. Component image files may be created based only on respective identified portions of the image. The component image files may be compressed and saved at the respective bit rates. A reasonable facsimile of the image may be reproduced based on an aggregate of the component image files. 
     In a second embodiment, a file may include audio data. Portions of the audio data may be identified as portions capable of being compressed and saved at respective bit rates, such that a reasonable facsimile of the respective portions of the audio data may be reproduced. Component audio files may be created based only on the respective identified portions of the audio data. The component audio files may be compressed and saved at the respective bit rates. A reasonable facsimile of the audio file may be reproduced based on an aggregate of the component audio files. 
     A network page may be defined as a webpage that may exist on a network, such as, for example, the World Wide Web or another network. In a third embodiment, a created work page, may include a reference to a file including auditory information or visual information. The reference to the file may include information indicating a location from which a copy of the file may be obtained. The file may be uploaded to a processing device, which may create a number of component files based on the uploaded file. Each of the component files may be based only on respective portions of the auditory information or the visual information and may be compressed differently than others of the component files. In the created network page, the reference to the file may be replaced with references to the component files. The references to the component files may include information indicating one or more locations from which copies of the component files may be obtained. Subsequently, when a processing device of a user requests the created network page, the component files may be provided to the processing device of the user, such that a reasonable facsimile of contents of the file may be reproduced and less bandwidth than conventional methods may be used to transfer the file to the processing device of the user via a network. 
     Exemplary Operating Environment 
       FIG. 1  illustrates an exemplary operating environment for embodiments consistent with the subject matter of this disclosure. The exemplary operating environment may include a first processing device  102 , a second processing device  104 , and a network  106 . Processing devices  102 ,  104  may be connected to each other via network  106 . 
     Network  106  may be a single network or a combination of networks, such as, for example, the Internet or other networks. Network  106  may include a wireless network, a wired network, a packet-switching network, a public-switched telecommunications network, a fiber-optic network, other types of networks, or any combination of the above. 
     Processing device  102  may be a desktop personal computer (PC), a laptop or notebook PC, or other type of processing device which may request a network page via network  106 . Processing device  104  may be a server, server farm, or other type of processing device which may provide a network page to a requesting processing device via network  106 . 
     The operating environment of  FIG. 1  is only exemplary. Other operating environments may have more or fewer processing devices and/or more networks. For example, in some operating environments, additional processing devices may communicate with second processing device  104  via network  106 . 
     Exemplary Processing Device 
       FIG. 2  is a functional block diagram of an exemplary processing device  200 , which may be used to implement processing device  102  or processing device  104  in embodiments consistent with the subject matter of this disclosure. Processing device  200  may be a desktop personal computer (PC), a notebook or laptop PC, a server, or other processing device. Processing device  200  may include a bus  210 , a memory  230 , a read only memory (ROM)  240 , a communication interface  270 , a processor  220 , and a storage device  250 . Bus  210  may permit communication among components of processing device  200 . 
     Processor  220  may include at least one conventional processor or microprocessor that interprets and executes instructions. Memory  230  may be a random access memory (RAM) or another type of dynamic storage device that stores information and instructions for execution by processor  220 . Memory  130  may store temporary variables or other intermediate information used during execution of instructions by processor  220 . ROM  240  may include a conventional ROM device or another type of static storage device that stores static information and instructions for processor  220 . Storage device  250  may include a hard disc and corresponding drive, or other type of data storage device for storing data and/or instructions for processor  220 . Communication interface  270  may permit processing device  200  to communicate via a network wirelessly, or through a cable. 
     Processing device  200  may perform functions in response to processor  220  executing sequences of instructions contained in a tangible machine-readable medium, such as, for example, memory  230 , ROM  240 , storage device  250  or other media. Such instructions may be read into memory  230  from another machine readable medium or from a separate device via communication interface  270 . 
     Exemplary Processing 
       FIG. 3  is a flowchart illustrating an exemplary process, which may be performed in embodiments consistent with the subject matter of this disclosure. The process may begin with a user, such as, for example, a network site designer, uploading a file, including visual information or auditory information, from a first processing device to a second processing device (act  302 ). In some embodiments, the uploaded file may be compressed while in other embodiments, the uploaded file may not be compressed. The second processing device may then create compressed component files based on the uploaded file (act  304 ). 
       FIG. 4  is a flowchart illustrating an exemplary process for performing act  304  by the second processing device in embodiments consistent with the subject matter of this disclosure. The process may begin with the second processing device identifying a portion of content of the file, such that the identified portion is suitable for compressing and saving at a particular bit rate and reproducing a reasonable facsimile of the identified portion from the compressed and saved portion (act  402 ). In embodiments in which the file is compressed, the second processing device may uncompress the file before performing act  402 . 
     All information that does not correspond to the identified portion may then be removed from the file (act  404 ). A remainder of content of the file may be compressed, using a particular compression method, and saved, at the particular bit rate, as a compressed component file (act  406 ). The second processing device may then determine whether creation of component files is completed by determining whether any other portions of the content of the file may be identified for compressing and saving at another bit rate (act  410 ) If no other portions of the contents of the file may be identified for compressing and saying, then the process may be completed. Otherwise, the particular bit rate and the particular compression method may be changed (act  412 ) and the file may be restored to an original form (act  414 ). The second processing device may then repeat acts  402 - 410 . 
     Alternatively, instead of removing, from the file, all information not corresponding to an identified portion of content of the file and saving a remainder of the content of the file as a component file. In other embodiments, only the identified portion of the content of the file may be copied, compressed using the particular compression method, and saved in a compressed component file, at the particular bit rate. 
       FIG. 5  is a flowchart illustrating the exemplary process of act  304 , with respect to a file including an image. The process may begin with the second processing device identifying a portion of content of an image suitable for compressing and saving at a particular bit rate (act  502 ). The second processing device may then remove, from the image, all information that does not correspond to the identified portion of the image (act  504 ). The second processing device may then compress and save, at the particular bit rate, a remainder of the image as a component image file (act  506 ). The second processing device may then determine whether additional component image files may be created based on the image by determining whether any other portions of the image may be identified for compressing and say at another bit rate (act  510 ). If no other portions of the image may be identified, then the process may be completed. Otherwise, the particular bit rate may be changed (act  512 ) and the file may be restored to an original form (act  514 ). The second processing device may then repeat act  502 - 510 . 
     Typically, when an image is compressed with a high compression ratio (low bitrate), a reproduction of the image based on the compressed image may have jagged edges along an edge of an object appearing the image. Other losses in image quality may also become obvious.  FIGS. 6-8  illustrate an original image and two component images which may be created, based on the original image, in embodiments consistent with the subject matter of this disclosure. 
     In one embodiment consistent with the subject matter of this disclosure, starting from a center of an object appearing in an image, a largest rectangular area within the object may be identified and saved at a lower bitrate to produce a lower bitrate component image.  FIG. 7  illustrates an exemplary lower bit rate component which may be produced based on the original mage shown in  FIG. 6 . A portion of the original image, not including the portion corresponding to the image of  FIG. 7 , may be identified and saved at a higher bit rate to produce a higher bit rate component image.  FIG. 8  illustrates an exemplary higher bit rate component which may be produced based on the original image shown in  FIG. 6 . In this example, the higher bit rate component image may include a portion of an object, in the image, including edges of the object. A reasonable facsimile of the original image may be reproduced from an aggregate representation of the component images. In many cases, a user may not detect a difference between the original image and the reasonable facsimile of the original image. 
       FIG. 9  illustrates exemplary processing of act  304  with respect to an audio file including auditory information. In one embodiment, the auditory file may include audio from a number of musical instruments. The musical instruments may produce sounds in various frequency ranges. Audio, including some frequency ranges, may be compressed and saved at a low bit rate and subsequently, adequately reproduced from the compressed and saved low bit rate audio. Audio including other frequency ranges may be compressed and saved at other bit rates, such that a reasonable facsimile thereof may be reproduced from the compressed and saved audio. In another embodiment, audio data may include audio of one or more human voices and audio data including other sounds. A portion of the audio data including the one or more human voices may be identified, compressed and saved at a high bit rate to produce a high bit rate component audio file. A remainder of the audio file may be compressed and saved at a low bit rate to produce a low bit rate component audio file. 
     The process of  FIG. 9  may begin with the second processing device identifying a portion of content of an audio file suitable for compressing and saving at a particular bit rate and reproducing a reasonable facsimile thereof (act  902 ). For example, a portion of the content may be identified based on a frequency range of audio included in the portion of the content. The second processing device may remove, from the audio file, all information not corresponding to the identified portion of the audio file (act  904 ). The second processing device may then compress, using a particular compression method, and save, at the particular bit rate, a remainder of the audio file as a component audio file (act  906 ). A determination may then be made to determine whether any other portions of the audio file remain to be identified (act  910 ). If there are no other portions of the audio file, then the process may be completed. Otherwise, the particular hit rate and the particular compression method may be changed (act  912 ) and the audio file may be restored to an original form (act  914 ). The second processing device may then repeat acts  902 - 910 . 
     Returning to  FIG. 3 , the user may create a network page including a reference to the uploaded file (act  306 ). The reference to the uploaded file in the network page may then be replaced with the references to the compressed component files (act  308 ). The created network page may then be saved (act  310 ). For example, the created network page may be saved to a storage device accessible by the second processing device or another processing device. 
     In some embodiments, the network page may be created by the user using a site editor. A tool may automatically replace the reference to the uploaded file in the network page with the references to the compressed component files when the site editor saves the created network page. 
       FIG. 10  is a flowchart illustrating an exemplary process, which may be performed in a processing device of a user, when the processing device requests the network page. The process may begin with the processing device requesting a network page, including references to compressed component files (act  1002 ). The processing device may then request the compressed component files (act  1004 ). Each of the component files may be compressed using a compression method different from compression methods used to compress other component files. The requested component files may then be transferred, or sent, to the processing device of the user via a network (act  1006 ). The processing device of the user may render an aggregate representation of the compressed component files, thereby producing a reasonable facsimile of an original file, from which the component files are based (act  1008 ). 
     In some embodiments, when reproducing an image from composite images, placement of the composite images in a produced aggregate image may be accomplished by using Cascading Style Sheets (CSS) style properties to place a low bit rate component as an image background and a high bit rate component as an actual image. Of course, in other embodiments, other methods may be used for the placement of composite images in the produced aggregate image, such as use of custom software or other methods. 
     Miscellaneous 
     Some of the exemplary embodiments discussed above may create two compressed component files based on an original file including auditory information or visual information. However, embodiments consistent with the subject matter of this disclosure are not limited to creating only two compressed component files based on an original file. For example, in other embodiments, a third component file may be produced, compressed, and saved at an intermediate bit rate based on an identified portion of the file. In further embodiments, more than three component files may be produced, compressed, and saved at various bit rates based on corresponding identified portions of the file. 
     An exemplary method of identifying portions of an image was previously discussed, in which a low bit rate portion of the image is identified by a largest rectangular area which may be created in an object in the image. In other embodiments, a different shape may be employed, such as, for example, a circle, or other shape. In one embodiment, the shape may be based on a shape of the object in the image. For example, an object having an irregular shape in an image may have a low bit rate portion having the irregular shaped area identified within the object. The identified portion may extend to, but not include, edges of the object. In other embodiments, other methods may be employed to identify portions of a file including visual information to be compressed at particular bit rates. For example, the portions may be identified and separated based on color, or other criteria. The visual information may include video as well as image data. 
     Further, in various embodiments, the file may include either visual information, audio information, or both visual information and audio information. In some of the various embodiments, portions of the audio information may be identified and separated based on frequency or other criteria. 
     In some embodiments, component files produced from an original file of visual and/or auditory information may have a same format. In other embodiments, the component files produced from the original file may have different formats. In such embodiments, one format may be used for component files compressed at one bit rate and another format may be used for component files compressed at a second bit rate. Further, when creating component image files, one embodiment may create component image files having a same outer dimension, or canvas size, to simplify reconstruction of an image. Another embodiment may create component image files having different outer dimensions, or canvas sizes. 
     Conclusion 
     Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are disclosed as example forms for implementing the claims. 
     Although the above descriptions may contain specific details, they are not be construed as limiting the claims in any way. Other configurations of the described embodiments are part of the scope of this disclosure. Further, implementations consistent with the subject matter of this disclosure may have more or fewer acts than as described with respect to  FIGS. 3-10 , or may implement acts in a different order than as shown. Accordingly, the appended claims and their legal equivalents define the invention, rather than any specific examples given.