Abstract:
An electronic device ( 100 ) includes digital image sensors ( 106 ) to capture visual media ( 114 ), a display ( 102 ) to present a visual representation of existing organizational categories and the option to create a new category, and a touch controller ( 103 ) to identify haptic contact engagement, haptic contact location and haptic contact release on the display. A visual media capture controller ( 110 ) organizes visual media ( 114 ) captured by the digital image sensors ( 106 ) into new and existing categories by identifying a predetermined number of haptic signals of predetermined type (a “predetermined haptic signal pattern”), generating organizational information based upon information generated by the touch controller ( 103 ) regarding the predetermined haptic signal pattern, and recording the organizational information. An advantage of one or more aspects of the invention is that they enhance the ability of the user to use a visual media capture device for visual thinking, which differs qualitatively from uses of visual media capture devices served by current designs known in the art. Another advantage of one or more aspects of the invention is that they facilitate faster and simpler collection of organizational information from the user, on-the-fly, upon visual media capture than methods known in the art. A third advantage of one or more aspects of the invention is that they facilitate more precise organization based upon fleeting thoughts, ideas and emotions that exist at the time of capture allowing for creative and subjective expression.

Description:
CROSS-REFERENCED APPLICATIONS 
     This application claims the benefit of U.S. Provisional Application No. 62/000,239, filed May 19, 2015, which is incorporated by reference. 
     This application references the single mode visual media capture device disclosed in U.S. Pat. No. 8,428,453 granted Apr. 23, 2013, which is incorporated by reference. 
    
    
     FIELD OF THE INVENTION 
     This invention relates generally to capturing visual media, such as photographs and videos. More particularly, this invention relates to capturing organizational information as a part of a visual media capture. 
     BACKGROUND 
     Existing visual media capture devices implement a single physical or virtual button for initiating capture upon a press of the button and terminating capture automatically, upon release of the button, or upon another press of the button. Automated data collection at the time of capture allows for a crude organization of captured media based upon objective characteristics such as time or location of capture. The organization of large quantities of captured visual media is a longstanding problem. This problem has worsened with the increasing ease of use and availability of visual media capture devices, such as smartphones, with large amounts of data storage capacity. I have found it a major shortcoming that existing designs do not provide any adequate mechanism for creative or subjective categorization responsive to the captured media. Creative or subjective categorization differs qualitatively from uses of visual media capture served by current designs; a design that provided for such would be of great utility to visual thinkers including creatives working in visual industries. 
     Some digital visual media capture devices have organizational options that do not alter the capture design. For example, some digital visual media capture devices allow the user to manage folders on the digital storage medium and select one as a destination for subsequently captured visual media. Folder management and selection is entirely distinct from the capture operation by design: it requires navigating the settings menus of the camera to either create a new folder or select an existing folder. To create a new folder the user is prompted to either manually input a name for the new folder or to confirm the default naming convention of the device. This design requires that a user specify the desired organizational category (colloquially an “album”) prior to capture. Specifying the desired organizational category for the result of a capture prior to capture is problematic in that it requires the user to envision the result of the capture beforehand. Additionally, setting the desired organizational category prior to beginning a capture operation delays the user from reaching his/her proximate goal of capturing visual media. 
     Other digital visual media capture devices have organizational options that alter the capture design by allowing folder assignment or creation after capture, but still require that a user either manually input a name for the new folder or to confirm the default naming convention of the device. Visual media capture devices are capable of implementing applications (“apps”) that modify the functionality of the device implementing the app for a niche specific purpose. For example, some apps are tailored to create posts on social media network platforms used for sharing visual media, text, links and more. A device running an app for a niche specific purpose may implement organizational features ancillary to a purpose distinct from visual media capture, such as making a social media post. In each of these devices, creating a new categorization entails requesting that the user provide information, such as inputting a title for the categorization, which requires significant abstract reasoning to anticipate what title would be appropriate for a set where the user has only one member so far, severely limiting the creative utility of the feature and the ability of the feature to reflect fluid subjective judgments. This solicitation of text information from user is preserved in order to facilitate organizational structures and display methods known presently in the art. Using these organizational features requires significant time and mental effort, limiting their practical value and explaining why these designs have not been widely adopted for visual media capture devices where visual media capture is not ancillary to a distinct purpose. 
     In sum, organization of large quantities of captured visual media is a longstanding problem with no existing visual media capture device providing a solution that allows organization along any subjective or objective parameter in a timely fashion that requires little mental and physical effort. Moreover, as it has not been previously recognized as a shortcoming of visual media capture devices, no existing device attempts to provide for fluidly creative and subjective organization responsive to the captured media akin to thinking visually. While such a use of a visual media capture device is qualitatively different from uses served by current designs, a visual media capture device that provides for creative and subjective organization with ease would be of great utility to visual thinkers including creatives working in visual industries. 
     SUMMARY 
     An electronic device includes digital image sensors to capture visual media (such as photographs and/or video), a display to present a visual representation of existing organizational categories (colloquially “albums”) and the option to create a new category, and a touch controller to identify haptic contact signals on the display. A visual media capture controller organizes visual media captured by the digital image sensors into new and existing categories by identifying a predetermined number of haptic signals of predetermined type (a “predetermined haptic signal pattern”), generating organizational information based upon information generated by said touch controller regarding the predetermined haptic signal pattern, and recording said organizational information. 
     In one embodiment, subsequent to receiving signals to begin and then end a media capture operation, the visual media capture controller causes the display to present a visual representation of existing categories as well as a representation of a new, empty category. The visual media capture controller interprets a predetermined haptic signal pattern to assign the captured media to a new or existing category by generating and storing corresponding organizational information. 
     In one embodiment, the predetermined haptic signal pattern corresponds to the haptic contact and release resulting from a single tap upon a visual representation of either an existing category or a representation of a new category upon the display. An advantage of one or more aspects of the invention is that they enhance the ability of the user to use a visual media capture device for visual thinking, which differs qualitatively from uses of visual media capture devices served by current designs known in the art. Another advantage of one or more aspects of the invention is that they facilitate faster and simpler collection of organizational information from the user, on-the-fly, upon visual media capture than methods known in the art. A third advantage of one or more aspects of the invention is that they facilitate more precise organization based upon fleeting thoughts, ideas and emotions that exist at the time of capture allowing for creative and subjective expression. Other advantages will be apparent from a consideration of the drawings and ensuing description. 
    
    
     
       BRIEF DESCRIPTION OF THE FIGURES 
       The invention is more fully appreciated in connection with the following detailed description taken in conjunction with the accompanying drawings, in which: 
         FIG. 1  illustrates components of an electronic device implementing organizational visual media capture in accordance with the invention. 
         FIG. 2  illustrates processing operations associated with an embodiment of the invention. 
         FIG. 3  illustrates the exterior of an electronic device implementing organizational visual media capture in accordance with the invention. 
         FIG. 4  illustrates the exterior of an electronic device implementing organizational visual media capture in accordance with the invention. 
     
    
    
     Like reference numerals refer to corresponding parts throughout the drawings. 
     REFERENCE NUMERALS 
     
         
           100  visual media capture device 
           102  display unit 
           103  touch controller 
           104  memory/storage unit 
           106  image sensor unit 
           108  processing unit 
           110  visual media capture controller 
           112  visual media library controller 
           114  visual media 
           202   FIG. 2  embodiment usage flowchart step  1   
           204   FIG. 2  embodiment usage flowchart step  2   
           206   FIG. 2  embodiment usage flowchart step  3   
           208   FIG. 2  embodiment usage flowchart step  4   
           210   FIG. 2  embodiment usage flowchart step  5   
           302  a carousel visual representation of an organizational structure and the option to create a new organizational category (colloquially an “album”) 
           304  a carousel panel receiving visual focus 
       
    
     DETAILED DESCRIPTION 
       FIG. 1  illustrates a visual media capture device  100 , implementing operations of the invention. The visual media capture device  100  may be a digital camera, smartphone or any other digital device with visual media (for example, photographs and/or video) capturing function. In one embodiment the media capture device  100  is a smartphone, which includes a number of functional units such as: a display unit  102 , a touch controller  103 , a memory/storage unit  104 , an image sensor unit  106 , a processing unit  108 , a visual media capture controller  110 , and visual media library controller(s)  112 . 
     The touch controller  103  is responsive to haptic signals applied to the display unit  102  and is also connected to the processing unit  108 . The processing unit  108  may be a central processing unit and/or a graphics processing unit, which is/are in communication with the memory/storage unit  104 . The memory/storage unit  104  is a combination of flash memory and random access memory. The memory/storage unit  104  stores a visual media capture controller  110  and one or more visual media library controller(s)  112  to implement operations of the invention. The visual media capture controller  110  interacts with the visual media library controller(s)  112 , which include(s) executable instructions to store, organize and present visual media  114 . The visual media capture controller  110  includes executable instructions for capturing the visual media and for receiving organizational information from the user based upon the processing of haptic signals, as discussed below. 
     In one embodiment, one of the visual media library controller(s)  112  is a media library controller capable of storing, organizing and presenting visual media without receiving any language-based descriptive information, such as titling information, from the user. The remainder of the visual media library controller(s)  112  may be standard media library controllers known in the art, which require text-based titles for the organizational categories (colloquially “albums”). In another embodiment, for backwards compatibility similar functionality can be achieved using only standard visual media library controller(s)  112 , where the visual media capture controller  110  generates titling information to pass to the visual library media controller(s)  112  automatically, without user interaction. The executable instructions contained in the visual capture controller  110  are designed such that the titling information generated thereby meets the validity requirements of the visual library media controller(s)  112  without requiring user input to generate the titling information. In both of said embodiments, the design of the visual media capture controller  110  enables organizing captured media using a predetermined number of contact signals of predetermined type (a “predetermined haptic signal pattern”). While both embodiments share the other advantages described herein, the embodiment automatically generating titling information has the additional advantage of backwards compatibility with legacy systems that require titling information for the organizational categories. 
     In one embodiment, the predetermined haptic signal pattern identified by the visual media capture controller  110  is the haptic contact and subsequent release signals within a short period of time generated by a single tap (or other predetermined haptic signal patterns used to identify a single tap known in the art) on the display  102 . The visual capture controller  110  generates and stores organizational information by analyzing the location of the tap on the display  102  and cross-referencing that location with the state of a visual representation upon the display  102  generated by the visual capture controller  110  of both the organizational structure and the option to create a new organizational category. Using solely a visual media capture controller  110  and visual media library controller(s)  112  known in the art precludes using a predetermined haptic signal pattern to create a new category since input of custom, user-provided language based descriptive information such as titling information for creation of a new category can not be achieved solely via a predetermined haptic signal pattern. Using a touch screen keyboard to input natural language titling information, for example, requires a variable number of haptic contact signals since the number of characters in a title desired by the user can not be known in advance and thus can not be achieved using a predetermined number of haptic signals. Other embodiments include where the predetermined haptic signal pattern is generated by the user by tapping twice, swiping, pinching, etc. upon the display  102 . Using exclusively predetermined haptic signal patterns facilitates more rapid and precise collection of organizational information on-the-fly than designs known in the art, which enhances uses of the device for creativity and visual thinking as well as certain more traditional uses of the device. 
     The visual media capture device  100  may also include other components commonly associated with a smartphone or digital camera or other visual media capture device, such as a wireless communications unit  116 , a power control unit  118  and a global positioning system unit  120 . While many of the components of  FIG. 1  are known in the art, new functionality is achieved through the visual media capture controller  110 . 
       FIG. 2  illustrates processing operations associated with particular embodiments of the visual media capture controller  110 . Initially, a visual media capture mode is invoked  200 . For example, various smartphone interfaces allow a user to access a camera application presented on the display  102  by tapping an icon representing that application. Doing so invokes a visual media capture mode, activating the visual media capture controller  110 . 
     A visual media capture mode can be invoked in many other ways known in the art. For example, the device may be dedicated to visual media capture, such as with digital camera devices and may enter a visual capture mode automatically upon the device being turned on. One additional example is when an application running on a smartphone device invokes a visual capture mode as part of a larger operation, such as during construction of a social media post. 
     The visual media capture controller  110  includes executable instructions executed by the processing unit  108  to simultaneously present the user with a live preview of the captured media and a capture interface upon the display unit  102 . The image sensor unit  106  transmits to the processing unit  108  information regarding a capture operation, including a live preview of the capture operation and media resulting from the capture operation. 
     The touch controller  103  detects haptic signals upon the display  102 , which cause the visual media capture controller  110  to capture visual media  202 . Executable instructions included in the touch controller  103  and executed by the processing unit  108  interpret these haptic signals, which determine parameters of the media capture including when it begins and ends. 
     The aforementioned capture interface created by the visual media capture controller  110  and executable instructions contained in the touch controller  103  interpreting the haptic signals thereupon can be any of the variations known in the art. In one embodiment, the user taps a visual representation of a camera shutter button upon the display unit  102 , generating haptic signals interpreted by the touch controller  103  to indicate the instant that the image sensor unit  106  should capture a photograph. In another embodiment, the user may tap and hold a visual representation of a button to capture a photograph or video alternatively in accordance with the device disclosed in U.S. Pat. No. 8,428,453 granted Apr. 23, 2013. 
     At some point after the visual media capture, the visual media  114  captured by the image sensor unit  106  is passed to the visual media library controller(s)  112  and stored thereby  208 . In one embodiment, the visual media capture controller  110  includes executable instructions to enter a visual media preview mode immediately after a visual media capture (not illustrated in  FIG. 2 ). Consequently, a user can conveniently review recently captured media and/or perform various other actions with the captured media such as editing it, sharing it and various other actions as known presently in the art. 
     Also after the visual media capture, the visual media capture controller  110  displays a representation of the existing organizational structure and representation of the option to create a new organizational category  204 . After the visual media capture, the visual media capture controller  110  transmits executable instructions to the processing unit  108  to retrieve from the one or more visual media library controller(s)  112  the information required to present the existing categories of visual media. The visual media capture controller  110  includes executable instructions executed by the processing unit  108  to display upon the display unit  102  a visual representation of the existing organizational structure stored by the visual media library controller(s)  112  as well as a visual representation of the option to create a new organizational category for storage by the visual media library controller(s)  112 . 
     In one embodiment, the visual representation of the organizational structure and the option to create a new organizational category is a two-dimensional representation of a three-dimensional carousel (where a “carousel” is a series of panels which move together, possibly around a rotational axis, and eventually wrap around back to the initial panel simulating a cylindrical arrangement of panels) with simulated axis of rotation oriented parallel to the longer side of the device  302  as illustrated in  FIG. 3 . In this embodiment, the frontmost panel of the carousel receives more prominent size and placement than the other panels naturally in order to attract visual focus to a single panel at a time  304  as shown in  FIG. 3 . In the carousel, each panel represents either the option to create a new organizational category or an organizational category. Each panel representing a category contains a visual representation of the category such as one or more photographs already contained within the category. This embodiment enhances the ability of the user to rapidly visually scan the existing organizational structure over the prior art, which expedites selecting an organizational category for the captured media. Additionally, for handheld form factor devices such as certain smartphones, this embodiment enhances the ability of the user to operate the device with only one hand by favoring a natural lateral thumb motion to scroll through the organizational categories. This is a significant advantage over devices displaying organizational categories known in the art, which typically use a flat vertically-scrolling table layout with long text descriptions accompanying small thumbnails representing organizational categories. The vertically-scrolling table layout known in the art favors using a vertical thumb motion to scroll, which is uncomfortable to use during one handed operation of the device. 
     In said embodiment, the user may touch the display  102  attempting to cause the visual representation of the carousel to rotate, or otherwise move, in order to change the image in the carousel receiving visual focus. Upon the user doing so, the touch controller  103  transmits information regarding said haptic signals to the visual media capture controller  110 , which interprets the haptic signals and transmits executable instructions to the processing unit  108 . In response to said instructions, the processing unit  108  updates the visual representation upon the display  102  in accordance with the received executable instructions and the visual media capture controller  110  keeps track of the current state of the visual representation. 
     Subsequent to the display unit  102  displaying the visual representation of the organizational structure, the visual media capture controller  110  identifies a predetermined haptic signal pattern indicating the desired categorization of the captured media  206 . The touch controller  103  transmits haptic signals to the visual media capture controller  110 , which recognizes the predetermined haptic signal pattern and transmits executable instructions to the processing unit  108  that cause the visual media library controller(s)  112  to store the organizational category to which the captured visual media should be assigned, new or pre-existing  208 . The visual media library controller(s)  112  include(s) executable instructions executed by the processing unit  108  to store the organizational information in the memory/storage unit  104 . 
     The foregoing embodiment relies upon evaluating haptic signals. Captured media is organized based upon recognizing a predetermined haptic signal pattern. A single tap on the visual representation of the desired organizational category or a visual representation of the desire to create a new category is sufficient to organize the captured visual media. Thus, visual media may be organized, including creation of new categories, at the time of capture with less effort than methods known in the art. This also allows for more precise organization based upon fleeting thoughts, ideas and emotions that exist at the time of capture and enhances the ability to use the device for visual thinking, which are creative uses of visual media capture devices for which the devices previously known in the art have not been optimized. 
     In alternate embodiments the predetermined haptic signal pattern may result from two taps, a long press, a pinch, or other predetermined haptic signal patterns. Such predetermined haptic signal patterns allow organizing visual media at the time of capture with all of the advantages of the previously described embodiments over the prior art. An advantage of using a predetermined haptic signal pattern other than a single tap is that it would avoid overt mimicry of the single tap design, while maintaining the advantages of the single tap design. 
     In another embodiment the displayed representation of organizational structure and a representation of the option to create a new organizational structure may be actively bypassed by recognizing a predetermined haptic signal pattern indicating that no categorization is desired. This is functionally equivalent to selecting an option to organize the visual media into a default/catch-all category, with all of the advantages of the previously described embodiments over the prior art. An additional advantage of this embodiment is that it can reduce the cognitive load on the user when desired by allowing the user to skip thinking about which category to select. 
     In another embodiment the organizational visual media capture device may conduct a visual media capture as a subcomponent of a larger process, such as, for example, creating a social media post. In such a case, the displayed representation of organizational structure and a representation of the option to create a new organizational structure may be passively bypassed without any user interaction with the organizational options by recognizing a predetermined haptic signal pattern indicating that the larger process should proceed and/or terminate such as, for example, a single tap on a button to finalize the social media post. This is functionally equivalent to selecting an option to organize the visual media into a default/catch-all category. This embodiment has all of the advantages of the previously described embodiments over the prior art. An additional advantage of this embodiment utilizing a visual media capture as a subcomponent of a larger process is that it offers the user a more complete experience for performing specific tasks, saving the user time and effort. 
     In alternate embodiments some or all of the memory/storage may not be a part of the memory/storage unit  104  and may be connected via a wireless data connection such as Wi-Fi, cellular data, Bluetooth, etc. For example, where the organizational visual media capture is for the purpose of creating a social media post, the captured media may be stored at a remote location controlled by the social media company. Various combinations of storage contained within the device and storage not contained within the device are possible, each with all of the advantages of the previously described embodiments over the prior art. 
     Similarly, in alternate embodiments some or all of the processing may not be performed by the processing unit  108  and may be connected via a wireless data connection such as Wi-Fi, cellular data, Bluetooth, etc. Colloquially, arrangements where some or all of the processing or memory/storage are not a part of the device are called “cloud” arrangements, each of which maintains all of the advantages of the previously described embodiments over the prior art. Advantages of a cloud arrangement include the ability to offer a more portable device than a comparable device not utilizing a cloud arrangement and other advantages known in the art. 
     In alternate embodiments the visual representation of the organizational structure and the option to create a new organizational category may be presented in various dimensions and structures. For example, the categories and the option to create a new category may be presented as flat tiles  402  as shown in  FIG. 4  or as segments of some or all of a disk or annulus (not illustrated) on the visual media capture device. Such variations in the visual representation of the organizational structure and the option to create a new organizational category maintain the advantages of the previously described embodiments over the prior art, aside from those specific to embodiments where the visual representation is a two dimensional projection of a three dimensional carousel. Advantages of certain embodiments using visual representations other than the carousel include a lower processing overhead for devices with less computational power, a visual appearance more in line with trends toward flat design, and other advantages known in the art. 
     In an alternate embodiment, immediately after a visual capture the visual media capture controller  110  displays the visual representation of the organizational structure and the option to create a new organizational category. Such an embodiment does not present the user with a preview of the captured media immediately after capture (as illustrated in  FIG. 2 ). An alternate embodiment displays a visual representation of the organizational structure and the option to create a new category simultaneously with a preview of the capture media. Said embodiments have all of the advantages of the previously described embodiments over the prior art, with the additional advantage of enabling faster visual media captures. 
     In an alternate embodiment, the visual capture controller  110  can change behavior between that of a visual capture controller known previously in the art or that of a visual capture controller implementing operations of the invention via a user setting. Said embodiment has all of the advantages of the previously described embodiments over the prior art, with the additional advantage of providing users the option to use alternative capture designs as desired. 
     An embodiment of the present invention relates to a computer storage product with a computer readable storage medium having computer code thereon for performing various computer-implemented operations. The media and computer code may be those specially designed and constructed for the purposes of the present invention, or they may be of the kind well known and available to those having skill in the computer software arts. Examples of computer-readable media include, but are not limited to: magnetic media such as hard disks, floppy disks, and magnetic tape; optical media such as CD-ROMs, DVDs and holographic devices; magneto-optical media; SD cards; flash cards; and hardware devices that are specially configured to store and execute program code, such as application-specific integrated circuits (“ASICs”), programmable logic devices (“PLDs”) and ROM and RAM devices. 
     Examples of computer code include machine code, such as produced by a compiler, and files containing higher-level code that are executed by a computer using an interpreter. For example, an embodiment of the invention may be implemented using JAVA®, C++, Objective C or other programming languages and development tools. Another embodiment of the invention may be implemented in hardwired circuitry in place of, or in combination with, machine-executable software instructions. 
     The foregoing description, for purposes of explanation, used specific nomenclature to provide a thorough understanding of the invention. However, it will be apparent to one skilled in the art that specific details are not required in order to practice the invention. Thus, the foregoing descriptions of specific embodiments of the invention are presented for purposes of illustration and description. They are not intended to be exhaustive or to limit the invention to the precise forms disclosed; obviously, many modifications and variations are possible in view of the above teachings. The embodiments were chosen and described in order to best explain the principles of the invention and its practical applications, they thereby enable others skilled in the art to best utilize the invention and various embodiments with various modifications as are suited to the particular use contemplated. It is intended that the following claims and their equivalents define the scope of the invention.