Abstract:
Capturing metadata, including: a data capture device, wherein the data capture device captures notes made by a user and stores the notes as captured data; a data ingest computer, including a connection interface to connect to the data capture device and receive the captured data from the data capture device, and a data conversion component to convert the captured data to formatted data; and a data repository, connected to the data ingest computer, wherein the data repository is connected to a network. Keywords include smart pen and on set metadata acquisition.

Description:
CROSS-REFERENCE TO RELATED APPLICATIONS 
       [0001]    This application claims the benefit of priority under 35 U.S.C. §119(e) of co-pending U.S. Provisional Patent Application No. 61/604,370, filed Feb. 28, 2012, entitled “Capturing Metadata On Set Using a Smart Pen”. The disclosure of the above-referenced application is incorporated herein by reference. 
     
    
     BACKGROUND 
       [0002]    1. Field of the Invention 
         [0003]    The present invention relates to a technique for capturing metadata, and more specifically, to capturing metadata on set using a smart pen. 
         [0004]    2. Background 
         [0005]    Capturing metadata on a set during production to be used downstream in post-production and distribution is a challenging task due to many antiquated activities that are historically part of the film and television production process. Over the years, technology has had an impact in areas like digital acquisition (new cameras and digital formats), visual effects, and downstream in postproduction. Despite all of these innovations, the majority of the data captured on the set is still typically in paper form, stored in disparate locations and not readily accessible to various stakeholders who could use it. 
       SUMMARY 
       [0006]    The present invention provides for capturing metadata. 
         [0007]    In one implementation, a system for capturing metadata is disclosed. The system includes: a data capture device, wherein the data capture device captures notes made by a user and stores the notes as captured data; a data ingest computer, including a connection interface to connect to the data capture device and receive the captured data from the data capture device, and a data conversion component to convert the captured data to formatted data; and a data repository, connected to the data ingest computer, wherein the data repository is connected to a network. 
         [0008]    In another implementation, a method for capturing metadata is disclosed. The method includes: registering a document; capturing notes made for the document using a data capture device as captured data; ingesting the captured data, including creating formatted data from the captured data; synchronizing the formatted data with a media file, including creating synchronized data; delivering the formatted data to a data repository. 
         [0009]    In yet another implementation, a non-transitory storage medium storing a computer program to capture metadata is disclosed. The computer program includes executable instructions that cause a computer to: register a document; capture notes made for the document using a data capture device as captured data; ingest the captured data, including creating formatted data from the captured data; synchronize the formatted data with a media file, including creating synchronized data; deliver the formatted data to a data repository. 
         [0010]    Other features and advantages of the present invention will become more readily apparent to those of ordinary skill in the art after reviewing the following detailed description and accompanying drawings. 
     
    
     
       BRIEF DESCRIPTION OF THE DRAWINGS 
         [0011]      FIG. 1  shows a conventional process for a script supervisor to make notes during production and distribute those notes. 
           [0012]      FIG. 2  is a functional block diagram of one implementation of a new system and process for on set data acquisition. 
           [0013]      FIG. 3  shows a flowchart of one implementation of an acquisition process for acquiring metadata on set, and converting and storing the data. 
           [0014]      FIG. 4A  illustrates a representation of a computer system and a user. 
           [0015]      FIG. 4B  is a functional block diagram illustrating the computer system hosting the on set metadata acquisition unit. 
       
    
    
     DETAILED DESCRIPTION 
       [0016]    Certain implementations as disclosed herein provide for capturing metadata. In one implementation, smart pen and paper are used to capture and store notes hand written by a script supervisor during production of a movie. The data captured by the pen is stored in a networked data store that can then be accessed by other participants in the production process. After reading this description it will become apparent how to implement the invention in various implementations and applications. Although various implementations of the present invention will be described herein, it is understood that these implementations are presented by way of example only, and not limitation. As such, this detailed description of various implementations should not be construed to limit the scope or breadth of the present invention. 
         [0017]    In a typical movie or television production environment, the script supervisor is the person who records information about the production and adjustments as the production occurs. The script supervisor makes hand written notes on a paper copy of the script (or other papers) and uses these for several purposes during production and post-production, including continuity, director&#39;s notes, slating, script updates, maintaining the lined script, production reports, and editor notes. 
         [0018]    Although it is considered a technical versus artistic role, the script supervisor is an integral part of the creative process. It is for that very reason that new ideas and technical solutions have not been widely adopted. The fear was that these new methods will have an adverse effect on the creative process. Accordingly, the majority of script notes are still hand written on printed versions of the screenplay. The notes are then copied and sent to the editorial group as a reference to complement the editing process. Once that process is complete, on set data is filed away, usually in a place that is not readily accessible to other stakeholders. 
         [0019]    In one implementation, a smart pen is used to digitally capture the script supervisor&#39;s hand written notes during production as data and store the data in a networked data storage accessible to many users. This maintains the flow and human interaction of production, but improves the capturing and transferring of the production data. 
         [0020]      FIG. 1  shows a conventional process  100  for a script supervisor  102  to make notes during production and distribute those notes. A script supervisor (person)  102  uses a typical pen or pencil  104  to make hand written notes on a paper copy of a screenplay or script  106  during production of a movie or television program. The script supervisor checks the notes, editing if necessary, and makes copies (see block  108 ). One set of copies are delivered to the dailies team  110  and another set of copies to editorial  112 . The dailies are then delivered to the editorial. Another hard copy (or the original) is stored for reference in a physical archive  114 . The digital intermediate (DI) facility  116  and other business units  118  (e.g., marketing, producers, studio management, legal) may have reasons to also want to see the notes, but typically would need to make specific additional requests to have copies made and delivered. 
         [0021]      FIG. 2  is a functional block diagram of one implementation of a new system and process  200  for on set data acquisition. The system includes a smart pen  202 , smart paper  204 , data acquisition client software  206 , and a data repository  208 . A script supervisor (person)  210  uses the smart pen  202  to make hand written notes on a copy of a screenplay or script printed on smart paper  204  during production of a movie or television program. In one implementation, when the script supervisor  210  is writing, the smart pen  202  records the script supervisor&#39;s pen strokes using an image sensor  250  to track the microdots  252  on the smart paper  204 , as discussed above, storing the notes as captured data. The script supervisor  210  checks the notes, editing if necessary (see block  212 ), and stores the paper original  204  (or a copy) for reference in a physical archive  214 . In other implementations, the smart paper  204  may also include special controls printed on each page which allows the user to better navigate the pen&#39;s features and applications. 
         [0022]    In another implementation, the smart pen  202  may include movement sensor(s) (e.g., accelerometer, gyroscope, level, compass, etc.) in place of the image sensor  250 . Further, the smart paper  204  may include special controls and/or markers to aid the movement sensor(s) in accurately detecting the hand movement of the script supervisor  210 . 
         [0023]    The script supervisor  210  (or another user) connects (using wire or wirelessly through a connection interface) the smart pen  202  to a computer storing the data acquisition client software  206 . The data acquisition client software  206  transfers the captured data from the smart pen  202  to a data repository  208 . In one implementation, the data repository may be connected to a network. The data acquisition client software  206  also converts the data to formatted data in a format suitable for review and associates the data with related information (e.g., the screenplay). For example, in one implementation, the data acquisition client software  206  stores blocks of text or drawings with page numbers and line numbers based on the position of the notes and with timestamps based on the time of capture. The data is then converted and transferred to the networked data repository  208 , such as a database connected to a production network. 
         [0024]    In one implementation, the data repository  208  also stores a digital copy of the screenplay, such as an optical scan or a formatted text document. The data repository  208  may also store media files, such as video captured during production. The stored notes data, the screenplay copy, and the media files can be linked, cross-referenced, and delivered together or separately to requesting users. The data repository  208  is connected to a network so that the other participants in production, post-production, and business can access the notes, such as editorial  216 , dailies  218 , DI facility  220 , and business  222  (e.g., marketing, producers, studio management, legal). In this system, the script supervisor&#39;s notes are stored as cross-referenced digital metadata in a network resource, allowing multiple users to easily access the metadata as needed. 
         [0025]      FIG. 3  shows a flowchart  300  of one implementation of an acquisition process for acquiring metadata on set, and converting and storing the data. Initially, the screenplay is registered, at block  302 . The registration step  302  can involve various operations required to kick off and manage an ongoing project. Examples of registration include ingesting of script (or screenplay) in PDF or Final Draft Format (FDX), registering the script, linking the script to the smart paper on which the script is printed on, version controlling required for re-writes/changes, and template creation. The notes are captured using a smart pen, at block  304 . The capture step  304  revolves around smart pen usage and can include starting and stopping the capture of data, template driven capturing, shortcuts and/or custom coding, camera logs, and call sheets. 
         [0026]    The captured data is then ingested, at block  306 , from the smart pen into a client side application. This step  306  can include processes such as output creation (PDF, PNG, XML), data conversion (handwriting detection/conversion to structured data), data formatting, and data Timestamp extraction. The ingested data is synchronized with media files, at block  308 , which synchronizes the “on set” data with rich media files (raw and/or dailies footage) to create synchronized data (in addition to the formatted data). Thus, this step  308  can include processes such as processing data timestamps, time alignment—data to file (e.g., aligning notes to video clip), data multiplexing (muxed/timed data into file header), data reformatting—new time aligned data and/or rich media converted into final deliverable package. Finally, the data is delivered, at block  310 , into the master repository (e.g., networked database). The data can be delivered a variety of ways including being synchronized back to raw files on a capture device (e.g., camera or audio recorder) and being directly ingested into the data repository. 
         [0027]      FIG. 4A  illustrates a representation of a computer system  400  and a user  402 . The user  402  uses the computer system  400  to perform various operations described with respect to  FIGS. 2 and 3 . Thus, the computer system  400  includes an on set metadata acquisition unit  490 . 
         [0028]      FIG. 4B  is a functional block diagram illustrating the computer system  400  hosting the on set metadata acquisition unit  490 . The controller  410  is a programmable processor and controls the operation of the computer system  400  and its components. The controller  410  loads instructions (e.g., in the form of a computer program) from the memory  420  or an embedded controller memory (not shown) and executes these instructions to control the system. In its execution, the controller  410  provides the on set metadata acquisition unit  490  as a software system. Alternatively, this service can be implemented as separate hardware components in the controller  410  or the computer system  400 . 
         [0029]    Memory  420  stores data temporarily for use by the other components of the computer system  400 . In one implementation, memory  420  is implemented as RAM. In one implementation, memory  420  also includes long-term or permanent memory, such as flash memory and/or ROM. 
         [0030]    Non-transitory storage  430  stores data for use by other components of the computer system  400 , such as for storing data used by the on set metadata acquisition unit  490 . In one implementation, storage  430  is a hard disk drive. 
         [0031]    The media device  440  receives removable media and reads and/or writes data to the inserted media. In one implementation, for example, the media device  440  is an optical disc drive. 
         [0032]    The user interface  450  includes components for accepting user input from the user  402  and presenting information to the user  402 . In one implementation, the user interface  450  includes a keyboard, a mouse, audio speakers, and a display. The controller  410  uses input from the user  402  to adjust the operation of the computer system  400 . 
         [0033]    The I/O interface  460  includes one or more I/O ports to connect to corresponding I/O devices, such as external storage or supplemental devices (e.g., a printer or a PDA). In one implementation, the ports of the I/O interface  460  include ports such as: USB ports, PCMCIA ports, serial ports, and/or parallel ports. In another implementation, the I/O interface  460  includes a wireless interface for communication with external devices wirelessly. 
         [0034]    The network interface  470  includes a wired and/or wireless network connection, such as an RJ-45 or “Wi-Fi” interface (including, but not limited to 802.11) supporting an Ethernet connection. 
         [0035]    The computer system  400  includes additional hardware and software typical of computer systems (e.g., power, cooling, operating system), though these components are not specifically shown in  FIG. 4B  for simplicity. In other implementations, different configurations of the computer system can be used (e.g., different bus or storage configurations or a multi-processor configuration). 
         [0036]    In summary, the features provided in the above-described implementations can include, but are not limited to, one or more of the following items: (1) Minimal impact on the conventional process/industry-wide standard operating procedure for a script supervisor; (2) Data is captured, converted, and saved in original and structured form; (3) Smart pen data is captured in digital form while maintaining the status quo (can be compatible with many standard operating procedures); (4) Smart pen data time is aligned to the media allowing editors and others the ability to see the notes against the timeline of each clip; (5) Smart pen data available on demand to a variety of users (from production through distribution); (6) Smart Pen data promotes data integrity, improved efficiency, and increased quality in output/product. 
         [0037]    The above description of the disclosed implementations is provided to enable any person skilled in the art to make or use the invention. Various modifications to these implementations will be readily apparent to those skilled in the art, and the generic principles described herein can be applied to other implementations without departing from the spirit or scope of the invention. Accordingly, additional implementations and variations are also within the scope of the invention. For example, a smart pen is not the only solution for capturing the on set data. Writing with a stylus (or finger) on an electronic tablet or touch screen computer can also be used. Typed notes, voice notes, or images or video could also be added. Similarly, optically scanning the handwritten notes and converting to data using optical character recognition (OCR) could also work. Further, it is to be understood that the description and drawings presented herein are representative of the subject matter which is broadly contemplated by the present invention. It is further understood that the scope of the present invention fully encompasses other implementations that may become obvious to those skilled in the art and that the scope of the present invention is accordingly limited by nothing other than the appended claims.