Patent ID: 8446297

Claim:
A smart pen device for generating one or more sessions including a plurality of different types of data comprising: a processor; a gesture capture system coupled to the processor for receiving gesture data of the smart pen, wherein the received gesture data represents marks made on a writing surface by the smart pen; one or more microphones coupled to the processor for receiving audio data; an onboard memory coupled to the processor and configured to store the received gesture data and received audio data responsive to the processor identifying the input; and a non-transitory computer-readable storage medium storing computer program code executable by the processor, the computer program code including instructions for: storing the received gesture data and received audio data to the onboard memory; generating a session identifier, which identifies a session of the smart pen; associating a portion of the received gesture data with a temporal position of the received audio data and with the session identifier; and generating an index file describing the session, the index file storing an association between (1) the session identifier, (2) the portion of the received gesture data, and (3) the temporal position within the received audio data associated with the portion of the received gesture data; and a storage device coupled to the processor for storing the index file.