Multipurpose stylus with exchangeable modules

An input device, such as a stylus, can include a main body comprising a main body connector for connecting to a charger to charge a power source of the stylus. A separate functional end module is removable from the main body to expose the main body connector. The functional end module includes a functional component and a module connector that communicates with the main body via the main body connector. Various different functional end modules can be interchangeable to provide a variety of distinct features to the stylus.

FIELD

The present description relates generally to touch-based input devices, such as styluses. More particularly, the present embodiments relate to touch-based input devices that have removable and exchangeable components.

BACKGROUND

A variety of handheld input devices exist for detecting input from a user during use. For example, a stylus can be utilized to provide input by contacting a touch panel of an electronic device. The touch panel may include a touch sensitive surface that, in response to detecting a touch event, generates a signal that can be processed and utilized by other components of the electronic device. A display component of the electronic device may display textual and/or graphical display elements representing selectable virtual buttons or icons, and the touch sensitive surface may allow a user to navigate the content displayed on the display screen. Typically, a user can move one or more input devices, such as a stylus, across the touch panel in a pattern that the device translates into an input command.

DETAILED DESCRIPTION

Some electronic devices that include a display surface and/or a touch panel can be used in combination with a stylus or other touch-based input device. In accordance with embodiments disclosed herein, improved touch-based input devices, such as styluses, can provide input detection for generating and removing markings that are digitally recorded by an external device. The stylus can provide interchangeability of various removable components, such as removable functional end modules that cover a connector for charging and communicating with the stylus. The various removable components each provide distinct features, thereby allowing the user to select various capabilities by employing each of the various functional end modules.

A touch-based input device in accordance with embodiments disclosed herein can include any device that is held, worn, or contacted by a user for receiving inputs from the user. The touch-based input device can be used alone or in conjunction with another device. For example,FIG. 1illustrates a system1including a stylus100and an external device90, having an interface surface50, according to some embodiments of the subject technology. The stylus100can be held by a user10and operate as a touch-based input device for use with the external device90. The interface surface50can include a display surface and/or a touch panel for interacting with the stylus100when contacted thereby. For example, the stylus100can include a tip module190for contacting the interface surface50. Such contact can be detected by the external device90and/or the stylus100. For example, the stylus100can include one or more sensors that detect when the tip module190contacts the interface surface50. Such sensors can include one or more contact sensors, capacitive sensors, touch sensors, cameras, piezoelectric sensors, pressure sensors, photodiodes, and/or other sensors operable to detect contact with the interface surface50.

The stylus100can support handling and operation by a user.FIG. 2illustrates a stylus100, according to some embodiments of the subject technology. According to some embodiments, for example as illustrated inFIG. 2, the stylus100can include a main body110that extends at least a portion of the total length of the stylus100. A user can grip the stylus100at the main body110, for example near the tip module190of the stylus100. Components of the stylus100can be positioned to receive tactile input from the user. For example, the main body110can include an input component such as a button150set within the main body110. The button150can include a switch, knob, lever, force sensor, and/or another input component.

The stylus100can include components for charging and communicating with the stylus, with the components being coverable by a functional end module that provides additional functionality.FIG. 3illustrates the stylus100with the tip module190removed from a first end thereof and a functional end module120removed from a second end thereof, according to some embodiments of the subject technology. According to some embodiments, for example as illustrated inFIG. 3, the main body110of the stylus100can include a main body connector112for receiving electrical power and/or data communications from another device (e.g., the external device90). The functional end module120can perform one or more functions and can be removably attached to the main body110for covering and protecting the main body connector112. When the functional end module120is removed from the main body110, the main body connector112is exposed for insertion into a charging or data communication port of another device (e.g., the external device90). When the functional end module120is attached to the main body110, a module connector122of the functional end module120can connect to the main body connector112of the main body110. The connection between the main body connector112and the module connector122can provide power and/or data communication between the main body110and the functional end module120. Alternatively or in combination, power and/or data communication between the main body110and the functional end module120can be provided via other connections and/or wirelessly.

According to some embodiments, the functional end module120includes one or more functional components130(not shown inFIG. 3) for receiving an input and/or providing an output. Various functions performed by the functional end modules120are discussed further herein. The functional component130can be located at a terminal end of the functional end module120that is located opposite the tip module190of the stylus100. According to some embodiments, the functional component130can include a tactile sensor, such as a push/touch button, a twist button that springs back to a default position when not operated by a user, and/or a twist mechanism that produces incremental clicks when moving between various positions. According to some embodiments, the functional component130can include other orientation detectors, gyroscopes, accelerometers, biometric readers, displays, switches (e.g., dome switches), buttons, speakers, compass, microphones, cameras, voice coils, and/or other components. User inputs provided to the functional component130can generate signals that are communicated to the external device90for performance of an action in accordance with the signal and the user input, as discussed further herein.

According to some embodiments, multiple functional end modules120can be provided and interchanged on the main body110of the stylus100. Each of a variety of functional end modules120can have a different functional component or other component to provide distinct functionally. Accordingly, each functional end module120can act as a module of the stylus100to provide certain features to the stylus100based on the user's selection of functional end module120. The stylus100can detect which of a variety of functional end modules is installed and perform corresponding actions upon receipt of inputs from the functional end module120. Each functional end module120can communicate with the main body110via the main body connector112and the module connector122or by other mechanisms. Each functional end module120can communicate with the external device90via the main body110or by other mechanisms.

According to some embodiments, the tip module190includes one or more functional components192(not shown inFIG. 3) for receiving an input and/or providing an output. The functional component192can be located at a terminal end of the functional end module120that is located opposite the tip module190of the stylus100. According to some embodiments, the functional component192can include a tactile sensor that detects when the tip module190is pressed against a surface, such as the interface surface50. User inputs provided to the functional component192can generate signals that are communicated to the external device90for performance of an action in accordance with the signal and the user input, as discussed further herein. According to some embodiments, the functional component192can provide outputs. For example, the functional component192of the tip module190can include an ink dispenser for physically writing on a surface, such as a whiteboard. By further example, the functional component192of the tip module190can include a light source, such as a laser pointer. Different sensors can also be integrated into the tip module190, such as a color sensor or ambient light sensor.

According to some embodiments, multiple tip modules190can be provided and interchanged on the main body110of the stylus100. Each of a variety of tip modules190can have a different functional component or other component to provide distinct functionally. Accordingly, each tip module190can act as a module of the stylus100to provide certain features to the stylus100based on the user's selection of tip module190. The stylus100can detect which of a variety of functional end modules is installed and perform corresponding actions upon receipt of inputs from the tip module190. Each tip module190can communicate with the main body110via a tip connector114or by other mechanisms. Each tip module190can communicate with the external device90via the main body110or by other mechanisms.

According to some embodiments, the functional end module120and the tip module190can operate independently of each other or in concert. For example, signals from the functional end module120can affect how the external device90responds to signals from the tip module190. By further example, signals from the tip module190can affect how the external device90responds to signals from the functional end module120. Operation of each of the functional end module120and the tip module190are further discussed herein.

The stylus100can be provided with components that facilitate the operation thereof, including use with the external device90.FIG. 4illustrates various components of the stylus100, according to some embodiments of the subject technology.

According to some embodiments, the stylus100can include the functional component192at a tip module190of the stylus100for sensing when the tip module190is contacting a surface, such as the interface surface50of the external device90. The functional component192can include one or more contact sensors, capacitive sensors, touch sensors, cameras, piezoelectric sensors, pressure sensors, photodiodes, and/or other sensors.

According to some embodiments, the stylus100can include a controller106and non-transitory storage media162. The non-transitory storage media162can include, for example, a magnetic storage medium, optical storage medium, magneto-optical storage medium, read-only memory, random access memory, erasable programmable memory, flash memory, or combinations thereof. According to some embodiments, the controller106can execute one or more instructions stored in the non-transitory storage media162to perform one or more functions. For example, the non-transitory storage media162can store one or more haptic profiles that the touch implement may utilize to simulate one or more textures. In some cases, the stylus100may retrieve a specific haptic profile utilizing one or more references and/or other codes detected from a surface utilizing the functional component192and/or received from an electronic device associated with the surface.

According to some embodiments, the stylus100can include a communication component166for communicating with the external device90, the functional end module120, and/or another device. The communication component166can include one or more wired or wireless components, WiFi components, near field communication components, Bluetooth components, and/or other communication components. The communication component166can include one or more transmission elements, such as one or more antennas. Alternatively or in combination, the communication component166can include an interface for a wired connection to the external device90, the functional end module120, and/or another device.

According to some embodiments, the stylus100can include a power source164, such as one or more batteries and/or power management units. The stylus100can include components for charging the power source164, such as the main body connector112. Alternatively or in combination, the stylus100can include wireless charging capabilities for charging the power source164. According to some embodiments, the stylus100can include components for converting mechanical energy into electrical energy. For example, the stylus100can include a piezoelectric device and/or a coil and magnetic components for generating electrical power upon mechanical movement thereof.

According to some embodiments, the stylus100can include a haptic device170for providing haptic feedback to a user. One or more haptic devices170can be located in the main body110and/or the functional end module120. Operation of the haptic device170of the stylus100can be performed in combination with haptic feedback provided directly from the external device90. Use of the button150and/or the functional end module120can be accompanied by haptic feedback to confirm receipt of a user input via the button150and/or the functional end module120. The haptic feedback can be provided in accordance with operation of an application (e.g., game) on the external device.

According to some embodiments, the stylus100can include other components including, for example, orientation detectors, gyroscopes, accelerometers, biometric readers, displays, sensors, switches (e.g., dome switches), buttons, speakers, microphones, cameras, voice coils, and/or other components. According to some embodiments, one or more of the components shown inFIG. 4as being located within the main body110can be located within the functional end module120.

The tip module190and the functional end module120of the stylus100can be used for virtually creating and erasing markings while drawing or writing on a surface. The stylus100can be used for drawing or writing by contacting the interface surface50of the external device90with the tip module190of the stylus100. According to some embodiments, the functional component192in the tip module190and the functional component130in the functional end module120can each detect tactile input from a user. For example, the tip module190and the functional end module120can be used to contact the interface surface50of the external device90. When the tip module190contacts the interface surface50, the external device90can record and/or display a marking at the location of contact by the tip module190. The external device90can detect the contact and/or receive a communication from the stylus100regarding usage of the tip module190. When the functional end module120contacts the interface surface50, the external device90can remove (e.g., erase) a marking, such as a marking previously recorded and/or displayed at the location of contact by the tip module190, as if using a virtual eraser to erase a marking on the interface surface50.

The functional end module120and/or the button150of the stylus100can be used to change settings of the external device90. According to some embodiments, a user can provide primary inputs via the tip module190and secondary inputs via the functional end module120and/or the button150. While the stylus100is used for drawing or writing, inputs provided with the tip module190can be recorded by the external device90with markings, lines, or shapes having a variety of characteristics. For example, the recorded markings can have a certain shape, thickness, and color. When the user operates the functional end module120and/or the button150to create a signal, the external device90can interpret the signal as a command to apply one or more characteristics to markings generated by subsequent input from the stylus100. Accordingly, subsequent contact between the tip module190of the stylus100and the interface surface50of the external device90can be recorded and/or displayed as markings having the one or more characteristics determined by use of the functional end module120and/or the button150. According to some embodiments, characteristics of a marking can be altered as the marking is being generated. For example, while a marking is being drawn with the tip module190of the stylus100, the button150can be pressed to change a characteristic (e.g., shape, thickness, color, etc.) of the marking. After the button150is pressed, additional portions of the marking are recorded and/or displayed in accordance with the new characteristic. As such, a continuous marking can have varying characteristics based on selections made by the user while drawing the marking. For example, a marking created by the user can have different segments with different colors by pressing the button150while drawing the marking.

According to some embodiments, the input provided to the functional end module120and/or the button150can generate a signal based on a characteristic of the input. For example, a user input can be evaluated to determine a duration of a user input, a number of user inputs, a number of user inputs within a span of time, a direction or pathway of a gesture, and/or a magnitude of a force. Based on a determined characteristic of the input, a signal can be generated in accordance with preprogrammed actions associated with predetermined characteristics of the input. According to some embodiments, a single press on the functional end module120and/or the button150can change a characteristic (e.g., shape, thickness, color, etc.) of a marking recorded by the external device90. According to some embodiments, a sustained press on the functional end module120and/or the button150can activate the stylus100(e.g., from a low-power consumption sleep mode) and/or establish a communication link between the stylus100and the external device90. According to some embodiments, a sustained press on the functional end module120and/or the button150can instruct the external device90to display a menu. Additional inputs can scroll through and/or select options displayed within the menu. According to some embodiments, a sustained press on the functional end module120and/or the button150can initiate an activity of a component of the stylus100(e.g., located at the functional end module120). The stylus100can provide haptic feedback (e.g., via a haptic device170) in response to receipt of inputs described herein, thereby providing an indication that the input is received.

The external device90can display feedback relating to the user inputs provided to the stylus100.FIGS. 5 and 6illustrate various selections52displayed on the interface surface50of the external device90, according to some embodiments of the subject technology. According to some embodiments, for example as illustrated inFIG. 5, multiple selections52are displayed, with each of the selections52corresponding to a setting or option that is available to the user. For example, the selections52can correspond to a characteristic (e.g., shape, thickness, color, etc.) of a marking. One of the selections52can be an active selection that is applied to markings. The other selections52that are displayed can be provided as a reference to a user as potential selections. As shown inFIG. 6, when the user provides input (e.g., to the functional end module120and/or the button150), the active one of the selections52can change to another one of the selections52that were previously displayed, and the new active one of the selections52can be applied to subsequent markings. With each detected user input, the display of the selections52can change as an indicator to the user. For example, the display of the selections52can rotate, scroll, slide, shift, change brightness, change opacity, change size, or otherwise be altered to indicate the selection by the user input as well as the current active one of the selections. The selections52that are made available to the user can be preprogrammed, selected by a user, for selected based on learning and the user's history (e.g., the colors most commonly selected by the user are presented for possible selection by the user).

The stylus100can provide tactile feedback to a user based on markings generated by the user.FIGS. 7 and 8illustrate markings56drawn with respect to a boundary54, according to some embodiments of the subject technology. According to some embodiments, for example as illustrated inFIG. 7, the tip module190of the stylus can be used to contact the interface surface50of the external device90. A corresponding marking56is recorded and displayed on the interface surface50at the location of the tip module190. Some or all of a boundary54can be displayed on the interface surface50as a reference for the user. Additionally or alternatively, some or all of the boundary54is not visible or displayed on the interface surface50, but rather is recorded by the external device90for reference in response to user input. Whether or not the boundary54is displayed or visible to a user, the external device can compare the user input to the known boundary54and response as described herein. When the tip module190or the corresponding marking56is outside the boundary54, the stylus100can provide haptic feedback (e.g., via a haptic device170) to indicate to a user that the user is drawing outside the boundary54. When the tip module190or the corresponding marking56returns to within the boundary54, the stylus100can cease providing haptic feedback. The boundary54can be selected to indicate an area to be marked or colored. The boundary54can correspond to a display of a letter, number, or other shape for the user to trace with the stylus100. Accordingly, the haptic feedback provided by the stylus100can indicate to the user when correction is needed to conform to the letter, number, or other shape that is to be traced by the user. Analytics can be performed to determine what portion and/or proportion of the marking is inside or outside the boundary54and provide corresponding feedback regarding the user's performance.

The stylus100can provide tactile feedback to a user based on other activities involving the stylus100. According to some embodiments, operation of the haptic device170can render texture sensations to simulate drawing on a textured surface with the stylus100. Vibrations can be transmitted to the user from the haptic device170as the stylus100is determined to be moving across the interface surface50of the external device90. The force of the contact, the speed of the stylus100, the orientation of the stylus100, and/or the textured surface to be simulated (e.g., paper, stone, wood, etc.) can provide inputs to determine the operation of the haptic device170.

The stylus100can provide tactile feedback to a user based on colors of a display of the external device90to assist users who are unable to fully distinguish colors of the display. According to some embodiments, operation of the haptic device170can be used when the stylus100contacts certain colors. A user can interpret the haptic feedback to infer the presence of colors that the user is otherwise unable to distinguish. A user can provide a selection of colors for which haptic feedback is desired, and the external device90can instruct the haptic device170of the stylus100to provide the haptic feedback when the stylus100is brought to the selected colors displayed on the interface surface50. For example, when a user brings the stylus100to a first color (e.g., red) displayed on the interface surface50, a first pattern (e.g., double vibration) of haptic feedback can be provided by the haptic device170. When the user brings the stylus100to a second color (e.g., green) displayed on the interface surface50, a second pattern (e.g., triple vibration) of haptic feedback can be provided by the haptic device170. The applied pattern of haptic feedback can correspond to certain colors based on preprogrammed or user-defined selections.

The stylus100can be used to record audio data. For example, the functional component130of the functional end module120can include a microphone. Alternatively or in combination, the main body110of the stylus100can include a microphone. A microphone of the stylus100can be used to record audio data, such as speech, music, reminders, lecture notes, command to a virtual assistant, etc. The audio data can be stored in the stylus100, transmitted to an external device90, and/or transcribed into text, where applicable. Recording of audio data can be initiated and/or terminated by operation of a sensor, such as the button150, a functional component of the functional end module120, or another tactile sensor of the stylus100.

According to some embodiments, a stylus100can be used to record written data and audio data. For example, the user can use the tip module190of the stylus100to write on the interface surface50of the external device90, which records the written data provided by the stylus100. The user can also operate the stylus100to record audio data, such as the user's voice. The stylus100and/or the external device90can transcribe the recorded audio data into text. The text can be displayed among the recorded written data on the interface surface50of the external device90. The user can operate the stylus100to edit, move, and/or manipulate the text. For example, the text can be displayed in a box that is separate from the recorded written data. Both the audio data and the transcribed text can be recorded, such that the user can play back the audio, for example upon selecting the text box or a feature thereof. Alternatively or in combination, the audio data can be recorded and displayed in a box that does not contain any transcribed text.

Gestures can be detected by the stylus100as user inputs that include information that is stored locally and/or transmitted to remote devices for use by others. The stylus100can include an accelerometer, a gyroscope, and/or a compass.FIG. 9illustrates the stylus100in communication with the external device90, according to some embodiments of the subject technology. According to some embodiments, for example as illustrated inFIG. 9, the stylus100can detect gestures made by a user holding the stylus100. When a gesture satisfies a predetermined threshold or other characteristic of gestures, the stylus100can transmit a signal to the external device90to perform one or more actions. According to some embodiments, a stylus100can be programmed to detect gestures only when a user is also providing a separate input, such as pressing the button150and/or the functional end module120. Such a prerequisite can limit detection of false inputs that are not intended by the user.

The stylus100can include a tip module190that provides markings on a physical surface. For example, the stylus100can include a tip module190with ink, paint, lead, or graphite. The stylus100can allow tips to be interchanged by a user. The tip module190can also include the functional component192, such that writing on a physical surface is also detected as inputs by the stylus100. Accordingly, handwriting that is generated on the physical surface can be digitally recorded by the stylus100and/or transmitted to the external device90. Movement and position of the stylus100can be detected with the accelerometer, the gyroscope, and/or the compass. Where contact is detected at the tip module190, the stylus100can record the position and record that a marking is generated at the position. These records allow handwriting and other user inputs to be recorded digitally. The records can be stored on the stylus100during a session and transmitted to an external device90when the stylus100is placed in communication with the external device90.

According to some embodiments, a user can use the tip module190of the stylus100to generate markings that are recorded digitally by the external device90. When a user shakes the stylus100, the stylus100can send a signal to the external device90to undo a prior action, such as generation of the previous marking. The external device performs an action to undo the recording of the previous marking based on the signal. Other preprogrammed or user-defined actions can be applied based on the signal. Other gestures are contemplated, such as moving, tilting, etc.

According to some embodiments, gestures detected by the stylus100can be used to control operation of particular devices. For example, where the external device90is a television or media device connected to a television, the stylus100can detect gestures and send corresponding signals to pause playback, advance playback by a certain rate or amount, reverse playback by a certain rate or amount, and/or advance or reverse to another episode, track, or photo. The stylus100can connect to the television or media device directly and/or via an intermediate device.

According to some embodiments, gestures detected by the stylus100can be used to transmit signals to multiple external devices90. For example, the stylus100can be used to generate and record data (e.g., markings, voice recording, photos). The nature of the data can be determined by the functional end module120that is installed onto the stylus100. After generating and recording the data, the stylus100can detect a gesture from a user and transmit the data to multiple external devices90. For example, a user can generate data during a presentation by operating the stylus100. The user can then perform a gesture that, when detected by the stylus100, causes the data to be transmitted to external devices90that are operated by the audience and/or other participants for the presentation. The stylus100can connect to the external devices90directly and/or via an intermediate device. For example, the operators of the external devices90can subscribe to an access point that broadcasts the data from the stylus100. The data can be broadcast, for example, via a wireless connection. By further example, the data can be broadcast to any external devices90within a communication range of an access point.

The stylus100can be used to edit a presentation displayed on an external device90. For example, the external device90can display prepared data, and a user can operate the stylus100to edit, supplement, or delete displayed data. The inputs provided by the stylus100can be recorded in the stylus100and/or the external device90. Separate versions of the display data can be recorded, such that original and altered data can be accessed later. Upon detection by the stylus100of a user gesture, the stylus100can transmit the original and/or altered data to other external devices, such as those of the audience and/or other participants for a presentation, as described herein.

According to some embodiments, gestures detected by the stylus100can be used to detect when a user is in danger. The stylus100can be worn or carried by a user and detects an abrupt fall with an accelerometer. The stylus100can then send an alert (e.g., wirelessly) to an external device90. The external device90can be a local device in communication with the stylus100or a remote device that communicates with the stylus100via a local device, a server, the internet, etc. The alert can be transmitted to individuals associated with the user, to alert the associates regarding a potential threat to the user.

According to some embodiments, the functional end module120can include a camera. According to some embodiments, the functional end module120can include a memory storage. According to some embodiments, the functional end module120can include a breathalyzer or other gas sensor. According to some embodiments, the functional end module120can include a speaker.

According to some embodiments, the tip module190of the stylus100can include an optical sensor, such as an RGB sensor for detecting color of a sample. The user can bring the optical sensor to the sample, and the stylus100can record the color of the sample. The stylus100can then transmit the color to the external device90. Where the external device90includes a display on the interface surface50, the user can, for example by operating the stylus100, apply the color of the sample to at least a portion of the display. According to some embodiments, the color of the sample can be applied to an object that is displayed on the external device90. For example, a user can scan a color of a sample and apply it to an object in a photograph or other picture that is displayed on the external device90. According to some embodiments, the color of the sample can be used as an input parameter for a purchase to be executed by the external device90. For example, a user can scan a color and upload an indicator of the color for purchase of paint in the color.