Patent ID: 12236066

DETAILED DESCRIPTION

FIG.1is a schematic diagram of an illustrative electronic device. Electronic device10may be an electronic device such as a voice-controlled electronic device (sometimes referred to as a digital assistant or voice-controlled speaker), a laptop computer, a computer monitor containing an embedded computer, a tablet computer, a cellular telephone, a media player, or other handheld or portable electronic device, a smaller device such as a wristwatch device, a pendant device, a headphone or earpiece device, a device embedded in eyeglasses or other equipment worn on a user's head, or other wearable or miniature device, a television, a computer display that does not contain an embedded computer, a gaming device, a navigation device, an embedded system such as a system in which device10is mounted in a kiosk, in an automobile, airplane, or other vehicle, other electronic equipment, or equipment that implements the functionality of two or more of these devices. If desired, device10may be a removable external case for electronic equipment, may be a strap, may be a wrist band or head band, may be a removable cover for a device, may be a case or bag that has straps or that has other structures to receive and carry electronic equipment and other items, may be a necklace or arm band, may be a wallet, sleeve, pocket, or other structure into which electronic equipment or other items may be inserted, may be part of a chair, sofa, or other seating (e.g., cushions or other seating structures), may be part of an item of clothing or other wearable item (e.g., a hat, belt, shirt, pants, shoes, etc.), or may be any other suitable electronic device. In an illustrative configuration, which is described herein as an example, electronic device10is a voice-controlled electronic device such as a voice-controlled speaker with internet access.

As shown inFIG.1, device10may include input-output devices18and control circuitry20. Control circuitry20may include microprocessors, microcontrollers, application-specific integrated-circuits, digital signal processors, baseband processors, and/or other controllers and may include storage such as random-access memory, read-only memory, solid state drives, and/or other storage and processing circuitry.

Control circuitry20may gather information from sensors and other circuitry in input-output devices18and may use input-output devices18to supply output. Input-output devices18may, for example, include audio devices such as microphones22and speakers24. Microphones22can gather audio input such as voice commands. Speakers24can produce audio output (e.g., sound such as music, synthesized voice, tones, etc.).

Device10may have input devices such as strain gauges26or other force sensors to gather force input. The strain gauges may be arranged in an array that covers some or all of the surface of device10. A user may provide force input to the strain gauges by pressing on one or more areas on the surface of device10.

Light sources such as semiconductor lasers or light-emitting diodes28may be provided in an array that covers some or all of the surface of device10. Diodes28may have one or more colors (e.g., diodes28may include white light-emitting diodes, red light-emitting diodes, green light-emitting diodes, blue light-emitting diodes, and/or light-emitting diodes of other colors). During operation, light-emitting diodes28may be used to supply steady and/or flashing visual output such as text, icons, and/or other graphical elements. If desired, light-emitting diodes28may produce dynamically adjustable button icons and moving light patterns (e.g., chasing light effects that progress around the perimeter of device10and/or that otherwise move across the surface of device10).

If desired, input-output devices18may include other components for gathering input and providing output. For example, devices18may include buttons for gathering button press input, touch sensors for gathering touch sensor input, capacitive sensors, optical sensors, proximity sensors, temperature sensors, moisture sensors, gas sensors pressure sensors, magnetic sensors, position and orientation sensors (e.g., accelerometers, gyroscopes, and/or compasses), and/or other sensors. Displays may be used in supply visual output to a user. Haptic output devices such as vibrators may provide haptic output. Wireless circuitry in circuitry20(e.g., wireless local area network circuitry, cellular telephone circuitry, etc.) may be used to support wireless communications with external equipment.

Electronic device10may have housings of any suitable shape.FIGS.2and3are perspective views of illustrative electronic devices. In the example ofFIG.2, device10has cylindrical housing30. Housing30has a cylindrical shape in which housing sidewall W wraps around longitudinal (vertical) axis32and upper (top) housing portion TP forms a circular or dome-shaped upper housing surface. In the example ofFIG.3, housing30of device10has a spherical shape with a top portion (portion TP) that has a planar or domed shape. In the examples ofFIGS.2and3, housing30exhibits rotational symmetry about vertical axis32. Other housing shapes may be used, if desired (e.g., device10may have a housing with planar sidewalls, curved sidewalls, a pyramidal shape, a rectangular box shape, a conical shape, and/or other housing shapes).

Input-output devices18and circuitry20may be mounted in the interior of housing30. In some embodiments, electrical components (e.g., integrated circuits and other circuits) may be mounted on a printed circuit under housing portion TP. Housing30may have one or more portions that are transparent to sound and light. For example, housing30ofFIG.2and/or housing30ofFIG.3may be covered by a layer of light-transmitting and sound-transmitting fabric (see, e.g., fabric14ofFIG.2).

Fabric14may include intertwined strands of material such as strands16. Fabric14may, for example, include warp knit fabric that is formed by warp knitting strands16and/or may include woven fabric, fabric with braided strands of material, etc. Strands16may be single-filament strands (sometimes referred to as fibers or monofilaments) or may be strands of material formed by intertwining multiple monofilaments of material together (sometimes referred to as yarns). Strands16may be formed from polymer, metal, glass, graphite, ceramic, magnetic materials, natural materials such as cotton or bamboo, or other organic and/or inorganic materials and combinations of these materials.

Fabric14or other sound-transparent and light-transparent material may have openings that allow at least some sound and light to pass. This allows fabric14to cover optical and audio components (e.g., light sources such as light-emitting diodes28, microphones22, speaker24, etc.). Fabric14or other sound-transparent and light-transparent layer of material that covers device10may also exhibit sufficient flexibility to allow force from a user's fingers or other external object to deform the layer inwardly so that overlapped strain gauge sensor circuitry can detect applied force.

During operation, light-emitting diodes28may be used to create visible text, icons, and/or other illuminated visual content on the exterior of device10. As shown inFIG.3, for example, light-emitting diodes28may be used to create illuminated patterned output34(sometimes referred to as light output or patterned light). Output34may include text (e.g., song titles, weather information, message content, and/or other words), may include graphics (e.g., icons), and/or other output. In the example ofFIG.3, output34includes dynamically adjustable button icons (e.g., illuminated patterns representing a forward button, a reverse button, an up button, a down button, and a pause/play button). These icons may each serve to identify the location of a respective button and may each overlap a respective strain gauge or set of strain gauges that monitors for force input to that button. During operation of device10, the size, shape, color, location and/or other attributes of the button icons can be adjusted (e.g., depending on the type of media playback operations being controlled, depending on the time of day, depending on user preferences, depending on the detected location of a user of device10relative to device10, and/or depending on other factors).

The buttons of output34may include button icons of one or more different colors. Different colors may, as an example, be used to indicate different button function and/or may be used to indicate which button options are currently available. Buttons may also be lit up or turned off depending on context. As an example, up and down buttons (e.g., up and down arrows or other volume adjustment buttons) may be used to increase or decrease media playback volume and may be selectively presented when media tracks are being played by device10(and may be hidden when the media tracks are not being played). Strain gauges26that are overlapped by output34(and, if desired, strain gauges26that are not overlapped by output34) may be used to gather input to control the operation of device10. For example, one or more strain gauges26that are overlapped by a button icon may be used to gather force input associated with that button icon.

If desired, the location at which output34(e.g., a set of media playback control buttons or other button icons) is presented on the exterior surface of housing30may be adjusted dynamically based on user location. Consider, as an example, the top view of device10ofFIG.4. In this example, housing30has a shape that is rotationally symmetric about axis32. Output34(e.g., a set of reconfigurable buttons) may be presented on housing30. When a user presses on a given illuminated button icon, one or more strain gages under the pressed location may detect the button press input, so that device10may take appropriate action in response (e.g., by adjusting playback volume, by changing tracks, by playing or pausing, etc.). Microphones22may be located on different sides of device10. By processing sound measurements with microphones22, microphones22can be used to detect the direction from which voice commands or other sound is being provided to device10. As an example, if a user or other sound source such as sound source36ofFIG.4produces sound in direction38, microphones22can use triangulation to determine this direction and can move output34accordingly. As shown inFIG.4, for example, buttons in output34may be configured to face direction38. In this way, a user who is providing voice commands to device10may be provided with output34that is visible to the user, even if the user changes position relative to device10over time.

FIG.5is a graph showing how force input to one or more of strain gauges26may be used to adjust device operations. In the graph ofFIG.5, the value of an adjustable device operating parameter P has been plotted as a function of the amount of force F measured by a strain gauge26(e.g., measured finger pressure which may be applied, as an example, to an illuminated button pattern overlapping the strain gauge). Parameter P may correspond to an output volume level for speaker24(sometimes referred to as a media playback volume), may corresponding to a brightness level for light-emitting diodes28, may correspond to the brightness value of a ceiling lamp or other external lighting device that is being wirelessly controlled using device10, may correspond to a fast-forward or rewind speed during media playback operations, and/or may correspond to any other adjustable parameter associated with the operation of device10.

As shown by illustrative curve40, device10may process applied force F in a binary fashion. With this type of arrangement, parameter P may have a first value (e.g., 0) when measured force F is less than a predetermined threshold TH and may have a second value (e.g., P1) when measured force F is more than the predetermined threshold TH. If, as an example, parameter P corresponds to speaker output volume for speaker24, the speaker may be off (no sound output) unless the measured value of F exceeds threshold TH, in which case the speaker may produce sound at a volume associated with value P1.

As shown by curve44, applied force F may be linearly mapped to a corresponding value of parameter P. With this type of arrangement, parameter P may have a larger value when measured force F is larger and may have a linearly proportional smaller value when measured force F is smaller. If, as an example, parameter P corresponds to speaker output volume, strong input to strain gauge26will result in a loud sound output and weak input to strain gauge26will result in a soft sound output.

Curve42illustrates how there may be a non-linear relationship between input force F and the resulting adjusted value of parameter P. If desired, the value of P may also change (in a binary fashion, linearly, and/or non-linearly) as a function of time. If, as an example, force F exceeds threshold TH for five seconds, output volume may be increased more than if force F only exceeds threshold TH for one second.

Combinations of these approaches may also be used. For example, the value of P may be ramped up as a function of the amount of time that force F is applied and, during this ramp-up process, may ramp up more quickly when force F is large than when force F is small.

FIG.6is a top view of an illustrative array of strain gauges26and light-emitting diodes28. As shown inFIG.6, strain gauges26and light-emitting diodes28may be organized in an array such as array50in which numerous strain gauges26and numerous light-emitting diodes28are mounted across the surface of substrate52(e.g., tens or hundreds of strain gauges26and/or tens or hundreds of light-emitting diodes28or more). In an illustrative configuration, array50contains multiple rows and columns of strain gauges26interspersed with multiple rows and columns of light-emitting diodes28. Strain gauges26and diodes28may have the same pitch or the density (number per unit surface area) of strain gauges26may be smaller or larger than the density of diodes28. With mounting arrangements of the type shown inFIG.6, there is an array of light-emitting diodes28on substrate52that effectively overlaps and merges with an array of strain gauges26on substrate52. Substrate52may extend over some or all of the area of housing30and may be covered with a light-transparent and sound-transparent cover layer (e.g., a fabric layer).

Substrate52may be formed from a flexible dielectric material such as flexible polymer (e.g., polyethylene terephthalate, silicone, polyimide, etc.). To enhance the flexibility of substrate52and thereby enhance the ability of substrate52to conform to curved surfaces of housing30, substrate52may optionally be provided with relief cuts56(e.g., to form strips of substrate52to form an array of openings to enhance substrate flexibility, etc.). If desired, substrate52may have a main portion52M on which strain gauges26and light-emitting diodes28are mounted and may have an optional narrow tail portion such as tail52T that helps route conductive lines54to control circuitry20(e.g., a printed circuit located in top portion TP). During operation, lines54may be used to convey strain gauges measurements from strain gauges26to control circuitry20(e.g., a printed circuit under upper portion TP) and may be used to convey drive currents (also called control signals) from control circuitry20to light-emitting diodes28.

Each strain gauge26may have a bridge circuit formed from resistors R. Each strain gauge bridge circuit may receive a positive voltage at power supply terminal Vdd and a ground voltage at ground terminal Vg. Resistors R may include at least one force-sensitive resistor R′ that exhibits a resistance that varies as a function of applied force from a user's finger or other external object. Force-sensitive resistor R′ may be formed from a resistive ink such as an organic resistive ink that is printed over metal traces on substrate52. During operation, the output of each strain gauge is measured by monitoring the voltage across the output terminals PT and NT in the strain gauge bridge circuit.

FIG.7is a cross-sectional side view of an illustrative array of strain gauges26and light-emitting diodes28in device10. As shown inFIG.7, device10may have an internal support structure such as support62(e.g., a supporting layer, a shell, a frame, and/or other support structure). Flexible substrate64may be supported on support62and may be overlapped by cover layer30C. Support62, substrate64, and cover30C separate interior region60in the interior of device10from exterior region58surrounding device10.

Flexible substrate64, which may be supported on the outer surface of support62may contain signal lines (see, e.g., lines54ofFIG.6) formed from metal traces74. In each strain gauge26, a strain gauge resistor76is electrically coupled across traces74at electrical connections78. Encapsulation may be provided to help hermetically seal resistor76. This encapsulation may be formed using cured liquid polymer encapsulant80or encapsulant film82. Cover layer30C of housing30may cover strain gauges26and light-emitting diodes28. Layer30C may contain fabric14and/or other flexible materials (e.g., flexible polymer, etc.) and is preferably sufficiently flexible to deform inwardly in direction84when outer surface70of layer30C is pressed inwardly by finger72of a user. Layer30C, substrate64, and support62may be interposed between exterior region58surrounding device10and interior region60within device10. Layer30C, substrate64, and support62preferably have openings (e.g., gaps between strands16in fabric14and/or other holes in fabric14) and/or are otherwise configured to be transparent to light and sound (see, e.g., sound90for microphone(s)22and/or speaker(s)24), which may pass between interior60and exterior58through layer30C, substrate64, and support62). Sound may also pass out of device10though an opening at the base of housing30.

In each light-emitting diode28, a die such as light-emitting diode die28D is coupled to traces74using electrical connections78(e.g., solder connections). Liquid encapsulant80and/or encapsulant film82may hermetically seal die28D. Encapsulant80and/or film82may be sufficiently transparent to allow light92to be emitted from diode28. Light92may then pass from the interior side of layer30C to exterior region58through layer30C.

If desired, light diffusing material, dust-blocking material, additional flexible substrate(s) with electrical components, adhesive and/or coating structures (e.g., reflective coatings such as coatings of white ink, metal, etc.), and/or other layers of material may be located at one or more, two or more, or three or more of the interfaces between the layers ofFIG.7(e.g., between support62, substrate64, and/or cover layer30C).

As described above, one aspect of the present technology is the gathering and use of information such as sensor information. The present disclosure contemplates that in some instances, data may be gathered that includes personal information data that uniquely identifies or can be used to contact or locate a specific person. Such personal information data can include demographic data, location-based data, telephone numbers, email addresses, twitter ID's, home addresses, data or records relating to a user's health or level of fitness (e.g., vital signs measurements, medication information, exercise information), date of birth, username, password, biometric information, or any other identifying or personal information.

The present disclosure recognizes that the use of such personal information, in the present technology, can be used to the benefit of users. For example, the personal information data can be used to deliver targeted content that is of greater interest to the user. Accordingly, use of such personal information data enables users to calculated control of the delivered content. Further, other uses for personal information data that benefit the user are also contemplated by the present disclosure. For instance, health and fitness data may be used to provide insights into a user's general wellness, or may be used as positive feedback to individuals using technology to pursue wellness goals.

The present disclosure contemplates that the entities responsible for the collection, analysis, disclosure, transfer, storage, or other use of such personal information data will comply with well-established privacy policies and/or privacy practices. In particular, such entities should implement and consistently use privacy policies and practices that are generally recognized as meeting or exceeding industry or governmental requirements for maintaining personal information data private and secure. Such policies should be easily accessible by users and should be updated as the collection and/or use of data changes. Personal information from users should be collected for legitimate and reasonable uses of the entity and not shared or sold outside of those legitimate uses. Further, such collection/sharing should occur after receiving the informed consent of the users. Additionally, such entities should consider taking any needed steps for safeguarding and securing access to such personal information data and ensuring that others with access to the personal information data adhere to their privacy policies and procedures. Further, such entities can subject themselves to evaluation by third parties to certify their adherence to widely accepted privacy policies and practices. In addition, policies and practices should be adapted for the particular types of personal information data being collected and/or accessed and adapted to applicable laws and standards, including jurisdiction-specific considerations. For instance, in the United States, collection of or access to certain health data may be governed by federal and/or state laws, such as the Health Insurance Portability and Accountability Act (HIPAA), whereas health data in other countries may be subject to other regulations and policies and should be handled accordingly. Hence different privacy practices should be maintained for different personal data types in each country.

Despite the foregoing, the present disclosure also contemplates embodiments in which users selectively block the use of, or access to, personal information data. That is, the present disclosure contemplates that hardware and/or software elements can be provided to prevent or block access to such personal information data. For example, the present technology can be configured to allow users to select to “opt in” or “opt out” of participation in the collection of personal information data during registration for services or anytime thereafter. In another example, users can select not to provide certain types of user data. In yet another example, users can select to limit the length of time user-specific data is maintained. In addition to providing “opt in” and “opt out” options, the present disclosure contemplates providing notifications relating to the access or use of personal information. For instance, a user may be notified upon downloading an application (“app”) that their personal information data will be accessed and then reminded again just before personal information data is accessed by the app.

Moreover, it is the intent of the present disclosure that personal information data should be managed and handled in a way to minimize risks of unintentional or unauthorized access or use. Risk can be minimized by limiting the collection of data and deleting data once it is no longer needed. In addition, and when applicable, including in certain health related applications, data de-identification can be used to protect a user's privacy. De-identification may be facilitated, when appropriate, by removing specific identifiers (e.g., date of birth, etc.), controlling the amount or specificity of data stored (e.g., collecting location data at a city level rather than at an address level), controlling how data is stored (e.g., aggregating data across users), and/or other methods.

Therefore, although the present disclosure broadly covers use of information that may include personal information data to implement one or more various disclosed embodiments, the present disclosure also contemplates that the various embodiments can also be implemented without the need for accessing personal information data. That is, the various embodiments of the present technology are not rendered inoperable due to the lack of all or a portion of such personal information data.

The foregoing is merely illustrative and various modifications can be made to the described embodiments. The foregoing embodiments may be implemented individually or in any combination.