Patent Description:
In modern vehicles, a growing number of functionalities is often provided in addition to classic driving functions. All functionalities of the vehicle (e.g. a car) such as air conditioning, seat adjustment, information and entertainment system or the like need to be operated and adjusted by a user of the vehicle. In order to reduce the number of user input devices for the various functions of the vehicle, central user input devices can be used instead of separate input devices for every single function. However, controlling different functionalities may require different input options of a user input device, e.g. for better usability. Therefore, demands on central input devices are high.

Input devices, e.g. physical interaction devices to be used by the user like buttons or switches, are often limited to operating to a plane or axis of operation (e.g. a computer mouse operates on a two dimensional plane of a table or desk, a rotary knob (or controller) operates about a single axis, etc.). Other physical interaction devices work on a limited degree of three dimensional freedom, such that they can be rotated, pushed/pulled and/or tilted within a certain limit of motion.

<CIT> discloses an input-output system for computer user interface using active magnetic levitation. The input-output system has a multiple degree-of-freedom magnetic levitation (maglev) device with a matched electro dynamically levitated flotor and stator combination and an electrodynamic forcer means for receiving coil currents for applying controlled magnetic forces mutual to the flotor and stator. A sensing means measures the relative position and orientation of the flotor and stator. This input-output system may enable higher freedom of motion of the input device, however, due to the use of the stator and flotor, the system is bulky and the free moving space of the flotor is highly limited due to the surrounding stator.

<CIT> discloses a mobile terminal dance method, where a first magnet is set at the bottom of a mobile terminal, the mobile terminal is placed in a base, and the base is set with a second magnet with a polarity opposite to a polarity of the first magnet; when a preset triggering condition is met, the mobile terminal sends a first control signal to control the polarity of the first magnet, such that the first magnet produces a polarity identical to the polarity of the second magnet.

<CIT> relates to a controller using a magnetic levitation principle. The controller using a magnetic levitation principle according to an embodiment of the present invention comprises: a jog shuttle including a first magnetic part; and a jog shuttle pad including a second magnetic part corresponding to the first magnetic part, wherein the jog shuttle can be magnetically levitated on the jog shuttle pad by the first magnetic part and the second magnetic part.

<CIT> discloses a system for levitating a mobile terminal, comprising: a levitation unit mounted on a rear surface of the mobile terminal; and a levitation module configured to generate an electromagnetic force to allow the levitation unit to levitate upward, wherein the levitation unit includes a mounting case attachably detachably coupled to the rear surface of the mobile terminal and a first permanent magnet seated on an inside of the mounting case, wherein the levitation module includes: a housing; a cover that covers the housing; a magnet module disposed in the housing to form an electromagnetic field for levitating the levitation unit; and a PCB that includes a control unit connected to the magnet module to control a current supplied to the magnet module, wherein the magnet module includes a plurality of electromagnets that generate an electromagnetic field for making a repulsive force act on the first permanent magnet, and a second permanent magnet that surrounds the exterior of the plurality of electromagnets and generates a magnetic field for allowing an attractive force to act on the first permanent magnet.

<CIT> discloses a device for holding an object in a vehicle comprises a device. The device is designed to generate a force. The force is at least partially opposed to a gravitational force acting on the object in such a way that the object is held in a position relative to the device by the force without contact.

There may be a desire for improved concepts for user devices and systems with user devices that enable to receive user input and/or give user output.

Further examples of the proposed concepts are described in the dependent claims, the following description and in combination with the figures.

Examples of the present disclosure relate to a system comprising a floating device and a base element for the floating device. The floating device is configured as at least one of an input device or an output device for a user interface. For example, the floating device may be an input/output device. The system is configured to maintain the floating device in a balanced position above the base element in a first operational mode, and to locate the floating device in a docking position on a top side or surface of the base element in a second operational mode.

For example, the floating device configured as input/output user device may be used in a vehicle. The floating device may be described as user device or user controller, for example. The increasing number of different functionalities in modern vehicles may be controlled by the floating device (e.g. provided as a central user device). The balanced position may be a levitating position, for example, such that the floating device can be moved in any direction. For example, the floating device may be a multiple degree-of-freedom input device that may be operable by at least one of rotating, tilting, moving, pushing, touching, tapping, placing, removing (e.g. if the floating device has an access function), reaching towards (e.g. proximity), etc. for example. The floating device may improve a functionality of a user interaction system, e.g. due to multi modal user feedback and/or the possibility for multi modal user input.

The floating device may be particularly well suitable for use in vehicles due to the provided docking mode, for example. In the docking position, the floating device may be positioned at the base element, e.g. fixed to the base element. The docking position may be a position in which the floating device may maintain a physical contact with the base element (e.g. with a larger contact area compared to a contact area while the floating device is operated in the balanced position). For example, due to the provided docking position, it may be possible to meet regulatory requirements for user devices in a car.

Further examples of the present disclosure relate to a vehicle comprising a user interface and a system with a floating device and a base element. The system is configured to control the operational mode of the floating device depending on a movement of the vehicle. Controlling the operational mode based on the movement of the car may enable to meet regulatory requirements, for example. It may be possible to operate the floating device in the balanced position while the vehicle is standing, for example for providing full functionality of the user input/output device. For example, while the car is moving, the floating device may be operated in the docking position, e.g. to improve a functionality of keeping the floating device within a predefined distance to the base element. For example, in the docking position the input functionality may be reduced compared to the floating position, e.g. the floating device may be rotated and/or pushed for receiving user input.

Further examples of the present disclosure relate to a floating device for an input/output system for a user interface. The floating device comprises a magnet element which is arranged circularly in the floating device, and an output element. An upper portion of the floating device is cone-shaped and the output element is provided at the cone-shaped portion. Providing the output element, e.g. a display or the like, at the upper cone-shaped portion may improve the visibility of the output element for a user, for example. Especially in vehicles, the floating device may be positioned next to a user, so that the output element may be better perceived by the user when it is positioned on a sloped side portion of the floating device, for example.

Accordingly, while further examples are capable of various modifications and alternative forms, some particular examples thereof are shown in the figures and will subsequently be described in detail. However, this detailed description does not limit further examples to the particular forms described. Further examples may cover all modifications, equivalents, and alternatives falling within the scope of the disclosure. Same or like numbers refer to like or similar elements throughout the description of the figures, which may be implemented identically or in modified form when compared to one another while providing for the same or a similar functionality.

It will be understood that when an element is referred to as being "connected" or "coupled" to another element, the elements may be directly connected or coupled via one or more intervening elements. If two elements A and B are combined using an "or", this is to be understood to disclose all possible combinations, i.e. only A, only B as well as A and B, if not explicitly or implicitly defined otherwise. An alternative wording for the same combinations is "at least one of A and B" or "A and/or B". The same applies, mutatis mutandis, for combinations of more than two Elements.

<FIG> shows a schematic example of a system <NUM> with a base element <NUM> and a floating device <NUM> in a balanced levitating position. <FIG> shows a schematic example of the system <NUM> and in a docking position.

The presented system <NUM> comprises a floating device <NUM> which is configured as at least one of an input device or an output device for a user interface (e.g. a user input device or a user output device for user interaction with a system). The system <NUM> further comprises a base element <NUM> for the floating device <NUM>. The system <NUM> is configured to maintain the floating device <NUM> in a balanced position above the base element <NUM> in a first operational mode (see e.g. <FIG>), and to locate the floating device <NUM> in a docking position on a top side of the base element <NUM> in a second operational mode (see e.g. <FIG>). As the system <NUM> may be turned by <NUM>° for example, it may be as well possible to operate the floating device <NUM> below the base element <NUM> in the balanced position, e.g. to provide a user device at a bottom side of an object.

The floating device <NUM> may be described as a user device or a user controller, for example. For example, the floating device <NUM> may be an input/output device. A user interface may be used for any system a user can interact with. For example, such systems may be provided in vehicles, e.g. an entertainment system or an information system.

The floating device <NUM> may enable improved usability of a user interaction system for the user, for example. For example, in the balanced position, the floating device <NUM> may be levitated above the base element <NUM>. In a levitation mode, the user can move (e.g. push, lift, drop, rotate, tilt, etc.) the floating device <NUM> in any direction which can improve the possibility to give user input, for example. Further, there may be elements provided at the floating device <NUM> that can directly give output to the user (e.g. by use of a light element, a display, haptic feedback, etc.), e.g. as a feedback function.

In the balanced position, the floating device <NUM> may provide improved usability while the docking position may enable to more securely hold or maintain the floating device <NUM> next to the base element <NUM>. Locating the floating device <NUM> in the docking position may comprise exerting a force (e.g. mechanical force; e.g. magnetic force) on the floating device <NUM> so that it can be kept located in the docking position. Within the docking position, the floating device <NUM> may still provide input functionality (e.g. the floating device <NUM> may be movable also in the docking position; for example the degree-of-freedom to move the floating device <NUM> for giving user input or output in the docking position may be reduced compared to the balanced position; e.g. it may be possible to rotate the floating device in the docking position like a dial or a regular rotating switch).

Alternatively, it may be possible that the floating device <NUM> is fixed to the base element <NUM> in the docking position (e.g. non-movable). Locating the floating device <NUM> in the docking position may comprise physically holding (e.g. grasping) the floating device <NUM>. For example, a connection between the floating device <NUM> and the base element <NUM> may be stable in the docking position (e.g. more stable than in the balanced position).

By providing the balanced position and the docking position, the floating device <NUM> may be well suitable for use within vehicles, for example. For example, for the use in a vehicle (e.g. a car), both a high degree-of-freedom functionality of a user input/output device as well as a stable location of the user input/output device may be required. The proposed floating device <NUM> may meet these requirements, for example.

For example, the balanced position may be a position in which a part of the floating device <NUM> is in physical contact with the base element <NUM> or in which the floating device <NUM> is levitating above (or below) the base element <NUM>. The levitating position is shown in <FIG>, for example. The floating device <NUM> may have a form which does not allow a stable position of the floating device, e.g. without external exertion of force on the floating device <NUM>, for example. Whereas in a non-balance operation mode the floating device <NUM> may perform uncontrolled movements (unstable condition), it may be kept in a defined position in the balanced position, for example. In the balanced position, the floating device <NUM> may be positioned above or below the base element <NUM> (e.g. suspended), for example.

The base element <NUM> and the floating device <NUM> may comprise an information transmitting system, e.g. a wireless transmitting system, configured to send data between the base element <NUM> and the floating device <NUM>, for example. User input data may be sent from the floating device <NUM> to the base element <NUM> and output data may be sent from the base element <NUM> to the floating device <NUM>, for example.

For example, the wireless transmitting system may enable that the floating device <NUM> may be removed from the (e.g. magnetic) base element <NUM> by a user and thereby may effectively become a remote control (e.g. a controller with a 3D surface) that can be moved in free space, for example. Providing the possibility of using the floating device <NUM> also in greater distance of the base element <NUM> (e.g. outside the magnetic field of the base element <NUM>) may broaden the usability of the floating device <NUM> for the user. For example, in autonomous cars the floating device <NUM> may be used on the base element <NUM> or remotely from the base element <NUM> in different situations (e.g. autonomous driving mode or manual driving mode).

The system <NUM> comprises a magnetic system. For maintaining the floating device <NUM> in the balanced position, the magnetic system may be arranged in the base element <NUM> and the floating device <NUM>, for example.

The magnetic system may be configured to hold the floating device in the balanced position. For example, the floating device <NUM> may comprise a magnet (e.g. permanent magnet) that interacts with a magnetic field generated by the base element <NUM>. By adjustment of the magnetic field (e.g. by using a controller of the base element <NUM> or the system <NUM>) a position of the floating device <NUM> may be controlled. For example, controlling the position of the floating device <NUM> may comprise controlling an orientation of the floating device <NUM>, controlling a distance between the floating device <NUM> and the base element <NUM> and/or controlling a movement of the floating device <NUM> (e.g. altering a levitation height of the floating device <NUM>; e.g. providing haptic feedback to a user by vibration of the floating device <NUM>).

According to an example, the system <NUM> may further comprise an electromechanical actuation unit. For example, the magnetic system may comprise an electromagnetic coil being positioned in the base element <NUM>, and the electromechanical actuation unit may be configured to alter a position of the electromagnetic coil within the base element <NUM>. By adjusting a position of the electromagnetic coil, a levitation height of the floating device <NUM> may be controlled or adjusted, for example. Using the electromechanical actuation unit for controlling the levitation height may be easier than controlling the magnetic field, for example.

As described above, the balanced position may be a levitating position. The system <NUM> may be configured to levitate the floating device <NUM> in the balanced position within a range defined by a minimal distance (e.g. levitation height) of at least <NUM> (or at least <NUM>, at least <NUM> or at least <NUM>) and/or of at most <NUM> (or at most <NUM>, at most <NUM> or at most <NUM>) between the base element <NUM> and the floating device <NUM>. For example, smaller distances between the floating device <NUM> and the base element <NUM> may reduce a complexity of a system to levitate the floating device <NUM> (e.g. the magnetic system) whereas a greater distance may increase a freedom of movement of the floating device <NUM> (e.g. for user input; e.g. the user may push the floating device down along a greater distance for controlling parameters of a system).

The system <NUM> may further comprise a fixing means configured for retaining or fixing the floating device <NUM> to the base element <NUM> in the docking position. The fixing means may be used to exert stronger forces to the floating device <NUM>, e.g. to increase a stability of the position of the floating device <NUM> in the docking position. However, it may still be possible to move the floating device <NUM> in the docking position, e.g. the fixing means can be a magnetic system configured to magnetically attract the floating device <NUM> to the base element <NUM> while still enabling a rotation of the floating device <NUM> on the base element <NUM>, for example.

For example, the fixing means may comprise an electromagnet and/or a permanent magnet and/or a mechanical fixing means and/or an electromechanical system. The magnetic system may be used to pull the floating device <NUM> from the balanced position into the docking position where it interacts with a mechanical click mechanism so that it can be more securely fixed in the docking position.

For example, the electromechanical system may comprise a lock bar (which is e.g. electromechanically operable) configured to more firmly connect the floating device with the base element.

For example, the base element <NUM> may comprise a mating element for the floating device <NUM> configured to receive the floating device <NUM> in the docking position. The mating element and a bottom of the floating device may be designed to fit together positively, e.g. to mechanically engage and/or increase surface friction (or contact area), etc. For example, in the docking position there may be a form fit between the floating device <NUM> and the base element <NUM>. The form fit may increase a stability of the connection between the floating device <NUM> and the base element <NUM> in the docking position, for example. A first mating element may be a notch (e.g. V-shaped or U-shaped), for example, and a second mating element may be a bulge formed as a counterpart to the notch. For example, the notch may be provided at the base element <NUM>.

For example, the system <NUM> may be configured to measure a change of position of the floating device <NUM> and/or a change of orientation and/or a change of motion of the floating device <NUM> relative to the base element <NUM> for detection of a user input. The user may alter a height of the floating device <NUM>, tilt the floating device <NUM> in any direction and/or rotate the floating device <NUM>, for example, to give user input.

For example, the floating device <NUM> may comprise a touch control element and/or a proximity sensor and/or an optical sensor and/or a sound sensor and/or a temperature sensor and/or a bio sensor and/or an inertial measurement unit for detection of a user input. A plurality of different user input sensors may allow multi modal user input due to the floating device <NUM>, for example. For example, an optical sensor (e.g. camera, e.g. time of flight camera, IR sensor, etc. to help with figuring out position or orientation relative to the base <NUM>) may be located in the floating device <NUM> or in the base <NUM> or in the surrounding environment (e.g. optical sensors (e.g. camera, LIDAR, etc.) that may be located in the cabin of a vehicle, e.g. in the ceiling/headliner).

For example, the floating device <NUM> may comprise a display and/or a touchscreen display and/or a light source element and/or a speaker and/or a haptic actuator and/or or a thermal device for the provision of an output to a user. The floating device <NUM> may be a multi modal user device, for example.

For example, the system <NUM> may further comprise an optical sensor positioned separated from the floating device <NUM> and configured to detect a position and/or an orientation of the floating device <NUM> relative to the base element <NUM>. The optical sensor may be used to detect a movement of the floating device <NUM>, for example triggered by a user. For example, the user may have the possibility to alter a position of the floating device <NUM> (e.g. push it down or pull it upward) to give user input.

For example, the system <NUM> may further comprise a wireless charging system configured to charge a battery of the floating device <NUM> at least in the docking position. The floating device <NUM> may comprise a rechargeable battery as energy storage, for example. The wireless charging system may be configured to charge the battery in the balanced position as well. Further it may be possible to charge the device by use of an electromechanical connection (e.g. wired electrical contact).

For example, the system <NUM> may further comprise a wireless energy transmission system configured to transmit electromagnetic energy from the base element <NUM> to the floating device <NUM> to operate the floating device <NUM>. It is possible to provide a separate accessory, e.g. a charging cradle (docking station) that may be movable (e.g. for use of the floating device <NUM> at home instead of within a vehicle), for example. For example, by use of the wireless energy transmission system no battery may be needed in the floating device <NUM> as the floating device <NUM> may be powered directly by the base element <NUM>. For example, this may enable to design smaller and lighter floating devices <NUM>. For example, an inductive power supply may provide a combination of power to recharge the battery and/or directly power the floating device <NUM>.

For example, the system <NUM> may be configured to electromagnetically control a rotational movement of the floating device <NUM>. For example, the system <NUM> may be configured to manipulate the floating device <NUM>. For example, it may be possible to rotate the floating device <NUM>, provide indexing (e.g. controlled rotation per index), and/or provide resistance to prevent or impede rotation or motion (e.g. to enable moving the floating device <NUM> with a predefined force only), etc. The manipulation of the floating device <NUM> may be achieved by use of the magnetic system, for example.

For example, the system <NUM> may be configured to enable wireless data communication between the floating device <NUM> and the base element <NUM> and/or the vehicle (e.g. by use of Wi-Fi, Bluetooth, near field communication etc.).

The system <NUM> with the floating device <NUM> may bring particular benefits for usage in a vehicle like a car, for example. For example, the system <NUM> may enable to remove, place/replace the device <NUM> (e.g. swap the device <NUM> by different users), and/or unique devices for different users, etc. Compared to other user devices, the high degree-of-freedom level for user input may be combined with the usability in vehicles, e.g. due to the presence of a defined docking position and a relatively small size of the floating device <NUM>.

The floating device <NUM> may be configured to be removed and replaced by the user, for example. For example, the user may place the floating device on the platform (e.g. the base element <NUM>), e.g. to activate the system or place it in the floating position. An enhancement of stability may be achieved due to at least one of mechanical constraint, servomechanism, Halbach array, or rotational stability, for example. For example, different devices (e.g. two or more floating devices <NUM>) may be provided with similar or different functionality of features.

<FIG> accordingly shows a schematic example of a vehicle <NUM> comprising an input/output system <NUM> with a floating device <NUM>. The dashboard of the vehicle <NUM> is presented. The vehicle <NUM> comprises a user interface and a system <NUM> as described above or below. The system <NUM> is configured to control the operational mode of the floating device <NUM> depending on a movement of the vehicle <NUM>.

For example, the system <NUM> may operate the floating device <NUM> in a first operational mode, e.g. balancing or levitating, when the vehicle <NUM> moves, and in a second operational mode, e.g. in a docking position, when the vehicle <NUM> is stopped. Alternatively, the operational mode may be chosen vice versa, e.g. depending on requirements on the system <NUM>. For example, the balanced mode may be chosen for vehicle speed up to <NUM>/h (or <NUM>/h) and the docking position may be chosen above a vehicle speed of <NUM>/h (or <NUM>/h) or under certain conditions (e.g. vehicle cornering, braking, crash collision (e.g. airbag deployment), etc.). For example, in autonomously driving cars it may be possible to operate the floating device <NUM> in balanced mode while the car is moving.

For example, the floating device <NUM> of the system <NUM> may comprise a specific identification feature and the vehicle <NUM> may be configured to detect the specific identification feature of the floating device <NUM>. For example, the vehicle <NUM> may be configured to control an availability of usable functions of the vehicle <NUM> depending on the specific identification feature of the floating device <NUM>. The floating device <NUM> may be used as a key or an access device to enable the use of specific functions of the vehicle <NUM>, for example. It may be possible to provide the vehicle <NUM> with two different floating devices <NUM> (e.g. for a first user and a second user) so that the first user may have different functional options compared to the second user. For example, the floating device <NUM> may be used for controlling internal car features only, but not access to the car.

In <FIG>, the dashboard of the vehicle <NUM> shows a steering wheel <NUM>, control buttons <NUM> (e.g. rotating switches), and a user display <NUM>. The system <NUM> may comprise a magnetic system to enable the balanced position of the floating device (e.g. levitating the floating device <NUM>) by use of a magnetic field <NUM>. Further, a camera device <NUM> is provided to enable measuring a position of the floating device <NUM>, e.g. in relation to the base element <NUM>.

For example, the floating device <NUM> may be used to control functions displayed at the user display <NUM>. The floating device <NUM> may enable 3D interactive user experience, e.g. to improve a connection between a physical space and a virtual space. For example, a reproduction of the floating device <NUM> may be displayed on the display <NUM> including the present position and orientation of the floating device <NUM> to increase the connection between real world and virtual reality (VR) or augmented reality (AR), for example. Due to the haptic 3D experience and the projected virtual reproduction, the user interaction may be improved, for example by connecting visual and haptic features.

The camera <NUM> may detect which user of the car uses the floating device <NUM>, for example. The driver may control different functions by using the floating device <NUM> than a co-driver, for example. Depending on a direction of approach of a user's hand, different functions may be displayed on the display <NUM> for the corresponding user, for example. For example, when the co-driver approaches the floating device <NUM>, the system <NUM> may rotate the floating device <NUM> to orient the floating device <NUM> (e.g. a specific output element of the floating device <NUM>) towards the co-driver, e.g. to enable better usability of the floating device <NUM> to the co-driver.

When the system <NUM> is used in a vehicle <NUM>, additional data may be used: For example, the dynamics of the vehicle (e.g. acceleration, braking, cornering, orientation, etc.) may be used to control the system <NUM>. The floating device <NUM> may be used to control and compensate for the vehicle and adapt sensor information on the floating device. User information (e.g. seat occupancy, user identification, user state, etc.) may be used for the interactive user system. Safety events (e.g. data that primes and actuates seat belt tensioning, air bag, etc.) may be included, for example.

More details and aspects of the concept are mentioned in connection with the proposed concept or one or more examples described above or below (e.g. <FIG> and <FIG>). The concept may comprise one or more additional optional features corresponding to one or more aspects of the proposed concept or one or more examples described above or below.

A further aspect relates to a floating device <NUM> for an input/output system <NUM> for a user interface. The floating device <NUM> may comprise a magnet element which is arranged circularly in the floating device <NUM> (e.g. a ring magnet), and an output element. An upper portion of the floating device <NUM> is cone-shaped or inclined and the output element is provided at the cone-shaped or inclined portion.

For example, the floating device <NUM> may have a maximal height of at most <NUM> (or at most <NUM>, at most <NUM> or at most <NUM>) and/or of at least <NUM> (or at least <NUM> or at least <NUM>). For example, the floating device may have a maximal diameter of at most <NUM> (or at most <NUM>, at most <NUM> or at most <NUM>) and/or of at least <NUM> (or at least <NUM> or at least <NUM>). For example, the size of the floating device <NUM> may be large enough to give a good handling to a user and small enough for suitable use in vehicles.

More details and aspects of the concept are mentioned in connection with the proposed concept or one or more examples described above or below (e.g. <FIG>). The concept may comprise one or more additional optional features corresponding to one or more aspects of the proposed concept or one or more examples described above or below.

<FIG> shows a floating device <NUM> and a base element <NUM> with mating elements for contacting each other in the docking position. A first mating element 34a at the base element <NUM> is a V-shaped notch. The counterpart at the floating device <NUM>, a second mating element 34b, is also V-shaped to enable a form fit with the first mating element 34a when located in the docking position on the base element <NUM>. A more detailed view of a floating device <NUM> that can be used is given in combination with <FIG>, for example.

The base element <NUM> shown in <FIG> comprises a magnetic system with coils <NUM> generating a magnetic field <NUM> to maintain the floating device <NUM> in a balanced position. Here, the balanced position is a levitating position. A levitation height h may be controlled by the system <NUM>, e.g. by controlling strength and/or orientation and/or position of the magnetic field <NUM>. The levitation height h may be variable.

A user <NUM> may manipulate, e.g. move (e.g. rotate, push or the like) the floating device <NUM> to give user input to a system. The high degree-of-freedom movability of the floating device <NUM> may enable movements in all directions (e.g. x/y/z direction) as well as rotating (e.g. in the x/y plane) or tilting (e.g. with respect to the z-axis). An output element <NUM> of the floating device <NUM> may give output to the user <NUM>. The output element <NUM> is positioned at an upper inclined portion of the floating device <NUM> so that a user looking at the floating device <NUM> from above at an angle can better perceive the content of the output element <NUM>, for example. A camera device <NUM> may be provided to detect a movement of the floating device <NUM>, e.g. triggered by the user <NUM>. The camera device <NUM> may be used as proximity sensor to detect a position of the user <NUM> (e.g. hand of the user <NUM>) close to the floating device <NUM>. For example, in a proximity operational mode, the magnetic system may move the floating device <NUM> to maintain a predefined distance between the user <NUM> and the floating device <NUM> (e.g. distance of <NUM>, of <NUM> or of <NUM>). In other words, the system <NUM> may be configured to let the floating device <NUM> follow a user's movement, for example. The system <NUM> may further be configured to resist (e.g. counteract) the movement of the device <NUM> by the user.

<FIG> show a schematic example of a floating device in a non-floating position (<FIG>) and in a balanced position (<FIG>). In the non-floating or non-balanced position, the floating device <NUM> is located in an unstable position on the base element <NUM> (e.g. rolling around). When the magnetic field <NUM> is activated, the floating device <NUM> may be brought into the balanced position (e.g. balancing on a corner of the floating device <NUM> which is in contact with the base element <NUM>).

For example, a wake up function may be enabled by use of a proximity sensor. When an approach of the user <NUM> to the floating device <NUM> is detected, the system <NUM> may switch the operational mode to bring the floating device <NUM> from the docking position to the balanced position.

<FIG> show an example of a system with an electromechanical actuator <NUM> which may be included in the base element <NUM>. The electromechanical actuator <NUM> may be configured to move (e.g. elevate) the floating device <NUM> and/or the electromagnetic coils <NUM> of the base element <NUM> mechanically.

<FIG> shows the floating device <NUM> in the docking position. In the docking position, the electromechanical actuator <NUM> may be retracted in the base element <NUM> to receive the floating device <NUM> at least partly in the base element <NUM>. In <FIG>, the electromechanical actuator <NUM> may be extended and the system <NUM> maintains the floating device <NUM> in the balanced position by use of the magnetic field <NUM> (e.g. first operational mode). Further, e.g. in a third operational mode, the floating device <NUM> may be levitated to a first height (e.g. shown in <FIG>). Further, e.g. in a fourth operational mode, the floating device <NUM> may be levitated to an altered second height, for example.

By combination of electromechanical and magnetic actuation, the levitation may be variable, for example. The floating device <NUM> may be docked (e.g. physically contacting; e.g. held in place), balancing (e.g. a point contact, balanced in equilibrium) and/or floating (e.g. levitating). The electromechanical actuation may physically separate the magnetic sub-system from the physical support (e.g. docking) of the floating device <NUM>. The magnetic actuation may be further comprised of a permanent magnet and electro magnet subsystems. For example, the magnetic polarity of the sub-systems may be reversed to either lock the floating device <NUM> in a docked position (e.g. to prevent theft, or as a safety mechanism such as in the event of strong accelerations in a car); to float - e.g. levitate; and/or to stabilize the floating device <NUM>, e.g. to maintain a state of equilibrium (e.g. balance, float, resist, etc.) against external forces (e.g. exerted by a user, gravity, vehicle acceleration, etc.).

<FIG> show an example of a base element with a cradle <NUM> for the floating device. For example, the system <NUM> may be configured to position the floating device <NUM> at least partly in the cradle <NUM> when operated in the balanced position mode.

<FIG> shows a side view of a U-shaped cradle 60a with a levitated floating device <NUM> inside the cradle. <FIG> shows a side view of a rectangular shaped cradle 60b with a levitated floating device <NUM> inside the cradle. Positioning the floating device <NUM> in the cradle <NUM> may result in the possibility of using less complex magnetic systems for balancing the floating device <NUM>, for example.

<FIG> show an example of a floating device <NUM> with a number of output elements 36a, 36b, 36c on the upper side and top of the floating device <NUM>. Two output elements 36a, 36b may be ring-shaped input/output elements (e.g. touch screen elements) which are arranged circumferentially on a sloping upper side of the floating device <NUM>. A third output element 36c (e.g. a touch screen element as well) is circular shaped and arranged centrally at the top of the floating device <NUM>. The different elements may improve the usability of the floating device <NUM> for the user, for example.

An example relates to a system comprising a floating device configured as at least one of an input device or an output device for a user interface. The floating device may comprise a magnet, e.g. provided in a ring-formed arrangement. The system may further comprise a base element for the floating device and a controller, wherein the base element may comprise an electromagnetic coil configured to generate a magnetic field for at least balancing the floating device. The controller may be configured to control the magnetic field in order to adjust a balancing position of the floating device. In addition or alternatively, the controller may be configured to control an electromechanical unit of the system configured to alter a position of the electromagnetic coil, to adjust the balancing position. When being operated in the balancing position, the floating device may touch the base element or may levitate above the base element. The controller may be configured to alter a distance between the floating device and the base element, e.g. a minimal distance may be varied between at least <NUM> (or at least <NUM>) and at most <NUM> (or at most <NUM>).

Examples relate to a floating user interaction device, e.g. a multi-axis multi-sensory user interaction device (e.g. the floating device; e.g. a balance device that can be operated in a balanced position and/or a levitation device that can be operated in a levitating position).

Other interaction devices may be limited with respect to their operation functionalities. Proposed examples may enable a desirable and iconic element within the interior of a vehicle.

The element may have a jewel like shape and specific quality. Some technological components or mechanisms may be hidden from the view of the user, e.g. enabling a high quality user experience when touched and operated. Sensor technology (e.g. RGB cameras, IR cameras, Lidar, etc.), has progressed such that it may be possible to precisely monitor actions, interactions and behaviors of users and objects (e.g. the floating device) (e.g. the position, orientation, motion, state, events, proximity, touch, manipulation, gesture, etc.) between a user and the object. Also, computer processing technology has progressed which can enable the analysis of sensor data to further understand the state and intent of users, objects around them and the environment surrounding them, and, for example, to further adapt those objects and environments in response.

Compared to other concepts, the proposed floating device may have advantages especially in the context of vehicles. For example, the floating device applied to a vehicle may give distinctive opportunity to: e.g. multiple users (e.g. left vs. right passenger); e.g. controlled cabin environment for multi-sensory experience; e.g. to leverage vehicle data and sub-systems; e.g. requirements such as theft security and safety can be addressed with the control of magnetic sub-systems; e.g. an interactive and multi-sensory/multi-modal interface onboard the floating device may be provided, including: user control input via touch, gesture and manipulation and/or graphical display and/or illumination and/or audio speaker and/or microphone and/or haptic actuator.

Proposed concepts may provide an inside-out sensing approach: For example, onboard sensors e.g. IMU (inertial measurement unit, e.g. gyroscope, accelerometer, etc.) may provide precise information on the position, orientation and motion of the object (e.g. the floating device). Information on a combination of: the physical status of the object, user touch (e.g. moment of touch, touch and touch gesture sensing (e.g. like a touch-screen display) and/or the manipulation of the object by a user may be provided.

Proposed concepts may provide outside-in sensing provides approach: It may be possible to provide data redundancy with inside-out sensing approach to minimize errors and provide information that reveals user context, intent and informs machine learning aspects, for example. A camera based approach may sense: The status of the object, a manipulation of the object, and or a user context relative to the object. This may be achieved e.g. without touching the object - e.g. proximity and approach of the user, identification of the user (e.g. left or right passenger dependent on the approach angle, seat occupancy, etc.), by touch (e.g. without significant manipulation of the object) and/or by manipulation (e.g. moving the object).

Proposed examples may enable multisensory experiences by specifically choreographing multiple sensory inputs between users and their objects and environment (e.g. the overall cabin experience) across time. For example, using magnets and magnetic levitation, electro-magnetics and sensing technology in new ways to create dynamic sensations and multi-layered interactions (e.g. motion, haptic, force feedback, etc.) relative to an interactive artefact or element (e.g. jewel, object, floating device, etc.) that has many degrees of freedom (e.g. less constraints to conventional interaction devices).

In addition to providing merely aesthetical components, proposed examples provide devices that are dynamic and interactive at the same time (e.g. from user experience, user interaction, symbolic, etc. points of view). Proposed concepts may enable premium user devices for improved usability, for example.

Proposed concepts may be used for delivering a sensation to the user via the object (e.g. the floating device <NUM>) - e.g. by engaging the senses of the user (e.g. seeing, hearing, touching, motion (proprioception), temperature, etc.). Controlling magnetic balancing and/or levitation may be provided. For example, it may be possible to raise and lower the floating device <NUM> (object) (e.g. not just suspend/float an object in a static position), control the motion (e.g. <NUM>-dimensional position (XYZ axes), linear and/or rotational) of the floating device. Concepts may include controlling magnetic feedback. When the user touches, engages or interacts with the object, the user may receive a haptic sensation magnetically from the object (e.g. resistance, force feedback, virtual haptic (e.g. simulating a real life interaction, such as the pop of a button, or the detent of a mechanical element indexing when it is moved, etc.), vibration, motion, etc.), for example.

Concepts may include the possibility of sensing the object. It may be possible using both inside-out sensing (e.g. a sensor onboard the object such as an IMU) and/or outside-in sensing (e.g. a RGB or IR camera, radar, LIDAR, etc.). The system may enable sensing the user, e.g. by using sensor technologies (e.g. a RGB or IR camera, radar, LIDAR, etc.) to detect the user <NUM> (e.g. fingers, hand, arm, etc.) relative to the object. Further, proposed concepts may include analyzing (e.g. by combining the sensor data of the object and the user) and/or directly sensing the users interaction with the object (e.g. proximity, gesture, touch, manipulation (e.g. direct finger/hand manipulation of the object, such as touching, pushing/pulling, lifting, rotating, sliding) etc.).

Examples relate to a multisensory object (e.g. floating device <NUM>) - e.g. providing lighting/illumination, ambient GUI (abstract/ambient display/GUI), interactive GUI (conventional pixel based GUI), sound, motion and haptic, thermal, etc. For example, multisensory integration with the vehicle systems (e.g. infotainment, entertainment, climate control, experience modes, driving modes, ambient lighting, seat and massage systems, window shades, scent dispenser, etc.) may be achieved. For example, integration with multi-modal interaction systems - e.g. Intelligent Personal System (IPA), voice, eye gaze/tracking, gesture, etc. may be achieved.

Examples relate to controlling a user interface of the vehicle (e.g. controlling a GUI (graphical user interface)/HMI (human machine interface)), features or functionality. The features/functions may be static or dynamic GUI elements depending on the context of the interaction, for example. Features may relate to conventional features (e.g. infotainment, climate control, vehicle modes, etc.) and novel features (e.g. sensory experiences, scent based experience, well-ness experiences, etc.). Electromagnetic levitation and motion control of the object (e.g. floating device) may be enabled. Sensing the object (e.g. floating device), e.g. position, motion, etc. may be enabled. Sensing the user - e.g. sensing touch, proximity, manipulation, user state, eye gaze, face recognition, emotion recognition (affective computing), biometrics, bio-signals, etc. may be enabled. Sensing the state of the car <NUM> and/or analyzing vehicle data (e.g. <NUM>-dimensional motion (e.g. XYZ directions, cornering/turning, vibration, bumps, etc.), acceleration/deceleration, parked/static, forwards/reverse, etc.) may be enabled. Analyzing the combined data to determine the interaction between the user and the object may be possible. A feedback loop may be generated between the user and the object such that interactions between the user and the object are bidirectional (e.g. when the object is pushed by the user, the object can push back, depending on the context of the GUI function/feature), for example.

An example relates to an electromagnetic device to raise and lower an object (e.g. variable levitation) via controlled electromagnetic and/or electromechanical configuration/mechanism. Therefore, an electromagnetic approach may be supplemented or enhanced by an electromechanical actuator that moves the electromagnetic assembly, and/or the electromechanical motion may provide a greater distance of motion (e.g. compared to electromechanical).

The electromechanical motion may be in multiple axes, e.g. to move the object also backwards and forwards, e.g. in the cabin of a vehicle, and/or towards or away from the user(s), depending on the seating position/configuration (e.g. reclined or lay-flat seat position), for example.

Proposed concepts may enable to control the <NUM>-dimensional position (linear and angular position, XYZ axes), and to provide a haptic feedback sensation when manipulated by the user (e.g. resistance, force, virtual haptic (e.g. sensation that feels physical, <NUM>-dimensional, geometric, etc.), for example. The object may comprise multi-modal components - e.g. OLED touchscreen display, LED lighting, haptic actuator, sound, IMU (inertial measurement unit). The floating device <NUM> may be battery powered and/or wireless charged. The floating device <NUM> may have optical properties (e.g. opaque, transparent, semi-transparent, etc.). The object(s) (floating devices <NUM>) may be interchangeable, replaceable, swappable, there may be more than one object (e.g. within one system <NUM>), such that different floating devices <NUM> may activate different features/functionality or belong to different users (e.g. in a way similar to a wireless key or digital token).

The floating device <NUM> may provide a multisensory experience, e.g. enabled by: an OLED display, and/or touchscreen display, LEDs, audio speaker, haptic actuator, thermal device, etc. The floating device <NUM> may have onboard (inside-out) sensors that may allow the system to sense touch, proximity, manipulation, user state, eye gaze, etc. (e.g. capacitive or piezo touch surfaces, IMU to detect motion/acceleration, biometric/bio signal sensors (e.g. similar to those found on a smartwatch, e.g. optical sensors, ECG, GSR, etc.). The behavior of the floating device <NUM> may be coordinated with the electromagnetic (and/or electromechanical) functionality. The floating device <NUM> may be powered by a battery and/or be a wireless connection and/or wired connection (e.g. conductive electrical contacts).

Aspects relate to a user Experience / user Interaction that can be provided. The interaction with and around the floating device <NUM> may affect: a user interface (HMI/GUI) on the floating device <NUM> itself (e.g. an OLED display and/or touchscreen, LEDs, etc.); a HMI/GUI in the vehicle - e.g. integrated with typical vehicle systems; e.g. the interaction may control features such as: Infotainment, entertainment, climate control, experience modes, sensory modes, etc.; an HMI/GUI that is provided in addition to the standard HMI/GUI (e.g. of the vehicle) (i.e. the floating device <NUM> may unlock/enable optional, additional and/or customized (e.g. premium class) features that are not available on a standard vehicle, for example). Direct manipulation (e.g. touch, push/pull, turn/twist, tilt, etc.) of the floating device <NUM> may provide a user input to the user interface (e.g. GUI of the vehicle that comprises a display and/or VR (virtual reality) and/or AR (augmented reality) and/or digital projection based).

Interactions (e.g. proximity, hand gesture, eye gaze, face recognition, emotion recognition (affective computing), biometrics, biosignals, etc.) in the space surrounding the floating device <NUM> (but not necessarily touching the floating device <NUM>) may provide a contextual interaction space depending on the state/mode of the GUI (e.g. display, projection, VR, AR, MR, etc.), for example. Interactions in the space and surrounding the floating device <NUM> and with the floating device <NUM> itself may be combined to create a continuous interaction (e.g. depending on the mode of the GUI, the users hand moving towards the floating device <NUM>, touching the floating device <NUM> and pushing/pulling the floating device <NUM> might be recognized as a single or continuous gesture/interaction). The GUI interaction model may include a digital representation (e.g. photorealistic, abstract, artistic, etc.) of the object(s) and may be based on a physical interaction mental model that represents the real life degrees of freedom of the object(s), for example.

A proposed system may have dedicated sensors, e.g. external sensors (outside-in) that may be positioned in the vehicle (e.g. above, below, to the side of the floating device <NUM> and/or user) to monitor the user and/or floating device <NUM>; e.g. a fusion of one or more sensor technologies (e.g. a RGB or IR camera, radar, LIDAR, magnetic sensor (e.g. hall effect), etc.); e.g. a fusion of external (outside-in) sensors and sensors mounted in the floating device <NUM> (e.g. sensors such as an IMU, capacitive touch, biometric, bio signal, etc.), for example.

The system <NUM> may be integrated with the vehicle <NUM> in a number of ways. It may be used to leverage vehicle data such as motion (e.g. forwards, reverse), driving mode, acceleration/deceleration, braking, cornering/turning, steering wheel <NUM> movement, vehicle direction, etc., for example. Vehicle data may be provided directly from the vehicle and/or crowd sourced from multiple vehicles (e.g. predicting vehicle dynamics relative to the road/map). Vehicle data may be used to control the motion and/or behavior of the system <NUM> (e.g. to compensate for vehicle motion and maintain the balance or stability of the floating device <NUM> when it is floating, raise/lower the floating device <NUM> depending on the speed of the vehicle, raise and lower the floating device <NUM> when the vehicle is locked/unlocked and/or when the door is open/closed, etc.), for example. The system <NUM> may function (e.g. respond, interact, display, feedback, etc.) in coordination with and/or control various vehicle functions and features - such as infotainment, entertainment, climate control, seat functionality, driving modes, experience modes, scent modes, etc., for example. The system <NUM> may function as a physical interaction point for physically interacting with an Intelligent Personal Assistant (IPA), for example, and as part of multi-modal interactions with the vehicle <NUM> (e.g. voice, touch, gaze, etc.), for example. The system <NUM> may leverage vehicle sensors that exist in the vehicle <NUM> for other purposes (e.g. microphone, light sensor, eye tracking, cameras (e.g. RGB, IR, etc.), for example. The system <NUM> may leverage existing systems such as ambient lighting, audio, displays, digital projectors, window shades, seating system, seat massage system, scent dispenser, etc., for example.

The multimodal interaction device (floating device <NUM>) may be used in a vehicle <NUM>, for example. Proposed concepts may be used generally in interactive products and devices (e.g. consumer products, entertainment products, etc.).

Functions of various elements shown in the figures, including any functional blocks labeled as "means", "means for providing a signal", "means for generating a signal. ", etc., may be implemented in the form of dedicated hardware, such as "a signal provider", "a signal processing unit", "a processor", "a controller", etc. as well as hardware capable of executing software in association with appropriate software. When provided by a processor, the functions may be provided by a single dedicated processor, by a single shared processor, or by a plurality of individual processors, some of which or all of which may be shared. However, the term "processor" or "controller" is by far not limited to hardware exclusively capable of executing software, but may include digital signal processor (DSP) hardware, network processor, application specific integrated circuit (ASIC), field programmable gate array (FPGA), read only memory (ROM) for storing software, random access memory (RAM), and nonvolatile storage.

It is to be understood that the disclosure of multiple acts, processes, operations, steps or functions disclosed in the specification or claims may not be construed as to be within the specific order, unless explicitly or implicitly stated otherwise, for instance for technical reasons. Therefore, the disclosure of multiple acts or functions will not limit these to a particular order unless such acts or functions are not interchangeable for technical reasons. Furthermore, in some examples a single act, function, process, operation or step may include or may be broken into multiple sub-acts, -functions, -processes, -operations or -steps, respectively. Such sub acts may be included and part of the disclosure of this single act unless explicitly excluded.

Claim 1:
A system (<NUM>) comprising:
a floating device (<NUM>) which is configured as at least one of an input device or an output device for a user interface;
a base element (<NUM>) for the floating device (<NUM>); and
a magnetic system,
wherein the system (<NUM>) is configured to maintain the floating device (<NUM>) in a balanced position above the base element (<NUM>) in a first operational mode, and
wherein the system (<NUM>) is configured to locate the floating device (<NUM>) in a docking position on a top side of the base element (<NUM>) in a second operational mode,
wherein locating the floating device (<NUM>) in the docking position comprises exerting a force on the floating device (<NUM>) so that it can be kept located in the docking position,
wherein the system (<NUM>) further comprises a fixing means configured for retaining or fixing the floating device (<NUM>) to the base element (<NUM>) in the docking position, wherein the fixing means comprises at least one of a mechanical fixing means having a mechanical click mechanism, and an electromechanical system,
wherein the magnetic system is configured to pull the floating device (<NUM>) from the balanced position into the docking position where it interacts with the mechanical click mechanism so that the floating device (<NUM>) can be fixed in the docking position.