Terminal and storage medium

A portable terminal for controlling an apparatus includes: a display with a touchscreen; a vibrator that is configured to perform a vibration action of vibrating at least an operation surface of the touchscreen; and a hardware processor that determines whether or not the terminal is in a placed state of being placed on an object and causes the vibrator to perform the vibration action in response to a touch operation on the operation surface. When the terminal is in the placed state, the hardware processor causes the vibrator to perform the vibration action at first vibration intensity. When the terminal is not in the placed state, the hardware processor causes the vibrator to perform the vibration action at second vibration intensity that is lower than the first vibration intensity.

CROSS-REFERENCE TO RELATED APPLICATIONS

The entire disclosure of Japanese Patent Application No. 2020-119608 filed on Jul. 13, 2020 is incorporated herein by reference in its entirety.

TECHNICAL FIELD

The present disclosure relates to a terminal and a storage medium.

BACKGROUND

A stationary image forming apparatus, such as a multifunctional peripheral, may include a terminal that is detachable from the main body of the apparatus and that sends a control signal to the apparatus for operating the apparatus in response to receiving an input operation. A common type of such a terminal has a display for displaying the operation window and detects a touch operation made on the operation surface of the touchscreen of the display as an input operation. Further, according to JP2017-130030A, a terminal includes a vibrator that vibrates the terminal in response to a touch operation received on the operation surface (vibration response).

SUMMARY

However, the terminal may be in various states when receiving the touch operation. For example, the terminal may be mounted on the main body of the apparatus or may be held in the hand of a user (operator). Depending on the state of the terminal, the user may touch different parts of the terminal for different periods of time and may not perceive a vibration response. More specifically, depending on the state of the terminal, the vibration response may be too week to feel or may be too strong and annoying.

The known art has not taken into account whether or not the vibration response is perceivable to the user, and therefore may not provide an appropriate vibration response to the user.

Objects of the present invention include providing a terminal and a storage medium storing a program that can give more appropriate vibration responses to the user.

To achieve at least one of the abovementioned objects, according to an aspect of the present invention, there is provided a portable terminal for controlling an apparatus, including: a display with a touchscreen; a vibrator that is configured to perform a vibration action of vibrating at least an operation surface of the touchscreen; and a hardware processor that determines whether or not the terminal is in a placed state of being placed on an object and causes the vibrator to perform the vibration action in response to a touch operation on the operation surface, wherein when the terminal is in the placed state, the hardware processor causes the vibrator to perform the vibration action at first vibration intensity, and when the terminal is not in the placed state, the hardware processor causes the vibrator to perform the vibration action at second vibration intensity that is lower than the first vibration intensity.

According to another aspect of the present invention, there is provided a portable terminal for controlling an apparatus, including: a display with a touchscreen; a vibrator that is configured to perform a vibration action of vibrating at least an operation surface of the touchscreen; and a hardware processor that controls the vibration action of the vibrator, determines whether or not the terminal is in a placed state of being placed on an object, makes a prediction on whether a touch operation is to be performed on the operation surface by detecting an operation tool approaching the operation surface within a certain distance, and detects the touch operation performed on the operation surface with the operation tool, wherein when the terminal is in the placed state, the hardware processor causes the vibrator to start the vibration action in response to predicting the touch operation, and when the terminal is not in the placed state, the hardware processor causes the vibrator to start the vibration action in response to detecting the touch operation.

According to another aspect of the present invention, there is provided a portable terminal for controlling an apparatus, including: a display with a touchscreen; a first vibrator that is configured to perform a first vibration action of vibrating an operation surface of the touchscreen; a second vibrator that is configured to perform a second vibration action of vibrating a surface of the terminal opposite the operation surface; and a hardware processor that controls the first vibration action by the first vibrator and the second vibration action by the second vibrator and determines whether or not the terminal is in a placed state of being placed on an object, wherein when the terminal is in the placed state, the hardware processor causes the first vibrator to perform the first vibration action in response to a touch operation on the operation surface, and when the terminal is not in the placed state, the hardware processor causes the second vibrator to perform the second vibration action in response to the touch operation on the operation surface.

According to another aspect of the present invention, there is provided a non-transitory computer-readable storage medium storing a program that causes a computer of a portable terminal, the terminal being for controlling an apparatus and including a display with a touchscreen and a vibrator that is configured to perform a vibration action of vibrating at least an operation surface of the touchscreen, to function as a hardware processor that: determines whether or not the terminal is in a placed state of being placed on an object; and causes the vibrator to perform the vibration action in response to a touch operation on the operation surface, wherein when the terminal is in the placed state, the hardware processor causes the vibrator to perform the vibration action at first vibration intensity, and when the terminal is not in the placed state, the hardware processor causes the vibrator to perform the vibration action at second vibration intensity that is lower than the first vibration intensity.

According to another aspect of the present invention, there is provided a non-transitory computer-readable storage medium storing a program that causes a computer of a portable terminal, the terminal being for controlling an apparatus and including a display with a touchscreen and a vibrator that is configured to perform a vibration action of vibrating at least an operation surface of the touchscreen, to function as a hardware processor that: controls the vibration action of the vibrator; determines whether or not the terminal is in a placed state of being placed on an object; makes a prediction on whether a touch operation is to be performed on the operation surface by detecting an operation tool approaching the operation surface within a certain distance; and detects the touch operation performed on the operation surface with the operation tool, wherein when the terminal is in the placed state, the hardware processor causes the vibrator to start the vibration action in response to predicting the touch operation, and when the terminal is not in the placed state, the hardware processor causes the vibrator to start the vibration action in response to detecting the touch operation.

According to another aspect of the present invention, there is provided a non-transitory computer-readable storage medium storing a program that causes a computer of a portable terminal, the terminal being for controlling an apparatus and including: a display with a touchscreen; a first vibrator that is configured to perform a first vibration action of vibrating an operation surface of the touchscreen; and a second vibrator that is configured to perform a second vibration action of vibrating a surface of the terminal opposite the operation surface, to function as a hardware processor that: controls the first vibration action by the first vibrator and the second vibration action by the second vibrator; and determines whether or not the terminal is in a placed state of being placed on an object, wherein when the terminal is in the placed state, the hardware processor causes the first vibrator to perform the first vibration action in response to a touch operation on the operation surface, and when the terminal is not in the placed state, the hardware processor causes the second vibrator to perform the second vibration action in response to the touch operation on the operation surface.

DETAILED DESCRIPTION OF THE EMBODIMENTS

Hereinafter, an embodiment of the present invention is described with reference to the drawings. However, the scope of the present invention is not limited to the disclosed embodiment.

First Embodiment

FIG. 1is a schematic configuration of an image forming apparatus1in a first embodiment.

The image forming apparatus1in this embodiment is an electrophotographic multifunctional apparatus that forms color images. The image forming apparatus1has functions as a scanner, a color copier, and a laser printer.

As shown inFIG. 1, the image forming apparatus1includes a main body200and a terminal100that is attachable to and detachable from the main body200.

The main body200includes: a housing200a; a main-body controller10and an image former20housed in the housing200a; a scanner30; an auto document feeder (ADF)40; a cradle part50on which the terminal100is placed and mounted and that is provided outside the housing200a; a sheet receiver60that is exposed outside the housing200aunder the scanner30; and a sheet feeder70that can be opened to the front of the housing200aand closed.

FIG. 2is a configuration of the image former20.

The image former20forms images on a sheet of paper fed by the sheet feeder70and ejects the sheet to the sheet receiver60under the control of the main-body controller10.

The image former20includes: image carriers21each of which is a drum-type photoconductor that carries an electrostatic latent image(s) on its surface; cleaners22each of which removes residual toner on the surface of the corresponding image carrier21; charging rollers23each of which uniformly charges the surface of the corresponding image carrier21; exposing units24each of which forms the electrostatic latent image by exposing the surface of the charged corresponding image carrier21; developing units25each of which develops the electrostatic latent image and forms a toner image on the surface of the corresponding image carrier21by using a developer containing toner; a transfer unit26that transfers the formed toner images onto an intermediate transfer belt261in the transferring region as the first transfer and that transfers the YMCK toner image on the intermediate transfer belt261onto a sheet as the second transfer; a fixing unit27that fixes the YMCK toner image to the sheet; and conveying rollers28that convey the sheet on a conveying path from the sheet feeder70to the sheet receiver60. Among the above components, the image carrier21, the cleaner22, the charging roller23, the exposing unit24, and the developing unit25constitutes an imaging unit.

The image former20has four imaging units for colors of yellow (Y), magenta (M), cyan (C), and black (K). The imaging units are arranged in the order of Y, M, C, and K along the bottom plane surface of the intermediate transfer belt261. In each of the imaging units, the cleaner22, the charging roller23, the exposing unit24, and the developing unit25are arranged in this order along the outer circumferential surface of the image carrier21.

The image carrier21rotates on an axis. The image carrier21has a photosensitive layer on its outer circumferential surface.

The cleaner22has a plate-shaped cleaning blade formed of an elastic material. The cleaner22causes the cleaning blade to abut the surface of the image carrier21, so that foreign substances on the surface of the image carrier21, such as residual toner that has not been transferred to the intermediate transfer belt261, are removed.

The charging roller23is a cylindrical member. The charging roller23abuts the surface of the image carrier21and rotates on an axis in accordance with the rotation of the image carrier21. The charging roller23receives charge-driving voltage from a not-shown power source to uniformly charge the surface of the image carrier21.

The exposing unit24includes a laser diode (LD) as a light-emitting element. The exposing unit24irradiates, with laser light, the surface of the image carrier21charged by the charging roller23to form an electrostatic latent image on the image carrier21.

The developing unit25includes a developing sleeve (developing roller) that faces the surface of the image carrier21. The developing unit25supplies a developer containing toner, which is supplied from a not-shown toner bottle, to the surface of the developing sleeve that has a certain developing-bias potential, so that the toner in the developer on the surface of the developing sleeve is adhered to the electrostatic latent image on the surface of the image carrier21. The developing unit25thus forms a toner image on the surface of the image carrier21.

The transfer unit26includes: two belt-conveying rollers262; four first transfer rollers263positioned so as to face the respective image carriers21; the intermediate transfer belt261stretched around the belt-conveying rollers262and the first transfer rollers263; a belt cleaner264that removes residual toner on the intermediate transfer belt261; and a second transfer roller265that is pressed against one of the belt-conveying rollers262and that is driven to rotate as the belt-conveying roller262rotates.

The transfer unit26transfers toner on the surface of the rotating image carriers21onto the intermediate transfer belt261by rotally moving the intermediate transfer belt261while applying, to the first transfer rollers263, bias voltage having a polarity reverse to the polarity of the toner. After transferring the Y, M, C, and K toner images such that the toner images are superposed on one another on the intermediate transfer belt261, the transfer unit26transfers the YMCK color toner image from the intermediate transfer belt261onto the sheet that passes through between the intermediate transfer belt261and the second transfer roller265to which predetermined bias voltage is applied. The residual toner on the intermediate transfer belt261that has not been transferred onto the sheet is removed by the cleaning blade of the belt cleaner264.

The fixing unit27heats and pressurizes the sheet on which the YMCK toner image has been transferred to fix the toner image to the sheet. The fixing unit27includes a pair of rollers constituted of a heating roller and a pressurizing roller to hold the sheet. The sheet to which the toner image has been fixed is conveyed by the conveying rollers28to the sheet receiver60.

The scanner30includes; a platen glass31that has a placing surface on which a sheet is placed; an optical system that includes, for example, a light source and a reflective mirror to irradiate the sheet on the platen glass31; and an imaging element that detects the light emitted by the optical system and reflected by the sheet. The scanner30reads an image on the sheet placed on the platen glass31, generates bitmapped image data for the respective colors of red (R), green (G), and blue (B), and stores the data in the storage13shown inFIG. 6under the control of the main-body controller10.

The ADF40is provided above the scanner30. The ADF40includes a conveying mechanism that conveys manually-fed sheets one by one so that the scanner30scans the sheets. The ADF40is movable by the user within its movable range between the state of covering the platen glass31and the state of exposing the platen glass31.

The cradle part50shown inFIG. 1is a cradle on which the terminal100is placed and mounted. The cradle part50has a placing surface51that supports the back of the terminal100and a supporter52that supports the bottom edge surface of the terminal100. The supporter52is provided with a connecting terminal for exchanging signals with the terminal100and for supplying power to the terminal100. When the terminal100is placed and mounted on the supporter52, the connecting terminal of the terminal100is electrically connected to the connecting terminal of the supporter52.

The sheet receiver60is provided under the scanner30and exposed to the outside of the housing200a. The sheets on which images have been formed by the image former20are ejected to the sheet receiver60such that the user can take the sheets.

The sheet feeder70can be opened by being pulled towards the front of the housing200aand can be closed. The sheet feeder70stores sheets on which images are to be formed.

The terminal100is a portable operation terminal for operating the main body200. The terminal100includes a controller110shown inFIG. 5(hardware processor, computer) that is separate from the main-body controller10of the main body200and that controls the operation of the terminal100. The terminal100functions as the operation display unit140of the main body200both in the placed state of being placed on the cradle part50of the main body200and in the held state of being detached from the cradle part50and held by the user. In the placed state on the cradle part50, the terminal100operates with power supplied via the connecting terminal of the supporter52. When detached from the cradle part50, the terminal100operates with power of the built-in battery.

The terminal100includes the operation display unit140(display) that has a touchscreen. The terminal100displays, on the operation display unit140, an operation window for receiving input operations for operating the main body200, a status window for showing the status of the main body200, and so forth. The operation window shows, for example, operation buttons on which touching operations are performed via the touchscreen. When the touchscreen detects a touch operation within a range of any of the operation buttons shown on the operation display unit140, the controller110determines that an input operation of selecting the operation button is performed and sends, to the main body200, a control signal to cause the main body200to perform a process associated with the operation button. When the terminal100is placed on the cradle part50, the control signal is sent via the connecting terminal of the supporter52. When the terminal100is detached from the cradle part50, the control signal is sent over a wireless communication, such as Bluetooth (registered trademark).

FIG. 3is the sectional view of the configuration of the terminal100.

The terminal100includes the operation display unit140; an operation surface vibrator150(vibrator, first vibrator); an inertial sensor120; a vibration absorber171; a back casing172; and a lateral casing173.

The operation display unit140includes a display panel141and a touchscreen143.

The display panel141may be, for example, a liquid crystal display but is not limited thereto. The display panel141may be other types of display, such as an organic electroluminescent display. The display panel141is driven by a display-screen driver142inFIG. 5to display the operation window, the status window, and so forth under the control of the controller110.

The touchscreen143is superimposed on and combined with the display panel141. The touchscreen143has an operation surface143athat is laid on the display region of the display panel141. The touchscreen143detects a touch of an operating tool (e.g., the user's finger or a stylus) on the operation surface143aand the touched position. In this embodiment, the touchscreen143detects the position touched by the operating tool on the basis of change in capacitance of the touchscreen143.

FIG. 4is a sectional view of a detailed configuration of the operation display unit140.

The touchscreen143includes: a glass substrate1431placed on the display panel141; an electrode pattern layer1432placed on the glass substrate1431; and a protective cover1433placed on the electrode pattern layer1432. The surface of the protective cover1433constitutes the operation surface143a.

The electrode pattern cover1432has the first layer, the second layer, and the insulative layer. In the first layer, first electrode wirings are arranged so as to extend in a first direction. In the second layer, second electrode wirings are arranged so as to extend in a second direction orthogonal to the first direction. The insulative layer is provided between the first and second layers. The first electrode wirings have transparent rectangular electrodes that are connected in the first direction, and the second electrode wirings have transparent rectangular electrodes that are connected in the second direction, for example.

When a finger approaches the operation surface143a, the finger and part of the electrodes are capacitively coupled and generate an electric field E. According to the intensity of the electric field E, the capacitance between the electrodes changes. According to the change in capacitance, current flows through part of the first electrodes and part of the second electrodes. By calculating the ratio of current flowing through part of the first and second electrodes, the position (coordinate in the display region) touched with the finger can be identified.

Referring back toFIG. 3, the operation-surface vibrator150has vibration elements151that convert electric signals into physical vibration. Each of the vibration elements151is placed on the touchscreen143-side surface of the display panel141so as not to overlap the display region of the display panel141. InFIG. 3, one vibration element151is placed at each side of the display region of the display panel141as an example. The number and the position of vibration elements151are not limited to these shown inFIG. 3. For example, the vibration elements151may be placed on the side opposite the touchscreen143of the display panel141(back surface of the display panel141).

The vibration elements151are vibrated by the vibration driver152shown inFIG. 5under the control of the controller110. The vibration of the vibration elements151is transmitted to the operation surface143avia the touchscreen143. When the use's finger (operating tool) touches the operation surface143athat is receiving the vibration, the user feels the vibration as the vibration response from the operation display unit140. The operation-surface vibrator150including the vibration elements151thus performs the vibration action of vibrating the operation surface143aof the touchscreen143.

The inertial sensor120includes: an acceleration sensor that detects the acceleration of the terminal100; and a gyro sensor that detects the angular velocity of the rotation of the terminal100. The inertial sensor120outputs the result of detecting the acceleration and the angular velocity to the controller110. On the basis of the detection result, the controller110determines whether the terminal100is placed on a stationary place (for example, the cradle part50) or is held and operated in the hand of the user.

The vibration absorber171is placed between the back surface of the display panel141of the operation display unit140and the back casing172. The vibration absorber171is a damper that absorbs the vibration of the display panel141that is generated by the vibration action of the operation-surface vibrator150. The vibration transmitting path from the back surface of the display panel141to the back casing172is set so as to pass through the vibration absorber171. This allows the vibration absorber171to efficiently prevent the vibration of the display panel141from being transmitted to the back casing172. Thus, when the terminal100is placed on an object, the vibration absorber171absorbs the vibration transmitted from the operation-surface vibrator150towards the place via the back casing172. The vibration absorber171may not completely absorb the vibration transmitted from the operation-surface vibrator150towards the place but may absorb at least part of the vibration. The material of the vibration absorber171is not limited to a specific material but may be an elastic resin, for example.

The back casing172is a box-shaped member that houses the controller110, the inertial sensor120, the display-panel driver142, the touchscreen driver144, and circuit elements constituting the vibration driver152. The internal configuration of the back casing172is not shown inFIG. 3.

The lateral casing173is a plate-shaped member that covers the lateral sides of the display panel141, the touchscreen143, and the back casing172. The lateral sides of the display panel141and the touchscreen143are fixed to the lateral casing173. The lateral casing173has an opening part for exposing the operation surface143aof the touchscreen143to the outside. Through the opening part, the user can perform the touch operation on the exposed operation surface143a. The lateral casing173also receives the vibration of the vibration elements151of the operation-surface vibrator150via the display panel141and the touchscreen143. Therefore, when the user detaches the terminal100from the cradle part50and holds it in his/her hand, the user can feel the vibration of the vibration elements151via the lateral casing173as well as via the operation surface143a. InFIG. 3, space is present between the lateral casing173and the back casing172. The space may be filled with the vibration absorber171.

FIG. 5is a block diagram showing main functional components of the terminal100.

The terminal100includes the controller110, the inertial sensor120, the communication unit130, the operation display unit140, the operation-surface vibrator150, and a bus180. The operation display unit140includes the display panel141, the display-panel driver142, the touchscreen143, and the touchscreen driver144. The operation-surface vibrator150includes the vibration elements151and the vibration driver152. The components of the terminal100are connected via the bus180. The components that have already been described are not described below.

The controller110includes a central processing unit (CPU)111, a random access memory (RAM)112, and a storage113. The CPU111of the controller110executes the programs113astored in the storage113to perform various processes, so that the controller110functions as a vibration control unit, a state determination unit, a touch-operation prediction unit, and a touch-operation detection unit.

The CPU111reads and executes the programs113astored in the storage113to perform various arithmetic processes.

The RAM112provides a working memory space for the CPU111and stores temporal data.

The storage113consists of a nonvolatile storage, such as a hard disk drive (HDD), a solid state drive (SSD), and/or a flash memory. The storage113stores the programs113ato be performed by the CPU111and various kinds of data.

The controller110, which includes the CPU111, the RAM112, and the storage113, centrally controls the components of the terminal100in accordance with the programs113a.

For example, the controller110sends a control signal to the display-panel driver142to cause the display panel141to display the operation window and the status window.

Further, the controller110sends a control signal to the touchscreen driver144and receives a detection signal from the touchscreen driver144to detect the touch on the operation surface143aof the touchscreen143with the operating tool and the touched position.

Further, the controller110sends a control signal to the vibration driver152to cause the vibration elements151to vibrate at an appropriate timing, intensity and vibration pattern.

The communication unit130is a communication module that includes an antenna, a modulation and demodulation circuit, and a signal processing circuit. The communication unit130wirelessly sends and receives data to and from the communication unit80of the main body200in accordance with a wireless communication protocol, such as Bluetooth.

FIG. 6is a block diagram showing main functional components of the main body200.

The main body200includes the main-body controller10, the image former20, the scanner30, the ADF40, the communication unit80, and a bus90. The components of the main body200are connected via the bus90. The components that have already been described are not described below.

The main-body controller10includes a CPU11, a RAM12, and a storage13.

The CPU11reads and executes programs13astored in the storage13to perform various arithmetic processes.

The RAM12provides a working memory space for the CPU11and stores temporal data.

The storage13consists of a nonvolatile storage, such as a HDD, a SSD, and/or a flash memory. The storage13stores the programs13ato be performed by the CPU11and various kinds of data. The kinds of data to be stored in the storage13include image data obtained by the scanner30and image data input from outside via the communication unit80.

The controller10, which includes the CPU11, the RAM12, and the storage13, centrally controls the components of the main body200in accordance with the programs13a. For example, the controller10causes the components of the main body200to perform the operation corresponding to an input operation received by the terminal100in accordance with a control signal sent from the terminal100and received via the communication unit80.

The communication unit80consists of a network card, a communication module, and/or the like. The communication unit80is connected to a communication network, such as a local area network (LAN) to send and receive data to and from external apparatuses over the network. The communication unit80wirelessly sends and receives data to and from the communication unit130of the terminal100in accordance with the wireless communication protocol, such as Bluetooth.

Next, the operation of the image forming apparatus1is described. The description is mainly on the reception of an input operation with the terminal100.

The operation display unit140of the terminal100in this embodiment receives a touch operation on the operation surface143aof the touchscreen143by the user as an input operation. The operation display unit140converts the input operation into an operation signal and outputs the operation signal to the controller110. The operation display unit140also sends a notification to the user in response to the received input operation by causing the operation-surface vibrator150to perform a vibration action (vibration response). More specifically, in response to the touch operation on the operation surface143abeing detected, the operation-surface vibrator150vibrates the vibration elements151. The vibration of the vibration elements151vibrates the operation surface143aand the lateral casing173. The vibration of the operation surface143aand the lateral casing173is received by the user as the vibration response.

When the touch operation is performed on the terminal100placed on an object (placed state), the vibration of the operation surface143ais transmitted to the finger of the user touching the operation surface143a. The placed state may be a state in which the terminal100is placed on the cradle part50of the main body200or may be a state in which the terminal100is detached from the cradle part50and placed on a stationary place, such as a table. The object may not be stationary and may be, for example, a table set inside a moving vehicle. Examples of the object, however, do not include parts of the user's body (e.g., hand).

When the terminal100is in a state other than the placed state, namely in the non-placed state, the terminal100is operated in the hand of the user. The state of the terminal100other than the placed state is therefore called the held state. When the touch operation is performed on the operation surface143aof the terminal100in the held state, the hand of the user is in contact with the lateral casing173as well as the operation surface143a. The user therefore receives the vibration of the lateral casing173with his/her finger as well as the vibration response with his/her finger.

The vibration response in the placed state is transmitted only to the user's finger and is therefore less perceivable than the vibration response in the held state, which is transmitted to the user's hand.

When the intensity of the vibration response is increased so that the vibration response in the placed state is more perceivable to the user's finger, the vibration may be too strong for the user's hand holding the lateral casing173.

Vibrating the vibration elements151at uniform intensity therefore may not send an appropriate vibration response to the user.

To deal with the above issue, the controller110of the terminal100in this embodiment determines whether or not the terminal100is in the placed state, namely whether the terminal100is in the placed state or in the held state, and adjusts the vibration intensity of the operation-surface vibrator150according to the determination.

More specifically, when determining that the terminal100is in the placed state, the controller110causes the operation-surface vibrator150to perform the vibration action at first vibration intensity that can be felt by the finger. When determining that the terminal100is in the held state, the controller110causes the operation-surface vibrator150to perform the vibration action at second vibration intensity that is weaker than the first vibration intensity.

Accordingly, when the terminal100is in the placed state in which only the finger of the user is in contact with the terminal100, the terminal100performs vibration at appropriate and sufficient intensity so that the user easily feels the vibration. On the other hand, when the terminal100is in the held state in which both the finger and the hand of the user are in contact with the terminal100, the terminal100performs vibration at reduced intensity so as to avoid problems caused by too strong vibration and reduce power consumption by vibration.

FIG. 7shows the voltage waveform (first driving waveform) of the driving signal to be applied to the vibration elements151when the terminal100in the placed state performs the vibration action at the first vibration intensity.

FIG. 8shows the voltage waveform (second driving waveform) of the driving signal to be applied to the vibration elements151when the terminal100in the held state performs the vibration action at the second vibration intensity.

The first and second driving waveforms are both sine waves having the same frequency. The amplitude of the first driving waveform is greater than the amplitude of the second driving waveform with respect to the reference voltage. The maximum voltage to be applied with the first driving waveform is therefore greater than the maximum voltage to be applied with the second driving waveform. As the vibration intensity of the vibration elements151corresponds to the voltage of the applied driving waveform, the first vibration intensity driven with the first driving waveform inFIG. 7is greater than the second vibration intensity driven with the second driving waveform inFIG. 8.

Next, the vibration response process of the terminal100for performing the vibration response is described.

FIG. 9is a flowchart showing control steps of the vibration response process to be performed by the controller110in the first embodiment.

The vibration response process starts when the operation display unit140displays the operation window on the display panel141.

When the vibration response process starts, the controller110determines whether or not a touch operation on the operation surface of the touchscreen143is detected on the basis of the detection signal from the touchscreen driver144(Step S101). When determining that a touch operation is not detected (Step S101: NO), the controller110repeats Step S101.

When determining that a touch operation is detected (Step S101: YES), the controller110performs the state determination process to determine whether or not the terminal100is in the placed state (Step S102).

FIG. 10is a flowchart showing control steps of the state determination process by the controller110.

When the state determination process is called, the controller110determines whether or not the terminal100is placed on the cradle part50of the main body200(Step S201). Herein, the controller110determines that the terminal100is placed on the cradle part50when the terminal100is receiving power from the main body200via the connection terminal of the cradle part50. When determining that the terminal100is placed on the cradle part50(Step S201: YES), the controller110determines that the terminal100is in the placed state (Step S202).

When determining that the terminal100is not placed on the cradle part50(Step S201: NO), the controller110obtains an output signal from the inertial sensor120(Step S203). On the basis of the output signal, the controller110determines whether or not the terminal100is placed on a stationary place (i.e., placed at rest) (Step S204). Herein, the controller110determines that the terminal100is placed on a stationary place when the acceleration and/or the angular velocity detected by the inertial sensor120meet certain conditions. The conditions may be, for example, that the maximum value of the acceleration and/or the angular velocity during a certain period is smaller than a predetermined reference value. The reference value in the conditions is determined within the range of values smaller than the minimum value of the acceleration and/or the angular velocity that can be detected during a certain period when the terminal100is held and operated in the hand.

When determining that the terminal100is placed on a stationary place (Step S204: YES), the controller110determines that the terminal100is in the placed state (Step S202). When determining that the terminal100is not placed on a stationary place (Step S204: NO), the controller110determines that the terminal100is in the held state (Step S205).

After Step S202or S205, the controller110ends the state determination process and returns to the vibration response process.

After ending the vibration response process inFIG. 9(Step S102), when determining that the terminal100is in the placed state (Step S103: YES), the controller110sends a control signal to the vibration driver152to perform the vibration action at the first vibration intensity (Step S104). When determining that the terminal100is not in the placed state but in the held state (Step S103: NO), the controller110sends a control signal to the vibration driver152to perform the vibration action at the second vibration intensity that is weaker than the first vibration intensity (Step S105).

After Step S104or S105, the controller110ends the vibration response process.

In the above description, the controller110determines whether or not the terminal100is in the placed state by determining (i) whether or not the terminal100is placed on the cradle part50of the main body200and (ii) whether or not the terminal100is placed at rest on the basis of the output signal of the inertial sensor120. This is an example and not limitation.

For example, the controller110may determine whether or not the terminal100is in the placed state only by determining whether or not the terminal100is placed on the cradle part50. In the case, Steps S203and S204inFIG. 10may be omitted.

As another example, the controller110may determine whether or not the terminal100is in the placed state only by determining whether or not the terminal100is placed at rest on the basis of the output signal of the inertial sensor120. In the case, the controller110may first perform Step S203in the state determination process inFIG. 10without performing Step S201.

As described above, the terminal100in the first embodiment is a portable terminal for controlling the main body200. The terminal100includes: the operation display unit140with the touchscreen143; the operation-surface vibrator150that is configured to perform a vibration action of vibrating at least the operation surface143aof the touchscreen143; and the controller110. The controller110as the state determination unit determines whether or not the terminal100is in a placed state of being placed on an object. The controller110as the vibration control unit causes the operation-surface vibrator150to perform the vibration action in response to a touch operation on the operation surface143a. When the terminal100is in the placed state, the controller110causes the operation-surface vibrator150to perform the vibration action at first vibration intensity. When the terminal100is not in the placed state, the controller110causes the operation-surface vibrator150to perform the vibration action at second vibration intensity that is lower than the first vibration intensity.

According to this configuration, the terminal100in the placed state can perform the vibration response at appropriate intensity that can be felt with the finger on the operation surface143a. When in the held state in which the user's finger and hand are in contact with the terminal100, the terminal100can perform the vibration response at the second vibration intensity weaker than the first vibration intensity. The terminal100thus can avoid annoying the user with too strong vibration and reduce power consumption by vibration.

Further, the terminal100includes the vibration absorber171that absorbs vibration propagating from the operation-surface vibrator150towards the object on which the terminal100is placed. According to this configuration, the terminal100placed on the cradle part50can prevent vibration of the operation-surface vibrator150from being transmitted to the main body200. The terminal100thus can avoid affecting the operation of the main body200with the vibration of the operation-surface vibrator150, while adjusting the vibration intensity of the operation-surface driver150such that the user can easily feel the vibration. More specifically, the terminal100can avoid decreasing the quality of image data formed by the image former20or generated by the scanner30, while increasing the vibration intensity in the placed state.

Further, the controller110determines that the terminal100is in the placed state when the terminal100is placed on the cradle part50. According to this configuration, the terminal100placed on the cradle part50can perform the vibration response at sufficient intensity so that the user feels the vibration with his/her finger touching the operation surface143a.

Further, the controller110as the state determination unit determines that the terminal100is in the placed state in response to the terminal100receiving power from the main body200. According to this configuration, the controller110can easily and properly determine whether or not the terminal100is placed on the cradle part50.

Further, the terminal100includes the inertial sensor120, and the controller110as the state determination unit determines whether or not the terminal100is in the placed state based on an output of the inertial sensor120. According to this configuration, the terminal100placed on an object other than the cradle part50of the main body200, such as a table, can perform the vibration response the same way as the vibration response when placed on the cradle part50. When the terminal100is placed on an object other than the cradle part50, the user is not holding the terminal100but touching the terminal10only with his/her finger operating the operation surface143a. The terminal100placed on the object other than the cradle part50performs the vibration action the same way as when placed on the cradle part50. The terminal100thus can perform the vibration response at sufficient intensity so that the user can feel the vibration with the finger touching the operation surface143a.

Further, the program113ain the first embodiment causes the controller110(computer) of the terminal100to function as a hardware processor that: determines whether or not the terminal100is in a placed state of being placed on an object; and causes the operation-surface vibrator150to perform the vibration action in response to a touch operation on the operation surface143a, wherein when the terminal100is in the placed state, the hardware processor causes the operation-surface vibrator150to perform the vibration action at first vibration intensity, and when the terminal100is not in the placed state, the hardware processor causes the operation-surface vibrator150to perform the vibration action at second vibration intensity that is lower than the first vibration intensity.

According to such a program, the terminal100in the placed state can perform the vibration response at sufficient intensity so that the user can feel the vibration with his/her finger on the operation surface143a. Further, according to the program, the terminal100in the held state can avoid annoying the user with too strong vibration and can reduce power consumption by vibration.

Second Embodiment

Next, a second embodiment is described. The second embodiment is different from the first embodiment in that the terminal100predicts a touch operation and performs the vibration action according to the prediction. Hereinafter, aspects of the second embodiment that are different from the first embodiment are described.

When the terminal100is in the placed state, the terminal100has to start the vibration response before the user leaves his/her finger from the operation surface143a, or the user can not feel the vibration. A touch time during which the user's finger is in contact with the operation surface143adiffers from user to user. For a user with a short touch time, the terminal100may not start the vibration response before the touch time ends.

In this second embodiment, the terminal100predicts a touch operation by detecting approach of the finger to the operation surface143a. In response to predicting the touch operation, the terminal100starts the vibration action for the vibration response before the finger touches the operation surface143a.

With the capacitance-type touchscreen143, capacitance coupling between the finger and the electrodes of the touchscreen143occurs when the finger is close to but not in touch with the operation surface143aas well as when the finger is in contact with the operation surface143a. The touchscreen143can therefore detect the approach of the finger to the operation surface143aon the basis of changes in intensity of an electric field caused by capacitance coupling.

FIG. 11is a figure to explain how the touchscreen143detects the approach of the finger.

In the top part ofFIG. 11, three cases with different distances d between the finger and the operation surface143aare shown. In the left case, the finger is in touch with the operation surface143a, where d=0. In the center case, the finger is separate from the operation surface143aby the distance d1. In the right case, the finger is separate from the operation surface143aby the distance d2that is greater than d1.

The graph in the bottom part ofFIG. 11shows the relation between the distance d and the intensity of the electric field E formed between the finger and the electrodes. As shown in the graph, the electric field E is strongest when the finger is in touch with the operation surface143a, and becomes weaker as the distance d between the finger and the operation surface143ais longer.

The approach of the finger to the operation surface143awithin the detection distance range dn can be detected by determining the threshold th of the electric field E to be detected (i.e., change in current that corresponds to electric field E). For example, when the threshold th of the electric field E is set to th1inFIG. 6, the finger within the detection distance range d1to the operation surface143acan be detected.

Hereinafter, a series of steps for predicting the touch of the finger and performing the vibration action at the timing when the finger approaches the operation surface143within the detection distance range dn is called the predictive response process.

FIG. 12shows the first driving waveform in the predictive response process in the second embodiment. The first driving waveform shown inFIG. 12is used when the terminal100is in the placed state.

InFIG. 12, T1is the timing at which the finger is within the detection distance range dn to the operation surface143a, and T2is the timing at which the finger touches the operation surface143a. As shown inFIG. 12, at the timing T1at which the finger is within the detection distance range dn, the first driving waveform is applied to start the vibration action for the vibration response, so that the vibration action has already been started at the timing T2. Accordingly, the terminal100can send a proper vibration response to the user even in in the placed state, in which only the user's finger touches the operation surface143a. There may be a case where the terminal100cannot start vibration before the finger touches the operation surface143aowing to a time lag between detecting the approach of the finger and starting the vibration. The terminal100can still start vibration earlier than in the case of starting vibration after detecting the touch of the finger. The vibration is therefore more likely to be sent while the finger is in contact with the operation surface143a.

On the other hand, the terminal100in the held state does not perform the predictive response process but starts the vibration action for the vibration response in response to detecting the actual touch of the finger on the operation surface143a.

This is firstly because the user can feel the vibration with the hand holding the lateral casing173of the terminal100even if the vibration does not start while the finger is in contact with the operation surface143a.

Secondly, if the terminal100in the held state performs the predictive response process, the vibration response is started and transmitted to the user's hand holding the lateral casing173before the user's finger touches the operation surface143a. Such a too early vibration response may be strange to the user.

Thirdly, when the prediction is wrong, the hand holding the lateral casing173may receive an inappropriate vibration response. There may be a case where the touch operation is not actually performed although the terminal100predicts a touch operation and starts vibration. In the case, the user receives the vibration response via the lateral casing173even though he/she has not touched the operation surface143a. On the other hand, when the terminal100is in the placed state, the user does not receive such an inappropriate vibration response because the user is not holding the lateral casing173in his/her hand.

FIG. 13shows the second driving waveform in the second embodiment. The second driving waveform inFIG. 13is used when the terminal100is in the held state.

The terminal100in the held state does not perform the predictive response process nor perform vibration at the timing T1at which the finger is within the detection distance range dn. The terminal100starts applying the second driving waveform to start vibration action for the vibration response after detecting the touch of the finger at the timing T2and confirming the touched position at the timing T3. In a case where the finger leaves the operation surface143aafter the timing T2and before the timing T3at which the vibration starts, the hand holding the lateral casing173receives vibration after the timing T3.

FIG. 14is a flowchart showing control steps of the vibration response process to be performed by the controller110in the second embodiment.

The flowchart inFIG. 14is different from the flowchart inFIG. 9in that Steps S106to S109are added. Hereinafter, aspects different from the flowchartFIG. 9are described.

After the state determination process in Step S102, when determining that the terminal100is in the placed state (Step S103: YES), the controller110starts the predictive response process (Step S106). The controller110determines whether or not the finger approaches the operation surface143awithin the detection distance range dn (Step S107). When determining that the finger is not within the detection distance range dn (Step S107: NO), the controller110repeats Step S107. When determining that the finger is within the detection distance range dn, namely predicting a touch operation (Step S107: YES), the controller110sends a control signal to the vibration driver152to perform the vibration action at the first vibration intensity (Step S104).

In Step S103, when determining that the terminal100is not in the placed state (i.e., the terminal100is in the held state) (Step S103: NO), the controller110performs the vibration response without performing the predictive response process. The controller110repeats determining whether or not a touch operation is detected until a touch operation on the operation surface143ais detected (Step S108). When the touch operation is detected (Step S108: YES), the controller110performs the process of identifying the touched position until confirming the touched position (Step S109). When confirming the touched position (Step S109: YES), the controller110sends a control signal to the vibration driver152to perform the vibration action at the second vibration intensity weaker than the first vibration intensity (Step S105).

After Step S104or S105, the controller110ends the vibration response process.

In the above description, the first vibration intensity in the placed state is stronger than the second vibration intensity in the held state as an example. However, the vibration intensity may not be different between in the placed state and the held state if, as a result of the predictive response process, the user can certainly feel the vibration response of the terminal100in the placed state.

As described above, the terminal100in the second embodiment is a portable terminal for controlling the main body200. The terminal100includes: the operation display unit140with the touchscreen143; the operation-surface vibrator150that is configured to perform a vibration action of vibrating at least the operation surface143aof the touchscreen143; and the controller110. The controller110as the vibration control unit controls the vibration action of the operation-surface vibrator150. The controller10as the state determination unit determines whether or not the terminal100is in a placed state of being placed on an object. The controller110as the touch-operation prediction unit makes a prediction on whether a touch operation is to be performed on the operation surface143aby detecting the operation tool approaching the operation surface143awithin a certain distance. The controller110as the touch-operation detection unit detects the touch operation performed on the operation surface143awith the operation tool. When the terminal100is in the placed state, the controller110as the vibration control unit causes the operation-surface vibrator150to start the vibration action in response to predicting the touch operation. When the terminal100is not in the placed state, the controller110as the vibration control unit causes the operation-surface vibrator150to start the vibration action in response to detecting the touch operation.

According to this configuration, the terminal100in the placed state can start the vibration response before the timing T2at which the finger touches the operation surface143a. Accordingly, the terminal100in the placed state, in which only the finger touches the terminal100, can make sure to send the vibration response to the user. There may be a case where the terminal100cannot start vibration before the finger touches the operation surface143aowing to a time lag between the detecting the approach of the finger and starting the vibration. The terminal100can still start vibration earlier than in the case of starting vibration after detecting the touch of the finger, so that the vibration is more likely to be sent to the finger while the finger is in contact with the operation surface143a.

The terminal100in the held state does not perform the predictive response process but performs the vibration response when detecting the touch. The terminal100can therefore avoid sending an inappropriate vibration response to the hand holding the lateral casing173when the prediction is wrong. There may be a case where the touch operation is not actually performed although the terminal100predicts a touch operation and starts vibration. In the case, the terminal100can avoid sending the vibration response via the lateral casing173to the user who is not touching the operation surface143a.

Further, the program113ain the second embodiment causes the controller110(computer) of the terminal100to function as a hardware processor that: controls the vibration action of the operation-surface vibrator150; determines whether or not the terminal100is in a placed state of being placed on an object; makes a prediction on whether a touch operation is to be performed on the operation surface143aby detecting the operation tool approaching the operation surface143awithin a certain distance; and detects the touch operation performed on the operation surface143awith the operation tool. When the terminal100is in the placed state, the hardware processor causes the operation-surface vibrator150to start the vibration action in response to predicting the touch operation, and when the terminal100is not in the placed state, the hardware processor causes the operation-surface vibrator150to start the vibration action in response to detecting the touch operation.

According to this program, the terminal100in the placed state starts the vibration response before the timing T2at which the finger touches the operation surface143a, so that the vibration response is certainly transmitted to the user. Further, according to this program, the terminal100in the held state can avoid sending an inappropriate vibration response to the user when the prediction is wrong.

Third Embodiment

Next, a third embodiment is described. The third embodiment is different from the first embodiment in that the terminal100further includes, in addition to the operation-surface vibrator150, a back-surface vibrator160that vibrates the back surface of the terminal100. Hereinafter, aspects of the third embodiment that are different from the first embodiment are described. The third embodiment can be combined with the second embodiment.

FIG. 15is a sectional view of a configuration of the terminal100in the third embodiment.

FIG. 16is a block diagram showing main functional components of the terminal100in the third embodiment.

The terminal100in the third embodiment includes the back-surface vibrator160(second vibrator) in addition to the operation-surface vibrator150. The operation-surface vibrator150performs a first vibration action of vibrating the operation surface143aof the touchscreen143. The back-surface vibrator160performs a second vibration action of vibrating the back surface of the terminal100opposite the operation surface143a(i.e., vibrating the back surface172aof the back casing172). The back-surface vibrator160includes a vibration element161placed near the back surface172aof the back casing172(e.g., placed on the inner surface of the back casing172) and a vibration driver162that drives the vibration element161.

The vibration element161of the back-surface vibrator160directly vibrates the back surface172a, so that a more perceivable vibration response is sent to the hand holding the terminal100than the vibration response sent from the vibration elements151of the operation-surface vibrator150to the lateral casing173. In the third embodiment, the terminal100in the held state performs the vibration action with the back-surface vibrator160to send the vibration response mainly to the hand that holds the back casing172. The terminal100may also perform the vibration action with the operation-surface vibrator150in addition to the vibration action with the back-surface vibrator160.

On the other hand, the terminal100in the placed state does not perform the vibration action with the back-surface vibrator160but performs the vibration action with the operation-surface vibrator150. The terminal100in the placed state thus sends the vibration action to the finger on the operation surface143a. In the third embodiment, when the terminal100is placed on an object, the vibration absorber171between the operation display unit140and the back casing172absorbs vibration transmitted from the operation-surface vibrator150towards the object on which the terminal100is placed via the back casing172.

FIG. 17is a flowchart showing control steps of the vibration response process to be performed by the controller110in the third embodiment.

The flowchart inFIG. 17is different from the flowchart inFIG. 9in that Steps S104and S105are replaced by Steps S110and S111, respectively. Hereinafter, aspects different from the flowchart inFIG. 9are described.

After ending the vibration response process in Step S102, the controller110determines whether or not the terminal100is in the placed state (Step S103). When determining that the terminal100is in the placed state (Step S103: YES), the controller110sends a control signal to the vibration driver152of the operation-surface vibrator150to perform the vibration action (Step S110).

When determining that the terminal100is not in the placed state but in the held state (Step S103: NO), the controller110sends a control signal to the vibration driver162of the back-surface vibrator160to perform the vibration action (Step S111).

After Step S110or S111, the controller110ends the vibration response process.

As described above, the terminal100in the third embodiment is a portable terminal for controlling the main body200. The terminal100includes: the operation display unit140with the touchscreen143; the operation-surface vibrator150that is configured to perform a first vibration action of vibrating the operation surface143aof the touchscreen143; the back-surface vibrator160that is configured to perform a second vibration action of vibrating the surface of the terminal100opposite the operation surface143a; and the controller110. The controller110as the vibration control unit controls the first vibration action by the operation-surface vibrator150and the second vibration action by the back-surface vibrator160. The controller110as the state determination unit determines whether or not the terminal100is in a placed state of being placed on an object. When the terminal100is in the placed state, the controller110causes the operation-surface vibrator150to perform the first vibration action in response to a touch operation on the operation surface143a. When the terminal100is not in the placed state, the controller110causes the back-surface vibrator160to perform the second vibration action in response to the touch operation on the operation surface143a.

According to this configuration, when the terminal100is in the held state, the vibration element161of the back-surface vibrator160directly vibrates the back surface172a. Such a vibration response can be more perceivable to the hand holding the terminal100than the vibration response with the operation-surface vibrator150, which is transmitted to the hand via the lateral casing173.

On the other hand, when the terminal100is in the placed state, the terminal100does not perform the vibration action with the back-surface vibrator160but performs the vibration action with the operation-surface vibrator150. Accordingly, the terminal100can avoid transmitting vibration to the main body200and affecting the operation of the main body200. This also can reduce power consumption by the vibration action.

Further, the program113ain the third embodiment causes the controller110(computer) of the terminal100to function as a hardware processor that: controls the first vibration action by the operation-surface vibrator150and the second vibration action by the back-surface vibrator160; and determines whether or not the terminal100is in a placed state of being placed on an object, wherein when the terminal100is in the placed state, the hardware processor causes the operation-surface vibrator150to perform the first vibration action in response to a touch operation on the operation surface143a, and when the terminal100is not in the placed state, the hardware processor causes the back-surface vibrator160to perform the second vibration action in response to the touch operation on the operation surface143a.

According to the program, the terminal100in the held state can perform the vibration response that is more perceivable to the hand holding the terminal100. Further, the terminal100in the placed state can avoid transmitting vibration to the main body200and affecting the operation of the main body200. Further, power consumption by the vibration action can be reduced.

The above-described embodiments are not intended to limit the present invention and can be variously modified.

For example, whether or not the terminal100is placed on the cradle part50may not be determined by determining whether or not power is supplied to the terminal100by the main body200. For example, the state of the terminal100may be determined on the basis of the state of a physical button that is provided to terminal100and that is pressed when the terminal100is placed on the cradle part50.

As another example, the main body200may include a detection unit that detects whether or not the terminal100is placed on the cradle part50and that sends a detection signal to the terminal100when detecting that the terminal100is placed on the cradle part50. On the basis of the detection signal, the controller110of the terminal100can determine that the terminal100is placed on the cradle part50.

Further, although the cradle part50in the above description is electrically connectable to the terminal100via the connecting terminal of the supporter52, the cradle part50may be a placing surface that does not have a connecting terminal to the terminal100and that supplies power to the terminal100with contactless charging technology.

Further, when effects of the vibration of the back casing172on the main body200can be ignored (e.g., the cradle part50is provided with a damper), the back casing172may be integrated with the lateral casing173so that the vibration of the operation-surface vibrator150is transmitted to the back casing172and the back surface172a.

Further, the touchscreen143may not be an electrostatic capacitance type but may be a resistance film type that detects the position touched by the operating tool according to connections between electrodes.

Although embodiments of the present invention have been described and illustrated in detail, the disclosed embodiments are made for purposes of illustration and example only and not limitation. The scope of the present invention encompasses the scope of the invention recited in the claims and the equivalent thereof.