FORCE WAVE DETERMINATION DEVICE, FORCE WAVE DETERMINATION METHOD, AND FORCE WAVE DETERMINATION PROGRAM

Disclosed herein are systems and methods for force wave determination. A method includes receiving both first candidate information indicating a first candidate force wave as a candidate of a force wave and second candidate information indicating a second candidate force wave as a different candidate of the force wave; modulating the first candidate force wave and the second candidate force wave by the envelope based on the first candidate information and the second candidate information, respectively, to generate a first waveform signal and a second waveform signal; configuring the target object to generate a first candidate vibration based on the first waveform signal and a second candidate vibration based on the second waveform signal, respectively; receiving a selection of one of the first candidate vibration and the second candidate vibration; and determining the force wave based on the selection.

TECHNICAL FIELD

The present disclosure relates to a force wave determination device, a force wave determination method, and a force wave determination program.

BACKGROUND

In handheld or body-worn vibration devices, a vibration mechanism such as a linear resonant actuator or the like is incorporated to present a vibration to a user by operating a vibration mechanism. For example, in WO Patent Publication No. 2019/038887, a vibration device generates a vibration according to the content of data obtained by synthesizing tactile sensory vibration data representing a tactile sensory vibration that causes a user to feel a tactile sensation as if the user had touched any object, and pseudo force sensory vibration data. Here, the pseudo force sensory vibration data is data representing a pseudo force sensory vibration that causes the user to feel a tractive force in a specific direction. Pseudo force sensory vibration data specifically represents the content of a vibration repeating at predetermined intervals (e.g., a basic waveform of a specific pattern composed of a sine wave, a triangle wave, a sawtooth wave, or a square wave). In a vibration device, the intensity of at least either one of the pseudo force sensory vibration and the tactile sensory vibration can be adjusted according to the content of setting information accepted from the user.

However, since the perception of the vibration generated by a vibration device is different from user to user, a force sense of the vibration that suits the taste of the user may not be realized even if the intensity of the vibration is changed.

The present disclosure has been made in view of such circumstances, and it is an object thereof to provide a force wave determination device, a force wave determination method, and a force wave determination program capable of realizing a force sense that suits the taste of a user.

SUMMARY

A force wave determination device according to one aspect of the present disclosure includes: a candidate information acquisition unit which acquires first candidate information indicative of a first candidate force wave as a candidate of a force wave modulated by an envelope of a waveform signal to cause a target object to generate a vibration, and second candidate information indicative of a second candidate force wave as the candidate but different from the first candidate force wave; a modulation unit which modulates the first candidate force wave and the second candidate force wave respectively by the envelope based on the first candidate information and the second candidate information to generate a first waveform signal and a second waveform signal; a vibration generation unit which causes the target object to generate a first candidate vibration based on the first waveform signal and a second candidate vibration based on the second waveform signal, respectively; a selection result acquisition unit which acquires a result of selecting either one of the first candidate vibration and the second candidate vibration; and a determination unit which determines the force wave based on the result.

According to the present disclosure, there can be provided a force wave determination device, a force wave determination method, and a force wave determination program capable of realizing a force sense that suits the taste of a user.

DETAILED DESCRIPTION

Embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings. Note that the same elements are given the same reference numerals to omit redundant description as much as possible.

First Exemplary Embodiment

A game system according to a first embodiment is now described.FIG.1is a diagram illustrating an overview of the game system according to the first embodiment of the present disclosure. As illustrated inFIG.1, a game system3mainly includes a computer11, a display monitor20, and a controller21(target object).

For example, the computer11executes a game program and displays, on the display monitor20, a virtual reality deployed by the game program. A user6is, for example, a game program creator or a game player. For example, the user6recognizes the situation of a character in the virtual reality projected on the display monitor20, and operates the controller21to give movement to the character according to the situation. The computer11executes the game program according to the details of the operation performed on the controller21.

Further, the computer11presents, to the user6, at least one of “force sense,” “pressure sense,” and “tactile sense” by haptics (hereinafter, also called haptic presentation”). Here, for example, the “force sense” causes a sensation of being pulled or pushed, and a sensation of response when being tightly held down or popped up. The “pressure sense” is, for example, a sense of touch when touching an object or when feeling the hardness or softness of the object. The “tactile sense” is, for example, the feeling of touch on the surface of the object, or a tactile sense and a feeling of roughness such as an uneven degree of the surface of the object.

The hierarchy of software and hardware in the computer11is composed of a game program in an application layer, an SDK (Software Development Kit) in a middle layer, and system/game engine/HW (Hardware) in a physical layer.

The SDK includes, for example, plugins or an authoring tool and middleware. In the middleware, a program for vibrating the controller21to give the user6at least one of the “force sense,” the “pressure sense,” and the “tactile sense” (hereinafter, which may also be called a target program) is included. For example, when a specific event has occurred to a character, the game program calls the target program according to an API (Application Programming Interface). At this time, for example, the game program passes, to the target program, event information indicative of the content of the event and the start time of the event (start timings of a first phenomenon and a second phenomenon). The content of the event is identified, for example, by an ID.

The specific event is, for example, that an external force to pull or push the character is applied to the character in the virtual reality, that the character shot a gun, that the character was hit, that the character is dancing to music, or the like.

Based on the event information, the target program generates a waveform signal for haptic presentation of a sense according to the content of the event indicated by the event information. The target program transmits the generated waveform signal to the controller21through the game engine, an operating system, and hardware.

The controller21vibrates based on the waveform signal. The user6can hold the vibrating controller21by hand to recognize the situation of the character in the virtual reality by at least one of the “force sense,” the “pressure sense,” and the “tactile sense” in addition to sight and hearing.

FIG.2is a diagram illustrating the hardware configuration of the game system according to the first embodiment of the present disclosure. As illustrated inFIG.2, the game system3includes the computer11, a speaker19, the display monitor20, and the controller21. The computer11includes a CPU (Central Processing Unit)12, a memory13, a disk14, an audio interface (I/F)15, a GPU (Graphics Processing Unit)16, a communication interface (I/F)17, and a bus18. The controller21includes an MCU (Micro Controller Unit)22, a communication interface (I/F)23, a haptic output driver24, a haptic element25, a sensor input driver26, and a sensor element27.

In the computer11, the CPU12, the memory13, the disk14, the audio interface15, the GPU16, and the communication interface17are connected to one another through the bus18to be able to transmit and receive data to and from one another.

In the present embodiment, the disk14is a non-volatile storage device capable of reading and writing data such as an HDD (Hard Disk Drive) or an SSD (Solid State Drive), on which programs (code) such as the game program and the SDK are stored. Note that the disk14is not limited to the HDD or the SSD, and it may also be a memory card, a read-only CD-ROM (Compact Disc Read Only Memory), a DVD-ROM (Digital Versatile Disc-Read Only Memory), or the like. Further, the programs such as the target program can be installed externally. Further, the programs such as the target program circulate in such a state as to be stored on a storage medium readable by the computer11like the disk14. Note that the programs such as the target program may also circulate on the Internet connected through the communication interface.

The memory13is a volatile storage device such as a DRAM (Dynamic Random Access Memory). The communication interface17transmits and receives various data to and from the communication interface23in the controller21. This communication may be performed by wire or wirelessly, and any communication protocol may be used as long as the communication with each other can be performed. The communication interface17transmits various data to the controller21according to instructions from the CPU12. Further, the communication interface17receives various data transmitted from the controller21, and outputs the received data to the CPU12.

Upon execution of a program, the CPU12transfers, to the memory13, the program stored on the disk14and data required to execute the program. The CPU12reads, from the memory13, processing instructions and data required to execute the program, and executes arithmetic processing according to the content of the processing instructions. At this time, the CPU12may newly generate data required to execute the program and store the data in the memory13. Note that the CPU12is not limited to acquiring the program and data from the disk14, and the CPU12may also acquire the program and data from a server or the like via the Internet.

Specifically, for example, upon execution of the game program, the CPU12receives the details of operations of the user6to the controller21to execute processing instructions according to the operation details in order to give movement to the character in the virtual reality. At this time, the CPU12performs processing for haptic presentation, video display, and audio output according to the situation of the character in the virtual reality.

More specifically, for example, when the external force to pull or push the character is applied to the character in the virtual reality, the CPU12generates a waveform signal for haptic presentation of the force sense when the external force is applied.

Further, for example, when the character shot a gun in the virtual reality, the CPU12generates a waveform signal for haptic presentation of a sense of reaction when the character shot the gun.

Further, for example, when the character was hit in the virtual reality, the CPU12generates a waveform signal for haptic presentation of a sense of shock when the character was hit.

Further, for example, when the character is dancing to the music in the virtual reality, the CPU12generates a waveform signal for haptic presentation of a feeling of dynamism toward musical beat and rhythm.

The CPU12digitally encodes the generated waveform signal to generate haptic information, and outputs the generated haptic information to the controller21via the communication interface17.

Further, the CPU12generates screen information required for video display such as the character moving in the virtual reality and the background, and outputs the generated screen information to the GPU16. For example, the GPU16receives the screen information from the CPU12, performs rendering and the like based on the screen information, and generates a digital video signal including a video such as 3D graphics. The GPU16transmits the generated digital video signal to the display monitor20to display the 3D graphics and the like on the display monitor20.

Further, the CPU12generates audio information indicative of audio according to the environment, movement, and situation of the character in the virtual reality, and outputs the generated audio information to the audio interface15. For example, the audio interface15receives the audio information from the CPU12, performs rendering and the like based on the received audio information, and generates an audio signal. The audio interface15transmits the generated audio signal to the speaker19to output sound from the speaker19.

The haptic element25in the controller21is a vibration actuator configured to convert an electronic signal to mechanical vibration, which is, for example, a voice coil actuator with a wide frequency band of vibration dampening. Note that the haptic element25may also be an eccentric motor, a linear resonant actuator, an electromagnetic actuator, a piezoelectric actuator, an ultrasonic actuator, an electrostatic actuator, a polymer actuator, or the like.

The MCU22is configured to control the haptic output driver24and the sensor input driver26. Specifically, for example, when power is supplied, the MCU22reads a program stored in a ROM (not illustrated) to execute arithmetic processing according to the content of the program.

In the present embodiment, for example, when receiving the haptic information from the computer11via the communication interface23, the MCU22controls the haptic output driver24based on the received haptic information to perform haptic presentation by the haptic element25.

Specifically, the MCU22outputs the haptic information to the haptic output driver24. The haptic output driver24receives the haptic information from the MCU22, generates an analog electronic signal as an electronic signal according to the waveform signal and capable of driving the haptic element25based on the received haptic information, and outputs the electronic signal to the haptic element25. Thus, the haptic element25vibrates based on the electronic signal to perform a haptic presentation.

The sensor element27is configured to sense the movements of operation parts operated by the user6such as a joystick and a button provided in the controller21, and outputs an analog electronic signal indicative of the sensing result to the sensor input driver26.

For example, the sensor input driver26operates under the control of the MCU22to supply, to the sensor element27, power required to drive, and receives an electronic signal from the sensor element27to convert the received electronic signal to a digital signal. The sensor input driver26outputs the converted digital signal to the MCU22. Based on the digital signal received from the sensor input driver26, the MCU22generates operation information indicative of the details of operations of the user6to the controller21, and transmits the operation information to the computer11via the communication interface23.

FIG.3is a graph illustrating an example of a waveform signal according to the first embodiment of the present disclosure. Note that the horizontal axis indicates time and the vertical axis indicates amplitude inFIG.3. As illustrated in FIG.3, a waveform signal75is, for example, a periodic square wave that continues for a certain amount of time. In the present embodiment, the waveform signal75is a square wave that continues during a period T1from time is to time te. Note that the amplitude of the waveform signal75may also change over time. Further, the length of the period T1can be set arbitrarily.

For example, if a second haptic presentation is performed before the end of a first haptic presentation when a haptic presentation is performed for each event, the user6may not be able to receive an expected haptic presentation.

FIG.4is a graph for describing Problem 1. As illustrated inFIG.4, for example, such a situation that the character in the virtual reality is pulled forward at time tsa and further pulled forward at time tsb after time tsa is assumed. Since the character is further pulled forward after being pulled forward, it is considered that the user6expects a force sense of being pulled forward in two stages.

However, such a configuration that a reference waveform signal91awhen the character is pulled forward at time tsa and a reference waveform signal91bwhen the character is pulled forward at time tsb are simply overlapped and synthesized causes a problem below.

In other words, when a difference between the start time tsa of the reference waveform signal91aand the start time tsb of the reference waveform signal91bcorresponds to a half cycle of the square wave in the reference waveform signal91a,the reference waveform signals91aand91binterfere to weaken each other, and a vibration based on a reference composite waveform signal92with zero amplitude from time tsb to the end time tea of the reference waveform signal91ais presented to the user6. The user6expected a force sense of being pulled forward in two stages, but the user6feels only a weak force sense, and hence feels uncomfortable.

On the other hand, though not illustrated, when the difference between time tsa and time tsb corresponds to one cycle of the square wave in the reference waveform signal91a,the reference waveform signals91aand91binterfere to strengthen each other, and the user6can receive an expected force sense. In other words, since the force sense perceived by the user6is uncomfortable or expected depending on the difference between the start time of a first event and the start time of a second event, such a configuration that the reference waveform signal91aand the reference waveform signal91bare simply overlapped and synthesized is difficult to stabilize the force sense perceived by the user6.

FIG.5is a graph for describing Problem 2. As illustrated inFIG.5, for example, such a situation that the character in the virtual reality is pulled forward at time tsa and then pulled backward as the opposite direction of the forward side at time tsb after time tsa is assumed. Since the character is pulled backward after being pulled forward, it is considered that the user6expects a weak force sense of being not pulled both to the forward side and the backward side.

However, such a configuration that the reference waveform signal91awhen the character is pulled forward at time tsa and a reference waveform signal91cwhen the character is pulled backward at time tsb are simply overlapped and synthesized causes a problem below.

In other words, when a difference between time tsa and time tsb corresponds to a half cycle of the square wave in the reference waveform signal91a, since the sign of the reference waveform signal91cis opposite to that of the reference waveform signal91a,the reference waveform signals91aand91cinterfere to strengthen each other. Therefore, a vibration based on a reference composite waveform signal93with a large amplitude is presented to the user6from the start time tsb of the reference waveform signal91cto the end time tea of the reference waveform signal91a.Since the user6receives a strong force sense even though the user6expects a weak force sense of being not pulled both to the forward side and the backward side, the user6feels uncomfortable.

On the other hand. though not illustrated, when the difference between time tsa and time tsb corresponds to one cycle of the square wave in the reference waveform signal91a,the reference waveform signals91aand91cinterfere to weaken each other, and the user6can receive an expected weak force sense. In other words, since the force sense perceived by the user6is uncomfortable or expected depending on the difference between the start time of the first event and the start time of the second event, such a configuration that the reference waveform signal91aand the reference waveform signal91care simply overlapped and synthesized is difficult to stabilize the force sense perceived by the user6.

[Configuration of Signal Generation Device]

FIG.6is a block diagram illustrating the configuration of a signal generation device according to the first embodiment of the present disclosure. For example, a signal generation device1is implemented by causing the CPU12in the computer11to execute a signal generation program as an example of the target program. The signal generation device1includes, as functional blocks, an event reception unit31, an envelope generation information acquisition unit32(an envelope information acquisition unit and a weighting information acquisition unit), a current amplitude calculation unit33(synthesis unit), a counter34, a modulation unit35, a unit force wave information acquiring unit36, and an output unit37.

The counter34counts clock pulses generated by an oscillator circuit using a crystal oscillator or the like, and holds the counted value. For example, this counted value indicates current time.

For example, the event reception unit31is configured to accept event information from the game program when a specific event has occurred to the character in the virtual reality.

In the present embodiment, when such an event that the character is pulled forward in the virtual reality (hereinafter, which may also be called event E1) has occurred, the event reception unit31receives, from the game program, event information indicative of an ID of the event E1and the start time of the event E1(hereinafter, which may also be called event information EM1).

Further, when such an event that the character is pulled backward in the virtual reality (hereinafter, which may also be called event E2) has occurred, the event reception unit31receives, from the game program, event information indicative of an ID of the event E2and the start time of the event E2(hereinafter, which may also be called event information EM2).

Each time the event reception unit31receives the event information EM1or the event information EM2from the game program, the event reception unit31outputs the event information EM1or the event information EM2to the envelope generation information acquisition unit32.

FIG.7is a table illustrating correspondence information held on the disk in the signal generation device according to the first embodiment of the present disclosure.FIG.8andFIG.9are graphs illustrating examples of event-specific force amplitude envelopes indicated by envelope waveform information held by the signal generation device according to the first embodiment of the present disclosure. Note that the horizontal axis indicates time and the vertical axis indicates amplitude inFIG.8andFIG.9.

As illustrated inFIG.7toFIG.9, correspondence information101indicates correspondences among “Event Content,” “Event ID,” and “Envelope Generation Information.” The “Envelope Generation Information” is information for generating each envelope, which includes “Envelope Waveform Information,” “Start Time Offset Information,” and “Weighting Information.”

For example, the “Event Content” is that the “character is pulled forward,” the “character is pulled backward,” the “character shoots a gun,” the “character is hit from the front,” the “character is hit from behind,” the “character dances to the BGM,” and the like. The “Event ID” is a number unique to each event content. In the present embodiment, for example, “001” and “002” are assigned to the event content that the “character is pulled forward,” and the event content that the “character is pulled backward,” respectively.

The “Envelope Waveform Information” is data for creating a waveform of an envelope, which may also be called an “event-specific force amplitude envelope”, of a waveform signal corresponding to each event content. For example, the event-specific force amplitude envelope has a waveform different from event content (event ID) to event content (event ID). Specifically, for example, the “Envelope Waveform Information” is data that in which pairs of times and amplitudes at respective times are arranged in chronological order. Note that, for example, when the waveform of the event-specific force amplitude envelope is generated by a spline curve, the “Envelope Waveform Information” may also be data indicative of pairs of times at control points used for the spline curve and amplitudes at the times.

In the present embodiment, envelope waveform information Env1corresponds to an event with an “event ID” of “001,” which represents an event-specific force amplitude envelope71P illustrated inFIG.8. In the present embodiment, the event-specific force amplitude envelope71P is set to have a positive amplitude for the event E1that the “character is pulled forward.”

Envelope waveform information Env2corresponds to an event with an “event ID” of “002,” which represents an event-specific force amplitude envelope71M illustrated inFIG.9. In the present embodiment, the event-specific force amplitude envelope71M is set to have an amplitude the sign of which is different from that of the event-specific force amplitude envelope71P, that is, a negative amplitude, for the event E2that the “character is pulled backward.” In the present embodiment, the event-specific force amplitude envelope71P and the event-specific force amplitude envelope71M have a symmetrical shape with respect to the axis on which the amplitude is zero, that is, with respect to the time axis. Note that the event-specific force amplitude envelope71P and the event-specific force amplitude envelope71M may also have asymmetrical shapes with respect to the time axis.

For example, the “Start Time Offset Information” indicates a difference between the start time of the event-specific force amplitude envelope and the start time of an event indicated by the event information. For example, when it is intended to start a vibration in the controller21at the time when an event occurs to the character in the virtual reality, a value indicated by the start time offset information is set to zero.

Further, when it is intended to make the start time of the vibration in the controller21earlier or later than the time at which the event occurs to the character in the virtual reality in consideration of perceptual properties of a force sense, the value indicated by the start time offset information is set to a non-zero value. In the present embodiment, for example, when the value indicated by the start time offset information is set to a positive value, the start time of the vibration in the controller21is made later than the time when the event occurs to the character in the virtual reality. On the other hand, when the value indicated by the start time offset information is set to a negative value, the start time of the vibration in the controller21is made earlier than the time when the event occurs to the character in the virtual reality.

For example, the “Weighting Information” indicates a weight given to the amplitude of the event-specific force amplitude envelope. Specifically, for example, when pieces of weighting information w1and w2corresponding to “Event IDs” of “001” and “002” indicate 1, respectively, the event-specific force amplitude envelope71P (seeFIG.8) and the event-specific force amplitude envelope71M (seeFIG.9) are used as they are.

On the other hand, for example, when a value indicated by weighting information w3corresponding to an event ID of “003” is 3, the amplitude is tripled and an event-specific force amplitude envelope represented by envelope waveform information Env3is used. Further, for example, when a value indicated by weighting information w4corresponding to an event ID of “004” is 0.5, the amplitude is multiplied by 0.5, and an event-specific force amplitude envelope represented by envelope waveform information Env4is used.

As illustrated inFIG.6, when receiving the event information EM1from the event reception unit31, the envelope generation information acquisition unit32refers to the correspondence information101(seeFIG.7) stored on the disk14. Then, based on the event information EM1, the envelope generation information acquisition unit32acquires, from the disk14, envelope generation information corresponding to the “Event ID” of “001,” that is, the envelope waveform information Env1, start time offset information Ts1, and the weighting information w1.

Based on the start time of the event E1indicated by the event information EM1and a value indicated by the start time offset information Ts1, the envelope generation information acquisition unit32calculates time to start the event-specific force amplitude envelope71P (hereinafter, which may also be called a first set time).

The envelope generation information acquisition unit32generates first envelope setting information including the first set time, the envelope waveform information Env1, and the weighting information w1, and outputs the generated first envelope setting information to the current amplitude calculation unit33.

Further, when receiving the event information EM2from the event reception unit31, the envelope generation information acquisition unit32refers to the correspondence information101stored on the disk14. Then, based on the event information EM2, the envelope generation information acquisition unit32acquires, from the disk14, envelope generation information corresponding to the “Event ID” of “002,” that is, the envelope waveform information Env2, start time offset information Ts2, and the weighting information w2.

Based on the start time of the event E2indicated by the event information EM2and a value indicated by the start time offset information Ts2, the envelope generation information acquisition unit32calculates time to start the event-specific force amplitude envelope71M (hereinafter, which may also be called a second set time).

The envelope generation information acquisition unit32generates second envelope setting information including set time information indicative of the second set time, the envelope waveform information Env2, and the weighting information w2, and outputs the generated second envelope setting information to the current amplitude calculation unit33.

When receiving the first envelope setting information from the envelope generation information acquisition unit32, the current amplitude calculation unit33is configured to calculate the start time and end time of the event-specific force amplitude envelope71P (seeFIG.8) based on the first set time and the envelope waveform information Env1included in the received first envelope setting information. Then, the current amplitude calculation unit33sets a generation period from the start time to the end time (hereinafter, which may also be called a waveform signal generation period Tp).

Further, based on the weighting information w1included in the first envelope setting information, the current amplitude calculation unit33is configured to perform processing for weighting the amplitude of the event-specific force amplitude envelope71P. In the present embodiment, since a value indicated by the weighting information w1is 1, the amplitude of the event-specific force amplitude envelope71P is the same before and after the processing.

When receiving the second envelope setting information from the envelope generation information acquisition unit32, the current amplitude calculation unit33is configured to calculate the start time and end time of the event-specific force amplitude envelope71M (seeFIG.9) based on the second set time and the envelope waveform information Env2included in the received second envelope setting information. Then, the current amplitude calculation unit33sets a generation period from the start time to the end time (hereinafter, which may also be called a waveform signal generation period Tm).

Further, based on the weighting information w2included in the second envelope setting information, the current amplitude calculation unit33performs processing for weighting the amplitude of the event-specific force amplitude envelope71M. In the present embodiment, since a value indicated by the weighting information w2is 1, the amplitude of the event-specific force amplitude envelope71M is the same before and after the processing.

The current amplitude calculation unit33sets a confirmation time, for example, in every predetermined time interval. The current amplitude calculation unit33monitors the counted value of the counter34, that is, the current time, and when the confirmation time comes, the current amplitude calculation unit33confirms whether or not waveform signal generation periods overlap.

Here, the fact that the waveform signal generation periods overlap means that the next waveform signal generation period Tp or Tm is started before the end of the waveform signal generation period Tp or Tm. On the other hand, the fact that the waveform signal generation periods do not overlap means that the next waveform signal generation period Tp or Tm is started after the end of the waveform signal generation period Tp or Tm.

When confirming that the waveform signal generation periods do not overlap, the current amplitude calculation unit33acquires a value of the amplitude of the event-specific force amplitude envelope71P or71M at the current time (hereinafter, which may also be called an envelope current amplitude), and outputs the acquired value of the envelope current amplitude to the modulation unit35.

FIG.10is a graph illustrating an example of event-specific force amplitude envelopes synthetically processed by the signal generation device according to the first embodiment of the present disclosure. Note that each horizontal axis indicates time and each vertical axis indicates amplitude inFIG.10.

InFIG.10, an event-specific force amplitude envelope71Pa (first envelope) and an event-specific force amplitude envelope71Pb (second envelope) are illustrated. Here, the event-specific force amplitude envelope71Pa is an envelope of a waveform signal75d(first waveform signal) corresponding to the event E1(first phenomenon). The event-specific force amplitude envelope71Pb is an envelope of a waveform signal75e(second waveform signal) corresponding to another event E1(second phenomenon) that occurred after the event E1concerned. InFIG.10, the sign of the event-specific force amplitude envelope71Pa and the sign of the event-specific force amplitude envelope71Pb are the same.

The first set time and the envelope waveform information Env1included in the first envelope setting information used to generate the event-specific force amplitude envelope71Pa are first envelope information P1indicative of the event-specific force amplitude envelope71Pa. The first set time and the envelope waveform information Env1included in the first envelope setting information used to generate the event-specific force amplitude envelope71Pb are second envelope information P2indicative of the event-specific force amplitude envelope71Pb. In this case, the envelope information P1and the second envelope information P2are different in terms of the first set time.

Start time t2(second timing) of a waveform signal generation period Tpb of the event-specific force amplitude envelope71Pb is between start time t1(first timing) of a waveform signal generation period Tpa of the event-specific force amplitude envelope71Pa and end time t3of the waveform signal generation period Tpa. Note that the start time t2is time after a half cycle of the waveform signal75dfrom the start time t1inFIG.10.

As illustrated inFIG.6andFIG.10, when confirming that the waveform signal generation periods overlap, the current amplitude calculation unit33generates a composite envelope72aby synthesizing (overlapping) the event-specific force amplitude envelope71Pa and the event-specific force amplitude envelope71Pb.

Here, the composite envelope72ahas the same amplitude as that of the event-specific force amplitude envelope71Pa from the start time t1to the start time t2. Further, the composite envelope72ahas an amplitude obtained by adding up the amplitude of the event-specific force amplitude envelope71Pa and the amplitude of the event-specific force amplitude envelope71Pb, that is, twice the amplitude of the event-specific force amplitude envelope71Pa, from the start time t2to the end time t3. Further, the composite envelope72ahas the same amplitude as the amplitude of the event-specific force amplitude envelope71Pb from the end time t3to the end time t4of the waveform signal generation period Tpb.

The current amplitude calculation unit33acquires a value of the envelope current amplitude of the composite envelope72a,and outputs the acquired value of the envelope current amplitude to the modulation unit35.

FIG.11is a graph illustrating an example of event-specific force amplitude envelopes synthetically processed by the signal generation device according to the first embodiment of the present disclosure. Note that each horizontal axis indicates time and each vertical axis indicates amplitude inFIG.11.

InFIG.11, an event-specific force amplitude envelope71Pc (first envelope) and an event-specific force amplitude envelope71Ma (second envelope) are illustrated. Here, the event-specific force amplitude envelope71Pc is an envelope of a waveform signal75f(first waveform signal) corresponding to the event E1(first phenomenon). The event-specific force amplitude envelope71Ma is an envelope of a waveform signal75g(second waveform signal) corresponding to the event E2(second phenomenon) that occurred after the event E1. InFIG.11, the sign of the event-specific force amplitude envelope71Pc and the sign of the event-specific force amplitude envelope71Ma are different.

The first set time and the envelope waveform information Env1included in the first envelope setting information used to generate the event-specific force amplitude envelope71Pc are first envelope information Q1indicative of the event-specific force amplitude envelope71Pc. The second set time and the envelope waveform information Env2included in the second envelope setting information used to generate the event-specific force amplitude envelope71Ma are second envelope information Q2indicative of the event-specific force amplitude envelope71Ma. In this case, both the first set time and the envelope waveform information are different between the first envelope information P1and the second envelope information P2.

Start time t6(second timing) of a waveform signal generation period Tma of the event-specific force amplitude envelope71Ma is between start time t5(first timing) of a waveform signal generation period Tpc of the event-specific force amplitude envelope71Pc and end time t7of the waveform signal generation period Tpc. Note that the start time t6is time after a half cycle of the waveform signal75ffrom the start time t5inFIG.11.

As illustrated inFIG.6andFIG.11, when confirming that the waveform signal generation periods overlap, the current amplitude calculation unit33generates a composite envelope72bby synthesizing (overlapping) the event-specific force amplitude envelope71Pc and the event-specific force amplitude envelope71Ma.

Here, the composite envelope72bhas the same amplitude as the amplitude of the event-specific force amplitude envelope71Pc from the start time t5to the start time t6. Further, the composite envelope72bhas an amplitude obtained by adding up the amplitude of the event-specific force amplitude envelope71Pc and the amplitude of the event-specific force amplitude envelope71Ma, that is, zero amplitude from the start time t6to the end time t7. Further, the composite envelope72bhas the same amplitude as the amplitude of the event-specific force amplitude envelope71Ma from the end time t7to end time t8of the waveform signal generation period Tma.

The current amplitude calculation unit33acquires a value of the envelope current amplitude of the composite envelope72b,and outputs the acquired value of the envelope current amplitude to the modulation unit35.

FIG.12is a graph illustrating an example of a unit force wave held by the signal generation device according to the first embodiment of the present disclosure.FIG.13is a graph illustrating an example of a waveform signal when waveform signal generation periods do not overlap according to the first embodiment of the present disclosure. Note that inFIG.12andFIG.13, the horizontal axis indicates time and the vertical axis indicates amplitude.

As illustrated inFIG.12andFIG.13, a force wave74has a cycle Pu in the present embodiment. Further, the force wave74is a wave vibrating during the waveform signal generation periods Tp, Tpa, Tpb, Tpc, and Tma. InFIG.12, one cycle of a force wave (hereinafter, which may also be called a unit force wave73) is illustrated. In the present embodiment, the force wave74is a square wave having the cycle Pu. Note that the shape of the unit force wave73is not limited to the square wave, and it may have any other shape.

As illustrated inFIG.6andFIG.12, for example, unit force wave information indicative of the cycle and shape of the unit force wave73is pre-stored on the disk14. The unit force wave information is data for creating the waveform of a force wave, for example, which is specifically data in which pairs of times and amplitudes at respective times are arranged in chronological order. Note that, for example, when the waveform of the force wave is generated by a spline curve, the unit force wave information may also be data indicative of pairs of times at control points used for the spline curve and amplitudes at the times. The unit force wave information acquiring unit36acquires the unit force wave information from the disk14, and outputs the acquired unit force wave information to the modulation unit35.

For example, in the case where the current amplitude calculation unit33confirms that the waveform signal generation periods do not overlap, the event-specific force amplitude envelope71P, the force wave74, and the waveform signal75awhen the value of the envelope current amplitude of the event-specific force amplitude envelope71P (seeFIG.8) is output to the modulation unit35are illustrated inFIG.13.

FIG.14is a graph illustrating an example of a waveform signal when waveform signal generation periods overlap according to the first embodiment of the present disclosure. Note that each horizontal axis indicates time and each vertical axis indicates amplitude inFIG.14. InFIG.14, for example, the composite envelope72a,the force wave74, and the waveform signal75bare illustrated when the value of the envelope current amplitude of the composite envelope72a(seeFIG.10) is output to the modulation unit35in the case where the current amplitude calculation unit33confirms that the waveform signal generation periods overlap.

FIG.15is a graph illustrating an example of a waveform signal when the waveform signal generation periods overlap according to the first embodiment of the present disclosure. Note that each horizontal axis indicates time and each vertical axis indicates amplitude inFIG.15. InFIG.15, for example, the composite envelope72b,the force wave74, and a waveform signal75care illustrated when the value of the envelope current amplitude of the composite envelope72b(seeFIG.11) is output to the modulation unit35in the case where the current amplitude calculation unit33confirms that the waveform signal generation periods overlap.

As illustrated inFIG.6andFIG.12toFIG.15, the modulation unit35modulates a periodic force wave by the composite envelope to generate a waveform signal. In the present embodiment, the modulation unit35is configured to receive unit force wave information from the unit force wave information acquiring unit36to generate the unit force wave73based on the received unit force wave information. The modulation unit35is also configured to generate the unit force wave73every cycle Pu to generate the force wave74in which the unit force wave73is continuous (seeFIG.13toFIG.15).

The modulation unit35is configured to modulate the force wave74by the value of the envelope current amplitude of the event-specific force amplitude envelope71P, the composite envelope72a,or the composite envelope72breceived from the current amplitude calculation unit33as the current time elapses to generate the waveform signal75a,75b,or75c,respectively. The modulation in the modulation unit35is, for example, digital modulation. Note that the modulation in the modulation unit35may also be analog modulation. The modulation unit35acquires a value of the amplitude of the generated waveform signal75a,75b,or75cat the current time (hereinafter, which may also be called a signal current amplitude), and outputs the acquired value to the output unit37.

When receiving the value of the signal current amplitude from the modulation unit35, the output unit37digitally encodes the received value of the signal current amplitude to generate haptic information, and transmits the generated haptic information to the controller21via the communication interface17.

As illustrated inFIG.10, in such a configuration that the waveform signal75dand the waveform signal75eare simply overlapped and synthesized, the waveform signal75dand the waveform signal75einterfere to weaken each other. On the contrary, when the start time t2of the waveform signal generation period Tpb is later than the start time t1of the waveform signal generation period Tpa and earlier than the end time t3, the composite envelope72acan keep a convex shape protruding in the positive direction regardless of the difference between the start time t2and the start time t1. Then, as illustrated inFIG.14, since such a configuration as to modulate the force wave74by the composite envelope72acan generate the waveform signal75b,the user6can perceive such an expected force sense of being pulled forward in two stages regardless of the difference between the start time of the first event and the start time of the second event. Namely, Problem 1 can be solved.

Further, as illustrated inFIG.11, such a configuration that the waveform signal75fand the waveform signal75gare simply overlapped and synthesized causes the waveform signal75fand the waveform signal75gto interfere to strengthen each other.

On the contrary, when the start time t6of the waveform signal generation period Tma is later than the start time t5of the waveform signal generation period Tpc and earlier than the end time t7, the composite envelope72bcan keep such a shape that the amplitude between the start time t6and the end time t7becomes zero regardless of the difference between the start time t6and the start time t5. Then, as illustrated inFIG.15, since such a configuration that the force wave74is modulated by the composite envelope72bcan generate the waveform signal75c,the user6can perceive the expected weak force sense regardless of the difference between the start time of the first event and the start time of the second event. In other words, Problem 2 can be solved. Thus, the force sense perceived by the user6can be stabilized regardless of the start times of two or more events.

FIG.16is a flowchart defining an operation procedure when the signal generation device according to the first embodiment of the present disclosure performs event information processing.

As illustrated inFIG.16, at step S102, the event reception unit31in the signal generation device1waits for reception of event information from the game program.

In response to receiving the event information from the game program, the event reception unit31outputs the received event information to the envelope generation information acquisition unit32. When receiving the event information from the event reception unit31, at step S104, the envelope generation information acquisition unit32acquires, from the disk14, envelope generation information corresponding to the ID of the event indicated by the received event information.

At step S106, based on the acquired envelope generation information and event information, the envelope generation information acquisition unit32calculates time to start the event-specific force amplitude envelope.

At step S108, based on the envelope generation information, the envelope generation information acquisition unit32generates envelope setting information including the time to start the event-specific force amplitude envelope, the envelope waveform information, and the weighting information, and outputs the generated envelope setting information to the current amplitude calculation unit33.

At step S110, when receiving the envelope setting information from the envelope generation information acquisition unit32, the current amplitude calculation unit33sets a waveform signal generation period based on the envelope setting information.

At step S112, based on the weighting information included in the envelope setting information, the current amplitude calculation unit33weights the amplitude of the event-specific force amplitude envelope indicated by the envelope waveform information included in the envelope setting information.

Subsequently, again at step S102, the event reception unit31waits for reception of new event information from the game program.

Note that the order of step S110and step S112is not limited to that mentioned above, and the order may be changed.

FIG.17is a flowchart defining an operation procedure when the signal generation device according to the first embodiment of the present disclosure performs waveform signal generation processing.

As illustrated inFIG.17, when the confirmation time comes (i.e., YES in step S202), at step S204, the current amplitude calculation unit33in the signal generation device1confirms whether or not there are waveform signal generation periods that overlap each other.

When confirming that there are no waveform signal generation periods that overlap each other (i.e., NO in step S204), at step S206, the current amplitude calculation unit33acquires the envelope current amplitude of the event-specific force amplitude envelope, and outputs a value of the envelope current amplitude to the modulation unit35.

On the other hand, when there are waveform signal generation periods that overlap each other, at step S208, the current amplitude calculation unit33performs synthetic processing for generating a composite envelope, acquiring an envelope current amplitude of the composite envelope, and outputting a value of the envelope current amplitude to the modulation unit35. The details of the synthetic processing will be described in detail later.

Next, when the confirmation time does not come (i.e., NO in step S202) or when the value of the envelope current amplitude is output to the modulation unit35(i.e., in step S206and S208), at step S210, the modulation unit35generates the unit force wave73every cycle Pu based on the unit force wave information received from the unit force wave information acquiring unit36to generate the force wave74.

Next, the modulation unit35modulates the force wave74by the value of the envelope current amplitude received from the current amplitude calculation unit33to generate a waveform signal. At step S212, the modulation unit35acquires a value of the signal current amplitude of the waveform signal and outputs the value of the signal current amplitude to the output unit37.

At step S214, when receiving the value of the signal current amplitude from the modulation unit35, the output unit37digitally encodes the received value of the signal current amplitude to generate haptic information, and transmits the generated haptic information to the controller21via the communication interface17.

The processes from step S210to step S214are repeated until the current amplitude calculation unit33confirms that a new confirmation time comes (i.e., NO in step S202).

FIG.18is a flowchart defining an operation procedure when the signal generation device according to the first embodiment of the present disclosure performs the synthetic processing.FIG.18illustrates the details of the operation in step S208ofFIG.17.

As illustrated inFIG.18, for example, such a situation that N (an integer of 2 or greater) waveform signal generation periods overlap each other is assumed. N event-specific force amplitude envelopes correspond to the N waveform signal generation periods, respectively.

At step S302, for example, the current amplitude calculation unit33in the signal generation device1performs initial value setting processing for setting an integer i to 1 and resetting a composite amplitude value to zero.

At step S304, the current amplitude calculation unit33selects the i-th event-specific force amplitude envelope corresponding to the i-th waveform signal generation period among the N waveform signal generation periods.

At step S306, the current amplitude calculation unit33acquires an envelope current amplitude of the i-th event-specific force amplitude envelope.

At step S308, the current amplitude calculation unit33performs addition processing to add the acquired envelope current amplitude to the composite amplitude value.

At step S310, the current amplitude calculation unit33increments the integer i.

At step S312, the current amplitude calculation unit33confirms whether or not all the N event-specific force amplitude envelopes are selected. Specifically, the current amplitude calculation unit33confirms whether or not the integer i is larger than N.

At step S304, when all the N event-specific force amplitude envelopes are not selected, that is, when integer i is N or less (i.e., NO in step S312), the current amplitude calculation unit33selects the i-th event-specific force amplitude envelope corresponding to the i-th waveform signal generation period among the remaining waveform signal generation periods.

On the other hand, when all the N event-specific force amplitude envelopes are selected, that is, when the integer i is larger than N (i.e., YES in step S312), at step S314the current amplitude calculation unit33outputs, to the modulation unit35, the composite amplitude value, that is, a value of the envelope current amplitude of the composite envelope. Thus, the synthetic processing is ended.

Although the weighting information is described as static information included in the correspondence information101pre-stored on the disk14in the signal generation device1of the present embodiment, the weighting information may also be dynamic information. Specifically, for example, the game program may also be configured to be able to rewrite the weighting information. In this case, since a value indicated by the weighting information can be changed according to the situation of the game, the priority of haptic presentation can be set for each event to change the priority according to the situation of the game or adjust the intensity of a force sense according to the situation of the game.

Further, in the signal generation device1of the present embodiment, such a configuration that the envelope generation information acquisition unit32acquires the envelope generation information from the disk14to generate an event-specific force amplitude envelope is described, but the envelope generation information acquisition unit32may also be configured to generate multiple patterns of event-specific force amplitude envelopes in advance and held in the memory13in order to read, from the memory13, an event-specific force amplitude envelope as needed.

Further, in the signal generation device1of the present embodiment, such a configuration that the current amplitude calculation unit33generates a composite envelope by synthesizing two weighted event-specific force amplitude envelopes, and acquires a value of the envelope current amplitude based on the generated composite envelope is described, but the present disclosure is not limited thereto. The current amplitude calculation unit33may also perform processing below when two event-specific force amplitude envelopes are synthesized without being weighted to generate a composite envelope and a value of the envelope current amplitude is acquired from the generated composite envelope. In other words, the current amplitude calculation unit33may also be configured to weight the amplitude of each of event-specific force amplitude envelopes that constitute the composite envelope, respectively, in order to acquire a value of the envelope current amplitude by adding the respective weighted amplitudes.

Further, in the signal generation device1of the present embodiment, such a configuration that the current amplitude calculation unit33synthesizes the two weighted event-specific force amplitude envelopes and uses the composite envelop as it is described, but the present disclosure is not limited thereto. For example, the current amplitude calculation unit33may also perform limiter processing to limit the upper limit of the composite envelope or perform processing to adjust the shape of the composite envelope.

Further, in the signal generation device1of the present embodiment, such a configuration that the modulation unit35outputs, to the output unit37, the generated waveform signal as it is described, but the present disclosure is not limited thereto. For example, the modulation unit35may also perform limiter processing to limit the upper limit of the waveform signal.

Further, in the signal generation device1of the present embodiment, another waveform signal may also be superimposed on the waveform signal based on the composite envelope output by the signal generation device1.

Further, such a configuration that the signal generation device1of the present embodiment generates a waveform signal to cause the controller21to vibrate according to the event in the virtual reality is described, but the present disclosure is not limited thereto. For example, when remotely operating an operation target such as a construction machine, a vehicle, or an airplane using a controller, the signal generation device1may be configured to generate a waveform signal to cause the controller to vibrate according to a real event in the operation target.

Further, in the signal generation device1of the present embodiment, such a configuration that the current amplitude calculation unit33generates the composite envelope72aobtained by synthesizing the event-specific force amplitude envelopes71Pa and71Pb based, for example, on the first envelope information P1and the second envelope information P2is described, but the present disclosure is not limited thereto. The current amplitude calculation unit33may also be configured to synthesize three or more event-specific force amplitude envelopes indicative of three or more pieces of envelope information, respectively, based on the three or more pieces of envelope information in order to generate a composite envelope.

Second Embodiment

A game system of a second embodiment is now described. Description of matters common to those in the first embodiment will be omitted in the second embodiment, and only different points will be described. In particular, similar actions and effects of similar configurations are not mentioned sequentially for each embodiment.

In the game system according to the first embodiment, such a configuration that the force wave74is generated using the unit force wave73pre-stored on the disk14is described, but the game system according to the second embodiment is different from the game system according to the first embodiment in that the unit force wave used to generate a force wave can be changed.

In the game system3, according to the first embodiment, since the waveform signal is generated by the force wave74based on the predetermined unit force wave73, there is a case where it may be difficult to obtain a force sense satisfied by the user6.

For details, force senses given to the user6are different between when the waveform signal is generated using the unit force wave73of the square wave and when the waveform signal is generated using a unit force wave having a shape different from that of the unit force wave73of the square wave.

Further, the satisfaction of the user6about the force sense varies depending, for example, on the hand sensitivity, the skin thickness, age, gender, the physical and mental states, and the usage time such as morning, afternoon, and night. Further, the user6has tastes and preferences about the feeling of the force sense, the intensity of stimulus, the quietness, and the power consumption.

In other words, in the game system3, according to the first embodiment, since the unit force wave used to generate a waveform signal is fixed despite the fact that the unit force wave to give a highly satisfied force sense to the user6is different depending on the user6, it is difficult to improve the satisfaction of the user6who was dissatisfied with the force sense based on the unit force wave.

FIG.19is a graph illustrating an example of candidate unit force waves stored on the disk according to the second embodiment of the present disclosure. Note that each horizontal axis indicates time and each vertical axis indicates amplitude inFIG.19. InFIG.19, unit force waves73,73a,and73bof candidate unit force waves as candidates of a unit force wave used to generate a force wave to be modulated by an envelope of a waveform signal are illustrated.

As illustrated inFIG.19, the unit force waves73,73a,and73bhave the same shape. Here, the fact that two unit force waves have “the same shape” means that one unit force wave is expanded or shrunk independently in the time axis direction and the amplitude axis direction, respectively, so that the waveform of one unit force wave after being expanded or shrunk and the waveform of the other unit force wave can be made to match each other. In the present embodiment, the unit force waves73,73a,and73bare square waves. On the other hand, the unit force waves73,73a,and73bare different in fundamental frequency.

For details, the unit force wave73is the same square wave as the unit force wave73illustrated inFIG.12. The unit force wave73ahas a cycle Pu1shorter than the cycle Pu of the unit force wave73. In other words, the unit force wave73ahas a fundamental frequency higher than the fundamental frequency of the unit force wave73.

The unit force wave73bhas a cycle Pu2longer than the cycle Pu of the unit force wave73. In other words, the unit force wave73bhas a fundamental frequency lower than the fundamental frequency of the unit force wave73.

FIG.20is a graph illustrating an example of candidate unit force waves stored on the disk according to the second embodiment of the present disclosure. Note that each horizontal axis indicates time and each vertical axis indicates amplitude inFIG.20. InFIG.20, unit force waves73,83, and84are illustrated as candidate unit force waves.

As illustrated inFIG.20, the unit force waves73,83, and84have the same cycle Pu, that is, they have the same fundamental frequency. On the other hand, the unit force waves73,83, and84have different shapes. Here, the fact that two unit force waves have “different shapes” means that one unit force wave is expanded or shrunk independently in the time axis direction and the amplitude axis direction, respectively, so that the waveform of one unit force wave after being expanded or shrunk and the waveform of the other unit force wave cannot be made to match each other. Specifically, each of the unit force waves73,83, and84is a square wave, a sawtooth wave, and a triangle wave, respectively.

Note that each unit force wave may have any shape as long as it is a periodic wave. For example, the shape of the unit force wave may be a waveform shape such as a sawtooth wave, a square wave, or a triangle wave, or a waveform shape obtained by part or all of a sign wave is combined.

FIG.21is a graph illustrating an example of candidate unit force waves stored on the disk according to the second embodiment of the present disclosure. Note that each horizontal axis indicates time and each vertical axis indicates amplitude inFIG.21. InFIG.21, unit force waves73,73c,and73dare illustrated as candidate unit force waves.

As illustrated inFIG.21, the unit force waves73,73c,and73dhave the same cycle Pu, that is, they have the same fundamental frequency. Further, the unit force waves73,73c,and73dhave the same shape. In the present embodiment, the unit force waves73,73c,and73dare square waves. On the other hand, the unit force waves73,73c,and73dare different in terms of the smoothness of the waveform shape.

For details, the unit force wave73is the same square wave as the unit force wave73illustrated inFIG.12,FIG.19, andFIG.20. The unit force wave73cis a square wave with rounded corners, for example, by reducing a high frequency component from the unit force wave73. The unit force wave73dis a square wave with further rounded corners, for example, by reducing a high frequency component from the unit force wave73c.

Note that the cases where the smoothness of the shapes of the square waves are different are described in the present embodiment, but the unit force waves made different in terms of smoothness are not limited to square waves, and they may also have any other shapes as long as they are periodic waves.

As illustrated inFIG.2, for example, seven pieces of candidate information respectively indicative of unit force waves73,73a,73b,73c,73d,83, and84are stored on the disk14. Each piece of candidate information is managed, for example, by an index. Note that the candidate information stored on the disk14is not limited to these seven pieces of candidate information, and candidate information indicative of any other unit force wave may also be stored. Further, for example, the candidate information has the same data format as the unit force wave information.

[Configuration of Force Wave Determination Device]

FIG.22is a block diagram illustrating the configuration of a force wave determination device according to the second exemplary embodiment of the present disclosure. For example, a force wave determination device2is implemented by causing the CPU12in the computer11to execute a force wave determination program as an example of the target program. The force wave determination device2includes, as functional blocks, a command reception unit51, a candidate information processing unit52(a candidate information acquisition unit and a determination unit), a presentation processing unit53, an envelope waveform information acquisition unit55, and an operation information reception unit57(a selection result acquisition unit).

The game program (seeFIG.1) controls the GPU16, for example, to cause the user6to select a unit force wave, and displays, on the display monitor20, a game content setting screen for tuning haptics or a game system setting screen. At this time, the game program outputs a force wave determination processing execution command to the command reception unit51.

When receiving the force wave determination processing execution command from the game program, the command reception unit51is configured to launch the force wave determination program and outputs the force wave determination processing execution command to the candidate information processing unit52.

When receiving the force wave determination processing execution command from the command reception unit51, the candidate information processing unit52is configured to acquire, from the disk14, two pieces of candidate information from among multiple pieces of candidate information stored on the disk14.

The two pieces of candidate information are candidate information for generating waveform signals, for example, to give very different stimuli. Specifically, the two pieces of candidate information are first candidate information for generating a waveform signal to give a strong stimulus and second candidate information for generating a waveform signal to give a weak stimulus. Note that the two pieces of candidate information may also candidate information for generating waveform signals to give very different degrees of quietness. Further, the two pieces of candidate information may be candidate information for generating waveform signals to give very different degrees of power consumption or base frequency, or the smoothness of waveform shapes, which are not limited to giving stimuli and quietness.

For example, the candidate information processing unit52is configured to output the first candidate information to the presentation processing unit53. At this time, the candidate information processing unit52can be configured to control the GPU16to display, on the display monitor20, that it is causing the controller21to generate a vibration (hereinafter, which may also be called a first candidate vibration) based on a unit force wave indicated by the first candidate information.

The envelope waveform information acquisition unit55refers to the correspondence information101(seeFIG.7) stored on the disk14to acquire envelope waveform information from the disk14. The envelope waveform information acquired by the envelope waveform information acquisition unit55is, for example, envelope waveform information corresponding to an event ID defined by default. Note that the envelope waveform information may also be designated by the game program. The envelope waveform information acquisition unit55outputs the acquired envelope waveform information to the presentation processing unit53.

When receiving the first candidate information from the candidate information processing unit52, the presentation processing unit53is configured to generate haptic information based on the first candidate information and the envelope waveform information received from the envelope waveform information acquisition unit55, and transmits the generated haptic information to the controller21via the communication interface17. Thus, the first candidate vibration occurs to the controller21.

When a predetermined waiting time W passes after the first candidate information is output to the presentation processing unit53, the candidate information processing unit52outputs the second candidate information to the presentation processing unit53. Thus, a vibration (hereinafter, which may also be called a second candidate vibration) based on the unit force wave indicated by the second candidate information occurs to the controller21. At this time, the candidate information processing unit52may also control the GPU16to display, on the display monitor20, that it is causing the controller21to generate the second candidate vibration.

Here, for example, the waiting time W is set longer than the length of the waveform signal generation period of the event-specific force amplitude envelope indicated by the envelope waveform information. This can prevent the first candidate vibration and the second candidate vibration from occurring at the same time.

When the waiting time W passes after the second candidate information is output to the presentation processing unit53, the candidate information processing unit52controls the GPU16to display, on the display monitor20, that the user6is urged to select either one of the first candidate vibration that first occurred and the second candidate vibration that last occurred.

FIG.23is a block diagram illustrating the configuration of a presentation processing unit in the force wave determination device according to the second embodiment of the present disclosure.FIG.24is a graph illustrating an example of an event-specific force amplitude envelope, a second candidate force wave, and a waveform signal according to the second embodiment of the present disclosure. Note that each horizontal axis indicates time and each vertical axis indicates amplitude inFIG.24. InFIG.24, the event-specific force amplitude envelope71P illustrated inFIG.13, a force wave74d,and a waveform signal75hare illustrated.

As illustrated inFIG.13,FIG.23, andFIG.24, the presentation processing unit53includes, as functional blocks, the counter34, the modulation unit35, the output unit37(e.g., a vibration generation unit), and a current amplitude calculation unit63.

When receiving the envelope waveform information from the envelope waveform information acquisition unit55, the current amplitude calculation unit63monitors the counted value of the counter34, that is, the current time, and when the confirmation time comes, the current amplitude calculation unit63acquires a value of the envelope current amplitude of an event-specific force amplitude envelope (for example, the event-specific force amplitude envelope71P illustrated inFIG.13andFIG.24) indicated by the envelope waveform information. The current amplitude calculation unit63outputs the acquired value of the envelope current amplitude to the modulation unit35.

When receiving the first candidate information from the candidate information processing unit52, the modulation unit35generates a unit force wave (for example, the unit force wave73illustrated inFIG.13) indicated by the first candidate information every cycle (for example, every cycle Pu) to generate a force wave, which may also be called a “first candidate force wave”, for example, the force wave74illustrated inFIG.13, in which the unit force wave is continuous.

The modulation unit35is configured to modulate the first candidate force wave by the value of the envelope current amplitude received from the current amplitude calculation unit63as the current time elapses to generate a waveform signal (hereinafter, which may also be called a first waveform signal) (for example, the waveform signal75aillustrated inFIG.13). The modulation unit35is configured to output a value of the signal current amplitude of the first waveform signal to the output unit37.

Further, when receiving the second candidate information from the candidate information processing unit52, the modulation unit35is configured to generate a unit force wave (for example, the unit force wave73dillustrated inFIG.21andFIG.24) indicated by the second candidate information every cycle (for example, every cycle Pu) to generate a force wave, which may also be called a “second candidate force wave, (for example, the force wave74dillustrated inFIG.24) in which the unit force wave is continuous.

The modulation unit35is also configured to modulate the second candidate force wave by the value of the envelope current amplitude received from the current amplitude calculation unit63as the current time elapses to generate a waveform signal, which may also be called a “second waveform signal” (for example, the waveform signal75hillustrated inFIG.24). The modulation unit35outputs a value of the signal current amplitude of the second waveform signal to the output unit37.

The output unit37causes the controller21to generate a vibration based on the first waveform signal, that is, the first candidate vibration, and to generate a vibration based on the second waveform signal, that is, the second candidate vibration, respectively. In the present embodiment, when receiving the value of the signal current amplitude from the modulation unit35, the output unit37digitally encodes the received value of the signal current amplitude to generate haptic information, and transmits the generated haptic information to the controller21via the communication interface17.

As illustrated inFIG.22, the operation information reception unit57acquires a selection result(s) of the first candidate vibration and the second candidate vibration by the user6.

In the present embodiment, the user6is looking at the display monitor20, for example, while holding the controller21in hand. Based on the first candidate vibration that first occurred to the controller21and the second candidate vibration that last occurred to the controller21, the user6recognizes a force sense by the first candidate vibration, which may also be called a “first force sense” and a force sense by the second candidate vibration, which may also be called a “second force sense”, respectively.

The user6performs an operation on the controller21to select a vibration to generate a force sense that suits user's taste and preference between the first force sense and the second force sense. Specifically, the user6performs an operation on the controller21to select either one of the first candidate vibration that first occurred and the second candidate vibration that last occurred.

The controller21generates operation information indicative of the operation result by the user6, and transmits the operation information to the operation information reception unit57. When receiving the operation information from the controller21, the operation information reception unit57outputs the received operation information to the candidate information processing unit52.

The candidate information processing unit52determines a force wave based on the operation information acquired by the operation information reception unit57. In the present embodiment, for example, when the operation information indicates that the first candidate vibration that first occurred is selected by the user6, the candidate information processing unit52discards the second candidate information for generating a waveform signal to give a weak stimulus. Then, the candidate information processing unit52acquires, from the disk14, new second candidate information for generating a waveform signal to give a stimulus slightly stronger than the weak stimulus from among the multiple pieces of candidate information stored on the disk14.

The candidate information processing unit52outputs, to the presentation processing unit53, the first candidate information that was not discarded. Then, when the waiting time W passes after the first candidate information is output to the presentation processing unit53, the candidate information processing unit52outputs the new second candidate information to the presentation processing unit53.

On the other hand, for example, when the operation information indicates that the second candidate vibration that last occurred is selected by the user6, the candidate information processing unit52discards the first candidate information for generating a waveform signal to give a strong stimulus. Then, the candidate information processing unit52acquires, from the disk14, new first candidate information for generating a waveform signal to give a stimulus slightly weaker than the strong stimulus from among the multiple pieces of candidate information stored on the disk14.

The candidate information processing unit52outputs the new first candidate information to the presentation processing unit53. Then, when the waiting time W passes after the new first candidate information is output to the presentation processing unit53, the candidate information processing unit52outputs, to the presentation processing unit53, the second candidate information that was not discarded.

Further, when a predetermined condition is met, the candidate information processing unit52determines that the selection of the unit force wave was sufficiently narrowed down, and determines the unit force wave to be used in the game program. Then, the candidate information processing unit52stores (registers) the candidate information indicative of the unit force wave on the disk14as unit force wave information, and outputs, to the game program, determination information indicating that the force wave was determined. For example, when receiving the determination information from the candidate information processing unit52, the game program controls the GPU16to switch the display content of the display monitor20from the game content setting screen or the game system setting screen to a game execution screen.

Here, the predetermined condition is, for example, that candidate information for generating a waveform signal to give a stimulus that suits the taste and preference of the user6could be determined. Note that the predetermined condition may also be that there was no candidate information to be newly presented among the multiple pieces of candidate information stored on the disk14.

FIG.25is a flowchart defining an operation procedure when the force wave determination device according to the second embodiment of the present disclosure performs force wave determination processing.

As illustrated inFIG.25, such a situation that the command reception unit51in the force wave determination device2accepts a force wave determination processing execution command from the game program to launch a force wave determination program is first assumed.

At step S402, When receiving the force wave determination processing execution command from the command reception unit51, the candidate information processing unit52acquires, from the disk14, two pieces of candidate information from among the multiple pieces of candidate information stored on the disk14.

At step S404, the candidate information processing unit52outputs, to the presentation processing unit53, first candidate information of the acquired two pieces of candidate information. When receiving the first candidate information from the candidate information processing unit52, the presentation processing unit53causes the controller21to generate a first candidate vibration based on the first candidate information and the envelope waveform information. Thus, haptic presentation based on the first candidate vibration is performed.

At step S406, when the waiting time W passes after the first candidate information is output to the presentation processing unit53, the candidate information processing unit52outputs, to the presentation processing unit53, second candidate information of the acquired two pieces of candidate information. When receiving the second candidate information from the candidate information processing unit52, the presentation processing unit53causes the controller21to generate a second candidate vibration based on the second candidate information and the envelope waveform information. Thus, haptic presentation based on the second candidate vibration is performed.

At step S408, when the waiting time W passes after the second candidate information is output to the presentation processing unit53, the candidate information processing unit52controls the GPU16to display, on the display monitor20, that the user6is urged to select either one of the first candidate vibration that first occurred and the second candidate vibration that last occurred.

Next, the operation information reception unit57waits until operation information is received from the controller21(i.e., NO in step S410). Then, when receiving operation information from the controller21(i.e., YES in step S410), the operation information reception unit57outputs the received operation information to the candidate information processing unit52.

At step S412, when receiving the operation information from the operation information reception unit57, the candidate information processing unit52determines whether or not the selection of the unit force wave was narrowed down sufficiently based on the operation information.

When determining that the selection of the unit force wave was not sufficiently narrowed down (i.e., NO in step S412), at step S416, the candidate information processing unit52discards candidate information that was not selected by the user6, and acquires new candidate information from the disk14.

Next, the candidate information processing unit52outputs, to the presentation processing unit53, first candidate information from between the new candidate information and the candidate information selected by the user6. When receiving the first candidate information from the candidate information processing unit52, the presentation processing unit53causes the controller21to generate a first candidate vibration based on the first candidate information and the envelope waveform information. Thus, haptic presentation based on the first candidate vibration is performed (step S404).

On the other hand, when determining that the selection of the unit force wave was sufficiently narrowed down (i.e., YES in step S412), at step S414, the candidate information processing unit52determines the unit force wave to be used in the game program, and stores candidate information indicative of the unit force wave on the disk14as unit force wave information.

The candidate information processing unit52outputs, to the game program, determination information indicating that the unit force wave was determined, and the force wave determination processing is ended.

FIG.26is a flowchart defining an operation procedure when the force wave determination device according to the second embodiment of the present disclosure performs force wave determination processing using indexes. The flowchart illustrated inFIG.26is different from the flowchart illustrated inFIG.25in that indexes are used to determine whether or not the selection of the unit force wave was sufficiently narrowed down.

As illustrated inFIG.26, for example, such a situation that M (an integer of 2 or greater) pieces of candidate information are stored on the disk14and these pieces of candidate information are managed by 1 to M indexes is first assumed.

At step S500, when receiving the force wave determination processing execution command from the command reception unit51, the candidate information processing unit52in the force wave determination device2performs initial value setting processing for setting an integer j to 1.

At step S502, the candidate information processing unit52acquires, from the disk14, candidate information with an index of j and candidate information with an index of j+1 from among the M pieces of candidate information stored on the disk14.

At step S504, the candidate information processing unit52outputs, to the presentation processing unit53, the candidate information with the index of j as first candidate information. When receiving the first candidate information from the candidate information processing unit52, the presentation processing unit53causes the controller21to generate a first candidate vibration based on the first candidate information and the envelope waveform information. Thus, haptic presentation based on the first candidate vibration is performed.

Next, when the waiting time W passes after the first candidate information is output to the presentation processing unit53, the candidate information processing unit52outputs, to the presentation processing unit53, the candidate information with the index of j+1 as second candidate information. When receiving the second candidate information from the candidate information processing unit52, the presentation processing unit53causes the controller21to generate a second candidate vibration based on the second candidate information and the envelope waveform information.

At step S506, haptic presentation based on the second candidate vibration is performed.

At step S508, when the waiting time W passes after the first candidate information is output to the presentation processing unit53, the candidate information processing unit52controls the GPU16to display, on the display monitor20, that the user6is urged to select either one of the first candidate vibration that first occurred and the second candidate vibration that last occurred.

Next, the operation information reception unit57waits until operation information is received from the controller21(i.e., NO in step S510). Then, when receiving operation information from the controller21(i.e., YES in step S510), the operation information reception unit57outputs the received operation information to the candidate information processing unit52.

At step S512, when receiving the operation information from the operation information reception unit57, the candidate information processing unit52determines whether or not the integers j and M are equal to each other.

At step S516, when determining that the integers j and M are not equal (i.e., NO in step S512), the candidate information processing unit52increments the integer j.

At step S518, the candidate information processing unit52discards candidate information that was not selected by the user6, and acquires candidate information with the index of j+1 from the disk14.

Next, the candidate information processing unit52outputs, to the presentation processing unit53, first candidate information as either one of the candidate information with the index of j+1 and the candidate information selected by the user6. When receiving the first candidate information from the candidate information processing unit52, the presentation processing unit53causes the controller21to generate a first candidate vibration based on the first candidate information and the envelope waveform information. Thus, haptic presentation based on the first candidate vibration is performed (step S504).

On the other hand, when determining that the integers j and M are equal (i.e., YES in step S512), at step S514, the candidate information processing unit52determines the unit force wave to be used in the game program, and stores candidate information indicative of the unit force wave on the disk14as unit force wave information.

The candidate information processing unit52outputs, to the game program, determination information indicating that the unit force wave was determined, and the force wave determination processing is ended.

Note that, in the force wave determination device2of the present embodiment, such a configuration that the user6selects either one of the first candidate vibration that first occurred and the second candidate vibration that last occurred is described, but the present disclosure is not limited thereto. For example, the configuration may also be such that an AI (Artificial Intelligence) that learned the taste and preference of the user6selects either one of the first candidate vibration that first occurred and the second candidate vibration that last occurred. This can determine a unit force wave that suits the taste and preference of the user6in a short time without burdening the user6.

Further, in the force wave determination device2of the present embodiment, such a configuration that the candidate information and the unit force wave information indicate the unit force wave is described, but the present disclosure is not limited thereto. The configuration may also be such that the candidate information and the unit force wave information indicate a force wave in which multiple of unit force waves concerned are continuous.

Further, in the force wave determination device2of the present embodiment, such a configuration that both the first candidate vibration that first occurred and the second candidate vibration that last occurred are presented to the user6is described, but the present disclosure is not limited thereto. The force wave determination device2may be configured to present three or more candidate vibrations to the user6so that the user6selects one candidate vibration from among these candidate vibrations.

Further, in the signal generation device1of the first embodiment and the force wave determination device2of the present embodiment, such a configuration that each force wave is a periodic wave is described, but the present disclosure is not limited thereto. The force wave may be a wave with no cycle. Specifically, for example, the configuration may also be such that part of the force wave is a periodic wave such as in a case where L unit force waves73aeach having the cycle Pu1(seeFIG.19) (L is an integer of 2 or greater) are continuing after K unit force waves73each having the cycle Pu (seeFIG.19) (K is an integer of 2 or greater) are continued. In other words, the force wave may also be configured to include a wave having a cycle. Further, for example, the force wave may be so configured that the cycle Pu of the unit force wave73changes at random.

Further, in the force wave determination device2of the present embodiment, such a configuration that the waveform shape of each unit force wave for one cycle has point symmetry or rotational symmetry, such as the unit force wave83as a sawtooth wave, the unit force wave73as a square wave, and the unit force wave84(seeFIG.20) as a triangle wave, is described, the present disclosure is not limited thereto.FIG.27is a graph illustrating a modification of a candidate unit force wave stored on the disk according to the second embodiment of the present disclosure. As illustrated inFIG.27, like a unit force wave85, the waveform shape of the candidate unit force wave for one cycle may also be configured not to have any symmetry such as point symmetry, rotational symmetry, or line symmetry, that is, the waveform shape for one cycle may be asymmetrical. Further, the unit force waves73a,73b,73c,73d,83,84, and85can be used in the signal generation device1of the first embodiment.

Further, in the signal generation device1of the first embodiment and the force wave determination device2of the present embodiment, such a configuration that the sign of the amplitude of an event-specific force amplitude envelope is either positive or negative like the event-specific force amplitude envelope71P (seeFIG.8) and the event-specific force amplitude envelope71M (seeFIG.9) is described, but the present disclosure is not limited thereto. The event-specific force amplitude envelope may also be configured to include a part in which the sign of the amplitude is positive and a part in which the sign of the amplitude is negative.

FIG.28is a graph illustrating a modification of an event-specific force amplitude envelope according to the first embodiment and the second embodiment of the present disclosure. As illustrated inFIG.28, for example, an event-specific force amplitude envelope111has a part111pin which the sign of the amplitude is positive and a part111min which the sign of the amplitude is negative during a waveform signal generation period Tpm. For example, when a force wave74is modulated by the event-specific force amplitude envelope111, a waveform signal115is generated.

As mentioned above, the exemplary embodiments of the present disclosure are described. The signal generation device1generates a waveform signal to cause the controller21to generate a vibration according to an event. In the signal generation device1, the envelope generation information acquisition unit32acquires first envelope information P1indicative of the event-specific force amplitude envelope71Pa of the waveform signal75dcorresponding to the event E1, and second envelope information P2indicative of the event-specific force amplitude envelope71Pb of the waveform signal75ecorresponding to the event E1. Based on the first envelope information P1and the second envelope information P2, the current amplitude calculation unit33generates the composite envelope72aobtained by synthesizing the event-specific force amplitude envelopes71Pa and71Pb. The modulation unit35modulates the force wave74by the composite envelope72ato generate the waveform signal75b.

Thus, such a configuration that the composite envelope72aobtained by synthesizing the event-specific force amplitude envelope71Pa having a time change smaller than the time change of the waveform signal75d,and the event-specific force amplitude envelope71Pb having a time change smaller than the time change of the waveform signal75eis generated can suppress a change in the shape of the composite envelope72adue to the difference between the start time of the waveform signal75dand the start time of the waveform signal75e.Thus, even when occurrence times of two events vary, since the change in the shape of the composite envelope72ais suppressed, the change in the shape of the waveform signal75bto cause the controller21to vibrate can be suppressed. Therefore, in the configuration to generate a waveform signal to cause the controller21to generate a vibration according to an event, the modes of vibration in the controller21when two events have occurred can be stabilized. Thus, the user6can receive an expected force sense, and the sense of presence can be improved by the favorable force sense.

Further, in the signal generation device1, the envelope generation information acquisition unit32acquires first envelope information Q1indicative of the event-specific force amplitude envelope71Pc of the waveform signal75fcorresponding to the event E1, and second envelope information Q2indicative of the event-specific force amplitude envelope71Ma corresponding to the waveform signal75gcorresponding to the event E2. Based on the first envelope information Q1and the second envelope information Q2, the current amplitude calculation unit33generates the composite envelope72bobtained by synthesizing the event-specific force amplitude envelopes71Pc and71Ma. The modulation unit35modulates the force wave74by the composite envelope72bto generate the waveform signal75c.

Thus, such a configuration that the composite envelope72bobtained by synthesizing the event-specific force amplitude envelope71Pc having a time change smaller than the time change of the waveform signal75f,and the event-specific force amplitude envelope71Ma having a time change smaller than the time change of the waveform signal75gis generated can suppress a change in the shape of the composite envelope72bdue to the difference between start time t5of the waveform signal75fand start time t6of the waveform signal75g.Thus, even when occurrence times of two events vary, since the change in the shape of the composite envelope72bis suppressed, the change in the shape of the waveform signal75cto cause the controller21to vibrate can be suppressed. Therefore, in the configuration to generate a waveform signal to cause the controller21to generate a vibration according to an event, the modes of vibration in the controller21when two events have occurred can be stabilized. Thus, the user6can receive an expected force sense, and the sense of presence can be improved by the favorable force sense.

Further, in the signal generation device1, the sign of the event-specific force amplitude envelope71Pa and the sign of the event-specific force amplitude envelope71Pb are the same.

With such a configuration, since the amplitude of the composite envelope72acan be made equal to or more than the amplitudes of the event-specific force amplitude envelopes71Pa and71Pb, the waveform signal75bsuitable for events that require the effect of strengthening two events with each other when the two events overlap, for example, like when being pulled twice in the same direction, can be generated. Thus, even when the occurrence times of the two events vary, a force sense of being pulled in the same direction in two stages can be stably given to the user6.

Further, in the signal generation device1, the sign of the event-specific force amplitude envelope71Pc and the sign of the event-specific force amplitude envelope71Ma are different.

With such a configuration, since the amplitude of the composite envelope72bcan be made equal to or less than the amplitudes of the event-specific force amplitude envelopes71Pc and71Ma, the waveform signal75csuitable for events that require the effect of weakening two events with each other when the two events overlap, for example, like when being pulled from a certain direction and further pulled from an opposite direction, can be generated. Thus, even when the occurrence times of the two events vary, a weak force sense as a result of being pulled from opposite directions can be stably given to the user6.

Further, in the signal generation device1, the waveform signal75dis started at time t1based on the start time of the event indicated by the event information used to generate the first envelope information P1. The waveform signal75eis started at time t2based on the start time of the event indicated by the event information used to generate the second envelope information P2. The current amplitude calculation unit33generates the composite envelope72aobtained by synthesizing the event-specific force amplitude envelope71Pa started at time t1and the event-specific force amplitude envelope71Pb started at time t2.

With such a configuration, the start time t1of the event-specific force amplitude envelope71Pa can be made simultaneous with the start time of the corresponding event, or made later or earlier than the start time of the corresponding event. Similarly, the start time t2of the event-specific force amplitude envelope71Pb can be made simultaneous with the start time of the corresponding event, or made later or earlier than the start time of the corresponding event. Thus, in consideration of perceptual properties of a force sense corresponding to the content of the event, a comfortable force sense that suits the content can be given to the user6.

Further, in the signal generation device1, the waveform signal75fis started at time t5based on the start time of the event indicated by the event information used to generate the first envelope information Q1. The waveform signal75gis started at time t6based on the start time of the event indicated by the event information used to generate the second envelope information Q2. The current amplitude calculation unit33generates the composite envelope72bobtained by synthesizing the event-specific force amplitude envelope71Pc started at time t5and the event-specific force amplitude envelope71Ma started at time t6.

With such a configuration, the start time t5of the event-specific force amplitude envelope71Pc can be made simultaneous with the start time of the corresponding event, or made later or earlier than the start time of the corresponding event. Similarly, the start time t6of the event-specific force amplitude envelope71Ma can be made simultaneous with the start time of the corresponding event, or made later or earlier than the start time of the corresponding event. Thus, in consideration of perceptual properties of a force sense corresponding to the content of the event, a comfortable force sense that suits the content can be given to the user6.

Further, in the signal generation device1, the envelope generation information acquisition unit32acquires the weighting information w1indicative of weighting of the event-specific force amplitude envelopes71Pa and71Pb. The current amplitude calculation unit33generates the composite envelope72aobtained by synthesizing the event-specific force amplitude envelopes71Pa and71Pb based on the weighting information w1.

With such a configuration, for example, at least either one of the amplitude of the event-specific force amplitude envelope71Pa and the amplitude of the event-specific force amplitude envelope71Pb can be adjusted and synthesized to generate the composite envelope72a.Thus, a force sense to be given to the user6can be adjusted according to the content of the event. Further, at least either one of the amplitude of the event-specific force amplitude envelope71Pa and the amplitude of the event-specific force amplitude envelope71Pb can be dynamically adjusted and synthesized to generate the composite envelope72a.Thus, a force sense to be given to the user6can be adjusted according to the progress of the game, the degree of overlap between the event-specific force amplitude envelopes71Pa and71Pb, or the like.

Further, in the signal generation device1, the envelope generation information acquisition unit32acquires the pieces of weighting information w1and w2indicative of weighting of the event-specific force amplitude envelopes71Pc and71Ma, respectively. Based on the pieces of weighting information w1and w2, the current amplitude calculation unit33generates the composite envelope72bobtained by synthesizing the event-specific force amplitude envelopes71Pc and71Ma.

With such a configuration, for example, at least either one of the amplitude of the event-specific force amplitude envelope71Pc and the amplitude of the event-specific force amplitude envelope71Ma can be adjusted and synthesized to generate the composite envelope72b.Thus, a force sense to be given to the user6can be adjusted according to the content of the event. Further, at least either one of the amplitude of event-specific force amplitude envelope71Pc and the amplitude of the event-specific force amplitude envelope71Ma can be dynamically adjusted and synthesized to generate the composite envelope72b.Thus, a force sense to be given to the user6can be adjusted according to the progress of the game, the degree of overlap between the event-specific force amplitude envelopes71Pc and71Ma, or the like.

Further, in the signal generation device1, the force wave74is a wave vibrating during the waveform signal generation period Tpa of the event-specific force amplitude envelope71Pa and the waveform signal generation period Tpb of the event-specific force amplitude envelope71Pb, or during the waveform signal generation period Tpc of the event-specific force amplitude envelope71Pc and the waveform signal generation period Tma of the event-specific force amplitude envelope71Ma.

With such a configuration, the force wave74can be modulated properly by the composite envelopes72aand72bto generate favorable waveform signals75band75c.

Further, in the signal generation device1, the force wave74has the cycle Pu.

With such a configuration, the force wave74can be generated by simple processing to make unit force wave73with fewer amount of data continuous.

Further, in the force wave determination device2, the candidate information processing unit52acquires first candidate information indicative of a first candidate wave as a candidate of the force wave74modulated by the event-specific force amplitude envelope71P of a waveform signal to cause the controller21to generate a vibration, and second candidate information indicative of a second candidate force wave as the candidate but different from the first candidate force wave. Based on the first candidate information and the second candidate information, the modulation unit35modulates the first candidate force wave and the second candidate force wave respectively by the event-specific force amplitude envelope71P to generate the waveform signals75aand75h.The output unit37causes the controller21to generate a first candidate vibration based on the waveform signal75aand a second candidate vibration based on the waveform signal75h,respectively. The operation information reception unit57acquires a result of selecting either one of the first candidate vibration and the second candidate vibration. Then, the candidate information processing unit52determines a force wave based on the result.

Thus, such a configuration that the waveform signal75abased on the first candidate force wave and the waveform signal75hbased on the second candidate force wave different from the first candidate force wave is generated can cause the controller21to generate the first candidate vibration based on the waveform signal75aand the second candidate vibration based on the waveform signal75hdifferent from the first candidate vibration. Thus, since different force senses can be generated by the first candidate vibration and the second candidate vibration, it can be determined which of the first candidate vibration and the second candidate vibration suits the taste of the user6based on the result of selecting either one of the first candidate vibration and the second candidate vibration. Therefore, a force sense that suits the taste of the user6can be realized.

Further, in the force wave determination device2, the force waves74and74dhave the cycle Pu.

With such a configuration, the unit force waves73and73dcan be generated by simple processing to make the unit force waves73and73dwith fewer amount of data continuous.

Further, in the force wave determination device2, for example, the first candidate force wave is a force wave in which the unit force wave73is continuous, and the second candidate force wave is a force wave in which the unit force wave73ais continuous. The waveform of the first candidate force wave and the waveform of the second candidate force wave have the same shape. Then, the fundamental frequency of the first candidate force wave and the fundamental frequency of the second candidate force wave are different.

Thus, such a configuration that the fundamental frequency of the first candidate force wave and the fundamental frequency of the second candidate force wave are made different can determine a fundamental frequency to give a force sense that suits the taste of the user6.

Further, in the force wave determination device2, for example, the first candidate force wave is a force wave in which the unit force wave73is continuous, and the second candidate force wave is a force wave in which the unit force wave83is continuous. The fundamental frequency of the first candidate force wave and the fundamental frequency of the second candidate force wave are the same. Then, the waveform of the first candidate force wave and the waveform of the second candidate force wave have different shapes.

Thus, such a configuration that the waveform of the first candidate force wave and the waveform of the second candidate force wave have different shapes can determine the shape of a force wave to give a force sense that suits the taste of the user6.

Further, in the force wave determination device2, for example, the first candidate force wave is a force wave in which the unit force wave73is continuous, and the second candidate force wave is a force wave in which the unit force wave73dis continuous. The fundamental frequency of the first candidate force wave and the fundamental frequency of the second candidate force wave are the same. The waveform of the first candidate force wave and the waveform of the second candidate force wave have the same shape. Then, the smoothness of the waveform of the first candidate force wave and the smoothness of the waveform of the second candidate force wave are different.

Thus, such a configuration that the smoothness of the waveform of the first candidate force wave and the smoothness of the waveform of the second candidate force wave are different can adjust the proportion of high frequency components of a force wave optimized, for example, in terms of the parameters of the fundamental frequency and the waveform, to further optimize the force wave in order to determine a force wave to give a force sense that suits the taste of the user6.

Further, in the force wave determination device2, the operation information reception unit57acquires the selection results of the first candidate vibration and the second candidate vibration by the user6.

With such a configuration, since the taste of the user6can be directly reflected in the selection of the first candidate vibration and the second candidate vibration, a force wave to give a force sense unsuitable to the taste of the user6can be prevented from being determined.

Further, in the force wave determination device2, the force waves74and74dare waves vibrating during the waveform signal generation period Tp of the event-specific force amplitude envelope71P.

With such a configuration, the force waves74and74dcan be modulated properly by the event-specific force amplitude envelope71P to generate the favorable waveform signals75aand75h.

In general, it is noted that each of the embodiments described above is to make it easier to understand the present disclosure, and it is not intended to limit the interpretation of the present disclosure. The present disclosure can be changed/improved without departing from the scope thereof, and equivalents thereof are included in the present disclosure. Namely, any design change added to each embodiment by a person skilled in the art is included in the scope of the present disclosure as long as it has the features of the present disclosure. For example, each element, the arrangement, material, condition, shape, and size of the element, and the like included in each embodiment are not limited to those illustrated, and changes can be made appropriately. Further, each embodiment is just an illustrative example, and it is needless to say that configurations illustrated in different embodiments can be partially replaced or combined, and these are included in the scope of the present disclosure as long as they have the features of the present disclosure.

REFERENCE SIGNS LIST