INFORMATION PROCESSING DEVICE, INFORMATION PROCESSING METHOD, AND RECORDING MEDIUM

Provided is an information processing device including an input detector that detects a designated position of a display, a tag generator that generates a tag image by associating the position detected by the input detector with input information to be input and displays the generated tag image on the display, and a display processor that displays, on the display, a plurality of pieces of the input information associated with each of a plurality of the tag images generated by the tag generator, based on each of attributes of the plurality of tag images.

INCORPORATION BY REFERENCE

This application is based upon and claims the benefit of priority from the corresponding Japanese Patent Application No. 2019-100123 filed on May 29, 2019, the entire contents of which are incorporated herein by reference.

BACKGROUND OF THE INVENTION

Field of the Invention

The present disclosure relates to an information processing device in which it is possible to draw (input) drawing information on a display with a touch pen, and also relates to an information processing method and an information processing program.

Description of the Background Art

Conventionally, an electronic board (also referred to as an electronic blackboard or an electronic whiteboard) is known as one of display devices (information processing devices) in which a touch panel is used to receive an instruction input (touch) from a user. The electronic board reads position coordinates of information (an object) handwritten with a touch pen or the like on a touch panel, recognizes the object as a character, based on the information of the read position coordinates, converts the character into text, and displays the converted text on a display.

There is proposed a tag image in which a so-called tag paper is electronically represented on the electronic board. A tag function enables display of various opinions in tag images at a meeting or the like. However, a conventional tag function only has a mode for displaying a plurality of tag images on a display, a mode for moving the tag images to any position, and the like, and it is difficult to efficiently create materials such as meeting minutes.

SUMMARY OF THE INVENTION

An object of the present disclosure is to provide an information processing device capable of efficiently creating materials utilizing a tag function, and also to provide an information processing method and an information processing program.

An information processing device according to an aspect of the present disclosure includes an input detector that detects a designated position of a display, a tag generator that generates a tag image by associating the position detected by the input detector with input information to be input and displays the generated tag image on the display, and a display processor that displays, on the display, a plurality of pieces of the input information associated with each of a plurality of the tag images generated by the tag generator, based on each of attributes of the plurality of tag images.

An information processing method according to another aspect of the present disclosure includes using one or more processors to execute: an input detection process for detecting a designated position of a display; a tag generation process for generating a tag image by associating the position detected in the input detection process with input information to be input, and displaying the generated tag image on the display; and a display process for displaying, on the display, a plurality of pieces of the input information associated with each of a plurality of the tag images generated in the tag generation process, based on each of attributes of the plurality of tag images.

In a non-transitory recording medium for storing an information processing program according to another mode of the present disclosure, the program causes one or more processors to execute: an input detection process for detecting a designated position of a display, a tag generation process for generating a tag image by associating the position detected in the input detection process with input information to be input, and displaying the generated tag image on the display, and a display process for displaying, on the display, a plurality of pieces of the input information associated with each of a plurality of the tag images generated in the tag generation process, based on each of attributes of the plurality of tag images.

According to the present disclosure, it is possible to provide an information processing device capable of efficiently creating materials utilizing a tag function, and also to provide an information processing method, and an information processing program.

DESCRIPTION OF THE PREFERRED EMBODIMENTS

An embodiment of the present disclosure will be described below with reference to the attached drawings. The following embodiment is an example in which the present disclosure is embodied, and does not intend to limit the technical scope of the present disclosure.

As illustrated inFIG. 1, an information processing device1according to the embodiment of the present disclosure includes a touch display100, a control device200, and a touch pen300. The control device200is a computer that is connected to the touch display100and that controls the touch display100. The touch pen300is connected to the control device200via a network (wireless communication or wired communication). The touch pen300may be omitted.

The touch display100includes a touch panel110and a display120. The touch panel110may be a capacitive touch panel, or may be a pressure sensitive or an infrared ray touch panel. That is, the touch panel110may be any device capable of appropriately receiving a user operation input such as a touch. The touch panel110is provided in the display120. The display120is, for example, a liquid crystal display. The display120is not limited to a liquid crystal display, and may be a light emitting diode (LED) display, an organic electro-luminescence (EL) display, a projector, or the like.

The touch display100may be a device such as a computer, a tablet terminal, a smartphone, and a car navigation system where a touch panel is provided.

The touch pen300is a pen used by a user to touch (input into) the touch display100. If the touch pen300is omitted, the user touches (inputs to) the touch display100with a finger. For example, the user inputs (draws) an object such as a character or a figure by handwriting with the touch pen300or a finger.

As illustrated inFIG. 1, the control device200includes a storage220and a controller210.

The storage220is a non-volatile storage such as a hard disk drive (HDD) or a solid state drive (SSD) that stores various types of information.

Specifically, the storage220stores tag information222on a tag image created on the touch display100by the user.FIG. 2is a diagram illustrating an example of the tag information222. As illustrated inFIG. 2, information such as “tag ID”, “page number”, “position”, “color”, “size”, and “input information” for each tag image P is registered with the tag information222. The “tag ID” is identification information of the tag image P. The “page number” is the number of the page on which the tag image P is generated. The “position” is a coordinate position of the tag image P on the display120. The “color” is a background color of the tag image P. The “color” is an example of an attribute of a tag image according to the present disclosure. The “size” is the size of an outer shape of the tag image P on the display120. The “input information” is information input by the user, such as a character, a figure, and a symbol displayed in an area of the tag image P. The user may input the input information with the touch pen300or a finger on the touch panel110, or may input the input information using an operation device such as a keyboard and a mouse. In the tag information222, the above information is stored in an order (time series) in which the tag images P are generated.

Further, the storage220also stores input information input to an area other than the tag image P.

Further, the storage220stores a control program such as an information processing program221for causing the controller210to execute information processing (seeFIG. 11) described later. For example, the information processing program221is recorded non-temporarily on a computer-readable recording medium such as a CD or a DVD, read by a reading device (not illustrated) such as a CD drive or a DVD drive provided in the information processing device1, and stored in the storage220.

The controller210includes a control device such as a CPU, a ROM, and a RAM. The CPU is a processor that executes various types of arithmetic processes. The ROM is a non-volatile storage in which a control program such as BIOS and OS for causing the CPU to execute various types of arithmetic processes is stored in advance. The RAM is a volatile or non-volatile storage that stores various types of information, and is used as a temporary storage memory (working area) for various types of processes executed by the CPU. The controller210controls the information processing device1by causing the CPU to execute various types of control programs stored in advance in the ROM or the storage220.

Specifically, as illustrated inFIG. 1, the controller210includes various types of processing devices such as an input detector211, a tag generator212, a tag processor213, and a display processor214. The controller210functions as the various types of processing devices by causing the CPU to execute various types of processes according to the information processing program221. Further, some or all of the processing devices may be configured by an electronic circuit. The information processing program221may be a program for causing a plurality of processors to function as the various types of processing devices.

The input detector211detects an input to the touch display100by the touch pen300or a finger. The input detector211is an example of an input detector according to the present disclosure. Specifically, the input detector211detects the page number and position coordinates of a position specified by the touch pen300or the finger of the user on the touch panel110. For example, if the user inputs a character by handwriting on the touch panel110, the input detector211detects the page number and the position coordinates of the input position. Further, if the user performs an operation to activate a tag function on the touch panel110, the input detector211detects the page number and the position coordinates of a position corresponding to the operation. Specifically, if the user maintains the contact state of the touch pen300at any position of the touch panel110(depresses the touch panel110with the touch pen300at any position) for a predetermined time, the tag function is activated (the mode transitions to a tag mode). In this case, the input detector211detects the contact position of the touch pen300, that is, the page number and the position coordinates of the position of the touch panel110depressed by the touch pen300for a predetermined time.

The tag generator212generates the tag image P by associating the page number and the position detected by the input detector211with the input information input by the user, and displays the generated tag image P on the display120. Further, the tag generator212displays the input information in the area of the tag image P selected on the display120. The tag generator212is an example of a tag generator according to the present disclosure.

For example, as illustrated inFIG. 3A, if the user depresses the touch panel110at any position X with the touch pen300for a long time to shift to the tag mode, the tag generator212displays a tag selection screen D1on the display120. Next, if the user selects a desired color on the tag selection screen D1with the touch pen300, as illustrated inFIG. 3B, the tag generator212displays the tag image P with the background color of the selected color at the position X on the display120.FIG. 3Billustrates the tag image P with the background color being red. Next, if the user selects the tag image P with the touch pen300, the mode shifts to an input mode for displaying information in the area of the tag image P. If the mode shifts to the input mode, the user inputs a character, a figure, a symbol, and the like using the touch pen300or an operation device (such as a keyboard). For example, as illustrated inFIG. 3C, if the user inputs by handwriting the characters “Osaka, Increase sales staff by 3” in the tag image P with the touch pen300, the tag generator212displays the input characters (input information) in the area of the tag image P. The tag generator212may display the input information in the tag image P in a handwritten font, or may display the input information in the tag image P in a previously set font (typeface, character size, character color), or may display the input information in the tag image P in a font selected by the user. The user selects a color in accordance with the category of the input information (such as the provider of the input information and the content of the input information).

Here, the tag selection screen D1may include an item for selecting the size of the tag image P. In this case, the tag generator212generates the tag image P in a size selected by the user. If the item for selecting the size of the tag image P is not included in the tag selection screen D1, the tag generator212generates the tag image P in a size at an initial setting. The size of the tag image P may be changed (enlarged or reduced) at any timing after the tag image P is displayed on the display120.

The tag generator212registers, with the tag information222, tag information corresponding to the generated tag image P. Specifically, the tag generator212registers, with the tag information222, information including the page number at which the tag image P is generated, the position coordinates corresponding to the position X (display position) of the tag image P, the color, the size, and the input information, in association with the identification information (tag ID) of the tag image P. For example, for the tag image P corresponding toFIG. 3C, the tag ID “001” is registered in association with the position coordinates (x1, y1) corresponding to the position X, the color “red”, the size “F1”, and the input information “T1” (“Osaka, Increase sales staff by 3”) (seeFIG. 2).FIG. 4illustrates a display screen of the display120in which nine tag images P are generated and displayed by the tag generator212. The tag information222illustrated inFIG. 2indicates the tag information of the nine tag images P illustrated inFIG. 4. InFIG. 4, each of the tag images P is provided with a tag ID for convenience. Further, in the example illustrated inFIG. 4, the tag images P with the tag IDs “001”, “004”, “005”, and “009” have a common attribute (“red”), the tag images P with the tag IDs “002”, “006”, and “008” have a common attribute (“blue”), and the tag images P with the tag IDs “003” and “007” have a common attribute (“yellow”).

The tag processor213changes at least any one of the page number, the position, the color (background color), the size, and the input information of the tag image P displayed on the display120. The tag processor213is an example of a tag processor according to the present disclosure.

For example, in the display screen illustrated inFIG. 4, if the user replaces the position of the tag image P having the tag ID “003” with the position of the tag image P having the tag ID “001” using the touch pen300, the tag processor213changes the position of each of the tag images P. Further, in the display screen illustrated inFIG. 4, if the user selects the tag image P by the touch pen300to perform an operation of changing the background color, the tag processor213changes the color of the tag image P. Further, in the display screen illustrated inFIG. 4, if the user performs an operation of changing the size of the tag image P with the touch pen300, the tag processor213changes the size of the tag image P. Further, in the display screen illustrated inFIG. 4, if the user selects the tag image P by the touch pen300to shift to the input mode and rewrite the input information, the tag processor213changes the input information displayed on the tag image P.

If at least any one of the page number, the position, the background color, the size, and the input information of the tag image P is changed, the tag processor213updates the corresponding information of the tag information222(seeFIG. 2).

The display processor214displays, on the display120, a plurality of pieces of input information associated with each of the plurality of tag images P generated by the tag generator21, based on each of attributes of the plurality of tag images P2. The display processor214is an example of a display processor according to the present disclosure. Specifically, the display processor214sorts the plurality of pieces of input information into different areas or different pages for each of the attributes based on the tag information222, and then displays the sorted information.

For example, the display processor214displays, in a first area, first input information associated with one or more first tag images P having the attribute of a first color, and displays, in a second area, second input information associated with one or more second tag images P having the attribute of a second color. For example, in the display screen illustrated inFIG. 4, if the user selects a “material creation” selection key K1, the display processor214displays input information associated with the tag images P with the tag IDs “001”, “004”, “005”, and “009” having the attribute “red” on a first sheet S1(seeFIG. 5), displays input information associated with the tag images P with the tag IDs “002”, “006”, and “008” having the attribute “blue” on a second sheet S2(seeFIG. 6), and displays input information associated with the tag images P with the tag IDs “003” and “007” having the attribute “yellow” on a third sheet S3(seeFIG. 7). The first sheet S1, the second sheet S2, and the third sheet S3may be included in one page or may be included in different pages. Thus, the display processor214aggregates (groups) the input information for each of the attributes of the tag images P.

Further, the display processor214displays the input information on a sheet based on a predetermined priority order. For example, in the display screen illustrated inFIG. 4, the priority order is set higher from right to left in the horizontal direction, and the priority order is set higher from downside to upside in the vertical direction. In this case, for example, the display processor214displays, on the first sheet S1, input information T5of the tag ID “005” at an uppermost part, displays input information T4of the tag ID “004” below the input information T5, displays input information T1of the tag ID “001” below the input information T4, and displays input information T9of the tag ID “009” below the input information T1. The priority order is not limited to the position of the tag image P, and may be set in accordance with the input information. For example, the priority order of the tag images P may be determined in accordance with the importance of keywords included in the input information. Further, the priority order of the tag images P may be determined in accordance with the attribute (such as a job title) of the user (information provider) corresponding to the input information.

Further, the display processor214may convert the input information into a predetermined display mode and then display the converted input information on the display120. For example, as illustrated inFIGS. 5 to 7, the display processor214converts the typeface of the input information from a handwritten font (seeFIG. 4) corresponding to a user input operation into “Gothic font” and then displays the converted input information on the display120.

Further, the display processor214may determine a display size and line spacing of the characters displayed on the display120based on the number of characters or the number of lines of the characters included in the plurality of pieces of input information, and display the plurality of pieces of input information on the display120in accordance with the determined display size and line spacing. For example, if sorting the input information for each attribute, the display processor214determines the display size and the line spacing of the characters on the sheet (here, the first sheet S1) with the largest amount of input information (such as the number of characters and the number of lines) (seeFIG. 8). The display processor214displays the input information on the first sheet S1(seeFIG. 8), the second sheet S2(seeFIG. 9), and the third sheet S3(seeFIG. 10) in accordance with the determined display size and line spacing.

Further, the display processor214may display the background color of each of the sheets in a color associated with the tag image P. For example, the display processor214displays the background color of the first sheet S1in “red”, the background color of the second sheet S2in “blue”, and the background color of the third sheet S3in “yellow”.

In this way, the display processor214embeds, in each of the sheets, the input information sorted in accordance with the attributes to create a material. The display processor214stores (saves) the created material (sheet) in the storage220. The controller210may perform control to print the material as meeting minutes or transmit data of the material to a user terminal in response to a request from the user.

The controller210may execute a process for drawing the input information on the display120in accordance with the attribute of the touch pen300. For example, the controller210receives an identification signal from the touch pen300and performs control to draw, on the display120, characters, figures, and symbols in accordance with the attribute (writing color, character thickness, pen tip shape, and the like) associated with the identification signal. The controller210may receive an identification signal of another writing instrument (such as an eraser) and perform control to execute processing (such as erasing of drawing information) in accordance with the writing instrument.

Information Processing

Information processing executed in the information processing device1will be described with reference toFIG. 11below. Specifically, in the present embodiment, the information processing is executed by the controller210of the information processing device1. The controller210may possibly end the information processing even if the information processing is not completed, in response to a predetermined operation of the user.

The present disclosure can be regarded as an invention of an information processing method in which one or more steps included in the information processing are executed. Further, one or more steps included in the information processing described here may be omitted where appropriate. In addition, each of the steps in the information processing may be executed in a different order as long as a similar operation and effect is obtained. Further, although a case where each of the steps in the information processing is executed by the controller210will be described as an example here, an information processing method in which each of the steps in the information processing is executed in a distributed manner by a plurality of processors may be regarded as another embodiment.

First, in step S11, the controller210determines whether an input to the touch display100by the touch pen300or a finger is detected. If the input is detected (S11: YES), the processing proceeds to step S12. Step S11is an example of an input detection process according to the present disclosure.

In step S12, the controller210determines whether an end command is selected by the user. If the end command is selected (S12: YES), the processing ends. If the controller210does not acquire the end command (S12: NO), the processing proceeds to step S13.

In step S13, the controller210determines whether the mode has shifted to the tag mode. For example, if the user maintains the contact state of the touch pen300at any position on the touch panel110(depresses the touch panel110with the touch pen300at any position on the touch panel110) for a predetermined time, the mode shifts to the tag mode. If the mode shifts to the tag mode (S13: YES), the controller210executes a tag generation process described later (seeFIG. 12). If the mode does not shift to the tag mode (S13: NO), the processing proceeds to step S14.

In step S14, the controller210determines whether a change in a tag content in the tag image P displayed on the display120is received from the user. If the change of the tag content is received (S14: YES), the controller210executes a tag change process described later (seeFIG. 13). If the change of the tag content is not received from the user (S14: NO), the processing proceeds to step S15.

In step S15, the controller210determines whether an instruction for material creation is received from the user. If the instruction for material creation is received from the user (S15: YES), the controller210executes a material creation process (seeFIG. 14) described later. If the instruction for material creation is not received from the user (S15: NO), the processing proceeds to step S16.

In step S16, the controller210determines whether another command is received from the user. If another command is received from the user (S16: YES), the controller210executes the command process. If another command is not received from the user (S16: NO), the processing returns to step S11. The command is, for example, a printing process and a saving process of the created material. These command processes are well-known processes and description thereof will be omitted.

Tag Generation Process

The tag generation process will be described with reference toFIG. 12.

In step S21, the controller210acquires the page number and the position coordinates of an input position input by the user. Specifically, the controller210acquires the page number and the position coordinates of the position X on the touch panel110that the user depresses for a long time by the touch pen300(seeFIG. 3A).

Next, in step S22, the controller210acquires the color selected by the user on the tag selection screen D1(seeFIG. 3A).

Next, in step S23, the controller210generates the tag image P based on the acquired position coordinates and color and performs control to display the tag image P on the display120(seeFIG. 3B). Step S23is an example of a tag generation step according to the present disclosure.

Next, in step S24, the controller210performs control to display input information input by the user in an area of the tag image P (seeFIG. 3C). Then, the processing proceeds to step S14ofFIG. 11. Step S24is an example of a display process according to the present disclosure.

Tag Change Process

The tag change process will be described with reference toFIG. 13.

In step S31, the controller210determines whether an operation of changing the page number or the position of the tag image P is received from the user. If the operation is received (S31: YES), the processing proceeds to step S32. On the other hand, if the operation is not received (S31: NO), the processing proceeds to step S33.

In step S32, the controller210changes the page number or the position of the tag image P in response to the operation of the user. For example, if the user performs a drag-and-drop operation on the tag image P with the touch pen300or a finger, the page number or the position of the tag image P is moved.

In step S33, the controller210determines whether an operation of changing the color of the tag image P is received from the user. If the operation is received (S33: YES), the processing proceeds to step S34. On the other hand, if the operation is not received (S33: NO), the processing proceeds to step S35.

In step S34, the controller210changes the background color of the tag image P to a color selected by the user.

In step S35, the controller210determines whether an operation of changing the size of the tag image P is received from the user. If the operation is received (S35: YES), the processing proceeds to step S36. On the other hand, if the operation is not received (S35: NO), the processing proceeds to step S37.

In step S36, the controller210changes the size of the tag image P in response to the operation of the user. For example, if the user performs an enlargement/reduction operation such as a pinch-in/pinch-out operation on the tag image P, the controller210changes the size of the tag image P.

In step S37, the controller210determines whether an operation of changing the input information displayed on the tag image P is received from the user. If the operation is received (S37: YES), the processing proceeds to step S38. On the other hand, if the operation is not received (S37: NO), the processing ends.

In step S38, the controller210changes the input information displayed on the tag image P to information rewritten by the user.

In step S39, the controller210updates each piece of information registered in the tag information222(seeFIG. 2) based on the information corresponding to each of the operations. Then, the processing proceeds to step S15ofFIG. 11.

Material Creation Process

The material creation process will be described with reference toFIG. 14.

In step S41, the controller210creates a different area or a different sheet (page) for the input information for each attribute. For example, the controller210creates the first sheet S1in red, the second sheet S2in blue, and the third sheet S3in yellow.

In step S42, the controller210determines the display mode of the input information associated with the tag image P. For example, the controller210converts the typeface from the handwritten font (seeFIG. 4) into “Gothic font” in response to a user input operation. Further, for example, the controller210determines the display size and the line spacing of the characters displayed on each of the sheets, based on the number of characters or the number of lines of the characters included in the plurality of pieces of input information (seeFIG. 8).

In step S43, the controller210performs control to display (embed) the input information on each of the sheets. For example, the controller210performs control to display, on the first sheet S1, the input information T1, T4, T5, and T9associated with the red tag image P (seeFIG. 5), display, on the second sheet S2, the input information T2, T6, and T8associated with the blue tag image P (seeFIG. 6), and display, on the third sheet S3, the input information T3and T7associated with the yellow tag image P (seeFIG. 7).

In step S44, the controller210performs control to save the created material. For example, the controller210performs control to save the data of the material including the first sheet S1, the second sheet S2, and the third sheet S3in the storage220. Then, the processing proceeds to step S16inFIG. 11.

The information processing device1according to the embodiment executes the information processing as described above.

As described above, the information processing device1creates an area or a page (sheet) for each attribute (color) of the tag image P, and inserts the input information of the tag image P into each page. Further, the information processing device1converts the handwritten characters into predetermined font characters and displays the converted characters on each page. Further, the information processing device1displays the characters in which the line spacing and the character size are unified in each page. As described above, the information processing device1can aggregate the plurality of pieces of input information in accordance with the attribute of the tag image P, and thus, efficiently create materials utilizing the tag function.

The present disclosure is not limited to the above-described embodiment. As another embodiment, the information processing device1may use a specific keyword displayed on the tag image P as an attribute. For example, the information processing device1may create a page for each specific mark (figure) displayed on the tag image P to sort the input information. Further, the keyword may be the content of the input information. For example, the information processing device1may create a page for each specific term included in the input information to sort the input information. As described above, the attribute according to the present disclosure may be a color, a character, a figure, or a symbol associated with the tag image P.

In a configuration of the information processing device according to the present disclosure, the touch panel110and the touch pen300may be omitted. For example, the information processing device according to the present disclosure may include the control device200and the display120. Furthermore, the information processing device according to the present disclosure may include only the control device200. In this configuration, the information processing device according to the present disclosure causes the display120connected via a network to execute various types of display processes.

Further, in the information processing device according to the present disclosure, the tag image may be a graphic image drawn by an operation of the user. For example, the tag image is a graphic image created by drawing application software, document creation application software, or the like, and in the graphic image, an attribute such as a color, a character, a figure, and a symbol is associated with input information input by the user. Further, in the tag image, it is possible to change at least one of a page number, a position, a background color, a size, and input information by an operation of the user. As described above, the tag image according to the present disclosure includes various electronic images that play the same role as the tag paper.

It is noted that, in the information processing device1according to the present disclosure, within the scope of the invention described in claims, the embodiments described above may be freely combined, or the embodiments may be appropriately modified or some of the embodiments may be omitted.