Information processing device, information processing method, and computer-readable medium that determine an area of a display screen to which an input operation belongs

An information processing device includes an input operation function identification unit configured to identify an input operation and a function performed on a display screen including at least two areas; an area determination unit configured to determine an area among the at least two areas of the display screen to which the input operation belongs; a function process unit configured to execute a process of the function corresponding to the input operation, with respect to the area determined by the area determination unit; and a display output unit configured to display, on the display screen, a result obtained by the process executed by the function process unit.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to an information processing device including a display device and an information processing method.

2. Description of the Related Art

Conventionally, there is known a technology of opening two windows in one screen displayed on a display device of an information processing device, and separately performing page operations for the respective windows. Specifically, in each of the separate windows, characters are written, lines and drawings are drawn, the written characters and drawn lines and drawings are moved, and pages are switched in each window.

Furthermore, Patent Document 1 discloses an education support system that is one kind of information processing device. The education support system includes an instructor-use terminal device and a student-use terminal device. The display control unit of the student-use terminal device includes a means for dividing the screen, displaying a display image of the instructor-use terminal device in a part of the screen, and displaying a unique image in another part of the screen. Accordingly, in one part of the divided screen, the display image of the instructor-use terminal device is displayed, and the student can display a unique screen in the other part and write a memorandum, etc., in the other part.

SUMMARY OF THE INVENTION

The present invention provides an information processing device and an information processing method, in which one or more of the above-described disadvantages are eliminated.

A preferred embodiment of the present invention provides an information processing device and an information processing method, by which characters/drawings can be drawn across plural areas obtained by dividing a screen such that the areas can be separately switched, the characters/drawings drawn across areas that are not switched can be left unmodified in the screen when any one of the plural areas is switched, and characters and drawings can be easily moved across areas.

According to an aspect of the present invention, there is provided an information processing device including an input operation function identification unit configured to identify an input operation and a function performed on a display screen including at least two areas; an area determination unit configured to determine an area among the at least two areas of the display screen to which the input operation belongs; a function process unit configured to execute a process of the function corresponding to the input operation, with respect to the area determined by the area determination unit; and a display output unit configured to display, on the display screen, a result obtained by the process executed by the function process unit.

According to an aspect of the present invention, there is provided an information processing method including identifying an input operation and a function performed on a display screen including at least two areas; determining an area among the at least two areas of the display screen to which the input operation belongs; executing a process of the function corresponding to the input operation, with respect to the area determined by at the determining; and displaying, on the display screen, a result obtained by the process executed at the executing.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

A description is given, with reference to the accompanying drawings, of a first embodiment of the present invention.

First Embodiment

Example of Configuration of Screen

FIG. 1Aillustrates an example of a screen displayed on a display device21(seeFIG. 2) of an information processing device20(seeFIG. 2) according to a first embodiment of the present invention.FIG. 1Billustrates another example of a screen displayed on the display device21of the information processing device20according to the first embodiment of the present invention. As the display device21according to the present embodiment, an electronic blackboard having a touch panel to which handwriting can be input is illustrated; however, the present invention is not so limited. For example, the display device may be an electronic device such as a tablet terminal.

For example, as illustrated inFIG. 1A, the display device21of the information processing device20according to the present embodiment displays a display screen10that is partitioned by an L-shaped line on a surface of an electronic blackboard. Specifically, the display screen10includes a wide first area11on the bottom side for drawing contents relevant to the agenda being discussed, and a narrow second area12occupying the left side and the top side for listing the agenda items of the meeting and for indicating the objective of the meeting. The display device21of the information processing device20according to the present embodiment is described as including a touch panel. However, operations may be input not only directly to the touch panel, but by operating a cursor or up/down/left/right arrow keys of a keyboard to activate a function icon in a screen or to draw lines.

FIG. 1Billustrates a display screen15of another example. The display screen15includes a first area16, a second area17, and a third area18, which are divided by a T-shaped line. The large first area16on the bottom side is for drawing contents relevant to the agenda being discussed, the vertically long, narrow small second area17on the left side is for listing the agenda items of the meeting, and the horizontally long, narrow third area18at the top side is for indicating the objective of the meeting.

For example, when the user runs his finger along a touch panel of the display device21displaying the display screen10or the display screen15shown inFIG. 1Aor1B, an input operation function identification unit detects the movement of the finger and the size of the contact area, and displays a drawing according to the detected movement and size of the contact area, as described below in detail. For example, as shown in the display screen15ofFIG. 1B, a character string19“ABC” can be drawn across the first area16, the second area17, and the third area18. Furthermore, an icon of a clear button11c,12c,16c, and17cis provided in each area of the screen, and when the user touches the clear button with his finger in a manner as to press the button, all of the drawn contents in the area corresponding to the touched clear button can be erased. For example, when the character string19“ABC” is determined as belonging to the third area18, even if the clear button16cor17cof the first area16or the second area17is pressed, the character string19“ABC” is not erased, as described below in detail. Input of information is not limited to using a finger; any other means may be used as long as information can be input, such as a pen referred to as a stylus. Furthermore, in the present specification, lines, characters, and figures including the character string19, may be referred to as strokes.

Configuration Example of Information Processing Device

FIG. 2is a functional block diagram of the information processing device20according to the first embodiment of the present invention. As shown inFIG. 2, the information processing device20includes the display device21provided with, for example, a liquid crystal display unit (not shown) for displaying images and a touch panel (not shown), an operation input unit23and a coordinate input unit22that are examples of an input operation function identification unit, and a layout management unit24.

The display device21includes the operation input unit23for detecting an operation input to the touch panel, and the coordinate input unit22for detecting the position of the input operation. For example, the input operation is performed by a “touch operation” or a “drag operation” on the touch panel. The “touch operation” means that the finger touches a position of one point (a position expressed by one pair of coordinates) on the touch panel, and a “drag operation” means to run the finger on the touch panel along a necessary length (along positions expressed by plural pairs of coordinates). Instead of the operation input by a finger tip on the touch panel, the click operation or the drag operation may be performed by operating a cursor or a pointer with a mouse or a keyboard.

The layout management unit24is for managing the input operations to manage the arrangement (layout) of strokes such as lines, characters, and figures drawn in areas11,12,16,17, and18in the screen of the display device21. The layout management unit24includes a function processing unit28for executing a function in a predetermined area, an area determination unit26for determining the area in which the function is to be executed, an area condition storage unit27for storing conditions for making the determination, and a display output unit25for displaying, on the display device21, the result of the function executed by the function processing unit28. For example, if the function is for drawing a stroke, the execution result of the function is the drawn stroke, and if the function is page switching, the execution result of the function is the stroke in the new page after switching the page. The management of the layout includes drawing, moving, and deleting a stroke. The area determination unit26and the area condition storage unit27are examples of an area determination unit.

Although not shown, the function processing unit28includes a CPU (Central Processing Unit), a ROM (Read-Only Memory) for storing fixed data, a RAM (Random Access Memory) for temporarily storing data, a backup memory constituted by a rewritable non-volatile memory, an input interface circuit including an A/D converter and a buffer, and an output interface circuit including a driving circuit.

The coordinate input unit22is connected to the area determination unit26and the function processing unit28, and the area determination unit26is connected to the area condition storage unit27. The coordinates are set according to positions on the display screen.

The area condition storage unit27stores conditions for determining the area, among the first area16through the third area18on the display screen shown inFIG. 1B, to which the position of operation input (position on an XY coordinate system) on a touch panel (i.e., the display screen) belongs (the position is the position detected by the coordinate input unit22when a user performs operation input on the touch panel). The area determination unit26determines the area to which the position of the operation input belongs, based on conditions stored in the area condition storage unit27, as described in detail below.

FIG. 5Ashows an example of conditions stored in the area condition storage unit27of the information processing device20according to the first embodiment of the present invention. This example is applicable to a case where a screen is divided into two areas11and12, as shown inFIG. 1A. InFIG. 5A, in each line, conditions relevant to an X coordinate and a Y coordinate are stored, for determining the area to which the position of input operation belongs. In the second line, the second area12is assigned, and for the second area12, “X<100 OR Y<100” is stored as the condition. In the first line, the first area11is assigned, but no conditions are stored for the first area11. This is because any position that does not belong to the second area belongs to the first area, and therefore it is only necessary to determine whether the position belongs to the second area.

FIG. 5Bshows another example of conditions stored in the area condition storage unit27of the information processing device20according to the first embodiment of the present invention. This example is applicable to a case where a screen is divided into three areas16,17, and18, as shown inFIG. 1B. InFIG. 5B, each line stores conditions relevant to an X coordinate and a Y coordinate for determining the area to which the position of the input operation belongs. In the second line and the third line, the second area17and the third area18are assigned, respectively. For the second area17, “X<100” is stored as the condition, and for the third area18, “X>=100 AND Y<100” is stored as the condition. Although the first area16is assigned to the first line, due to the reasons described above, no conditions are stored for the first area11.

Referring back toFIG. 2, the function processing unit28executes a function in an area identified by the determination of the area determination unit26, based on the determination of the area determination unit26and in response to the contents of the function selected by the user detected by the operation input unit23(for example, “activate”, “delete”, “move”, etc.). Furthermore, in the function processing unit28, a signal indicating the values of the coordinates expressing the position where the user performed operation input, is input from the coordinate input unit22.

Note that the determination as to which function has been selected by the user, may be made based on the detection of the operation input unit23. Alternatively, for example, the function may be determined according to whether the operation input of the user has been performed in a range of coordinates expressing the position of the icon of “clear” for performing delete, based on coordinate values from the coordinate input unit22. Furthermore, the function processing unit28includes a storage unit (not shown), which stores, for example, the page number of the page including the drawn characters, etc., and the coordinates of points constituting the characters, etc. The function processing unit28and the storage unit of the function processing unit28are an example of a function process unit.

The display output unit25is connected to the function processing unit28, and displays the results of functions executed by the function processing unit28on the display device21. For example, when the function is to draw, the drawn lines are displayed on the display device21.

The operation of the function processing unit28of the information processing device20is controlled by the CPU of the function processing unit28or a separate processing device (not shown).

The information processing program according to an embodiment of the present invention causes a computer to execute an input operation function identifying step of identifying the input operation and function performed in the display screens10,15including at least two areas11,12, an area determining step S11of determining the area of the display screen to which the input operation belongs, a function processing step S12of executing the process of the function corresponding to the input operation with respect to the area determined at the area determining step S11, and a display output step S13of displaying, on the display screens10,15, the results of the process executed at the function processing step S12.

Operation Example of Information Processing Device According to First Embodiment

FIG. 3is a flowchart of an example of a process performed by the layout management unit24of the information processing device20according to the first embodiment of the present invention. When the user performs a touch operation or a drag operation on the touch panel, the coordinate input unit22sends, to the area determination unit26and the function processing unit28of the layout management unit24, the values of coordinates on the display screen corresponding to the positions, which is an example of information relevant to the position at which the touch operation or the drag operation is performed. The operation input unit23sends a signal expressing a function selected by the user to the function processing unit28.

When the signals expressing the values of the coordinates expressing the position at which the touch operation or the drag operation has been performed are received from the coordinate input unit22, the area determination unit26determines the area in which the touch operation or the drag operation has been performed, based on the values of the coordinates (step S11). In this case, as described above, when the operation is a “touch operation”, there is one pair of coordinates, and when the operation is a “drag operation”, there are a plurality of pairs of coordinates corresponding to the positions relevant to the operation. When the position information is constituted by a plurality of pairs of coordinates, as described in detail below, when all of the points belong to the first area16, the area determination unit26determines that the pairs of coordinates belong to the first area16, and in other cases, for example, as in the screen shown inFIG. 1B, when the character string19of ABC also belongs to the second area17and the third area18other than the first area16, the area determination unit26determines that the pairs of coordinates belong to the second area17.

Next, when a signal expressing the operation performed by the user is received from the operation input unit23and a signal expressing the position information at which the operation input has been performed is received from the coordinate input unit22, the function processing unit28executes a function based on the operation performed by the user in the area determined by the area determination unit26(step S12). Next, the function processing unit28causes the display output unit25to display the result of the process on the display device21(step S13). For example, when the user performs a drag operation in a drawing mode, on the screen of the display device21, a line is drawn so as to connect the pairs of coordinates. When the user performs a touch operation, and the coordinates of the position at which the touch operation has been performed is included in the range of the icon of clear11c,12c(FIG. 1A), all of the drawings in the area determined by the area determination unit26are deleted, and the result is displayed on the display device21.

According to the above viewpoints, the information processing method according to an embodiment of the present invention includes an input operation function identifying step of identifying the input operation and function performed in the display screens10,15including at least two areas11,12, an area determining step S11of determining the area of the display screen to which the input operation belongs, a function processing step S12of executing the process of the function corresponding to the input operation with respect to the area determined at the area determining step S11, and a display output step S13of displaying, on the display screens10,15, the results of the process executed at the function processing step S12.

FIG. 4is a flowchart of an example of a process performed by the area determination unit26of the information processing device20according to the first embodiment of the present invention. When a user performs operation input, the input object expressed by a single coordinate or, for example, a plurality of pairs of coordinates like the character string19ABC in the screen shown inFIG. 1B, is referred to as a stroke.

InFIG. 4, “i” expresses the number of the area, and “j” expresses the number of the point corresponding to the position of the coordinates constituting a stroke. That is to say, inFIG. 1B, i is 1 for the first area16, i is 2 for the second area17, and i is 3 for the third area18. Furthermore, for example, the position corresponding to coordinates of a point on the far left side among the coordinates of points constituting A in the character string19of ABC is set as j=1, the position corresponding to the coordinates of the adjacent point is set as j=2, and similarly, numbers are sequentially assigned to points constituting each character for all of the characters.

When the user performs operation input on the touch panel and draws a character including one stroke, as described above, the coordinate input unit22inputs, in the area determination unit26, coordinates corresponding to information relevant to positions of all points constituting the one stroke. The area determination unit26assigns 1 in “i” (step S24), and assigns 1 in “j” (step S25). Next, the area determination unit26determines whether the coordinates of the jth point constituting the one stroke satisfies the conditions stored in the (i+1)th line in the area condition storage unit27(step S26). When the result of the determination at step S26is YES, the process proceeds to step S27, and the stroke is determined to belong to the (i+1)th area, and the process ends.

When the determination at step S26is NO, the area determination unit26determines whether the number of points constituting the stroke is less than or equal to “j” (step S28). When the result of step S28is YES, the process proceeds to the next step, and the area determination unit26determines whether the number of areas is less than or equal to “i” (step S29). When the result of step S29is YES, the process proceeds to step S30, and the area determination unit26determines that the stroke belongs to the first area16and the process ends.

When the result of determination at step S28is NO, j+1 is assigned in j (step S31), and the process returns to step S26. When the result of determination at step S29is NO, i+1 is assigned to i (step S32), and the process returns to step S25.

Next, a description is given of how the area determination unit26specifically performs the process based on the flowchart ofFIG. 4. In this example, the screen is divided into the first area11and the second area12, as shown inFIG. 1A. In this example, the conditions shown inFIG. 5Aare stored in the area condition storage unit27. When a stroke is drawn in the display device21of the information processing device20, it is assumed that the coordinates (j=1) of the first point of the stroke belongs to the first area11, and the coordinates (X1, Y1) of the second point of the stroke belongs to the second area12. In this example, there are two areas, i.e., the first area11and the second area12, and therefore it is assumed that in the area condition storage unit27, the condition of “X<100 OR Y<100” is stored for the second area12in the second line.

After steps S24and S25, in step S26, it is determined whether the coordinates of the (j=1)th point of the stroke satisfies the condition of the second area12in the second line “X<100 OR Y<100”. The coordinates of the (j=1)th point of the stroke belong to the first area11, and therefore the condition of the second area12“X<100 OR Y<100” is not satisfied, and the determination in this step is NO. Accordingly, the process proceeds to step S28. In step S28, in this example, there are coordinates of the second point, and the number of points constituting the stroke is larger than (j=1), and therefore the determination in this step is NO, and the process proceeds to step S31. In step S31, j+1 is assigned to j, and the process proceeds to step S26. In step S26, the coordinates of the (j=2)th point constituting the stroke satisfies the (i+1=2)th line in the conditions stored in the area condition storage unit27, and therefore the determination is YES, and the process proceeds to step S27. In step S27, it is determined that the stroke belongs to the second area12, and the process ends.

A storage unit such as a stroke storage unit76in an information processing device70(FIG. 7) according to a second embodiment of the present invention described below may be provided in the function processing unit28of the information processing device20shown inFIG. 2, and the information relevant to the stroke as determined as above may be stored in such a storage unit. The information relevant to the stroke may include the relationship between a stroke ID, an area ID, a page ID, and coordinates of points constituting the stroke, as shown inFIG. 10.

Second Embodiment

Example of Configuration of Screen

FIG. 6Aillustrates an example of a screen displayed on the display device21of the information processing device70(FIG. 7) according to a second embodiment of the present invention. As described below in detail, the information processing device70(FIG. 7) according to the present embodiment is different from the information processing device20according to the second embodiment described with reference toFIGS. 1A,1B, and2, in that the page can be switched in each area obtained by dividing a screen.

Specifically, as shown inFIG. 6A, a display screen60includes a wide first area61on the bottom side for drawing contents relevant to the agenda being discussed in the meeting, and a narrow second area62occupying the left side and the top side for listing the agenda items of the meeting and for indicating the objective of the meeting. At the bottom of both areas, there are triangular buttons61pf,61pb,62pf, and62pbprovided for switching the page. The buttons61pfand62pfare for proceeding from the page presently displayed to the next page (i.e., from the present display screen to the next display screen), and the buttons61pband62pbare for returning from the page presently displayed to the previous page. For example, when the button61pfis pressed, the page of the first area61is switched to the next page, and when the button62pbis pressed, the page of the second area62returns to the previous page. In the other area where the button is not pressed, the page remains unchanged.

FIG. 6Bshows a state where a character string65of ABC is written in the display screen60shown inFIG. 6A. As shown inFIG. 6B, the character string65of ABC is written across the first area61and the second area62. The pairs of coordinates of the character string65of ABC are determined as belonging to the second area62, according to the flowchart inFIG. 4.

Example of Information Processing Device70

FIG. 7is a functional block diagram of the information processing device70according to the second embodiment of the present invention. The information processing device70according to the second embodiment is different from the information processing device20according to the first embodiment shown inFIG. 2, in that the configurations of a function processing unit78and a storage unit75of a layout management unit74in the information processing device70according to the present embodiment are different from the function processing unit28of the information processing device20according to the first embodiment.

The storage unit75includes a present page storage unit77and the stroke storage unit76. InFIG. 7, the storage unit75is illustrated to include only the present page storage unit77and the stroke storage unit76; however, the storage unit75also includes a data storage unit for storing other data necessary for executing functions other than switching pages and drawing. However, such a storage unit is not shown as a matter of simplifying the configuration of the present embodiment and facilitating understanding.

The present page storage unit77stores information relevant to the page number presently being displayed, for each of the plurality of areas included in the screen of the display device21.

FIG. 9shows the relationship between the area number and the present page number stored in the present page storage unit77. In this example, in the present screen displayed on the display device21, the page number of the first area61is 1 and the page number of the second area62is 3. InFIG. 9, the line “ . . . ” under the line of the second area62is used when there is a third area, and “ . . . ” merely expresses abbreviation. When there is a fourth area, etc., similarly, lines are sequentially added below the line of the third area.

The stroke storage unit76stores information relevant to all strokes included in each page of each area.

FIG. 10shows an example of information relevant to strokes stored in the stroke storage unit76. This stored information is relevant to all strokes included in each page of each area. As shown inFIG. 10, information relevant to strokes includes, for example, a stroke ID in the first row, an area ID in the second row, a page ID in the third row, and point coordinates in the fourth row.

The stroke ID in the first row is constituted by a number for identifying a stroke. For example, as shown inFIG. 10, the strokes may be numbered in the order they are drawn. The area ID in the second row is constituted by a number indicating the area to which the stroke belongs. For example, an area ID “1” means the first area61(FIG. 6A), and the area ID “2” means the second area62(FIG. 6A). The page ID in the third row is constituted by a number indicating the page number of the area identified by the area ID to which the stroke belongs. For example, a page ID “2” means that a stroke having a stroke ID of 4 is present on the second page of the first area61. The point coordinates in the fourth row indicate XY coordinates in an orthogonal coordinate system of all points constituting each stroke. As long as the positions of the points of the stroke can be identified, a polar coordinate system may be used instead of the orthogonal coordinate system. Note that “ . . . ” inFIG. 10expresses abbreviation.

The function processing unit78includes a draw processing unit71and a page switch management unit72. The function processing unit78is illustrated to include only the draw processing unit71and the page switch management unit72; however, the function processing unit78also includes managing and processing units necessary for executing functions other than switching pages and drawing. However, such managing and processing units are not shown as a matter of simplifying the configuration of the present embodiment and facilitating understanding.

When the user performs operation input for switching the page in an area on the display screen of the display device21, the page switch management unit72detects that the page has been switched in the area determined by the area determination unit26. In this case, the area determination unit26determines the area based on the position information input from the coordinate input unit22, and detects that the page has been switched based on information input from the operation input unit23and the coordinate input unit22. When it is detected that the page has been switched, the page switch management unit72updates the drawn image on the screen displayed on the display device21according to output of the display output unit25and information of the present page number stored in the present page storage unit77, to the drawn image and the information of the page number relevant to the new page, respectively.

When the user performs an input operation for drawing in an area in the display device21, the draw processing unit71detects that a drawing operation has been performed in the area determined by the area determination unit26. In this case, the determination of the area by the area determination unit26is made based on position information input from the coordinate input unit22, and the detection of the drawing operation is performed based on information input from the operation input unit23and the coordinate input unit22. When the drawing operation is detected, the draw processing unit71refers to the present page number in the area stored in the present page storage unit77, updates the stroke storage unit76to add a line for a new stroke ID, and stores information of the area ID, the page ID, and point coordinates relevant to the new stroke. Furthermore, the draw processing unit71updates the drawn image displayed on the display device21according to output from the display output unit25, based on the updated information. That is to say, the new stroke is drawn in a predetermined position in a predetermined area.

Operation Example of Information Processing Device According to Second Embodiment

FIG. 8is a flowchart of an example of a process performed by the layout management unit74of the information processing device70according to the second embodiment of the present invention. When the user performs a touch operation or a drag operation on the touch panel, the coordinate input unit22sends, to the area determination unit26and the function processing unit78of the layout management unit74, the values of coordinates corresponding to the positions, which is an example of information relevant to the position at which the touch operation or the drag operation is performed. The operation input unit23sends a signal expressing a function selected by the user to the function processing unit78.

When the signals expressing the values of the coordinates expressing the position at which the touch operation or the drag operation has been performed are received from the coordinate input unit22, the area determination unit26determines the area in which the touch operation or the drag operation has been performed, based on the values of the coordinates (step S41). In this case, as described above, when the operation is a “touch operation”, there is one pair of coordinates, and when the operation is a “drag operation”, there are a plurality of pairs of coordinates corresponding to the positions relevant to the operation.

Next, the page switch management unit72of the function processing unit78receives a signal expressing the operation performed by the user from the operation input unit23and a signal expressing the position information at which the operation input has been performed from the coordinate input unit22. Accordingly, the page switch management unit72detects that an operation of switching pages has been performed in the area determined by the area determination unit26, and updates the present page number stored in the present page storage unit77to the new page number (step S42).

At this time, when the draw processing unit71detects that the drawing has been performed, the process proceeds from step S42to the next step S43. In step S43, the draw processing unit71updates the information of the stroke storage unit76, and causes the display output unit25to draw the new stroke on the new page based on the updated information.

Step S42is described in more detail. The page switch management unit72determines which one of the buttons61pf,61pbfor switching pages have been pressed, in the area identified at step S41, according to position information expressing where operation input has been performed sent from the coordinate input unit22. Next, the page switch management unit72acquires, from the present page storage unit77, the present page number in the area identified at step S41. At this time, for example, when the page switch management unit72determines that the button61pffor switching to the next page has been pressed, the present page number stored in the present page storage unit77is replaced with a new page number. Meanwhile, when the present page number is 1, and the page switch management unit72determines that the button61pbfor returning to the previous page has been pressed, no processes are executed and the process ends.

According to the example of the page number stored in the present page storage unit77shown inFIG. 9, in step S42, for example, when the button61pbfor switching pages to return to the previous page is pressed in the second area62, the page switch management unit72acquires the present page number “3” of the second area62stored in the present page storage unit77, and rewrites the page number to the previous page number “2”.

Furthermore, when the page has been switched to the page on which a stroke is drawn, the page switch management unit72refers to the stroke storage unit76and acquires all the information relevant to the stroke present in the destination page of the page switching in the area identified by the area determination unit26. Next, upon performing the operation of page switching, the page switch management unit72updates the present page number stored in the present page storage unit77to the page number of the destination page, accesses the storage unit (not shown) in which the page information is stored, and reads the information of the page corresponding to the new page number. This information of the new page is displayed on the display device21of the display output unit25. At this time, the page switch management unit72causes the display output unit25to draw the stroke acquired from the stroke storage unit76on an image of the new page of the display device21.

In step S43, when the draw processing unit71detects that a new object has been drawn, the process proceeds as follows. When the coordinate input unit22and the operation input unit23detects that the user has performed a drag operation on the display device21, the area determination unit26identifies the area in which the drag operation is performed, based on the information of the coordinate input unit22. For example, assuming that the drag operation has been performed in the first area61, the draw processing unit71detects that an object has been drawn, and acquires the present page number of the first area61from the present page storage unit77.

Next, the draw processing unit71acquires, from the coordinate input unit22, information expressing the pair of coordinates corresponding to the position of the point of the object drawn according to the drag operation by the user, and causes the display output unit25to draw the object at the position corresponding to the coordinates on the display device21. Furthermore, the draw processing unit71adds a line for new data below the last line of data shown in, for example,FIG. 10, which is stored in the stroke storage unit76, stores, for example, a number “8” as the stroke ID in the first row, stores “1” in the area ID of the second row, stores, for example, “2” as the page ID in the third row, and stores the pairs of coordinates obtained from the coordinate input unit22as the point coordinates in the fourth row.

According to the present embodiment, the page can be switched in each area. Furthermore, the character string65“ABC” drawn across plural areas is handled as belonging to a specific area. Therefore, when the character string65“ABC” is determined to belong to the second area62, even if the page is switched in the first area61, it is possible to avoid a situation where part of or the entirety of the character string65drawn in the first area61disappears upon switching the page in the first area61, so that the character string65remains unaffected in the original position on the screen.

Third Embodiment

Example of Configuration of Screen

FIG. 11Aillustrates an example of a screen displayed on a display device21of an information processing device80(FIG. 12) according to a third embodiment of the present invention. As described below in detail, the information processing device80(FIG. 12) according to the present embodiment is different from the information processing device70according to the second embodiment inFIG. 7in that the stroke can be moved across plural areas.

An overview of the display screen is described as follows.FIGS. 11A through 11Cshow the display screen60, which has the same configuration as the display screen60shown inFIGS. 6A and 6B. The display screen60includes the first area61and the second area62. However, at the bottom left of the first area61, a button61sis additionally provided, which is an icon displaying “move”. The button61sis used for starting and stopping the function of moving the stroke in the screen.

The information processing device80(FIG. 12) has two modes, i.e., a drawing mode and a draw change mode. Under regular circumstances, the drawing mode is used. In the drawing mode, when the user performs a drag operation for a certain length on the display screen60with his fingertip, a handwritten line can be drawn along the position where the drag operation has been performed. For example,FIG. 11Ashows an example where the user has performed a drag operation to draw the character string65of ABC on the right side and slightly toward the bottom of the first area61, in the drawing mode. However, at the time point when drawing is performed in the drawing mode, a rectangular box66drawn by dashed-dotted lines surrounding the character string65of ABC is not displayed, unlike the example shown inFIG. 11A.

Subsequently, when the user presses a move button61s(performs a touch operation at the position of the button61s), the information processing device80changes to the draw change mode. In the draw change mode, when at least one stroke is selected from among the strokes presently displayed in the screen, for example, when the character string65of ABC which is one of the strokes is selected, the character string65is displayed surrounded by the rectangular box66drawn by dashed-dotted lines as shown inFIG. 11A. Instead of displaying the box66, the range of the box66may be displayed by a color other than the color of the character string65. In other words, the selected character string65is activated. In this state, the user can drag the rectangular box66drawn by dashed-dotted lines to move the character string65.

FIG. 11Bshows a state where the rectangular box66drawn by dashed-dotted lines is dragged, so that the character string65of ABC is moved from the first area61to the second area62. In this state, the character string65of ABC is still surrounded by the rectangular box66drawn by dashed-dotted lines, and the user can drag the rectangular box66drawn by dashed-dotted lines to further move the character string65of ABC.FIG. 11Cshows a state where the character string65of ABC has moved to the boundary between the first area61and the second area62. In other words, the character string65of ABC is present across the first area61and the second area62. InFIG. 11C, the character string65is still surrounded by the rectangular box66drawn by dashed-dotted lines, and therefore the character string65can be further moved. At this time point, when the user presses the button61sonce again, the mode returns to the drawing mode from the draw change mode, the rectangular box66drawn by dashed-dotted lines disappears from the screen, and the character string65cannot be moved.

Example of Information Processing Device80

FIG. 12is a functional block diagram of the information processing device80according to the third embodiment of the present invention. The information processing device80according to the third embodiment is different from the information processing device70according to the second embodiment shown inFIG. 7, in that in the information processing device80, a function processing unit88of a layout management unit84further includes a draw change unit83, and the draw processing unit71and the draw change unit83function in the drawing mode and the draw change mode, respectively. The mode is switched between the drawing mode and the draw change mode by, for example, pressing the “move” button61sprovided in the first area61of the display screen60shown inFIG. 11A, as described above. The “move” button61sis an example of a mode change unit.

When the “move” button61sis pressed, the draw change unit83detects that the mode has switched to the draw change mode from the drawing mode based on an input signal from the operation input unit23and the coordinate input unit22. Next, when the user moves the stroke that has been activated, information expressing the contents of the movement is input to the draw change unit83from the operation input unit23and the coordinate input unit22. When this information is input, the draw change unit83determines the contents of the change to be made with respect to the present drawing, based on signals of one of or a combination of the operation input unit23, the coordinate input unit22, and the area determination unit26. Based on this determination, the draw change unit83updates the information stored in the stroke storage unit76. Furthermore, based on the updated contents, the draw change unit83causes the display output unit25to update the display contents on the display device21.

Operation Example of Information Processing Device According to Third Embodiment

FIG. 13is a flowchart of an example of a process performed by the draw change unit83of the function processing unit88of the layout management unit84of the information processing device80according to the third embodiment of the present invention. At the start point of the flowchart, it is assumed that the draw change unit83has switched to the draw change mode.

When the user performs a drag operation on the touch panel, the draw change unit83acquires, from the coordinate input unit22, coordinates (X1, Y1) corresponding to the start position of the drag operation (step S50), and acquires coordinates (X2, Y2) corresponding to the end position of the drag operation (step S51). At the same time, the draw change unit83acquires, from the area determination unit26, information relevant to the area to which the identified coordinates belong, and acquires, from the present page storage unit77, the present page number in each area. Next, the draw change unit83refers to all strokes in the present page in each area, among the stroke IDs stored in the stroke storage unit76, and extracts an assembly S1of all strokes whose coordinates of all points constituting the stroke (information in fourth row) are present inside a rectangular area formed by connecting the four points of (X1, Y1), (X1, Y2), (X2, Y2), (X2, Y1) with linear lines (step S52). Accordingly, the stroke to be moved is activated. When there are no strokes present in the rectangular area, the process returns to the start state.

At this time point, when the coordinate input unit22detects that the user has performed a further drag operation, the draw change unit83continues to perform the following operations. Note that when the operation input unit23detects that the user has performed an operation other than the drag operation, the process ends while remaining in the draw change mode.

When the draw change unit83acquires, from the coordinate input unit22, that the drag operation has been performed from (X3, Y3) to (X4, Y4) (steps S53and S54), the draw change unit83determines whether (X3, Y3) is present inside the rectangular area formed by connecting the four points of (X1, Y1), (X1, Y2), (X2, Y2), (X2, Y1) with linear lines (step S55). Accordingly, it is determined whether this drag operation is for moving the activated stroke.

When (X3, Y3) is not present in the rectangular area (NO in step S55), the process ends while remaining in the draw change mode. According to need, the drag operation of step S50is performed again.

When (X3, Y3) is present in the rectangular area (YES in step S55), the process proceeds to the next step S56.

In step S56, (X4−X3) is added to the X coordinates of all points constituting all strokes included in the assembly S1, and (Y4−Y3) is added to the Y coordinates of all points constituting all strokes included in the assembly S1, and the data of the point coordinates of the strokes in the fourth row stored in the stroke storage unit76is updated.

After the update, it is determined whether all points constituting the strokes included in the assembly S1are within the first area61(step S57). When the determination result is YES in step S57, the data in the second row stored in the stroke storage unit76is updated to express that all strokes included in the assembly S1belong to the first area61(step S58). When the determination result is NO in step S57, the data in the second row stored in the stroke storage unit76is updated to express that all strokes included in the assembly S1belong to the second area62(step S60).

Next, the process proceeds from step S58or step S60to step S59, and the draw change unit83causes the display output unit25to draw once again, on the display device21, all strokes present in the present page of each of the first area61and the second area62, based on the information in the fourth row stored in the stroke storage unit76.

InFIG. 11A, the character string65(strokes) surrounded by the rectangular box66drawn by dashed-dotted lines is the movement target. InFIG. 11B, all points constituting the character string65are included in the second area62, and therefore, this stroke is determined as being present in the second area62. InFIG. 11C, the character string65is present across the first area61and the second area62, and therefore this stroke is stored in the stroke storage unit76as being present in the second area62.

Modification of Third Embodiment

FIGS. 14A and 14Bshow another example of a screen displayed on the display device21of the information processing device80according to the third embodiment of the present invention. In this example, it is possible to reduce the size of the stroke in each of the areas61and62in the display screen60. The configuration of the screen inFIGS. 14A and 14Bis formed by adding a function of reducing the display contents in the display screen60as described below, to the draw change unit83of the information processing device80according to the present embodiment shown inFIG. 12.

In the example of the display screen60inFIGS. 11A through 11C, the “move” button61sis provided at the bottom left of the first area61. In the display screen60ofFIGS. 14A and 14B, at the position of the “move” button61s, instead of the “move” button61s, there is provided a “reduce” button61c. Furthermore, the draw change unit83executes the following operation in addition to, or instead of the function when pressing the “move” button61sas described above.

When the user touches the “reduce” button61c, the draw change unit83switches to the draw change mode based on information from the operation input unit23and the coordinate input unit22. At the same time, based on information from the operation input unit23and the coordinate input unit22, the draw change unit83acquires the page number of the present first area61from the present page storage unit77, refers to the data stored in the stroke storage unit76, and acquires the coordinate data of all points of all strokes present in the present page number of the first area61.

Next, the draw change unit83performs a process on the acquired coordinate data of all points of the strokes, to reduce the length of each stroke in the X axis direction and the Y axis direction by a predetermined reduction ratio. Accordingly, data of new point coordinates is calculated, and the data of the present page storage unit77is updated by the new data. For example, assuming that the reduction ratio is 0.7, the positions of the new coordinates in the X axis direction and the Y axis direction of the stroke after reduction is obtained by the following formula.
(original coordinate value−100)×0.7+100=new coordinate value

Next, the draw change unit83acquires the updated data of the present page storage unit77, and based on this updated data, the draw change unit83causes the display output unit25to draw a predetermined stroke again on the display device21. Accordingly, the draw change unit83ends the draw change mode.

By performing the reduction process as described above, an empty space can be created in the area, where a new object can be handwritten.

In the above example of reduction, the reduction targets are all strokes in a predetermined area, like the first area61. Instead, by the following operation, a desired stroke may be selected and the selected stroke may be reduced.

When the user touches the “reduce” button61c, the draw change unit83switches to the draw change mode according to information from the operation input unit23and the coordinate input unit22. In this state, when the user performs a drag operation on the touch panel, the draw change unit83acquires, from the coordinate input unit22, coordinates (X1, Y1) corresponding to the start position of the drag operation, and acquires coordinates (X2, Y2) corresponding to the end position of the drag operation. At the same time, the draw change unit83acquires information relevant to the area to which the coordinates identified by the area determination unit26belong, and acquires the present page number of each area from the present page storage unit77.

Next, the draw change unit83refers to all strokes in the present page in each area, among the stroke IDs stored in the stroke storage unit76, and extracts an assembly S1of all strokes whose coordinates of all points constituting the stroke (information in fourth row) are present inside a rectangular area formed by connecting the four points of (X1, Y1), (X1, Y2), (X2, Y2), (X2, Y1) with linear lines. Accordingly, the stroke to be reduced is activated.

In this state, when the user presses the “reduce” button61cagain, the activated stroke is reduced by a predetermined reduction ratio. For example, the reduction is performed as follows. The draw change unit83performs a process on the coordinate data of all points of the activated strokes, to reduce the length of each stroke in the X axis direction and the Y axis direction by a predetermined reduction ratio. Accordingly, data of new point coordinates is calculated, and data of a predetermined stroke in the data of the present page storage unit77is updated by the new data. For example, assuming that the reduction ratio is 0.7, the positions of the new coordinates in the X axis direction and the Y axis direction of the stroke after reduction is obtained by the following formula.
(original coordinate value−100)×0.7+100=new coordinate value

Next, the draw change unit83acquires the updated data of the present page storage unit77, and based on this updated data, the draw change unit83causes the display output unit25to draw a predetermined stroke again on the display device21. Accordingly, the draw change unit83ends the draw change mode.

According to one embodiment of the present invention, an information processing device and an information processing method are provided, by which characters/drawings can be drawn across plural areas obtained by dividing a screen such that the areas can be separately switched, the characters/drawings drawn across areas that are not switched can be left unmodified in the screen when any one of the plural areas is switched, and characters and drawings can be easily moved across areas.

The information processing device and information processing method are not limited to the specific embodiments described herein, and variations and modifications may be made without departing from the scope of the present invention.

The present application is based on and claims the benefit of priority of Japanese Priority Patent Application No. 2012-135392, filed on Jun. 15, 2012, the entire contents of which are hereby incorporated herein by reference.