Information processing apparatus and method for arranging elements on a display region

An information processing apparatus includes a display, a detector, a setting unit, an approaching display unit, and an element processor. The display displays an image including one or more elements on a display region of the display. The detector detects an operation in the display region. In response to detection of a first operation including specifying a specified point in the background, the setting unit sets a first region that is the entirety or a portion of the display region in accordance with the first operation. The approaching display unit displays element information relating to a first element displayed in the first region at a position closer to the specified point than the first element prior to detection of the first operation. In response to detection of a second operation on the element information, the element processor executes a process corresponding to the second operation on the first element.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is based on and claims priority under 35 USC 119 from Japanese Patent Application No. 2012-233669 filed Oct. 23, 2012.

BACKGROUND

Technical Field

The present invention relates to an information processing apparatus and method.

SUMMARY

According to an aspect of the invention, there is provided an information processing apparatus including a display, a detector, a setting unit, an approaching display unit, and an element processor. The display displays an image including the arrangement of one or more elements on a display region of the display. The detector detects an operation performed in the display region. The setting unit sets, in response to detection, by the detector, of a first operation including an operation in which a point in the background of the display region where no element is displayed is specified as a specified point, a first region that is the entirety or a portion of the display region in accordance with details of the first operation. The approaching display unit displays element information relating to a first element displayed in the first region, set by the setting unit, at a position closer to the specified point than the position of the first element prior to detection of the first operation. The element processor executes, in response to detection, by the detector, of a second operation performed on the element information, a process corresponding to the second operation on the first element.

DETAILED DESCRIPTION

Configuration of Exemplary Embodiment

FIG. 1is a diagram illustrating the external appearance of an information processing apparatus10.FIG. 2is a diagram illustrating the hardware configuration of the information processing apparatus10. The information processing apparatus10is a computer with a touch panel type graphical user interface (GUI). The information processing apparatus10includes a controller11, a memory12, a communication unit13, an operation unit14, a display15, and a housing19.

The controller11includes an arithmetic unit such as a central processing unit (CPU)11a, and storage devices such as a read-only memory (ROM)11band a random-access memory (RAM)11c.

The memory12includes storage devices such as an electronically erasable and programmable read-only memory (EEPROM) and a static random-access memory (SRAM). The memory12stores an operating system (OS) and an application program. By executing these programs, the controller11controls the operation of the information processing apparatus10.

The communication unit13includes communication interfaces such as Universal Serial Bus (USB) and a wireless local area network (LAN). In accordance with an operation accepted by the operation unit14or the display15, the controller11communicates with another information processing apparatus via the communication unit13.

The operation unit14includes an operator such as a power switch.

The touch panel may by of any type, such as an electrostatic capacitance type, an electromagnetic induction type, a resistive film type, a surface acoustic wave (SAW) type, or an infrared type. The exemplary embodiment discusses an example in which a touch panel is of a type in which an operation is performed when the user touches the display region15awith his/her finger or the like (such as an electrostatic capacitance type).

FIG. 3is a diagram illustrating the functional configuration of the information processing apparatus10. The functions of the information processing apparatus10are realized by executing, by the controller11, the OS and application program stored in the memory12.

A display unit101displays an image including the arrangement of one or more elements in the display region15aof the display15. Specific details are as follows.

The memory12stores desktop data that associates each of the elements to be displayed in the display region15awith the position of that element in the display region15a. The elements are icons, windows, and the like. On the basis of the desktop data, the controller11displays, in the display region15a, an image representing a desktop in which these elements are arranged. In accordance with an operation performed in the display region15a, the controller11updates the desktop data and updates the image in the display region15a. Even when the power of the information processing apparatus10is turned off, the desktop data is continuously stored in the memory12.

An icon represents a file, a folder (may also be referred to as a “directory”), an execution file of an application program, or a shortcut to the file or folder (may also be referred to as a “soft link” or “alias”) in picture. In the display region15a, for example, the lattice points of a square lattice are virtually set (the lattice points are not displayed), and each icon is arranged so that the center of the icon is positioned at any of the lattice points. Also, icons are arranged not to overlap one another.

A window displays, when an element is a folder, a frame that represents the folder, and, within this frame, displays the icons of elements (folders, execution files, shortcuts, or the like) associated with the folder as elements that belong to the folder.

The detector102detects an operation performed in the display region15a. Specific details are as follows.

Major operations in the exemplary embodiment are slide, tap, and double tap.

Sliding is an operation in which the user keeps touching, with his/her finger, the background of the display region15aand moves the finger. The background is a portion of the display region15ain which no element is displayed. The operation of the information processing apparatus10in the case where sliding is performed will be described later.

Tapping is an operation in which the user hits the display region15awith his/her finger. For example, when an element is tapped, the controller11recognizes that the element is selected, and changes the display status (tone, brightness, etc.) of this element.

Double tapping is an operation in which the user performs tapping twice within a determined time. A process to be performed in the case where an element is double-tapped is predetermined in accordance with the type of the element. For example, when the element is the icon of a file, the controller11executes an application program used to create that file, and displays the details of the file. When the element is the icon of an execution file, the controller11executes the execution file. A process to be performed in the case where double tap is performed in the background will be described later.

While the user's finger is touching the display region15a, the display15periodically outputs contact position information representing the contact position of the finger to the controller11. On the basis of the contact position information, the controller11specifies the details of the operation. For example, when the length of time in which the user's finger continuously touches the display region15ais less than or equal to a first threshold, the controller11specifies that this operation is tapping. When the length of time between two consecutive taps is less than or equal to a second threshold, the controller11specifies that this operation is double tapping.

When the length of time in which the user's finger continuously touches the display region15aexceeds the first threshold, the controller11calculates the speed of movement of the finger from the contact position information. When the speed of movement exceeds a third threshold, it is determined that sliding is performed. When the speed of movement that exceeds the third threshold becomes less than or equal to the third threshold, it is determined that sliding is stopped.

Next, a setting unit103and an approaching display unit104will be described.

In response to detection, by the detector102, of a first operation including an operation in which a point in the background of the display region15awhere no element is displayed is specified as a specified point, the setting unit103sets a first region that is the entirety or a portion of the display region15ain accordance with the details of the first operation.

The approaching display unit104displays element information relating to a first element displayed in the first region, set by the setting unit103, at a position closer to the specified point that the position of the first element prior to detection of the first operation. The above-described process performed by the approaching display unit104will be referred to as an approaching display process. Specific details are as follows.

The first operation in the exemplary embodiment is either double tapping or sliding the background. Double tapping corresponds to the case in which the first operation includes no operation of moving the specified point, whereas sliding corresponds to the case in which the first operation includes an operation of moving the specified point.

FIG. 4is a diagram illustrating the display region15a. A rectangle arranged in the display region15arepresents an element. A numeral (from 1 to 17) in the rectangle of each element is a numeral assigned to distinguish multiple elements in this description for the sake of explanatory convenience. Actually, a picture representing the type of each element and a unique name of that element are displayed. When an element is a file, a picture representing the type of that element is a picture symbolizing an application program used to create that file. When an element is a folder, a picture representing the type of that element is a picture symbolizing that folder. When an element is an execution file, a picture representing the type of that element is a picture symbolizing an application program of that execution file. Alternatively, when an element is a file, a picture that is a size-reduced image representing the details of that file (thumbnail) may be displayed. The unique name of each element is a file name, a folder name, an application program name, or the like.

FIG. 5is a diagram illustrating the arrangement of pieces of element information after an approaching display process is performed. A point A is a specified point specified with a finger F. When double tapping the background is detected, the controller11sets the entire display region15aas a first region. Therefore, all the elements displayed in the display region15abecome first elements, that is, targets of an approaching display process performed by the approaching display unit104, and pieces of element information relating to these first elements are displayed at positions closer to the specified point than the positions of the first elements.

In the example illustrated inFIG. 5, the pieces of element information are duplicates of the first elements. In this example, the first elements are displayed at the same positions as before the approaching display process. However, the first elements may not be displayed. Alternatively, the first elements themselves may be moved to positions closer to the specified point than the positions before the approaching display process. Alternatively, the display status of the first elements may be made different from that of the pieces of element information. For example, the first elements may be made darker than they were before the approaching display process.

In the approaching display process, the approaching display unit104arranges the pieces of element information in the display region15ain accordance with a predetermined rule. The rule is a rule that defines the form of arrangement of element information. The form of arrangement of element information may be in, for example, a matrix, a radial shape, or an arch shape. In the example illustrated inFIG. 5, the pieces of element information are arranged in a matrix. Furthermore, this rule may define the order of arrangement of element information, besides the form of arrangement of element information. The order of arrangement of element information may be, for example, the order of update dates of the original first elements or the order of names of the original first elements (in alphabetical order, in the order of the Japanese syllabary, etc.).

As the pieces of element information, the first elements may be transformed to be horizontally long, and these transformed elements may be arranged in the vertical direction and displayed. In short, the pieces of element information in the exemplary embodiment are elements generated on the basis of the first elements.

FIG. 6is a diagram illustrating an exemplary setting of the first region. In this example, sliding is performed from a start point A to an end point B. A broken line CD is a virtual perpendicular that passes the start point A and intersects a line segment AB. The controller11sets a region behind the perpendicular CD in the direction of movement of the specified point as a first region. In this case, the 12th to 17th elements become first elements.

FIG. 7is a diagram illustrating the arrangement of pieces of element information after an approaching display process is performed. The controller11displays the pieces of element information at positions closer to the specified point B than the positions of the first elements. In an approaching display process in response to sliding, the approaching display unit104arranges the pieces of element information in the display region15ain accordance with a predetermined rule, as in the case of double tapping.

FIG. 8is a diagram illustrating an exemplary setting of the first region.FIG. 9is a diagram illustrating the arrangement of pieces of element information after an approaching display process is performed. In the example illustrated inFIG. 6, the direction of movement of the specified point is horizontal; in the example illustrated inFIG. 8, the direction of movement of the specified point is vertical. In this case, the 1st, 2nd, 6th, 7th, 10th, 11th, 12th, 13th, 15th, and 16th elements become first elements.

Note that sliding may be in any direction.

In response to detection, by the detector102, of a second operation on element information, an element processor105executes a process corresponding to the second operation on a corresponding first element. The exemplary embodiment discusses, as an example of the process corresponding to the second operation, an example of a process of layering elements.

The second operation is double tapping any of the pieces of element information. In response to detection of the second operation, the controller11generates a folder, displays a window representing the folder on the display region15a, and stores the pieces of element information in the window. Here, visually, the pieces of element information are associated with the folder as elements that belong to the folder. Actually, when the pieces of element information are duplicate of the first elements, the controller11creates a folder as an element higher in layer than the first elements, and associates the pieces of element information with the folder.

FIG. 10is a diagram illustrating the layering of elements. This example shows the case in which any of the pieces of element information illustrated inFIG. 9is double tapped. The pieces of element information are stored in a folder18.

In response to detection, by the detector102, of a third operation that cancels an approaching display process performed by the approaching display unit104, the erasing unit106erases the element information from the display region15a. The third operation is an operation in which the user taps the background while the element information is being displayed. In response to detection of the third operation, the controller11erases the element information from the display region15a. The first elements are not erased even when the element information is erased.

Operation of Exemplary Embodiment

FIG. 11is a flowchart illustrating the operation of the information processing apparatus10. When power of the information processing apparatus10is turned on, the controller11executes the OS and application program, and controls the information processing apparatus10in accordance with the flowchart.

In step S101, the controller11periodically determines whether the first operation is detected by using a function as the detector102. When the first operation is detected (step S101: YES), the process proceeds to step S102.

In step S102, the controller11determines whether the first operation is sliding by using a function as the setting unit103. When the first operation is sliding (step S102: YES), the process proceeds to step S103. When the first operation is not sliding, that is, when the first operation is double tapping (step S102: NO), the process proceeds to step S104.

In step S103, the controller11sets a first region on the basis of the position of the start point of sliding and the direction of sliding by using the function as the setting unit103.

In step S104, the controller11sets the entire display region15aas a first region by using the function as the setting unit103.

In step S105, the controller11displays element information by using a function as the approaching display unit104.

In step S106, the controller11determines whether the second operation is detected by using the function as the detector102. When the second operation is detected (step S106: YES), the process proceeds to step S107. When the second operation is not detected (step S106: NO), the process proceeds to step S108.

In step S108, the controller11determines whether the third operation is detected by using the function as the detector102. When the third operation is detected (step S108: YES), the process proceeds to step S109. When the third operation is not detected (step S108: NO), the process returns to step S106. The controller11periodically repeats the determination in steps S106and S108until either the second operation or the third operation is detected.

In step S107, the controller11executes a process corresponding to the second operation by using a function as the element processor105.

In step S109, the controller11erases the element information from the display region15aby using a function as the erasing unit106.

Modifications

The above-described exemplary embodiment may be modified as described in the following modifications. Alternatively, the exemplary embodiment may be combined with one or more modifications, or multiple modifications may be combined.

First Modification

The exemplary embodiment discusses an example in which the entire display region15ais set as a first region in response to detection of double tapping. Alternatively, only an element that satisfies a particular condition may become a first element. For example, when the specified point is positioned in a second region that is a portion of the background and that is associated in advance with a condition, the approaching display unit104may display element information relating to a first element that satisfies the condition as a position closer to the specified point than the position of the first element. Specific details are as follows.

FIG. 12is a diagram illustrating second regions. Multiple second regions15a1,15a2, and15a3associated in advance with conditions are set in the display region15a. The contour of each of the second regions15a1,15a2, and15a3and a character string that represents a condition are displayed. Note that the contour of each of the second regions15a1,15a2, and15a3may be any shape. Alternatively, only one second region may be set.

A condition associated with the second region15a1specifies that elements are facsimile documents, that is, documents received via the Internet facsimile. The data format of facsimile documents is Portable Document Format (PDF) or Tagged Image File Format (TIFF), and the file name of each facsimile document includes a character string that indicates that the document is a facsimile document. When the second region15a1is double tapped, the controller11extracts, from among elements displayed in the display region15a, elements whose extensions are “.pdf” or “.tif”, specifies facsimile documents among the extracted elements from their file names, and regards the specified facsimile documents as first elements. As a result, duplicates of the icons of the facsimile documents are generated, and the duplicate icons are displayed in the second region15a1.

FIG. 13is a diagram illustrating the arrangement of pieces of element information after an approaching display process is performed. In this example, the 1st to 4th elements are facsimile documents.

A condition associated with the second region15a2specifies that elements are scanned documents, that is, image data generated by optically reading a subject copy of a document. The data format of scanned documents is TIFF. When the second region15a2is double tapped, the controller11extracts, from among the elements displayed in the display region15a, elements whose extensions are “.tif”, specifies scanned documents that are documents other than facsimile documents among the extracted elements from their file names, and regards the specified scanned documents as first elements. As a result, duplicates of the icons of the scanned documents are generated, and the duplicate icons are displayed in the second region15a2.

A condition associated with the second region15a3specifies that elements are recently used files, that is, a predetermined number of (such as ten) files in descending order of the date of access (browsed, updated, etc.). When the second region15a3is double tapped, the controller11extracts, from among the elements displayed in the display region15a, ten files in descending order of the date of access, and regards the extracted files as first elements. As a result, duplicates of the icons of the recently used files are generated, and the duplicate icons are displayed in the second region15a3.

Second Modification

When multiple elements are displayed in the display region15aand when the distance between any of these multiple elements and the specified point is less than or equal to a threshold, the approaching display unit104may display element information relating to a first element corresponding to the attribute of a second element whose distance from the specified point is less than or equal to the threshold at a position closer to the specified point than the position of the first element. Specific details are as follows.

For example, when double tapping is performed in the vicinity of the 14th element among the elements arranged as inFIG. 4, the controller11generates a duplicate of a first element corresponding to the attribute of this element. The vicinity of an element is a point in the background whose distance from the element is less than or equal to a threshold. Since double tapping an element is associated with another operation (such as opening a file or a folder or executing an execution file), double tapping an element is excluded. The attribute of an element includes any type of information that characterizes the element, such as the type or update date of the element.

FIG. 14is a diagram illustrating the arrangement of pieces of element information after an approaching display process is performed. For example, if the 14th element is a scanned document, the controller11specifies scanned documents other than the 14th document, generates duplicates of the icons of the specified scanned documents, and displays the duplicate icons at positions closer to the 14th element than the original icons. In this example, the 5th to 9th elements are scanned documents.

Third Modification

The exemplary embodiment discusses an example in which the approaching display unit104arranges the pieces of element information in the display region15ain accordance with the predetermined rule. Alternatively, the approaching display unit104may arrange the pieces of element information in accordance with any rule.

FIG. 15is a diagram illustrating the arrangement of pieces of element information after an approaching display process is performed. In this example, elements are classified by type and arranged in a matrix on a type-by-type basis. Note that first elements are omitted inFIGS. 15 to 19.

The display region15ais divided into regions corresponding to a facsimile document(s), a scanned document(s), and a folder(s) from the left. A line segment indicating the boundary of each region, and the name of a type associated with that region are displayed. Alternatively, the line segment and the name of each region may not be displayed. When elements are files (facsimile documents or scanned documents in this example), thumbnails that are size-reduced images representing the details of the files may be displayed.

FIG. 16is a diagram illustrating the arrangement of pieces of element information after an approaching display process is performed. In this example, the display region15ais divided by boundary lines extending in radial directions.

FIG. 17is a diagram illustrating the arrangement of pieces of element information after an approaching display process is performed. In this example, elements are arranged in a radial shape on a type-by-type basis. Also in this example, portions of adjacent elements are overlapped. The order of arrangement of the elements is, for example, the order of update dates of the elements or the order of names (file names, folder names, etc.) of the elements (in alphabetical order, in the order of the Japanese syllabary, etc.).

Alternatively, the elements may be arranged at random.

Fourth Modification

The approaching display unit104may change the external appearance of first elements that satisfy a predetermined condition.

FIG. 18is a diagram illustrating the arrangement of pieces of element information after an approaching display process is performed. In this example, the condition specifies that first elements are scanned documents. Thus, thumbnails of the scanned documents are displayed, and these thumbnails are enlarged.

Fifth Modification

The exemplary embodiment discusses an example in which an example of a process of layering elements is given as an example of the process corresponding to the second operation. Alternatively, the process corresponding to the second operation may be any process. For example, when element information is tapped as the second operation, the controller11recognizes that the tapped element information is selected. In this case, the controller11changes the external appearance of a first element that is the original of the tapped element information, which is a duplicate of the first element, by, for example, highlighting the first element, and erases the element information (selecting process).

A process performed on the first element may be made different according to the details of the second operation, such that the above-described selecting process is executed when element information is tapped, whereas the layering process is executed when element information is double tapped.

Alternatively, in a state where an approaching display process is performed, a menu including various predetermined second operations may be displayed in the display region15a, and the user may select a second operation from the menu.

Sixth Modification

When multiple first operations are performed, and when the same first elements are selected in response to these first operations, the approaching display unit104may display pieces of element information, the number of which corresponds to the number of these first operations, at positions closer to the specified points of these first operations than the positions of the first elements.

FIG. 19is a diagram illustrating the arrangement of pieces of element information after an approaching display process is performed. In this example, in a state where the elements are arranged as inFIG. 4, different users double tap two different specified points A and B almost at the same time. In this case, two sets of duplicates of the 1st to 17th elements are generated, and the generated sets of duplicates are displayed at positions closer to the specified points A and B than their originals.

Seventh Modification

The exemplary embodiment discusses an example in which a region behind the perpendicular CD, which passes the start point A and which intersects the line segment AB (B is the end point), in the direction of movement of the specified point is set as a first region. Alternatively, another region may be set as a first region.

FIG. 20is a diagram illustrating an exemplary setting of the first region.FIG. 21is a diagram illustrating the arrangement of pieces of element information after an approaching display process is performed. In this case, a belt-shaped region with a width W, which extends in the direction of sliding, is set as a first region. In this case, the 10th and 11th elements become first elements.

Alternatively, sliding may be performed toward the first elements. For example, when sliding is performed from a point B serving as a start point to an end point A inFIG. 20, the 10th and 11th elements become first elements.

FIG. 22is a diagram illustrating an exemplary setting of the first region. In this example, a fan-shaped region that extends at an angle θ on both sides of an extension of a line segment AB, behind the direction of sliding, is set as a first region. In this case, the 10th and 11th elements become first elements. Also in this case, sliding may be performed toward the first elements.

Eighth Modification

A region where the distance from the double-tapped specified point is greater than or equal to a threshold may be set as a first region. Alternatively, a region where the distance from the double-tapped specified point is less than or equal to a threshold may be set as a first region.

Ninth Modification

The exemplary embodiment discusses an example in which element information is an element generated on the basis of a first element, such as a duplicate of a first element. However, element information may by any information as long as it relates to a first element. For example, information indicating which element is a first element may be displayed as element information. Specifically, in the example illustrated inFIG. 5, instead of the duplicates of the first elements, character strings listing the file names, folder names, application program names, or the like of the first elements may be displayed. Alternatively, in the examples illustrated inFIGS. 15 to 18, character strings listing file names or folder names corresponding to the regions of facsimile documents, scanned documents, and folders may be displayed in the respective regions.

Tenth Modification

The exemplary embodiment discusses an example in which the first elements are specified by the user by touching the display region15a. Alternatively, another system in which the first elements are specified without touching the display region15amay be used. For example, a system in which the position of the user's finger or a pen is specified by using an infrared ray or the like may be used, or a system in which a position indicated by the user's finger, face, eyeball, or the like is specified by capturing an image of the finger, face, eyeball, or the like and analyzing the image may be used.

Although the exemplary embodiment discusses an example in which a touch panel is used, a system in which the first element is specified by using a mouse or a joystick may be used.

Eleventh Modification

The exemplary embodiment discusses, as an example of the information processing apparatus10, an example in which all the hardware items are provided in the housing19. Alternatively, the information processing apparatus10may be a notebook PC in which a housing including the display15and a housing including hardware items other than the display15are attached to each other with a hinge. Alternatively, the information processing apparatus10may include hardware other than the display15, and the information processing apparatus10and the display15(display apparatus) may be connected by signals or wireless communication units.

Twelfth Modification

The exemplary embodiment discusses an example in which the above-described functions are realized when the controller11of the information processing apparatus10executes the application program. Alternatively, the same or similar functions as those in the exemplary embodiment may be implemented in hardware on the information processing apparatus10. Alternatively, the program may be provided by being recorded on a computer readable recording medium, such as an optical recording medium or a semiconductor memory, and the program may be read from the recording medium and stored in the memory12of the information processing apparatus10. Alternatively, the program may be provided via an electric communication line.