Method and system for inputting in electronic device with a touch input and a proximity input

A method and a system for inputting in an electronic device are provided. The method includes receiving a proximity input provided by an input tool through a user interface, the input tool having a drawing means with a predetermined length which is within a distance of a proximity input supporting section of the electronic device, identifying an attribute of the received proximity input, determining a display attribute based on the identified attribute of the proximity input, and outputting a drawing on the user interface corresponding to the determined display attribute and a drawing pattern of the proximity input.

CROSS-REFERENCE TO RELATED APPLICATION(S)

This application claims the benefit under 35 U.S.C. § 119(a) of a Korean patent application filed on Sep. 10, 2013 in the Korean Intellectual Property Office and assigned Serial number 10-2013-0108276, the entire disclosure of which is hereby incorporated by reference.

TECHNICAL FIELD

The present disclosure relates to a method and a system for inputting in an electronic device, in which an intuitive and realistic drawing is provided through a user interface.

BACKGROUND

As smart phones are widely used, interfacing technologies between a user and an electronic device (i.e., a technology of which an electronic device identifies various user inputs and provides various outputs according to the result of the identification) are gradually developing.

In particular, by using an input means such as a pen on a user interface such as a touchscreen, a user input can be provided for the electronic device so the user may conveniently and intuitively take notes.

Also, various drawing inputs can be provided for the electronic device by using a touch pen, and the electronic device can output a drawing onto the touch screen corresponding to the drawing inputs.

Although an intuitive drawing input can be provided for the electronic device by using a currently available touch pen, there is a limit to providing a realistic drawing experience similar to drawing on paper with a brush.

SUMMARY

Aspects of the present disclosure are to address at least the above-mentioned problems and/or disadvantages and to provide at least the advantages described below. Accordingly, an aspect of the present disclosure is to provide a method and a system for inputting in an electronic device, which provides a realistic drawing experience similar to using a real drawing tool when drawing with an electronic device.

In accordance with an aspect of the present disclosure, a method for inputting in an electronic device is provided. The method includes receiving a proximity input provided by an input tool through a user interface, the input tool having a drawing means with a predetermined length which is within a distance of a proximity input supporting section of the electronic device, identifying an attribute of the received proximity input, determining a display attribute based on the identified attribute of the proximity input, and outputting a drawing on the user interface corresponding to the determined display attribute and a drawing pattern of the proximity input.

In accordance with another aspect of the present disclosure, a system for inputting in an electronic device is provided. The system includes an input tool comprising a proximity input responder and a drawing means with a predetermined length which is within a distance of a proximity input supporting section of the electronic device, and the electronic device comprising a user interface, and a control unit configured to receive a proximity input provided by the input tool through the user interface, to identify an attribute of the received proximity input, to determine a display attribute based on the identified attribute of the, and to output a drawing to the user interface corresponding to the determined display attribute and a drawing pattern of the proximity input.

DETAILED DESCRIPTION

For the same reasons, some components in the accompanying drawings are emphasized, omitted, or schematically illustrated, and the size of each component does not fully reflect the actual size. Therefore, the present disclosure is not limited to the relative sizes and distances illustrated in the accompanying drawings.

It is to be understood that the singular forms “a”, “an”, and “the” include plural referents unless the context clearly dictates otherwise. Further, it should not be understood that the term “comprise” or “include” doesn't mean to include all the items or operations listed in the disclosure.

Hereinafter, an input tool of an electronic device described in the present disclosure and the accompanying drawings means a system designed to provide a drawing output through a user interface of the electronic device, if the drawing is provided for the user interface of the electronic device by using an input tool.

Further, the user interface of the electronic device illustrated in the drawings of the present disclosure is a device for receiving a user input and outputting to the user. In particular, the user interface may include an input detection sensor for detecting the user input, to which various detection technologies such as a resistive type, a capacitive type, an electromagnetic induction type, and a pressure type can be applied.

The electronic device according to the present disclosure can detect not only the touch input through an input means such as an input tool but also a proximity input formed within a predetermined distance.

The input system of an electronic device according to various embodiments of the present disclosure includes an input tool and an electronic device.

FIG. 1is a schematic drawing illustrating an input tool for an input system of an electronic device according to an embodiment of the present disclosure.

The input system of an electronic device according to various embodiments of the present disclosure can provide a drawing through a proximity input performed by an input tool. The input tool includes an input responder, and an input detection sensor included in a user interface of the electronic device detects an input according to the input responder of the input tool.

For example, the input detection sensor of the user interface can detect a touch input and a proximity input according to an actual contact or a distance to the input responder of the input tool. If an electromagnetic sensor is included as an input detection sensor of the user interface, a resonance screen inducing an electromagnetic field may be used for the electromagnetic sensor.

The electronic device according to various embodiments of the present disclosure can provide a drawing input by receiving a proximity input from the input tool. Namely, a more practical drawing input can be provided on the user interface according to various attributes of the proximity input.

Referring toFIG. 1, an input tool100according to various embodiments of the present disclosure includes a drawing means130in a proximity input supporting section to support a practical drawing input. For example, the drawing means130may be a brush or another similar and/or suitable drawing device. Accordingly, a user can input a drawing into the electronic device through a proximity input by putting the drawing means130into contact with the user interface of the electronic device like using an actual drawing tool.

In more detail, the input tool100may include a body110which is used as a supporting bar for a user, input responder120for inducing an input on the electronic device, and drawing means130. The drawing means130may be attached to an end of the input responder120because it must be located in the proximity input supporting section.

In the meantime, the length of the drawing means130of the input tool100may be variously set according to an embodiment of the present disclosure.

For example, the length of the drawing means130may be formed in the same length as the maximum distance A of a proximity input supported by the input responder120as shown by case1ofFIG. 1. In this case, a drawing input can be provided through the user interface by controlling the drawing means130to operate with an actual drawing sense corresponding to the user interface.

Alternatively, the length of the drawing means130may be formed shorter than the maximum distance A+B of proximity input supported by the input responder120as shown by case2ofFIG. 1. According to the embodiment, if the input tool100is located between section A+B and section A corresponding to the user interface of the electronic device, various information such as a guide for drawing input, location of drawing, shape of drawing means130, drawing color can be displayed on the user interface of the electronic device. If the input tool100contacts with the user interface of the electronic device in the section A, a drawing output corresponding to the drawing input may be displayed on the user interface. Namely, if the drawing means130approaches to the user interface, the shape of the drawing means130is firstly output to the user interface and the drawing can start from the moment of touching the user interface.

The present disclosure is not limited to the above description and a guide or drawing function can be applied to various embodiments by setting different sections according to the distance in the proximity input supporting section.

FIG. 2is a block diagram illustrating a configuration of an input system for an electronic device according to an embodiment of the present disclosure.

Referring toFIGS. 1 and 2, an electronic device200is configured to receive a drawing input from the input tool100and may include a user interface unit210and a control unit220.

The user interface unit210receives a user input, and performs a function of outputting contents provided by the electronic device for a user. For example, the user interface unit210may be configured with a touch screen performing both an input function and a display function. In more detail, the user interface unit210may include a user input unit211and a display unit212.

The user input unit211is a device for receiving a user input, and may include an input detection sensor to detect the user input. Various input detection technologies such as a resistive type, a capacitive type, an electromagnetic induction type, and a pressure type can be applied to the input detection sensor. The user input unit211can detect not only the direct touch input through an input means such as an input tool but also a proximity input formed within a predetermined distance.

In more detail, the user input unit211can detect a proximity input through the input responder120of the input tool100. The proximity input can be a drawing input. The user input unit211transmits a received proximity input (for example, a drawing input) to the control unit220.

The display unit212is a device for displaying output information in the electronic device, and may include a display panel. In more detail, the display unit212can output a drawing corresponding to an input through the user input unit211under the control of the control unit220.

The control unit220controls general operations of the electronic device200. The control unit220can decide an attribute of a drawing to be output to the display unit212by identifying an attribute of a proximity input received from the user input unit211. The attribute of the proximity input denotes an attribute for providing an actual drawing sense for the user interface unit210by using the input tool100of the electronic device200. Namely, a specific shape of drawing is formed according to various factors when actually drawing on a paper with a brush, and the control unit220according to various embodiments of the present disclosure identifies the specific shape of drawing from the attribute of the proximity input in order to control the drawing output similar to the actual drawing.

In more detail, the control unit220may include an error corrector221, proximity input attribute identifier222, display attribute determiner223, and drawing control unit224.

The error corrector221performs a function of correcting a drawing output error which can be generated when the input tool100is inclined and a proximity input area received by the input responder120on the user interface unit210becomes different from a contact area of the drawing means130.

FIG. 3is a drawing illustrating an example of operating an error corrector for an input system of electronic device according to an embodiment of the present disclosure.

Referring toFIG. 3, when the input tool100performs an input function on the electronic device200in an specific inclined state, a proximity input generated by the input responder120on the user interface unit210is detected from area m, however the drawing means130actually contacts area n. Accordingly, a user makes a drawing by estimating the area n, however a deviation can be generated because the drawing output of area m is displayed on the user interface unit210. If the difference between the area m and area n becomes greater than a critical value, a drawing output can be displayed out of an area intended by the user.

The error corrector221corrects an error so that a drawing output can be displayed in the contact area of the drawing means130. In more detail, the error corrector221identifies an additional touch input of the drawing means130, and replaces the location of drawing output with the location of identified touch input. For this, the drawing means130of the input tool100must additionally include a touch responding material. Namely, the input tool100and the electronic device200according to the embodiment of the present disclosure can identify not only the proximity input but also a touch input. In the meantime, in order to avoid an unnecessary touch input such as a palm touch generated in the electronic device200, the error corrector221can identify only the touch input generated in a predetermined area based on the proximity input.

As another embodiment, the error corrector221can correct the drawing location by detecting the inclination of the input tool100. Namely, the correction of the drawing location can be performed by saving deviations of a drawing location corresponding to the inclinations of the input tool100and compensating with a corresponding deviation value when the input tool100is inclined.

The proximity input attribute identifier222identifies an attribute of a proximity input generated by the user interface unit210. The attribute of the proximity input may include at least one of a proximity distance, a movement speed, an input duration time, a movement direction, a number of inputs, a standstill time of the proximity input, a state of input tool, a type of drawing means of the input tool, surface material set to the user interface, and any other similar and/or suitable attribute. A drawing is generated according to various factors when actually drawing on a paper with a brush, and the attribute of the proximity input is also influenced by various factors. Because the attribute of the proximity input changes every moment, the proximity input attribute identifier222identifies the attribute of the proximity input in real time.

The display attribute determiner223determines the characteristics of drawing output to be provided for the user interface unit210based on the attribute of proximity input identified by the proximity input attribute identifier222. Alternatively, the display attribute determiner223may determine the display attribute by tuning the attribute of the proximity input identified by the proximity input attribute identifier222with a value modeled on an actual drawing means.

For example, if the attribute of proximity distance is relatively short, the display attribute determiner223may increase the thickness attribute of a drawing to be output. The determined display attribute may include at least one of a thickness of drawing, a dry brush effect, a concentration, a color, and any other similar and/or suitable attribute.

FIG. 4is a block diagram illustrating a configuration of a proximity input attribute identifier according to an embodiment of the present disclosure.

FIG. 5is a drawing illustrating an example of operating a thickness adjuster for an input system of an electronic device according to an embodiment of the present disclosure.

FIGS. 6A, 6B, and 6Care drawings illustrating an example of drawing lines by using a dry brush effect adjuster according to an embodiment of the present disclosure.

Referring toFIG. 4, the display attribute determiner223may include a thickness adjuster410, a dry brush effect adjuster420, a concentration adjuster430, and a color adjuster440.

The thickness adjuster410adjusts the thickness of a drawing to be output based on the distance of the proximity input identified by the proximity input attribute identifier222or the type of the drawing means130according to a user setting. For example, the thickness adjuster410may control the thickness of drawing nonlinearly as the distance of the proximity input becomes closer. The thickness of drawing can be adjusted according to the type of the drawing means130. Further, the thickness of drawing output can be adjusted according to various attributes of the proximity input.

Referring toFIG. 5, the distance attribute of the proximity input changes as the drawing means130of the input tool100approaches to the user interface unit210of the electronic device200. If the type of the drawing means130is a brush and a vertical line is drawn on the user interface unit210with a brush, the distance of the proximity input increases gradually. Here, the thickness adjuster410may nonlinearly increase the thickness as the distance of the proximity input becomes closer as shown by510. Namely, the thickness of drawing can be nonlinearly controlled in the same way of drawing with an actual brush. Accordingly, if the distance h between the drawing means130of the input tool100and the user interface unit210increases, the thickness of drawing decreases nonlinearly, and if the distance h decreases, the thickness of drawing increases nonlinearly. Further, the thickness adjuster410controls the thickness of drawing by considering various factors, and thereby the thickness of drawing output can be controlled similar to an actual drawing sense.

The dry brush effect adjuster420adjusts a dry brush effect of a drawing to be output according to at least one of a movement speed, input duration time, movement direction, and type of drawing means of the proximity input identified by the proximity input attribute identifier222. For example, the dry brush effect adjuster420increases the dry brush effect of outputting the drawing as the movement speed of the proximity input becomes greater. Referring toFIG. 6A, the movement speed of the uppermost line is slowest and the movement speed of the lowermost line is fastest, and thereby the lower line shows greater dry brush effect of drawing.

Further, the dry brush effect adjuster420increases the dry brush effect as the time elapses after starting a drawing by identifying the input duration time. As shown inFIG. 6B, if the line is drawn from the left to the right, the dry brush effect of drawing increases as the line moves towards the right direction.

Further, the dry brush effect adjuster420can adjust the dry brush effect of the drawing according to the movement direction of the proximity input. As shown byFIG. 6C, if the proximity input moves in a curved form, the dry brush effect of the outer part can be adjusted greater than the inner part.

Further, the dry brush effect adjuster420can adjust the dry brush effect of the drawing output according to the type of drawing means130and other various attributes of the proximity input.

The concentration adjuster430adjusts the concentration or diffusion of a drawing to be output according to at least one of the number of inputs, movement direction, stand still time of the proximity input identified by the proximity input attribute identifier222, and surface material set to the user interface of the electronic device. For example, the concentration adjuster430can control the concentration of the first drawing to be darkest when the drawing means130of the input tool100virtually picked up a black or color ink, and thereafter controls the concentration of drawing output to be gradually paler.

Further, if the movement direction of the proximity input is distinctly turned, the concentration adjuster430can increase the concentration and diffusion of drawing at the turning point. If the stand still time of the proximity input becomes longer, the concentration and diffusion of the drawing can be controlled to increase. Further, the concentration and diffusion of the drawing can be controlled according to the surface material set to the user interface of the electronic device (e.g., type of paper) and various attributes of the proximity input.

The color adjuster440adjusts the color of a drawing to be output based on a distance of the proximity input and a state of the input tool100identified by the proximity input attribute identifier222according to a user setting. If the color adjuster440is set to select different colors in every proximity section according to the user setting, the color of drawing output can be adjusted according to the proximity distance of the input tool100thereafter. Further, if an activator (not shown) is included in the input tool100, the color adjuster440can adjust the color of outputting drawing based on the activation state of the activator and support a function of adjusting a single color.

Further, the color adjuster440provides a function of selecting a color, and thereby can virtually set at least one color to the drawing means130of the input tool100.

FIG. 7is a drawing illustrating an example of operating a color adjuster for an input system of an electronic device according to an embodiment of the present disclosure.

Referring toFIG. 7, if a pallet710including at least one color is provided for the user interface, the color of the input tool100can be set by contacting the drawing means130of the input tool100with the pallet.

Subsequently, if a drawing input is performed according to a colored input tool100, the color adjuster440can put a color to the drawing output as if an actual color is painted on the paper.

If the display attribute of outputting the drawing is decided by the display attribute determiner223, the drawing control unit224outputs a drawing to the interface unit210corresponding to the decided display attribute and a drawing pattern of the proximity input.

The drawing pattern of proximity input denotes a shape of the drawing intended by a user such as a character, a symbol, a picture, and a gesture. The drawing control unit224provides a drawing output according the drawing pattern intended by the user and a more practical drawing sense when outputting the drawing according to the decided display attribute.

FIG. 8is a flowchart illustrating an input procedure in an electronic device according to an embodiment of the present disclosure.

The electronic device can execute an application to receive a drawing input. Of course, a waiting screen and other various screens can be set to receive a drawing input.

If the state of receiving a drawing input is ready, the electronic device receives a proximity input from the input tool100at operation S810. The proximity input can be a drawing input performed by the electronic device.

The electronic device identifies whether an area of detected proximity input on the user interface is identical to an actual area of contacted drawing means of an input tool at operation S811. This is to compensate a deviation between a drawing location intended by a user on the user interface and a drawing location identified by the drawing means.

If the area of detected proximity input on the user interface is identical to the actual area of the contacted drawing means of the input tool, the compensation of the deviation is unnecessary. If the area of the detected proximity input on the user interface is different from the actual area of the contacted drawing means of the input tool, the drawing location can be compensated by detecting the deviation at operation S812. The method of compensating the deviation of drawing location has already been described herein. Operations S811and S812of detecting and compensating the deviation of the drawing location are not essential to perform a drawing input in the electronic device, and may be performed selectively.

The electronic device identifies the attribute of the proximity input received from the user interface at operation S813. Because the attribute of the proximity input changes at every moment, the attribute of the received proximity input is identified in real time.

Subsequently, the display attribute of outputting the drawing is decided based on the attribute of the identified proximity input at operation S814. Here, the attribute of the identified proximity input may be tuned with a value modeled on an actual drawing means and may be decided with the attribute of a tuned proximity input.

The electronic device outputs a drawing to the user interface corresponding to the decided display attribute of the outputting of the drawing and a drawing pattern of the proximity input at operation S815. The electronic device can provide an output drawing intended by a user and a more practical drawing sense according to the decided display attribute.

According to various embodiments of the present disclosure, more intuitive and practical drawing can be achieved by using an input tool on a user interface of an electronic device. Further, a user environment for an optimum drawing sense can be provided.

According to various embodiments, at least part of a device (for example, modules or functions thereof) or a method (for example, operations) according to the various embodiments of the present disclosure may be embodied by, for example, one or more instructions stored in a non-transitory computer readable storage medium provided in a form of a programming module. When the command is executed by one or more processors (for example, control unit220), the one or more processors may perform a function corresponding to the command. At least a part of the programming module may be implemented (for example, executed) by, for example, the control unit220. At least a part of the programming module may include, for example, a module, a program, a routine, a set of instructions, and/or a process for performing one or more functions.

The non-transitory computer readable recording medium may include magnetic media such as a hard disk, a floppy disk, and a magnetic tape, optical media such as a Compact Disc Read Only Memory (CD-ROM) and a DVD, magneto-optical media such as a floptical disk, and hardware devices specially configured to store and perform a program instruction (for example, programming module), such as a Read Only Memory (ROM), a Random Access Memory (RAM), a flash memory and the like.

Further, the program commands may include high class language codes that can be executed in a computer by using an interpreter, as well as machine language codes that are made by a compiler. The aforementioned hardware device may be configured to operate as one or more software modules in order to perform the operation of the present disclosure, and vice versa. A programming module according to the present disclosure may include at least one of the described component elements, a few of the component elements may be omitted, or additional component elements may be included. Operations executed by a module, a programming module, or other component elements according to various embodiments of the present disclosure may be executed sequentially, in parallel, repeatedly, or in a heuristic manner. Also, a few operations may be executed based on a different order, may be omitted, or may additionally include another operation.