Patent Description:
An electronic device including a display such as a touch screen may acquire a handwriting input from a user through the display. The electronic device may display the recognized handwriting input on the display or convert the recognized handwriting input into text in a form (e.g., a font, a size, or a color) supported by the electronic device and display the converted text on the display. The electronic device may provide an environment in which the user may take notes freely using the electronic device by supporting a handwriting function.

<CIT> relates to a system for spacing, storing and recognizing electronic representations of handwriting and printing comprising a central processing unit that couples with a display device, an input device, and a memory. <CIT> relates to an electronic apparatus including a line recognition module, a character recognition module and a generator.

In a portable electronic device such as a smartphone or a tablet, a size of a display is limited, so that a space where a handwriting input may be acquired is also limited. For example, from a user's point of view, there may be situations in which a line needs to be changed because of lack of the space while inputting the handwriting. When the line-changed handwriting input is output as line-changed text, a sentence unintended by the user is generated, and consequently, utilization of a handwriting function may be reduced.

According to embodiments disclosed in the disclosure, the electronic device may increase the utilization of the handwriting function by reflecting the intention of the user for the handwriting input.

According to embodiments disclosed in the disclosure, the electronic device may increase a degree of freedom for a memo scheme of the user and provide a user-friendly environment.

In addition, various effects that are directly or indirectly identified through the disclosure may be provided.

The same reference numerals may be used to represent the same elements throughout the drawings.

Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the various embodiments described herein can be made without departing from the scope of the claims.

Referring to <FIG>, an electronic device <NUM> in a network environment <NUM> may communicate with an external electronic device <NUM> via a first network <NUM> (e.g., a short-range wireless communication network), or at least one of an external electronic device <NUM> or a server <NUM> via a second network <NUM> (e.g., a long-range wireless communication network). According to an embodiment, the electronic device <NUM> may communicate with the external electronic device <NUM> via the server <NUM>. According to an embodiment, the electronic device <NUM> may include a processor <NUM>, a memory <NUM>, an input module <NUM>, a sound output module <NUM>, a display module <NUM>, an audio module <NUM>, a sensor module <NUM>, an interface <NUM>, a connecting terminal <NUM>, a haptic module <NUM>, a camera module <NUM>, a power management module <NUM>, a battery <NUM>, a communication module <NUM>, a subscriber identification module (SIM) <NUM>, or an antenna module <NUM>. In some embodiments, at least one of the components (e.g., the connecting terminal <NUM>) may be omitted from the electronic device <NUM>, or one or more other components may be added in the electronic device <NUM>. In some embodiments, some of the components (e.g., the sensor module <NUM>, the camera module <NUM>, or the antenna module <NUM>) may be implemented as a single component (e.g., the display module <NUM>).

According to an embodiment, the audio module <NUM> may obtain the sound via the input module <NUM>, or output the sound via the sound output module <NUM> or a headphone of an external electronic device (e.g., the external electronic device <NUM>) directly (e.g., wiredly) or wirelessly coupled with the electronic device <NUM>.

The interface <NUM> may support one or more specified protocols to be used for the electronic device <NUM> to be coupled with the external electronic device (e.g., the external electronic device <NUM>) directly (e.g., wiredly) or wirelessly.

The connecting terminal <NUM> may include a connector via which the electronic device <NUM> may be physically connected with the external electronic device (e.g., the external electronic device <NUM>).

The communication module <NUM> may support establishing a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device <NUM> and the external electronic device (e.g., the external electronic device <NUM>, the external electronic device <NUM>, or the server <NUM>) and performing communication via the established communication channel.

The wireless communication module <NUM> may support various requirements specified in the electronic device <NUM>, an external electronic device (e.g., the external electronic device <NUM>), or a network system (e.g., the second network <NUM>). According to an embodiment, the wireless communication module <NUM> may support a peak data rate (e.g., <NUM> Gbps or more) for implementing eMBB, loss coverage (e.g., <NUM> dB or less) for implementing mMTC, or U-plane latency (e.g., <NUM> or less for each of downlink (DL) and uplink (UL), or a round trip of <NUM> or less) for implementing URLLC.

According to an embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on a first surface (e.g., the bottom surface) of the printed circuit board, or adjacent to the first surface and capable of supporting a designated high-frequency band (e.g., the mmWave band), and a plurality of antennas (e.g., array antennas) disposed on a second surface (e.g., the top or a side surface) of the printed circuit board, or adjacent to the second surface and capable of transmitting or receiving signals of the designated high-frequency band.

Each of the external electronic devices <NUM> or <NUM> may be a device of a same type as, or a different type, from the electronic device <NUM>. According to an embodiment, all or some of operations to be executed at the electronic device <NUM> may be executed at one or more of the external electronic devices <NUM> and <NUM> or the server <NUM>.

<FIG> shows an electronic device capable of acquiring a handwriting input according to an embodiment of the disclosure.

Referring to <FIG>, an electronic device (e.g., an electronic device <NUM> in <FIG>) may be a portable electronic device such as a smart phone or a tablet. A display <NUM> (e.g., the display module <NUM> in <FIG>) of the electronic device <NUM> may include a display panel (not shown) or a sensing panel (or a touch panel) (not shown) set to sense a touch input. The sensing panel (or the touch panel) may be placed on a pixel (or inside the pixel) of the display panel. The sensing panel may include, for example, at least one of a digitizer and/or a touch circuit.

According to one embodiment, the display <NUM> may be combined with or may be placed adjacent to some of a touch sensing circuit connected to the touch panel to sense the touch, a pressure sensor capable of measuring an intensity (a pressure) of the touch, and the digitizer that detects a magnetic field-type digital pen <NUM>.

According to one embodiment, the display <NUM> may be formed as a liquid crystal display (LCD), an organic light emitted diode (OLED), an active matrix organic light emitted diode (AMOLED), or a flexible display.

According to one embodiment, the electronic device <NUM> may acquire a handwriting input by receiving the touch input on the display <NUM> from the magnetic field-type digital pen <NUM>. Although <FIG> shows an embodiment in which the electronic device <NUM> acquires the handwriting input from the magnetic field-type digital pen <NUM>, according to another embodiment, the electronic device <NUM> may acquire the handwriting input from a body part (e.g., a finger) of a user.

<FIG> shows a handwriting input and text according to an embodiment of the disclosure.

Referring to a left drawing of <FIG>, an electronic device (e.g., an electronic device <NUM> in <FIG> or <FIG>) may acquire a handwriting input <NUM> (e.g., `Hello! Good morning ladies and gentlemen. Nice to meet you here today') on a region of the display <NUM>. According to various embodiments disclosed in the disclosure, the region capable of acquiring the handwriting input <NUM> in the display <NUM> may be referred to as an 'input field'. The input field may be, for example, an entirety or a portion of the display <NUM>. The electronic device <NUM> may provide the user with a user experience like writing with a pen by outputting the acquired (or recognized) handwriting input <NUM> on the input field in real time through the display <NUM>.

According to one embodiment, when a letter or a sentence represented by the acquired handwriting input <NUM> needs to be shared with a user of another electronic device or edited as a document, the electronic device <NUM> may convert the acquired handwriting input <NUM> into text in a form (e.g., at least one of a font, a size, or a color) supported by the electronic device <NUM>. For example, the electronic device <NUM> may convert the handwriting input <NUM> into text (e.g., first text <NUM> or second text <NUM>) shown in a right drawing of <FIG>, and output the converted text on the display <NUM>.

Because a size of the display <NUM> is limited by characteristics of the electronic device <NUM> that requires portability, a situation in which the user of the electronic device <NUM> is not able to write the handwriting input <NUM> in one line may occur. For example, the acquired handwriting input <NUM> may include a plurality of lines <NUM>, <NUM>, <NUM>, <NUM>, and <NUM>.

The electronic device <NUM> according to embodiments may convert the handwriting input <NUM> including the plurality of lines <NUM>, <NUM>, <NUM>, <NUM>, and <NUM> into the first text <NUM> including a plurality of lines through handwriting recognition. The first text <NUM> may not be in a form of a sentence desired by the user of the electronic device <NUM>.

The electronic device <NUM> according to embodiments may merge or maintain at least some of the plurality of lines <NUM>, <NUM>, <NUM>, <NUM>, and <NUM> included in the acquired handwriting input <NUM> based on a specified condition, and convert the handwriting input <NUM> in which the lines are changed into the second text <NUM>, thereby generating a sentence reflecting an intention of the user. For example, the electronic device <NUM> may merge some lines (e.g., line <NUM> and line <NUM>, or line <NUM> and line <NUM>) included in the handwriting input <NUM> into one line in the operation of converting the handwriting input <NUM> into the first text <NUM> or second text <NUM>. As another example, the electronic device <NUM> may separate some lines (e.g., line <NUM>) without merging with other lines in the operation of converting the handwriting input <NUM> into the first text <NUM> or the second text <NUM>. A specific example in which the lines are merged or maintained based on the specified condition will be described with reference to <FIG>, <FIG>, <FIG>, <FIG>, <FIG>, <FIG>, <FIG>, <FIG>, <FIG>, <FIG>, and <FIG>.

<FIG> shows a screen displaying a handwriting input and text according to an embodiment of the disclosure.

Referring to <FIG>, an electronic device (e.g., an electronic device <NUM> in <FIG> or <FIG>) may output text <NUM> (e.g., a second text <NUM> in <FIG>) in which at least some of the plurality of lines included in a handwriting input <NUM> are merged or maintained through a display <NUM>. For example, as shown in screen <NUM>, the electronic device <NUM> may output an output field <NUM> including the text <NUM> on a region that does not overlap an input field <NUM>. As another example, as shown in screen <NUM>, the electronic device <NUM> may output a pop-up window <NUM> including the text <NUM> on a region at least partially overlapping the input field.

As shown in screen <NUM>, the pop-up window <NUM> may include a visual object (e.g., a conversion button) for converting the handwriting input <NUM> into the text <NUM> or a visual object (e.g., a copy button) for copying the text <NUM>.

In embodiments, the output field <NUM> or the pop-up window <NUM> may be output based on various conditions. For example, the electronic device <NUM> may output the output field <NUM> or the pop-up window <NUM> substantially simultaneously with the input field <NUM>, output the output field <NUM> or the pop-up window <NUM> substantially simultaneously when sensing that the handwriting input is starting to be acquired on the input field <NUM>, and output the output field <NUM> or the pop-up window <NUM> when a specified time elapses after the handwriting input starts to be acquired. As another example, the electronic device <NUM> may receive a user input requesting to convert the handwriting input <NUM> into the text <NUM>, and output the output field <NUM> or the pop-up window <NUM> in response to the reception of the user input.

In embodiments, the electronic device <NUM> may provide a user interface (UI) such that the user may identify a portion in which the line is changed compared to the handwriting input <NUM> of the output text <NUM>. For example, the electronic device <NUM> may shade text <NUM> or text <NUM> in which the lines are merged. Although not shown in <FIG>, as another example, the electronic device <NUM> may output the text <NUM> or text <NUM> in which the lines are merged in a different color from other texts, or may output an indicator indicating that the lines are merged or maintained at a location adjacent to the text. The indicator may include, for example, a typesetting symbol such as a connecting line or an enter indication. In one embodiment, the electronic device <NUM> may return the merged or maintained lines to a previous state (that is, the same state as the handwriting input) in response to a user input of selecting the indicator. For example, contrary to an intention of the user, the electronic device <NUM> may merge a first line (e.g., 'Good morning ladies') and a second line (e.g., 'and gentlemen') and output the typesetting symbol such as the connecting line. In this case, when a user input of selecting the connecting line is received, the electronic device <NUM> may separate the first line and the second line from each other again.

<FIG> shows an operational flowchart of an electronic device for converting a handwriting input into text according to an embodiment of the disclosure.

Operations included in operational flowchart <NUM> to be described below may be implemented by the electronic device <NUM> or may be implemented by components of the electronic device <NUM>. For example, a processor (e.g., the processor <NUM> in <FIG>) of the electronic device <NUM> may perform the operations for converting the handwriting input into the text by executing instructions stored in a memory (e.g., the memory <NUM> in <FIG>).

Referring to <FIG>, in operation <NUM>, an electronic device <NUM> may acquire a handwriting input including a first handwriting input corresponding to the first line and a second handwriting input corresponding to the second line. The first line and the second line may be different lines. For example, the second line may mean a line below the first line.

In embodiments, the electronic device <NUM> may acquire the handwriting input through a touch circuit (e.g., a capacitive touch circuit or an electromagnetic induction-type touch circuit) included in a display (e.g., the display module <NUM> in <FIG> or the display <NUM> in <FIG>).

In embodiments, the electronic device <NUM> may identify attributes of the handwriting input including a color, a thickness, and a brush type and may identify characteristics of the handwriting input including a letter size, a line, an alignment, a slope, and stroke characteristics (e.g., a slope at an end of a stroke).

In embodiments, the electronic device <NUM> may convert the handwriting input into the text based on the identified attributes and characteristics of the handwriting input. For example, the electronic device <NUM> may maintain or merge the lines of the text corresponding to the first line and the second line included in the handwriting input.

In operation <NUM>, the electronic device <NUM> may determine whether to merge the second line into the first line or maintain the second line based on a specified condition. In one embodiment, the electronic device <NUM> may determine the merging or the maintenance of the line based on geometry information for the first handwriting input or the second handwriting input. The geometry information may include, for example, at least one of a size (e.g., a width or a height) of the recognized handwriting input, a width of a region occupied by the handwriting input on the input field, a start point of the handwriting input, an end point of the handwriting input, or a line spacing between the handwriting inputs. In another embodiment, the electronic device <NUM> may determine whether to merge or maintain the line based on a symbol or a number recognized in the first line or the second line. As another example, the electronic device <NUM> may determine whether to merge or maintain the line based on whether the acquired handwriting input represents a specified pattern. The specified pattern may indicate, for example, a phone number, a uniform resource locator (URL), or an e-mail address.

According to one embodiment, the electronic device <NUM> may consider the specified conditions independently, or may consider the specified conditions in combination. In this case, the electronic device <NUM> may set priorities for a plurality of specified conditions. The priorities may be determined, for example, based on a user setting or a frequency of use for the specified conditions.

In operation <NUM>, the electronic device <NUM> may convert the handwriting input to which the line merging or maintenance is applied to the text.

According to one embodiment, the electronic device <NUM> may perform the text conversion operation when receiving a user input for converting the handwriting input into the text. In operation <NUM>, the electronic device <NUM> may output the converted text through the display. In one embodiment, the electronic device <NUM> may display the converted text on the region that does not overlap with the acquired handwriting input or output the converted text as the pop-up window.

<FIG>, <FIG>, <FIG>, <FIG>, <FIG>, <FIG>, <FIG>, <FIG>, and <FIG> show embodiments for determining the merging or the maintenance of the line based on geometry information for the first handwriting input or the second handwriting input. The electronic device <NUM> may independently consider or combine the illustrated geometry information.

<FIG> illustrates an operation of converting a handwriting input into text based on a first condition according to an embodiment of the disclosure. According to the invention, the first condition is based on a width of a region occupied by the first handwriting input on the input field.

Referring to <FIG>, an electronic device <NUM> acquires a handwriting input through a display <NUM>. The acquired handwriting input is output on an input field <NUM> (or a screen of the display). The handwriting input includes a first handwriting input (e.g., 'Good morning ladies') corresponding to a first line <NUM> and a second handwriting input (e.g., 'and gentlemen') corresponding to a second line <NUM>.

In one embodiment, when a width <NUM> of a region occupied by the first handwriting input on the input field <NUM> is equal to or greater than a first threshold, the electronic device <NUM> may merge the second line <NUM> into the first line <NUM>. In this case, the electronic device <NUM> may output text <NUM> to which the merging of the second line <NUM> is applied.

According to the invention, the first threshold is determined based on a specified ratio of a width <NUM> of the input field <NUM>. For example, when the width <NUM> of the region occupied by the first handwriting input on the input field <NUM> is equal to or greater than about <NUM>/<NUM> of the width <NUM> of the input field <NUM>, the electronic device <NUM> may merge the second line <NUM> into the first line <NUM>. In another embodiment, the first threshold may be determined based on a specified ratio for at least one of a size of a display (e.g., the display <NUM> in <FIG>) or a font size of the handwriting input. In another embodiment, the first threshold may be adjusted by a user setting.

<FIG> illustrates an operational flowchart of an electronic device for converting a handwriting input into text based on a first condition according to an embodiment of the disclosure.

Referring to <FIG>, in operation <NUM> of operational flowchart <NUM>, an electronic device <NUM> may determine whether a width <NUM> of the region occupied by the first handwriting input on an input field <NUM> is equal to or greater than the first threshold.

When the width of the region occupied by the first handwriting input on the input field is equal to or greater than the first threshold, in operation <NUM>, the electronic device <NUM> may determine to merge the second line <NUM> into the first line <NUM>.

When the width <NUM> of the region occupied by the first handwriting input on the input field <NUM> is less than the first threshold, in operation <NUM>, the electronic device <NUM> may determine to maintain the second line <NUM> without merging. In this case, the text converted from the handwriting input may include a plurality of lines.

<FIG> illustrates an operation of converting a handwriting input into text based on a second condition according to an embodiment of the disclosure. In the disclosure, the second condition may be based on a location of an end point of a first handwriting input.

Referring to <FIG>, a handwriting input that is input on an input field <NUM> may include a first handwriting input corresponding to a first line <NUM> and a second handwriting input corresponding to a second line <NUM>.

In one embodiment, when a distance <NUM> between an end point <NUM> of the first handwriting input and an end point of the input field is equal to or less than a second threshold, the electronic device <NUM> may merge the second line <NUM> into the first line <NUM>. The electronic device <NUM> may output text <NUM> to which the merging of the second line <NUM> is applied. For convenience of description, <FIG> shows an example in which the end point <NUM> of the first handwriting input is displayed on the input field <NUM>, but the end point <NUM> of the first handwriting input may not be output through the display.

In one embodiment, the second threshold may be determined based on a specified ratio of a width <NUM> of the input field <NUM>. For example, when the distance <NUM> between the end point <NUM> of the first handwriting input and an end point of the input field is less than about <NUM>/<NUM> of the width <NUM> of the input field <NUM>, the electronic device <NUM> may merge the second line <NUM> into the first line <NUM>. In another embodiment, the second threshold may be determined based on a specified ratio for at least one of a size of a display (e.g., the display <NUM> in <FIG>) or a font size of the handwriting input. In another embodiment, the second threshold may be adjusted by a user setting.

In another embodiment, when the end point <NUM> of the first handwriting input is located within a first region <NUM>, the electronic device <NUM> may merge the second line <NUM> into the first line <NUM>. The first region <NUM> may mean, for example, a region formed at one side (e.g., a right end) of the input field <NUM>. A width <NUM> of the first region <NUM> may be determined based on a predetermined ratio (e.g., about <NUM>/<NUM> or about <NUM>/<NUM>) of the width <NUM> of the input field <NUM>.

<FIG> illustrates an operational flowchart of an electronic device for converting a handwriting input into text based on a first condition and a second condition according to an embodiment of the disclosure.

Referring to <FIG>, in operation <NUM> of operational flowchart <NUM>, an electronic device <NUM> may determine whether the width (e.g., a width <NUM> in <FIG>) of the region occupied by the first handwriting input in an input field <NUM> is equal to or greater than the first threshold. The first threshold may be determined based on the specified ratio of the width of the input field <NUM>.

When the width of the region occupied by the first handwriting input in the input field <NUM> is equal to or greater than the first threshold, the electronic device may perform operation <NUM>. When the width of the region occupied by the first handwriting input in the input field <NUM> is less than the first threshold, in operation <NUM>, the electronic device <NUM> may determine to maintain the second line <NUM> without merging.

In one embodiment, the electronic device <NUM> may directly perform operation <NUM> without performing operation <NUM>.

In operation <NUM>, the electronic device <NUM> may determine whether the distance <NUM> between the end point <NUM> of the first handwriting input and the end point of the input field is less than the second threshold. In another embodiment, the electronic device <NUM> may determine whether the end point <NUM> of the first handwriting input is located within the first region <NUM> formed at one side of the input field <NUM>.

When the distance <NUM> between the end point <NUM> of the first handwriting input and the end point of the input field is less than the second threshold or when the end point <NUM> of the first handwriting input is located within the first region <NUM>, in operation <NUM>, the electronic device <NUM> may determine to merge the second line <NUM> into the first line <NUM>.

When the distance <NUM> between the end point <NUM> of the first handwriting input and the end point of the input field exceeds the second threshold or when the end point <NUM> of the first handwriting input is not located within the first region <NUM>, in operation <NUM>, the electronic device <NUM> may determine to maintain the second line <NUM>.

<FIG> illustrates an operation of converting a handwriting input into text based on a third condition according to an embodiment of the disclosure. In the disclosure, the third condition may be based on a location of a start point of the second handwriting input.

In one embodiment, when a distance <NUM> between a start point <NUM> of the second handwriting input and a start point of the input field exceeds a third threshold, the electronic device <NUM> may maintain the second line <NUM>. In this case, the electronic device <NUM> may output text <NUM> in which the first line <NUM> and the second line <NUM> are separated from each other. Conversely, when the distance <NUM> between the start point <NUM> of the second handwriting input and the start point of the input field is less than the third threshold, the electronic device <NUM> may merge the second line <NUM> into the first line <NUM>. For convenience of description, <FIG> shows an example in which the start point <NUM> of the second handwriting input is displayed on the input field <NUM>, but the start point <NUM> of the second handwriting input may not be output through the display.

The third threshold may be determined based on a specified ratio of a width <NUM> of the input field <NUM>. For example, when the distance <NUM> between the start point <NUM> of the second handwriting input and the start point of the input field exceeds <NUM>/<NUM> of the width <NUM> of the input field <NUM>, the electronic device <NUM> may maintain the second line <NUM>.

As another example, the third threshold may be determined based on a specified ratio of a size of a display (e.g., the display <NUM> in <FIG>). As another example, the third threshold may be adjusted by a user setting.

As another example, the third threshold may be determined based on a size of a letter indicated by the acquired handwriting input. In the disclosure, the size of the letter may mean at least one of a height, a width, and/or an area (e.g., height x width) of the letter. For example, the electronic device <NUM> may determine a height <NUM>, a width <NUM>, or an area of one letter (e.g., 'G') included in the acquired handwriting input, and determine a specified multiple (e.g., <NUM> times) of the determined value as the third threshold. As another example, the electronic device <NUM> may calculate an intermediate value for sizes of a plurality of letters included in the acquired handwriting input, and determine a specified multiple (e.g., <NUM> times) of the calculated intermediate value as the third threshold. Depending on a handwriting scheme of the user, the sizes of the letters included in the handwriting input may be irregular, so that the electronic device <NUM> may more clearly reflect an intention of the user using the intermediate value instead of using an average value for the sizes of the plurality of letters.

In one embodiment, without being limited thereto, the electronic device <NUM> may determine the third threshold using at least one of a variance or a standard deviation value for a normalized distribution of the sizes of the plurality of letters included in the acquired handwriting input.

In another embodiment, the electronic device <NUM> may maintain the second line <NUM> when the start point <NUM> of the second handwriting input deviates from a second region <NUM>. The second region <NUM> may mean, for example, a region formed at a side (e.g., a left end) of the input field <NUM> opposite to a first region (e.g., the first region <NUM> in <FIG>). A width <NUM> of the second region <NUM> may be determined based on a specified ratio (e.g., about <NUM>/<NUM> or about <NUM>/<NUM>) of the width <NUM> of the input field <NUM>.

<FIG> illustrates an operational flowchart of an electronic device for converting a handwriting input into text based on a first condition and a third condition according to an embodiment of the disclosure.

Referring to <FIG>, in operation <NUM> of operational flowchart <NUM>, an electronic device <NUM> may determine whether a width (e.g., a width <NUM> in <FIG>) of a region occupied by the first handwriting input in an input field <NUM> is equal to or greater than the first threshold. The first threshold may be determined based on a specified ratio for a width of the input field <NUM>.

When the width of the region occupied by the first handwriting input in the input field <NUM> is equal to or greater than the first threshold, the electronic device may perform operation <NUM>. When the width of the region occupied by the first handwriting input in the input field <NUM> is less than the first threshold, in operation <NUM>, the electronic device <NUM> may determine to maintain the second line <NUM>.

In operation <NUM>, the electronic device <NUM> may determine whether the distance <NUM> between the start point <NUM> of the second handwriting input and the start point of the input field is less than the third threshold. In another embodiment, the electronic device <NUM> may determine whether the start point <NUM> of the second handwriting input is located within the second region <NUM>.

When the distance <NUM> between the start point <NUM> of the second handwriting input and the start point of the input field is less than the third threshold or when the start point <NUM> of the second handwriting input is located within the second region <NUM>, in operation <NUM>, the electronic device <NUM> may determine to merge the second line <NUM> into the first line <NUM>.

When the distance <NUM> between the start point <NUM> of the second handwriting input and the start point of the input field exceeds the third threshold or when the start point <NUM> of the second handwriting input is not located within the second region <NUM>, in operation <NUM>, the electronic device <NUM> may determine to maintain the second line <NUM>.

<FIG> shows a screen region used to merge or maintain a line of a handwriting input according to an embodiment of the disclosure.

Referring to <FIG>, a first region <NUM> (e.g., a first region <NUM> in <FIG>) may mean a location adjacent to an end point of a line in a region (e.g., an input field <NUM>) where the handwriting input may be acquired. For example, the first region <NUM> may be located in a right region of the input field <NUM>. A second region <NUM> (e.g., the second region <NUM> in <FIG>) may mean a location adjacent to a start point of the line in the region where the handwriting input may be acquired. For example, the second region <NUM> may be located in a left region of the input field <NUM>.

A width <NUM> of the first region <NUM> or a width <NUM> of the second region <NUM> may be determined based on a specified ratio of a width <NUM> of the input field <NUM>. For example, the width <NUM> of the first region <NUM> may be about <NUM>/<NUM> of the width <NUM> of the input field <NUM>, and the width <NUM> of the second region <NUM> may be <NUM>/<NUM> of the width <NUM> of the input field <NUM>.

In another embodiment, the width <NUM> of the first region <NUM> or the width <NUM> of the second region <NUM> may be determined based on a specified ratio for at least one of a size of the display <NUM> or a font size of the handwriting input.

In one embodiment, the electronic device <NUM> may use at least one of the first region <NUM> or the second region <NUM> to determine the merging or the maintenance of the line without outputting at least one of the first region <NUM> or the second region <NUM> on the display <NUM>. In another embodiment, the electronic device <NUM> may display at least one of the first region <NUM> or the second region <NUM> such that the user of the electronic device <NUM> may know a criteria by which line merging or the maintenance of the line is determined. For example, the electronic device <NUM> may output the first region <NUM> or the second region <NUM> in the region of the input field <NUM> on the display <NUM> while distinguishing (e.g., shading) the first region <NUM> or the second region <NUM>. In this case, the electronic device <NUM> change the width <NUM> of the first region <NUM> or the width <NUM> of the second region <NUM> by acquiring an input (e.g., a swipe input) of the user of moving the output first region <NUM> or second region <NUM> in a specified direction (e.g., direction <NUM> or direction <NUM>).

<FIG> illustrates an operation of converting a handwriting input into text based on a first condition and a fourth condition according to an embodiment of the disclosure. In the disclosure, the fourth condition may be based on locations of a start point of a first handwriting input and a start point of a second handwriting input.

In one embodiment, when a distance <NUM> between a start point <NUM> of the first handwriting input and a start point <NUM> of the second handwriting input is less than a fourth threshold, the electronic device <NUM> may merge the second line <NUM> into the first line <NUM>. In this case, the electronic device <NUM> may output text <NUM> in which the second line <NUM> is merged. For convenience of description, <FIG> shows an example in which the start point <NUM> of the first handwriting input and the start point <NUM> of the second handwriting input are displayed on the input field <NUM>, but the start point <NUM> of the first handwriting input and the start point <NUM> of the second handwriting input may not be output through the display.

The fourth threshold may be determined based on a specified ratio of a width <NUM> of the input field <NUM>. For example, when the distance <NUM> between the start point <NUM> of the first handwriting input and the start point <NUM> of the second handwriting input is less than about <NUM>/<NUM> of the width <NUM> of the input field <NUM>, the electronic device <NUM> may merge the second line <NUM>.

As another example, the fourth threshold may be determined based on a specified ratio of a size of a display (e.g., the display <NUM> in <FIG>). As another example, the fourth threshold may be adjusted by a user setting.

As another example, the fourth threshold may be determined based on a size of a letter included in the acquired handwriting input. For example, the electronic device <NUM> may determine at least one of a height <NUM>, a width <NUM>, or an area of one letter (e.g., 'm') included in the acquired handwriting input, and determine a specified multiple (e.g., <NUM> times) of the determined value as the fourth threshold. As another example, the electronic device <NUM> may calculate an intermediate value for sizes of a plurality of letters included in the acquired handwriting input, and determine a specified multiple (e.g., <NUM> times) of the calculated intermediate value as the fourth threshold.

<FIG> illustrates an operational flowchart of an electronic device for converting a handwriting input into text based on a first condition and a fourth condition according to an embodiment of the disclosure.

Referring to <FIG>, in operation <NUM> of operational flowchart <NUM>, an electronic device <NUM> may determine whether a width (e.g., a width <NUM> in <FIG>) of a region occupied by a first handwriting input in an input field <NUM> is equal to or greater than a first threshold. The first threshold may be determined based on a specified ratio of a width of the input field <NUM>.

In operation <NUM>, the electronic device <NUM> may determine whether the distance <NUM> between the start point <NUM> of the first handwriting input and the start point <NUM> of the second handwriting input is less than the fourth threshold.

When the distance <NUM> between the start point <NUM> of the first handwriting input and the start point <NUM> of the second handwriting input is less than the fourth threshold, in operation <NUM>, the electronic device <NUM> may determine to merge the second line <NUM> into the first line <NUM>.

When the distance <NUM> between the start point <NUM> of the first handwriting input and the start point <NUM> of the second handwriting input exceeds the fourth threshold, in operation <NUM>, the electronic device <NUM> may determine to maintain the second line <NUM>.

<FIG> illustrates an operation of converting a handwriting input into text based on a fifth condition according to an embodiment of the disclosure. In the disclosure, the fifth condition may be based on a line spacing between a plurality of handwriting inputs.

Referring to <FIG>, a handwriting input that is input on an input field <NUM> may include a first handwriting input corresponding to a first line <NUM>, a second handwriting input corresponding to a second line <NUM>, and a third handwriting input corresponding to a third line <NUM>.

In one embodiment, when a line spacing <NUM> between the first handwriting input and the second handwriting input exceeds a fifth threshold, the electronic device <NUM> may maintain the second line <NUM> without merging the second line <NUM> into the first line <NUM>. When a line spacing <NUM> between the second handwriting input and the third handwriting input is less than the fifth threshold, the electronic device <NUM> may merge the third line <NUM> into the second line <NUM>. In this case, the electronic device <NUM> may output text <NUM> in which the second line <NUM> and the first line <NUM> are separated from each other, and the third line <NUM> is merged into the second line <NUM>.

The fifth threshold may be determined based on a specified ratio of a height <NUM> of the input field <NUM>. For example, the electronic device <NUM> may determine about <NUM>/<NUM> of the height <NUM> of the input field <NUM> as the fifth threshold.

As another example, the fifth threshold may be determined based on a specified ratio of a size of a display (e.g., the display <NUM> in <FIG>). As another example, the fifth threshold may be adjusted by a user setting. As another example, the fifth threshold may be determined based on a size of a letter included in the acquired handwriting input. For example, the electronic device <NUM> may determine at least one of a height <NUM>, a width <NUM>, or an area of one letter (e.g., 'o') included in the acquired handwriting input, and determine a specified multiple (e.g., <NUM> times) of the determined value as the fifth threshold. As another example, the electronic device <NUM> may calculate an intermediate value for sizes of a plurality of letters included in the acquired handwriting input, and determine a specified multiple (e.g., <NUM> times) of the calculated intermediate value as the fifth threshold.

<FIG> illustrates an operational flowchart of an electronic device for converting a handwriting input into text based on a fifth condition according to an embodiment of the disclosure.

Referring to <FIG>, in operation <NUM> of operational flowchart <NUM>, an electronic device <NUM> may determine whether a line spacing <NUM> between the first handwriting input and the second handwriting input is less than the fifth threshold.

When the line spacing <NUM> between the first handwriting input and the second handwriting input is less than the fifth threshold, in operation <NUM>, the electronic device <NUM> may determine to merge the second line <NUM> into the first line <NUM>.

When the line spacing <NUM> between the first handwriting input and the second handwriting input exceeds the fifth threshold, in operation <NUM>, the electronic device <NUM> may determine to maintain the second line <NUM>.

<FIG> illustrate operations of converting a handwriting input into text based on a sixth condition according to various embodiments of the disclosure. In various embodiments disclosed in the disclosure, the sixth condition may be based on a symbol included in the handwriting input.

According to embodiments, the electronic device <NUM> may determine the merging or the maintenance of the line based on the symbols included in the acquired handwriting input. The symbols and determination conditions used to determine the merging or the maintenance of the lines may be exemplified in Table <NUM> below.

Table <NUM> illustrates only a case in which the bullet point is the first letter of the line. However, according to another embodiment, when lines in which the first letter is the bullet point are continuous, the lines containing the bullet points may be separated from each other. For example, some (e.g.,'-') of the bullet points may be used for other purposes (e.g., for connecting a word with a word), so that the electronic device <NUM> may accurately reflect an intention of the user compared to the case in which the bullet point is written as the first letter in only one line by separating the lines only when the lines in which the first letter is the bullet point are continuous.

For example, referring to <FIG>, a handwriting input that is input on an input field <NUM> may include a first handwriting input (e.g., 'Must Buy Item') corresponding to a first line <NUM>, a second handwriting input (e.g., '-banana') corresponding to a second line <NUM>, a third handwriting input (e.g., '-chocolate, nuts,') corresponding to a third line <NUM>, and a fourth handwriting input (e.g., 'cheese, bread') corresponding to a fourth line <NUM>. Because a symbol <NUM> indicating the bullet point is included in the second line <NUM> and the third line <NUM>, the electronic device <NUM> may maintain the first line <NUM>, the second line <NUM>, and the third line <NUM> without merging them. In addition, because a symbol <NUM> indicating the connective is included in the fourth line <NUM> and a symbol <NUM> indicating the connective is included in the third line <NUM>, the electronic device <NUM> may merge the fourth line <NUM> into the third line <NUM>. The electronic device <NUM> may output text <NUM> corresponding to a handwriting input in which the merging or the maintenance of the line is determined.

Referring to <FIG>, as another example, a handwriting input that is input on the input field <NUM> may include a first handwriting input (e.g., 'Good morning!') corresponding to a first line <NUM>, a second handwriting input (e.g., '[ladies and') corresponding to a second line <NUM>, and a third handwriting input (e.g., 'gentlemen]') corresponding to a third line <NUM>. Because the last letter of the first line <NUM> contains a symbol <NUM> indicating the terminating symbol, the electronic device <NUM> may maintain the second line <NUM> without merging the second line <NUM> into the first line <NUM>. In addition, because a symbol <NUM> indicating the match terminating symbol is included in the third line <NUM> and a symbol <NUM> indicating the match start symbol is included in the second line <NUM>, the electronic device <NUM> may merge the third line <NUM> into the second line <NUM>. The electronic device <NUM> may output text <NUM> corresponding to a handwriting input in which the merging or the maintenance of the line is determined.

According to another embodiment, the electronic device <NUM> may determine to merge or maintain the line based on a symbol set by the user. For example, referring to <FIG>, a handwriting input that is input on the input field <NUM> may include a first handwriting input (e.g., 'Good morning ladies') corresponding to a first line <NUM> and a second handwriting input (e.g., 'and gentlemen') corresponding to a second line <NUM>. When a symbol <NUM> set by the user is included at a location adjacent to an end point of the first line <NUM>, the electronic device <NUM> may merge the second line <NUM> into the first line <NUM>. The electronic device <NUM> may output text <NUM> corresponding to a handwriting input in which the merging or the maintenance of the line is determined.

In this case, the electronic device <NUM> may control the symbol <NUM> set by the user not to be included in the converted text <NUM>.

<FIG> illustrates an operation of converting a handwriting input into text based on a seventh condition according to an embodiment of the disclosure. In the disclosure, the seventh condition may be based on a specified pattern included in a handwriting input. The specified pattern may include, for example, a phone number, a URL, or an e-mail address.

Referring to <FIG>, a handwriting input that is input on an input field <NUM> may include a first handwriting input (e.g., 'Contact') corresponding to a first line <NUM>, a second handwriting input (e.g., '<NUM>. <NUM>-<NUM>') corresponding to a second line <NUM>, a third handwriting input (e.g., '-<NUM>') corresponding to a third line <NUM>, a fourth handwriting input (e.g., '<NUM>. ') corresponding to a fourth line <NUM>, a fifth handwriting input (e.g., 'com') corresponding to a fifth line <NUM>, a sixth handwriting input (e.g., 'https://www. ') corresponding to a sixth line <NUM>, and a seventh handwriting input (e.g., 'website. com') corresponding to a seventh line <NUM>. The electronic device <NUM> according to the embodiments may determine the merging or the maintenance of the line based on whether the handwriting inputs represent the specified pattern.

For example, because symbols <NUM> indicating the number list are included in the second line <NUM>, the fourth line <NUM>, and the sixth line <NUM>, the electronic device <NUM> may maintain the first line <NUM>, the second line <NUM>, the fourth line <NUM>, and the sixth line <NUM> without merging them. When a pattern of letters indicated by the second handwriting input and the third handwriting input is the same as a pattern of the phone number, the electronic device <NUM> may merge the third line <NUM> into the second line <NUM>. When a pattern of letters indicated by the fourth handwriting input and the fifth handwriting input is the same as a pattern of the e-mail address, the electronic device <NUM> may merge the fifth line <NUM> into the fourth line <NUM>. When a pattern of letters indicated by the sixth handwriting input and the seventh handwriting input is the same as a pattern of the URL, the electronic device <NUM> may merge the seventh line <NUM> into the sixth line <NUM>. The electronic device <NUM> may output text <NUM> corresponding to a handwriting input in which the merging or the maintenance of the line is applied.

As described above, an electronic device (e.g., <NUM> in <FIG>) according to an embodiment includes a display (e.g., at least a portion of the display module <NUM> in <FIG>) including a sensing panel that senses a handwriting input, at least one processor (e.g., the processor <NUM> in <FIG>) operatively connected to the display, and memory (e.g., the memory <NUM> in <FIG>) storing instructions which, when executed by the at least one processor, cause the electronic device to acquire the handwriting input (e.g., the handwriting input <NUM> in <FIG>) through the display, wherein the handwriting input includes a first handwriting input corresponding to a first line and a second handwriting input corresponding to a second line, determine whether to merge the second line into the first line or to maintain the second line based on whether at least one of the first handwriting input or the second handwriting input satisfies a specified condition, convert the handwriting input where the merging or the maintenance of the second line is applied into text (e.g., the first text <NUM> or the second text <NUM> in <FIG>), and display the converted handwriting input as text through the display.

According to an embodiment, the instructions may cause the electronic device to shade text corresponding to the second handwriting input, output the text corresponding to the second handwriting input in a color different from a color of text corresponding to the first handwriting input, or output an indicator indicating that the second line is merged through the display when the second line is merged into the first line.

According to an embodiment, the instructions may cause the electronic device to determine to merge the second line into the first line when a width (e.g., the width <NUM> in <FIG>) of a region occupied by the first handwriting input in an input field (e.g., the input field <NUM> in <FIG>) is equal to or greater than a first threshold, and determine to maintain the second line when the width of the region occupied by the first handwriting input in the input field is less than the first threshold.

According to an embodiment, the instructions may cause the electronic device to, when the width of the region occupied by the first handwriting input in the input field is equal to or greater than the first threshold, determine to merge the second line into the first line when a distance (e.g., the distance <NUM> in <FIG>) between an end point of the first handwriting input and an end point of the input field is less than a second threshold or when the end point of the first handwriting input is located within a first region (e.g., the first region <NUM> in <FIG>) adjacent to the end point of the input field, and determine to maintain the second line when the distance between the end point of the first handwriting input and the end point of the input field exceeds the second threshold or when the end point of the first handwriting input is not located within the first region.

According to an embodiment, the instructions may cause the electronic device to, when the width of the region occupied by the first handwriting input in the input field is equal to or greater than the first threshold, determine to merge the second line into the first line when a distance (e.g., the distance <NUM> in <FIG>) between a start point of the second handwriting input and a start point of the input field is less than a second threshold or when the start point of the second handwriting input is located within a second region (e.g., the second region <NUM> in <FIG>) adjacent to the start point of the input field, and determine to maintain the second line when the distance between the start point of the second handwriting input and the start point of the input field exceeds the second threshold or when the start point of the second handwriting input is located within the second region.

According to an embodiment, the instructions may cause the electronic device to determine a width of the first region or the second region based on a specified ratio of a width of the input field or based on a user input of moving the first region or the second region in a specified direction.

According to an embodiment, the instructions may cause the electronic device to, when the width of the region occupied by the first handwriting input in the input field is equal to or greater than the first threshold, determine to merge the second line into the first line when a distance (e.g., the distance <NUM> in <FIG>) between a start point of the first handwriting input and a start point of the second handwriting input is less than a fourth threshold, and determine to maintain the second line when the distance between the start point of the first handwriting input and the start point of the second handwriting input exceeds the fourth threshold.

According to an embodiment, the instructions may cause the electronic device to determine to merge the second line into the first line when a line spacing (e.g., the line spacing <NUM> or the line spacing <NUM> in <FIG>) between the first handwriting input and the second handwriting input is less than a fifth threshold, and determine to maintain the second line when the line spacing between the first handwriting input and the second handwriting input exceeds the fifth threshold.

According to an embodiment, the instructions may cause the electronic device to determine whether to merge the second line into the first line or to maintain the second line based on whether a symbol indicating at least one of a terminating symbol, a bullet point, a number list, a match symbol, or a connective is included in at least one of the first handwriting input or the second handwriting input.

According to an embodiment, the instructions may cause the electronic device to determine to merge the second line into the first line when the first handwriting input and the second handwriting input represent a specified pattern.

As described above, a method of an electronic device (e.g., the electronic device <NUM> in <FIG>) includes acquiring a handwriting input including a first handwriting input corresponding to a first line and a second handwriting input corresponding to a second line, determining whether to merge the second line into the first line or to maintain the second line based on whether at least one of the first handwriting input or the second handwriting input satisfies a specified condition, converting the handwriting input where the merging or the maintenance of the second line is applied into text (e.g., the first text <NUM> or the second text <NUM> in <FIG>), and outputting the converted handwriting input as text.

According to an embodiment, the method may further include shading text corresponding to the second handwriting input, outputting the text corresponding to the second handwriting input in a color different from a color of text corresponding to the first handwriting input, or outputting an indicator indicating that the second line is merged when the second line is merged into the first line.

According to an embodiment, the determining of whether to merge the second line into the first line or to maintain the second line may include determining to merge the second line into the first line when a width (e.g., the width <NUM> in <FIG>) of a region occupied by the first handwriting input in an input field (e.g., the input field <NUM> in <FIG>) is equal to or greater than a first threshold, and determining to maintain the second line when the width of the region occupied by the first handwriting input in the input field is less than the first threshold.

According to an embodiment, the determining of whether to merge the second line into the first line or to maintain the second line may include, when the width of the region occupied by the first handwriting input in the input field is equal to or greater than the first threshold, determining to merge the second line into the first line when a distance (e.g., the distance <NUM> in <FIG>) between an end point of the first handwriting input and an end point of the input field is less than a second threshold or when the end point of the first handwriting input is located within a first region (e.g., the first region <NUM> in <FIG>) adjacent to the end point of the input field, and determining to maintain the second line when the distance between the end point of the first handwriting input and the end point of the input field exceeds the second threshold or when the end point of the first handwriting input is not located within the first region.

According to an embodiment, the determining of whether to merge the second line into the first line or to maintain the second line may include, when the width of the region occupied by the first handwriting input in the input field is equal to or greater than the first threshold, determining to merge the second line into the first line when a distance (e.g., the distance <NUM> in <FIG>) between a start point of the second handwriting input and a start point of the input field is less than a second threshold or when the start point of the second handwriting input is located within a second region (e.g., the second region <NUM> in <FIG>) adjacent to the start point of the input field, and determining to maintain the second line when the distance between the start point of the second handwriting input and the start point of the input field exceeds the second threshold or when the start point of the second handwriting input is not located within the second region.

According to an embodiment, the method may further include determining a width of the first region or the second region based on a specified ratio of a width of the input field or based on a user input of moving the first region or the second region in a specified direction.

According to an embodiment, the determining of whether to merge the second line into the first line or to maintain the second line may include, when the width of the region occupied by the first handwriting input in the input field is equal to or greater than the first threshold, determining to merge the second line into the first line when a distance (e.g., the distance <NUM> in <FIG>) between a start point of the first handwriting input and a start point of the second handwriting input is less than a fourth threshold, and determining to maintain the second line when the distance between the start point of the first handwriting input and the start point of the second handwriting input exceeds the fourth threshold.

According to an embodiment, the determining of whether to merge the second line into the first line or to maintain the second line may include determining to merge the second line into the first line when a line spacing (e.g., the line spacing <NUM> or the line spacing <NUM> in <FIG>) between the first handwriting input and the second handwriting input is less than a fifth threshold, and determining to maintain the second line when the line spacing between the first handwriting input and the second handwriting input exceeds the fifth threshold.

According to an embodiment, the determining of whether to merge the second line into the first line or to maintain the second line may include determining whether to merge the second line into the first line or to maintain the second line based on whether a symbol indicating at least one of a terminating symbol, a bullet point, a number list, a match symbol, or a connective is included in at least one of the first handwriting input or the second handwriting input.

According to an embodiment, the determining of whether to merge the second line into the first line or to maintain the second line may include determining to merge the second line into the first line when the first handwriting input and the second handwriting input represent a specified pattern.

For example, a processor (e.g., the processor <NUM> in <FIG>) of the machine (e.g., the electronic device <NUM>) may invoke at least one of the one or more instructions stored in the storage medium, and execute it, with or without using one or more other components under the control of the processor.

Claim 1:
An electronic device (<NUM>) comprising:
a display (<NUM>, <NUM>) comprising a sensing panel configured to sense a handwriting input;
at least one processor (<NUM>) operatively connected to the display; and
memory storing instructions which, when executed by the at least one processor (<NUM>), cause the electronic device (<NUM>) to:
acquire the handwriting input sensed by the sensing panel and displayed on the display (<NUM>, <NUM>), the handwriting input comprising a first handwriting input corresponding to a first line and a second handwriting input corresponding to a second line,
based on whether at least one of the first handwriting input or the second handwriting input satisfies at least one specified condition, determine to merge the second line into the first line or maintain the second line,
based on a result of the determining convert the handwriting input into text by merging the second line into the first line or maintaining the second line, and
control the display (<NUM>, <NUM>) to display the converted handwriting input,
characterised in that the specified condition includes a condition of a width of a region occupied by the first handwriting input in an input field being equal to or greater than a specified ratio of a width of the input field.