Patent Description:
In general, a display apparatus such as a television (TV) displays an image based on resolution information of the image. For example, if the resolution of an image is <NUM> × <NUM>, a display apparatus displays the image of which width is longer than the height.

However, an actual image may not be an image of a horizontal type, i.e., in which the aspect ratio consists of a greater width than height. For example, a case wherein a user rotates an image photographed in a resolution of <NUM> × <NUM>, so as to have a resolution of <NUM> × <NUM>, and stores (or uploads to a server, etc.) the rotated image falls under this case.

In this case, as illustrated in <FIG>, a display apparatus displays an image of a vertical type (i.e., of which height is greater than width) as a horizontal image.

As a result, a user's viewing of the image is interfered with, such that there is a need to display an image of a vertical type as a vertical image of which height is greater than the width. Likewise, there is a need to display an image of a horizontal type as a horizontal image of which width is greater than the height.

<CIT> discloses an image display apparatus to display a horizontal image and a vertical image by changing the arrangement direction of a display unit. <CIT> discloses a display system, method and computer program for controlling a display. <CIT> discloses an image display device including a pivot and operating method. <CIT> discloses a display apparatus with a rotator. <CIT> discloses an image processor determining an orientation of an image based on text, people and objects extracted from the image.

Provided are a display apparatus which, in case resolution information of an image and the actual type of the image do not correspond to each other, rotates a display to correspond to the actual type of the image, and a control method thereof.

The invention is defined according to the independent claims. Further features of the invention will be appreciated from the dependent claims. Any embodiment which does not fall within the scope of the claims is to be interpreted as an example useful for a full and complete understanding of the present techniques.

First, terms in this specification and the claims are used in consideration of the functions, operations, and structures described in the disclosure. However, the terms may vary depending on an intention of those skilled in the art, legal or technical interpretation, or emergence of new technologies. Also, some terms may be designated or defined by the applicant on his own, and in such cases, the meaning of the terms may be interpreted based on a definition or context provided in this specification. Meanwhile, if there is no specific definition of the terms, the meaning of the terms may be interpreted based on the overall content of this specification and technical knowledge common in the pertinent technical field.

It is understood that, hereinafter, expressions such as "at least one of," when preceding a list of elements (e.g., "at least one of A and B" or "at least one of A or B"), modify the entire list of elements (i.e., only A, only B, or both A and B) and do not modify the individual elements of the list.

Also, in case it is determined that in describing embodiments, detailed explanation of related known functions or configurations may unnecessarily confuse the gist of the disclosure, the detailed explanation will be abridged or omitted.

Further, while one or more embodiments will be described in detail below with reference to the following accompanying drawings and the content described in the accompanying drawings, it is not intended that the disclosure is restricted or limited by these embodiments.

Hereinafter, a display arranged in a vertical direction (whereby a height of the display is greater than the width of the display) may be referred to as a display in a portrait posture, a display in a vertical direction posture, or a display in a vertical mode. Further, and a display in a horizontal direction (whereby a width of the display is greater than a height of the display) may be referred to as a display in a landscape posture, a display in a horizontal direction posture, or a display in a horizontal mode.

Hereinafter, one or more embodiments will be described in detail with reference to the accompanying drawings.

<FIG> is a block diagram for illustrating a display apparatus <NUM> according to an embodiment.

The display apparatus <NUM> according to an embodiment may be a smart TV. However, this is merely an example, and the display apparatus <NUM> may be various electronic apparatuses equipped with a display such as a computer, a laptop computer, a tablet, a digital camera, a camcorder, a personal digital assistant (PDA), a mobile display device, a smartphone, etc..

Referring to <FIG>, the display apparatus <NUM> according to an embodiment includes a display <NUM>, a driver <NUM>, and at least one processor <NUM>.

The display <NUM> may display various screens. As an example, the display <NUM> may not only display a pre-stored image, but also display an image received from an external apparatus. Here, an external apparatus may be various electronic apparatuses that can transmit an image to the display apparatus <NUM> such as a server, a computer, a laptop computer, a smartphone, etc..

Meanwhile, an image may include at least one of a still image or a moving image, and the display <NUM> may display various images such as a broadcasting content, a multimedia content, etc. Also, the display <NUM> may display various kinds of user interfaces (Uls) and icons.

The display <NUM> may be rotated. Specifically, the display <NUM> may be arranged in one of a horizontal type or a vertical type, according to a control signal for rotation. For this, the display apparatus further includes a driver <NUM> for rotating the display <NUM>.

The display <NUM> as described above may be implemented as displays in various forms such as a liquid crystal display (LCD) panel, a light emitting diode (LED) display or backlit display, an organic light emitting diodes (OLED) display, a liquid crystal on silicon (LCoS) display, a digital light processing (DLP) display, etc. Also, inside the display <NUM>, driving circuits that may be implemented in forms such as an a-Si thin-film-transistor (TFT), a low temperature poly silicon (LTPS) TFT, an organic TFT (OTFT), etc., a backlight unit, etc., may also be included.

In addition, the display <NUM> may be combined with a touch detector, and implemented as a touch screen.

The driver <NUM> may rotate the display <NUM>. Specifically, according to a control signal for rotation, the driver <NUM> may rotate the display <NUM> so as to be one of a horizontal type (in which width is greater than height) or a vertical type (in which height is greater than width). Here, the direction of rotation may not only be a clockwise direction, but also a counterclockwise direction. For this, the driver <NUM> may include a motor.

The processor <NUM> controls the overall operations of the display apparatus <NUM>. For this, the processor <NUM> may include one or more of a central processing unit (CPU), an application processor (AP), and a communication processor (CP).

The processor <NUM> may operate (e.g., execute) an operating system and/or an application program, control the hardware or software components connected to the processor <NUM>, and perform various types of data processing and operations. Also, the processor <NUM> may load an instruction or data received from at least one of other components on a volatile memory and process the received instruction or data, and store various data in a non-volatile memory.

The processor <NUM> may control the display <NUM> to display an image. Here, an image may be at least one of a still image or a moving image that is pre-stored, captured, or received from an external apparatus.

For example, if a user instruction for displaying a pre-stored still image or a pre-stored moving image is received, the processor <NUM> may control the display <NUM> to display the image. To this end, the display apparatus <NUM> may further include a storage for storing images.

Also, if a user instruction for reproducing a specific moving image is received through a moving image application, the processor <NUM> may transmit a signal requesting transmission of the moving image to an external apparatus (e.g., a server). Then, when a moving image is received from the external apparatus, the processor <NUM> may control the display <NUM> to display the received moving image. For this, the display apparatus <NUM> may further include a communicator for communicating with an external apparatus.

While an image is displayed on the display <NUM>, the processor <NUM> may identify an object included in the image. Here, an object may be at least one of a text, a thing, or a person included in the image displayed on the display <NUM>.

Specifically, while an image is displayed on the display <NUM>, the processor <NUM> may identify at least one of a text (e.g., a word, a character, or a number, etc.), a thing, or a person included in the image through an image recognition algorithm.

Here, an image recognition algorithm may be at least one of a character recognition algorithm, an object recognition algorithm, or a face recognition algorithm. For example, the processor <NUM> may detect a contour line of an object included in an image through a character recognition algorithm, and identify a text included in the image therefrom. Also, the processor <NUM> may detect a contour line of an object included in an image through an object recognition algorithm, and identify a text included in the image therefrom. In addition, by detecting at least one of skin tone or color, eyes, a nose, or a mouth included in the image through a facial recognition algorithm, the processor <NUM> may identify a person included in the image.

Meanwhile, the aforementioned algorithms are merely examples, and the disclosure may identify a text, a thing (e.g., inanimate object), and/or a person included in an image through various algorithms such as an algorithm identifying an object through analysis of color values of an image, an algorithm identifying an object through analysis of patterns of an object included in an image, etc..

Also, the processor <NUM> may identify an object included in an image through an artificial intelligence model. Here, an artificial intelligence model may be a model based on machine learning or a deep neural network (DNN). However, this is merely an example, and an artificial intelligence model may be various models such as a convolution neural network (CNN), a recurrent neural network (RNN), a bidirectional recurrent deep neural network (BRDNN), etc..

If an object is identified, the processor <NUM> identifies whether the image displayed on the display <NUM> is an image of a horizontal type or an image of a vertical type, based on the identified object.

Specifically, the processor <NUM> may identify the direction of the identified object, and if the width of the image displayed on the display <NUM> is longer than the height based on the direction of the object, the processor <NUM> may identify the image displayed on the display <NUM> as an image of a horizontal type, and if the height of the image displayed on the display <NUM> is longer than the width based on the direction of the object, the processor <NUM> may identify the image displayed on the display <NUM> as an image of a vertical type.

Hereinafter, description will be made with reference to <FIG>, <FIG>, <FIG>, and <FIG>.

<FIG> is a diagram for illustrating an embodiment wherein an image of a horizontal type is displayed on a display <NUM> arranged in a horizontal direction, and <FIG> is a diagram for illustrating an embodiment wherein an image of a horizontal type is displayed on a display <NUM> arranged in a vertical direction.

As described above, the processor <NUM> may identify an object included in an image by using at least one of an image recognition algorithm or an artificial intelligence model.

For example, in case an image is displayed on the display <NUM> arranged in a horizontal direction as in <FIG> (landscape posture), the processor <NUM> may identify at least one of a face <NUM> to <NUM> or text <NUM> included in the image by using at least one of an image recognition algorithm or an artificial intelligence model. Referring to <FIG>, a text may be a broadcasting logo, but is not limited thereto. For example, the text may include close captioning data, text in an image object, etc..

Likewise, in case an image is displayed on the display <NUM> arranged in a vertical direction as in <FIG> (portrait posture), the processor <NUM> may also identify at least one of a face <NUM> to <NUM> or text <NUM> included in the image by using at least one of an image recognition algorithm or an artificial intelligence model.

Also, the processor <NUM> may identify the direction of the identified object. Specifically, if it is determined that an object is not rotated or is rotated in a clockwise direction or a counterclockwise direction at an angle in a predetermined first range (e.g., <NUM>° to <NUM>°) based on a virtual y axis, the processor <NUM> may identify the direction of the object as a horizontal direction. Also, if it is determined that an object is rotated in a clockwise direction or a counterclockwise direction at an angle in a predetermined second range (e.g., <NUM>° to <NUM>°) based on a virtual y axis, the processor <NUM> may identify the direction of the object as a vertical direction.

For example, referring to <FIG>, the processor <NUM> may identify a text <NUM> that is an object not rotated based on a virtual y axis as an object in a horizontal direction. Also, the processor <NUM> may identify the face <NUM> to <NUM> of a person that is an object not rotated or rotated in a clockwise direction or a counterclockwise direction at an angle of <NUM>° to <NUM>° which is an angle in a predetermined first range based on a virtual y axis as an object in a horizontal direction.

As another example, referring to <FIG>, the processor <NUM> may identify a text <NUM> that is an object rotated in a counterclockwise direction at an angle of <NUM>° which is an angle in a predetermined second range based on a virtual y axis as an object in a vertical direction. Also, the processor <NUM> may identify the face <NUM> to <NUM> of a person that is an object rotated in a counterclockwise direction at an angle of <NUM>° to <NUM>° which is an angle in a predetermined second range based on a virtual y axis as an object in a vertical direction.

Accordingly, the processor <NUM> may identify the type of the image displayed on the display <NUM> based on the direction of the object.

Specifically, if the direction of the object is a horizontal direction, the processor <NUM> may identify the type of the image displayed on the display <NUM> based on a horizontal direction, and if the direction of the object is a vertical direction, the processor <NUM> may identify the type of the image displayed on the display <NUM> based on a vertical direction.

For example, if it is determined that an object in a horizontal direction is displayed on the display <NUM> as in <FIG>, the processor <NUM> identifies the type of the image displayed on the display <NUM> based on a horizontal direction. In this case, the width of the image is longer (greater) than the height of the image based on a horizontal direction (here, a virtual y axis is deemed as the width), and thus the processor <NUM> may identify the type of the image displayed on the display <NUM> as a horizontal type.

Meanwhile, if it is determined that an object in a vertical direction is displayed on the display <NUM> as in <FIG>, the processor <NUM> identifies the type of the image displayed on the display <NUM> based on a vertical direction. In this case, the width of the image is longer (greater) than the height of the image based on a vertical direction (i.e., a virtual y axis is deemed as the width), and thus the processor <NUM> may identify the type of the image displayed on the display <NUM> as a horizontal type.

That is, the type of an image is not determined based on the arrangement state of the display <NUM> itself, but based on the direction of an object. According to the present embodiment, regardless of whether the arrangement state of the display <NUM> is in a horizontal direction or in a vertical direction, the type of an image may be determined to be the same where the same image is displayed.

<FIG> is a diagram for illustrating an embodiment wherein an image of a vertical type is displayed on a display <NUM> arranged in a vertical direction, and <FIG> is a diagram for illustrating an embodiment wherein an image of a vertical type is displayed on a display <NUM> arranged in a horizontal direction.

For example, in case an image is displayed on the display <NUM> arranged in a vertical direction as in <FIG>, the processor <NUM> may identify at least one of a face <NUM> of a person, a thing <NUM>, or a text <NUM> included in the image by using at least one of an image recognition algorithm or an artificial intelligence model. Referring to <FIG>, a thing may be a microphone, and a text may be a subtitle, but are not necessarily limited thereto.

Likewise, in case an image is displayed on the display <NUM> arranged in a horizontal direction as in <FIG>, the processor <NUM> may identify at least one of a face <NUM> of a person, a thing <NUM>, or a text <NUM> included in the image by using at least one of an image recognition algorithm or an artificial intelligence model.

Also, the processor <NUM> may identify the direction of the identified object. As described above, if it is determined that the object is not rotated or rotated (e.g., oriented) in a clockwise direction or a counterclockwise direction at an angle in a predetermined first range (e.g., <NUM>° to <NUM>°) based on a virtual y axis, the processor <NUM> may identify the direction of the object as a horizontal direction. Meanwhile, if it is determined that an object is rotated in a clockwise direction or a counterclockwise direction at an angle in a predetermined second range (e.g., <NUM>° to <NUM>°) based on a virtual y axis, the processor <NUM> may identify the direction of the object as a vertical direction.

For example, referring to <FIG>, the processor <NUM> may identify a text <NUM> that is an object not rotated based on a virtual y axis as an object in a horizontal direction. Also, the processor <NUM> may identify the face <NUM> of a person and a thing <NUM> that are objects rotated in a clockwise direction or a counterclockwise direction at an angle of <NUM>° to <NUM>° which is an angle in a predetermined first range based on a virtual y axis as objects in a horizontal direction.

As another example, referring to <FIG>, the processor <NUM> may identify a text <NUM> that is an object rotated in a counterclockwise direction at an angle of <NUM>° which is an angle in a predetermined second range based on a virtual y axis as an object in a vertical direction. Also, the processor <NUM> may identify the face <NUM> of a person and a thing <NUM> that are objects rotated in a counterclockwise direction at an angle of <NUM>° to <NUM>° which is an angle in a predetermined second range based on a virtual y axis as objects in a vertical direction.

Accordingly, the processor <NUM> may identify the type of the image displayed on the display <NUM> based on the direction of an object.

As described above, if the direction of an object is a horizontal direction, the processor <NUM> may identify the type of the image displayed on the display <NUM> based on a horizontal direction, and if the direction of an object is a vertical direction, the processor <NUM> may determine the type of the image displayed on the display <NUM> based on a vertical direction.

For example, if it is determined that an object in a horizontal direction is displayed on the display <NUM> as in <FIG>, the processor <NUM> identifies the type of the image displayed on the display <NUM> based on a horizontal direction. In this case, the height of the image is longer (greater) than the width of the image based on a horizontal direction, and thus the processor <NUM> may identify the type of the image displayed on the display <NUM> as a vertical type.

Meanwhile, if it is determined that an object in a vertical direction is displayed on the display <NUM> as in <FIG>, the processor <NUM> identifies the type of the image displayed on the display <NUM> based on a vertical direction. In this case, the height of the image is longer (greater) than the width of the image based on a vertical direction, and thus the processor <NUM> may identify the type of the image displayed on the display <NUM> as a vertical type.

That is, in the present embodiment, the type of an image is not determined based on the arrangement state of the display <NUM> itself, but based on the direction of an object. Thus, regardless of whether the arrangement state of the display <NUM> is in a horizontal direction or in a vertical direction, the type of an image may be determined to be the same where the same image is displayed.

In the embodiment described above, the processor <NUM> identifies the type of the image based on the determined direction of the object and the corresponding width and height of the image according to the determined direction of the object. According to another embodiment, the processor <NUM> may identify the type of the image based on the direction of the object and the arrangement direction of the display <NUM>. For example, based on the direction of the object being vertical and the arrangement direction of the display <NUM> being vertical (as in <FIG>), the processor <NUM> identifies the type of the displayed image as the horizontal type. Meanwhile, based on the direction of the object being horizontal and the arrangement direction of the display <NUM> being horizontal (as in <FIG>), the processor <NUM> also identifies the type of the displayed image as the horizontal type. Furthermore, based on the direction of the object being vertical and the arrangement direction of the display <NUM> being horizontal (as in <FIG>), the processor <NUM> identifies the type of the displayed image as the vertical type. Meanwhile, based on the direction of the object being horizontal and the arrangement direction of the display <NUM> being vertical (as in <FIG>), the processor <NUM> also identifies the type of the displayed image as the horizontal type.

<FIG> and <FIG> are diagrams for illustrating an embodiment wherein a display <NUM> is rotated.

When the type of an image is identified, the processor <NUM> may control the driver <NUM> to rotate the display <NUM>, based on the arrangement state of the display <NUM> and the type (e.g., determined horizontal type or determined vertical type) of the image.

Specifically, if the arrangement state of the display <NUM> and the type of the image correspond to each other (e.g., determined to correspond to each other), the processor <NUM> may not rotate (i.e., control to rotate via, for example, a motor) the display <NUM>. If the arrangement state of the display <NUM> and the type of the image do not correspond to each other (e.g., determined to not correspond to each other), the processor <NUM> may rotate (i.e., control to rotate via, for example, a motor) the display <NUM>.

That is, while the display <NUM> is arranged in a vertical direction, if it is determined that an image of a horizontal type is displayed on the display <NUM>, the processor <NUM> may control the driver <NUM> to rotate the display <NUM> in a horizontal direction. Similarly, while the display <NUM> is arranged in a horizontal direction, if it is determined that an image of a vertical type is displayed on the display <NUM>, the processor <NUM> may control the driver <NUM> to rotate the display <NUM> in a vertical direction.

For example, in a state wherein the display <NUM> is arranged in a vertical direction as in <FIG>, in case an image of a horizontal type is displayed on the display <NUM>, the processor <NUM> may control the driver <NUM> to rotate the display <NUM> in a horizontal direction.

Alternatively, in a state wherein the display <NUM> is arranged in a horizontal direction as in <FIG>, in case an image of a vertical type is displayed on the display <NUM>, the processor <NUM> may control the driver <NUM> to rotate the display <NUM> in a vertical direction.

Accordingly, a user can enjoy a natural image.

Meanwhile, the processor <NUM> may determine a direction for rotating the display <NUM> by a minimum rotation angle, and control the driver <NUM> to rotate the display <NUM> in the determined direction.

Specifically, if it is determined that an object is rotated in a counterclockwise direction, the processor <NUM> may control the driver <NUM> to rotate the display <NUM> in a clockwise direction, and if it is determined that an object rotated in a clockwise direction, the processor <NUM> may control the driver <NUM> to rotate the display <NUM> in a counterclockwise direction.

For example, as illustrated in <FIG> or <FIG>, in case an object is determined to be rotated in a counterclockwise direction, the processor <NUM> may control the driver <NUM> to rotate the display <NUM> in a clockwise direction at an angle of <NUM>°, and in case an object is determined to be rotated in a clockwise direction, the processor <NUM> may control the driver <NUM> to rotate the display <NUM> in a counterclockwise direction at an angle of <NUM>°.

Accordingly, the load on a motor may be reduced. According to another embodiment, the load on the motor can be reduced by only rotating the display <NUM> a maximum of <NUM>° and then rotating the image <NUM>° if the image is upside down.

<FIG>, <FIG> and <FIG> are diagrams for illustrating an embodiment wherein the type of an image is determined.

Depending on cases, there may be a plurality of objects included in an image, and some of the directions of the plurality of objects may differ from each other. For example, in a case wherein a text, a person, and a thing are identified in an image, directions of some of these objects may be horizontal, while directions of other(s) of these objects may be vertical.

In this case, the processor <NUM> may determine the direction of the object (or the direction type of the image) based on priorities assigned or corresponding to one or more object types. For example, the processor <NUM> may determine the direction of the object (or the direction of the image) based on the direction of a particular object type, e.g., based on the direction of the text. Further, in case a text is not included in an image, the processor <NUM> may determine the direction of the object (orthe direction type of the image) based on the direction of a next prioritized type of object, e.g., based on the direction of a thing.

For example, in case an image as in <FIG> is displayed on the display <NUM>, the processor <NUM> may identify a thing <NUM> and a text <NUM> included in the image by using at least one of an image recognition algorithm or an artificial intelligence model.

Based on the identified thing <NUM> and/or the identified text <NUM>, the processor <NUM> may determine the direction of an object. Referring to <FIG>, the processor <NUM> may determine a thing <NUM> as an object not rotated or an object rotated in a counterclockwise direction at an angle in a predetermined first range (e.g., <NUM>° to <NUM>°) based on the shape of the thing <NUM>. That is, the processor <NUM> may determine that the direction of the thing <NUM> is a horizontal direction.

Also, the processor <NUM> may determine a text <NUM> in <FIG> as an object rotated in a clockwise direction at an angle of <NUM>° which is an angle in a predetermined second range based on the shape of the text <NUM>. That is, the processor <NUM> may determine that the text <NUM> is in a vertical direction.

As described above, in case the directions of a text <NUM> and a thing <NUM> included in an image displayed on the display <NUM> are different from each other, the processor <NUM> may determine the type of the image based on the direction of the text <NUM>. That is, in the present embodiment, the width of the image is longer (greater) than the height of the image, based on the vertical direction that is the direction of the text <NUM>, and thus the processor <NUM> may determine the type of the image displayed on the display <NUM> as a horizontal type.

Accordingly, the processor <NUM> may control the driver <NUM> to rotate the display <NUM> to a horizontal direction.

As another example, in case an image as in <FIG> is displayed on the display <NUM>, the processor <NUM> may identify a thing <NUM> and a face <NUM> of a person included in the image by using at least one of an image recognition algorithm or an artificial intelligence model.

Based on the identified thing <NUM> and/or the identified face <NUM>, the processor <NUM> may determine the direction of an object. Referring to <FIG>, the processor <NUM> may determine the thing <NUM> as an object rotated in a counterclockwise direction at an angle of <NUM>° which is an angle in a predetermined second range based on the shape of the thing <NUM>. That is, the processor <NUM> may determine that the direction of the thing <NUM> is a vertical direction.

Also, the processor <NUM> may determine the face <NUM> of a person in <FIG> as an object not rotated or an object rotated in a clockwise direction at an angle in a predetermined first range (e.g., <NUM>° to <NUM>°) based on the shape of the face <NUM>. That is, the processor <NUM> may determine that the direction of the face <NUM> of a person is a horizontal direction.

As described above, in case the directions of a thing <NUM> and a face <NUM> included in an image displayed on the display <NUM> are different from each other, the processor <NUM> may determine the type of the image based on the direction of the thing <NUM>. That is, in the present embodiment, the width of the image is longer (greater) than the height of the image based on a vertical direction that is the direction of the thing <NUM>, and thus the processor <NUM> may identify the type of the image displayed on the display <NUM> as a vertical type.

Accordingly, the processor <NUM> may control the driver <NUM> to rotate the display <NUM> in a horizontal direction.

As described above, in case the directions of a plurality of objects included in an image are different, the processor <NUM> may determine the type of the image according to predetermined priorities. That is, the processor <NUM> may determine the type of the image based on text included in the image as the first priority, based on an object as the second priority, and based on a person (or face of a person) as the third priority. Accordingly, the processor <NUM> may control to rotate a display <NUM> to correspond to the actual type of an image. Meanwhile, the aforementioned priorities are merely an example, and it is understood that one or more other embodiments are not limited thereto. For example, according to another embodiment, priorities may be set by a user, or may vary. Further, according to another embodiment, when the directions of the thing <NUM> and the face <NUM> included in the image displayed on the display <NUM> are different from each other, the processor <NUM> may determine the type of the image based on the direction of the face <NUM>. According to still another embodiment, if the number of identified first type of objects (e.g., faces) in a first direction is greater than a predetermined number or greater than the number of identified second type of objects (e.g., things) in a second direction, the processor <NUM> may determine the type of the image based on the direction of the first type of objects.

Meanwhile, depending on cases, a plurality of objects having the same priority but different directions may be included in an image. For example, as shown in <FIG>, a first object <NUM> may be oriented in a vertical direction and a second object <NUM> may be oriented in a horizontal direction. Here, the first object <NUM> may be a text that is displayed in a specific area of a screen while being fixed even if the frame of an image is changed (such as the logo of a broadcasting company), and the second object <NUM> may be a text that is not included in a screen when the frame of an image is changed such as a text included in a moving image.

In this case, the processor <NUM> determines the type of an image based on an object displayed in a specific area of a screen while being fixed even if the frame of an image is changed such as the logo of a broadcasting company. Specifically, in a case where a plurality of objects having the same priority but different directions are included in an image, the processor <NUM> may analyze a plurality of image frames and determine the type of the image based on the objects included in the plurality of image frames.

In the case of <FIG>, if the first text <NUM> is determined as a text included in a plurality of image frames from among the first text <NUM> and the second text <NUM> (and the second text <NUM> is determined as being included in only some of the plurality of image frames), the processor <NUM> may determine the first text <NUM> as an object displayed in a specific area of a screen while being fixed. Then, in case the first text <NUM> is a text rotated in a counterclockwise direction at an angle of <NUM>° as in <FIG>, the processor <NUM> may determine the direction of the first text <NUM> as a vertical direction, and determine the type of the image displayed on the display <NUM> as a horizontal type. Accordingly, the processor <NUM> may control the driver <NUM> to rotate the display <NUM> in a horizontal direction.

<FIG> is a diagram for illustrating a user interface (Ul) for rotation according to an embodiment.

As described above, while the display <NUM> is arranged in a vertical direction, if it is determined that an image of a horizontal type is displayed on the display <NUM>, the processor <NUM> may control the driver <NUM> to rotate the display <NUM> in a horizontal direction. Similarly, while the display <NUM> is arranged in a horizontal direction, if it is determined that an image of a vertical type is displayed on the display <NUM>, the processor <NUM> may control the driver <NUM> to rotate the display <NUM> in a vertical direction.

Meanwhile, such an operation may not only be automatically performed in case the arrangement state of the display <NUM> and the type of an image do not correspond to each other, but may also be performed on the premise that a user instruction selecting a user interface (Ul) or a graphical user interface (GUI) item for rotation is received.

For example, referring to <FIG>, in case the arrangement state of the display <NUM> and the type of an image do not correspond to each other, the processor <NUM> may display a UI <NUM> for rotation of the display <NUM> in an area of the display <NUM>. In this case, if a user instruction selecting the UI <NUM> is received, the processor <NUM> may control the driver <NUM> to rotate the display <NUM>.

As described above, by displaying a UI <NUM> for rotation in case the arrangement state of the display <NUM> and the type of an image do not correspond to each other, a user may rotate the display <NUM> with a simple operation of selecting the UI <NUM>.

<FIG> and <FIG> are diagrams for illustrating a method for, in case an image including a blank area is displayed on a display <NUM> arranged in a horizontal direction, identifying an object and rotating a display <NUM> according to an embodiment.

Depending on cases, on the display <NUM>, an image wherein blank areas are included in the left portion and the right portion of a content may be displayed. A case wherein a content having a resolution of <NUM> × <NUM> is reproduced while the display <NUM> is arranged in a horizontal direction, is shown in the left drawing in <FIG>.

The processor <NUM> may determine whether blank areas are included in an image displayed on the display <NUM>.

Specifically, the processor <NUM> may determine black areas <NUM>-<NUM>, <NUM>-<NUM> in an image displayed through the display <NUM>, and determine areas corresponding to the black areas as blank areas. Here, the black areas <NUM>-<NUM>, <NUM>-<NUM> may be determined by analyzing the color values of the image displayed through the display <NUM>. However, this is merely an example, and the processor <NUM> may determine the blank areas <NUM>-<NUM>, <NUM>-<NUM> included in the image displayed through the display <NUM> through an edge detection algorithm.

Then, the processor <NUM> may crop (e.g., virtually or logically crop) an image in the remaining area excluding the blank areas in the image displayed on the display <NUM>, and identify an object in the cropped image <NUM>.

As described above, by identifying an object in a cropped image, but not in the entire image, the burden of operation of or load on the processor <NUM> may be reduced.

Also, if it is determined that an object included in the cropped image is rotated in a counterclockwise direction as in <FIG>, the processor <NUM> may determine the direction of the object as a vertical direction.

Accordingly, the processor <NUM> may determine the type of the entire image including blank areas based on the direction of the object. In the present embodiment, the height of the entire image including blank areas is longer (greater) than the width based on a vertical direction, and thus the image may be determined as an image of a vertical type.

The processor <NUM> may therefore control the driver <NUM> to rotate the display <NUM> in a clockwise direction at an angle of <NUM>° as in <FIG>.

<FIG> and <FIG> are diagrams for illustrating a method for, in case an image including a blank area is displayed on a display <NUM> arranged in a vertical direction, identifying an object and rotating a display <NUM> according to an embodiment.

Depending on cases, on the display <NUM>, an image wherein blank areas are included in the upper and lower portions of a content may be displayed. A case wherein a content having a resolution of <NUM> × <NUM> is reproduced while the display <NUM> is arranged in a vertical direction, is shown in the left drawing in <FIG>.

Specifically, the processor <NUM> may determine black areas <NUM>-<NUM>, <NUM>-<NUM> in an image displayed through the display <NUM>, and determine areas corresponding to the black areas <NUM>-<NUM> and <NUM>-<NUM> as blank areas. Here, the black areas <NUM>-<NUM>, <NUM>-<NUM> may be determined by analyzing the color values of the image displayed through the display <NUM>. However, this is merely an example, and the processor <NUM> may determine the blank areas <NUM>-<NUM>, <NUM>-<NUM> included in the image displayed through the display <NUM> through an edge detection algorithm.

Then, the processor <NUM> may crop (e.g., vertically or logically) an image in the remaining area excluding the blank areas in the image displayed on the display <NUM>, and identify an object in the cropped image <NUM>.

Also, if it is determined that an object included in the cropped image is rotated in a clockwise direction as in <FIG>, the processor <NUM> may determine the direction of the object as a vertical direction.

Accordingly, the processor <NUM> may determine the type of the entire image including blank areas based on the direction of the object. In present embodiment, the width of the entire image including blank areas is longer (greater) than the height based on a vertical direction, and thus the image may be determined as an image of a horizontal type.

The processor <NUM> may therefore control the driver <NUM> to rotate the display <NUM> in a counterclockwise direction at an angle of <NUM>° as in <FIG>.

<FIG> is a diagram for illustrating an embodiment wherein a display apparatus <NUM> displays a mirrored image according to an embodiment.

The processor <NUM> may display an image being displayed at an external apparatus <NUM> by mirroring the image. To this end, the processor <NUM> may perform communication with the external apparatus <NUM>, and receive an image for mirroring from the external apparatus <NUM>. Here, the external apparatus <NUM> may be a smartphone, a computer, a laptop computer, etc., but is not necessarily limited thereto. The external apparatus <NUM> may be various electronic apparatuses that can transmit an image being displayed at the external apparatus <NUM> to the display apparatus <NUM>.

In particular, in case a moving image and a still image are included in an image received from the external apparatus <NUM>, the processor <NUM> may display the moving image on the display <NUM>. Specifically, when an image for mirroring is received from the external apparatus <NUM>, the processor <NUM> may analyze a plurality of frames included in the image, and determine an area wherein a content is changed and an area wherein a content is not changed according to the change of the image frames. Then, the processor <NUM> may determine an area wherein a content is changed according to the change of the image frames as an area in which a moving image is included, and an area wherein a content is not changed according to the change of the image frames as an area in which a still image is included. As an example, referring to <FIG>, the processor <NUM> may determine a first area <NUM> wherein a content is not changed according to the change of the image frames as an area in which a still image is included, and a second area <NUM> wherein a content is changed according to the change of the image frames as an area in which a moving is included.

The processor <NUM> may determine the direction of an object included in the moving image, as described above. In the case of <FIG>, the processor <NUM> may determine an object included in the image as an object in a horizontal direction based on the direction of the face of a person. Accordingly, as the width of the image in the second area <NUM> is longer (greater) than the height based on a horizontal direction, the processor <NUM> may determine the image in the second area <NUM> as an image of a horizontal type. The processor <NUM> may therefore control the driver <NUM> to rotate the display <NUM> in a horizontal direction, and display, on the display <NUM>, the image in the second area <NUM> displayed on the external apparatus <NUM> while the display <NUM> is in a horizontal direction.

<FIG> is a detailed block diagram for illustrating a display apparatus <NUM> according to an embodiment.

Referring to <FIG>, the display apparatus <NUM> according to an embodiment may include a display <NUM>, a driver <NUM>, a storage <NUM>, a communicator <NUM>, a microphone <NUM>, a speaker <NUM>, an inputter <NUM>, a signal processor <NUM>, and a processor <NUM>. Portions that overlap or are substantially redundant with the aforementioned descriptions will be omitted below or explained briefly below.

The storage <NUM> may store an operating system (OS) for controlling the overall operations of the components of the display apparatus <NUM> and instructions or data related to the components of the display apparatus <NUM>.

Accordingly, the processor <NUM> may control a plurality of hardware and/or software components of the display apparatus <NUM> by using various instructions, data, etc., stored in the storage <NUM>, load instructions or data received from at least one of the other components in a volatile memory and process the loaded instructions or data, and store various data in a non-volatile memory.

In particular, the storage <NUM> may store information on an image recognition algorithm or an artificial intelligence model that can identify an object in an image.

The communicator <NUM> may communicate with an external apparatus and transmit and receive various data. For example, the communicator <NUM> may not only perform communication with an electronic apparatus through a near field communication network (e.g., a Local Area Network (LAN)), an Internet network, and a mobile communication network, but also perform communication with an electronic apparatus through various communication methods such as Bluetooth (BT), Bluetooth Low Energy (BLE), Wireless Fidelity (WI-FI), Zigbee, NFC, etc..

For this, the communicator <NUM> may include various communication modules for performing network communication. For example, the communicator <NUM> may include at least one of a Bluetooth chip, a Wi-Fi chip, a wireless communication chip, etc..

In particular, the communicator <NUM> may perform communication with an external apparatus, and receive an image from the external apparatus. For example, an external apparatus may be a server, a smartphone, a computer, a laptop computer, etc., but is not necessarily limited thereto.

Meanwhile, the communicator <NUM> may perform communication with an external apparatus, and receive a broadcasting content (or, a broadcasting signal). Here, a broadcasting content may include at least one of an image, audio, or additional data (e.g., electronic programming guide (EPG)). For this, the communicator <NUM> may include a tuner, a demodulator, an equalizer, etc..

The microphone <NUM> may receive a user voice. Here, a user voice may be a voice for executing a specific function of the display apparatus <NUM>. If a user voice is received through the microphone <NUM>, the processor <NUM> may analyze the user voice through a speech to text (STT) algorithm, and perform a function corresponding to the user voice.

As an example, if a user voice for rotation of the display <NUM> is received through the microphone <NUM>, the processor <NUM> may control the driver <NUM> to rotate the display <NUM>.

The speaker <NUM> may output various audio. For example, the speaker <NUM> may output audio in case the display <NUM> is rotated.

The inputter <NUM> may receive input of various user instructions. The processor <NUM> may execute a function corresponding to an input user instruction through the inputter <NUM>.

For example, the inputter <NUM> may receive input of a user instruction for rotation of the display <NUM>. Also, the inputter <NUM> may receive input of user instructions for performing turning-on, change of a channel, adjustment of a volume, etc., and the processor <NUM> may control to turn on the display apparatus <NUM>, or perform change of a channel, adjustment of a volume, etc., according to an input user instruction.

For this, the inputter <NUM> may be implemented as an input panel. An input panel may be implemented in a touch pad type or in a key pad or a touch screen type including various function keys, number keys, special keys, character keys, etc..

The signal processor <NUM> performs signal processing of a content received through the communicator <NUM>. Specifically, the signal processor <NUM> may perform operations such as at least on eof decoding, scaling, frame rate conversion, etc., on an image of a content, and process the image as a signal in a form that can be output at the display apparatus <NUM>. Also, the signal processor <NUM> may perform signal processing such as decoding, etc., on audio of a content, and process the audio as a signal in a form that can be output at the speaker <NUM>.

Accordingly, the display <NUM> may display an image, etc., output at the signal processor <NUM>, and the speaker <NUM> may output audio output at the signal processor <NUM>.

The processor <NUM> controls the overall operations of the display apparatus <NUM>.

In particular, if a user instruction for displaying an image is input, the processor <NUM> may control the display <NUM> to display the image. Further, the processor <NUM> may identify the type of the image based on an object included in the image.

In this case, the processor <NUM> may identify the type of the image displayed on (or to be displayed on) the display <NUM> based on an object identified for a predetermined time period during which the image is displayed on the display <NUM> (or identified in a predetermined number of frames). For example, the predetermined time period may be <NUM> seconds, but the period may be set or changed variously according to a user instruction.

By identifying an object in an image based on a predetermined time period and not continuously identifying the type of the image over a long period of time, overload of the processor <NUM> may be avoided.

Meanwhile, an object identified for a predetermined time period may be displayed in a plurality of directions.

For example, in a music broadcasting content, an object included in an image may rotate as the actual camera angle rotates.

In case an object identified for a predetermined time period is displayed in a plurality of directions, the processor <NUM> may identify the type of the image based on a direction in which the object is displayed for a relatively long period of time (i.e., for the greatest period of time among the different directions).

That is, taking a case wherein a predetermined time period is <NUM> seconds as an example, if it is determined that the direction of an object is a horizontal direction for <NUM> seconds, and the direction of the object is a vertical direction for the remaining <NUM> seconds, the processor <NUM> may identify the object as an object in a horizontal direction.

Accordingly, the disclosure may identify the direction of an object precisely in a case in which the camera angle rotates or a case in which an image temporarily rotates, etc..

Meanwhile, if an object is determined to be rotated in a clockwise direction or a counterclockwise direction at an angle in a predetermined third range (e.g., <NUM>° to <NUM>°), the processor <NUM> may identify that the direction of the object is a horizontal direction.

For example, an image as in <FIG> or <FIG> may be reversed upside down. In this case, the processor <NUM> may control the driver <NUM> to rotate the display <NUM> at an angle of <NUM>°.

<FIG> is a flow chart for illustrating a control method of a display apparatus according to an embodiment.

A display apparatus may identify an object included in an image while the image is displayed on a display (or prior to display, for example, during an image processing) at operation S1410. Specifically, a display apparatus may identify an object included in an image by using an image recognition algorithm or an artificial intelligence model.

The display apparatus identifies whether the image is an image of a horizontal type or an image of a vertical type based on the identified object at operation S1420. Specifically, in case the direction of the object is a horizontal direction, if the width of the image is longer (greater) than the height, the display apparatus may identify that the image is of a horizontal type, and if the height of the image is longer (greater) than the width, the display apparatus may identify that the image is of a vertical type. Also, in case the direction of the object is a vertical direction, if the width of the image is longer (greater) than the height, the display apparatus may identify that the image is of a horizontal type, and if the height of the image is longer (greater) than the width, the display apparatus may identify that the image is of a vertical type.

Further, the display apparatus rotates the display based on the arrangement state of the display and the type of the image at operation S1430. Specifically, if the arrangement state of the display and the type of the image do not correspond to each other, the display apparatus may rotate the display.

Meanwhile, methods according to aforementioned embodiments may be implemented in the form of software or an application (stored on a storage medium and executable by at least one processor) that can be installed on a display apparatus with a driver <NUM>, motor, or other mechanism for physically rotating a display.

Also, methods according to aforementioned embodiments may be implemented by software upgrade, or hardware upgrade of a display apparatus with a driver <NUM>, motor, or other mechanism for physically rotating a display.

In addition, one or more of the aforementioned embodiments may be performed through an embedded server provided on a display apparatus, or a server outside the display apparatus.

Meanwhile, a non-transitory computer readable medium storing a program that sequentially or at least partially simultaneously performs the control method of a display apparatus according to the disclosure may be provided.

A non-transitory computer-readable medium may refer to a medium that stores data semi-permanently or permanently, and is readable by machines (e.g., processor). Specifically, the aforementioned various applications or programs may be provided while being stored in a non-transitory computer-readable medium such as a CD, a DVD, a hard disc, a blue-ray disc, a USB, a memory card, a ROM and the like.

Claim 1:
A display apparatus (<NUM>) comprising:
a display (<NUM>);
a driver (<NUM>) configured to rotate the display (<NUM>) between a horizontal arrangement state in which a width of the display (<NUM>) is greater than a height of the display (<NUM>), and a vertical arrangement state in which the height of the display (<NUM>) is greater than the width of the display (<NUM>); and
a processor (<NUM>) configured to:
identify an object as at least one of a text, a thing, or a person included in an image and identify a direction of the object included in the image based on the identification of the object,
based on the direction of the object, if a width of the image is greater than a height of the image, identify a type of the image as a horizontal type,
based on the direction of the object, if the height of the image is greater than the width, identify the type of the image as a vertical type,
based on an arrangement state of the display (<NUM>) and the identified type of the image, control the driver (<NUM>) to rotate the display, wherein based on the display (<NUM>) being arranged in the vertical arrangement state, and based on identifying the image as the image of the horizontal type, control the driver (<NUM>) to rotate the display (<NUM>) to the horizontal arrangement state, and based on the display (<NUM>) being arranged in the horizontal arrangement state, and based on identifying the image as the image of the vertical type, control the driver (<NUM>) to rotate the display (<NUM>) to the vertical arrangement state;
wherein based on the image including a plurality of objects that are different, the processor is configured to identify the type of the image according to predetermined priorities of the objects based on a text having a first priority, a thing having a second priority, and a person having a third priority; and
when the image includes a plurality of objects having the same priority but different directions, the processor is configured to analyse a plurality of image frames and identify the type of the image based on an object with that priority included in the plurality of image frames and not the object with that priority included in only some of the plurality of image frames.