Patent ID: 12217455

DETAILED DESCRIPTION

As embodiments disclosed herein are provided to provide a clear description of the spirit of the embodiments to one of ordinary skill in the art, the embodiments are not limited to the disclosed embodiments. According to various embodiments, the scope of the embodiments should be interpreted as including modifications or changes thereto without departing from the spirit of the embodiments.

Although terms commonly and widely used are adopted herein considering the functions in the embodiments, other terms may also be used depending on the intent of one of ordinary skill in the art, custom, or advent of new technology. For specific terms, their definitions may be provided. Accordingly, the terms used herein should be determined based on their meanings and the overall disclosure, rather than by the terms themselves.

The accompanying drawings are provided for a better understanding of the embodiments. Some views may be exaggerated in aid of understanding as necessary. The disclosure is not limited to the drawings.

When determined to make the gist of the embodiments unclear, a detailed description of known configurations or functions may be omitted as necessary.

It should be appreciated that various embodiments and the terms used therein are not intended to limit the technological features set forth herein to particular embodiments and include various changes, equivalents, or replacements for a corresponding embodiment. With regard to the description of the drawings, similar reference numerals may be used to refer to similar or related elements. It is to be understood that a singular form of a noun corresponding to an item may include one or more of the things, unless the relevant context clearly indicates otherwise. As used herein, each of such phrases as “A or B,” “at least one of A and B,” “at least one of A or B,” “A, B, or C,” “at least one of A, B, and C,” and “at least one of A, B, or C,” may include all possible combinations of the items enumerated together in a corresponding one of the phrases. As used herein, such terms as “1st” and “2nd,” or “first” and “second” may be used to simply distinguish a corresponding component from another, and does not limit the components in other aspect (e.g., importance or order). It is to be understood that if an element (e.g., a first element) is referred to, with or without the term “operatively” or “communicatively”, as “coupled with,” “coupled to,” “connected with,” or “connected to” another element (e.g., a second element), it means that the element may be coupled with the other element directly (e.g., wiredly), wirelessly, or via a third element.

As used herein, the term “module” may include a unit implemented in hardware, software, or firmware, and may interchangeably be used with other terms, for example, “logic,” “logic block,” “part,” or “circuitry”. A module may be a single integral component, or a minimum unit or part thereof, adapted to perform one or more functions. For example, according to an embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

According to embodiments, the operations of the machine (e.g., the electronic device110, camera device120, external electronic device130, and server140ofFIG.1) may be implemented as software (e.g., a program) including one or more instructions stored in a recording medium (or storage medium) readable by the machine. For example, the control circuit (e.g., a processor) of the machine (e.g., the electronic device110, external electronic device130, camera device120, or server140ofFIG.1) may invoke at least one instruction among one or more instructions stored in the recording medium, from the recording medium and execute the invoked instruction. This allows the machine to be operated to perform at least one function according to the at least one instruction invoked. The one or more instructions may include a code generated by a complier or a code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Wherein, the term “non-transitory” simply means that the storage medium is a tangible device, and does not include a signal (e.g., an electromagnetic wave), but this term does not differentiate between where data is semi-permanently stored in the storage medium and where the data is temporarily stored in the storage medium.

According to an embodiment, a method according to various embodiments may be included and provided in a computer program product. The computer program products may be traded as commodities between sellers and buyers. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read only memory (CD-ROM)), or be distributed (e.g., downloaded or uploaded) online via an application store (e.g., Play Store™), or between two user devices (e.g., smart phones) directly. If distributed online, at least part of the computer program product may be temporarily generated or at least temporarily stored in the machine-readable storage medium, such as memory of the manufacturer's server, a server of the application store, or a relay server.

According to various embodiments, each component (e.g., a module or a program) of the above-described components may include a single entity or multiple entities. According to various embodiments, one or more of the above-described components may be omitted, or one or more other components may be added. Alternatively or additionally, a plurality of components (e.g., modules or programs) may be integrated into a single component. In such a case, according to various embodiments, the integrated component may still perform one or more functions of each of the plurality of components in the same or similar manner as they are performed by a corresponding one of the plurality of components before the integration. According to various embodiments, operations performed by the module, the program, or another component may be carried out sequentially, in parallel, repeatedly, or heuristically, or one or more of the operations may be executed in a different order or omitted, or one or more other operations may be added.

FIG.1is a view100illustrating a method for providing content using a marker according to various embodiments.

In an embodiment,FIG.1may be a view for describing a system for performing a method for providing content using a marker.

Referring toFIG.1, a system for performing a method for providing content using a marker may include an electronic device110, a camera device120, an external electronic device130, and a server140.

According to an embodiment, the electronic device110(e.g., a smartphone or tablet) may obtain an image for a marker150disposed (e.g., placed) on a guide, through a camera. For example, the electronic device110may receive, from the camera device120, an image for the marker150obtained through a first camera121of the camera device120(hereinafter, referred to as a ‘first camera’). As another example, the electronic device110may obtain the image for the marker150through a second camera111included in the electronic device110(hereinafter, referred to as a ‘second camera’).

According to an embodiment, the marker150may be an object recognizable by the electronic device110. For example, the marker150may include a three-dimension (3D) object (e.g., a puzzle marker described below) including at least one surface printed with an image and/or text recognizable by the electronic device110. As another example, the marker150may include an object (e.g., a connection marker described below) having a shape recognizable by the electronic device110. As another example, the marker150may be a flat plate-shaped card (e.g., a puzzle card) printed with an image and/or text recognizable by the electronic device110.

According to an embodiment, the guide160(e.g., a rectangular piece of paper) may be used for the electronic device110to obtain the position of the marker150. For example, in a state in which the marker150is disposed (e.g., placed) on the guide160, the electronic device110may obtain an image for the marker150and the guide160(e.g., the contour of the guide160) through a camera. The electronic device110may determine the position of the marker150(e.g., coordinates of the image area representing the marker150) in the guide160(e.g., the area surrounded by the contour of the guide) based on the obtained image.

According to an embodiment, the guide160may be omitted. Even when the guide160is not used (e.g., when the marker150is not placed on the guide160), the electronic device110may obtain the position of the marker150. For example, when the marker150is disposed on the ground (e.g., on a desk), the electronic device110may obtain an image for the marker150positioned in the field-of-view (FOV) of the camera, through the camera. The electronic device110may determine the position of the marker150in the obtained image.

According to an embodiment, the camera device120may obtain the image through the first camera121. For example, the camera device120may obtain the image for the marker150positioned in the field-of-view of the first camera121through the first camera121.

According to an embodiment, the camera device120may transmit the obtained image for the marker150to the electronic device110through a communication module (e.g., a wireless communication module or a wired communication module).

According to an embodiment, the camera device120may mount the electronic device110thereon. For example, the camera device120may include a housing implemented to be able to mount the electronic device110as shown inFIG.1.

According to an embodiment, the external electronic device130may be an electronic device110that includes substantially the same configuration as the electronic device110and performs the same functions as those of the electronic device110. According to an embodiment, when the electronic device110is a first user's electronic device110, the external electronic device130may be a second user's electronic device.

According to an embodiment, the external electronic device130may transmit, through the communication module, the image for the marker obtained by the external electronic device130, content corresponding to the marker obtained from the image obtained by the external electronic device130, and information about the marker, to the electronic device via the server140(or directly).

AlthoughFIG.1illustrates one external electronic device (e.g., the external electronic device130), the embodiments are not limited thereto, and a system providing content using a marker may include a plurality of external electronic devices.

In an embodiment, the server140may communicate with the electronic device110and/or the external electronic device130through the communication module. In an embodiment, the server140may perform some of the operations for the electronic device110to provide content using a marker as described below.

In an embodiment, the electronic device110may obtain content based on the image for the marker150obtained through the camera (e.g., the first camera121or the second camera111) and the information about the marker identified from the external electronic device130. The electronic device110may display the obtained content through the display112. The operation for the electronic device to obtain content based on the image for the marker150obtained through the camera (e.g., the first camera121or the second camera111) and the information about the marker obtained from the external electronic device130is described below.

FIG.2is a block diagram illustrating an electronic device110according to various embodiments.

Referring toFIG.2, in an embodiment, an electronic device110may include a communication module210, a display module220, a camera module230, a memory240, and/or a processor250.

In an embodiment, the communication module210may support establishing a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device110and another electronic device (e.g., at least one of the camera device120, the external electronic device130, or the server140) and performing communication via the established communication channel.

According to an embodiment, the communication module210may include a wireless communication module (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (e.g., a local area network (LAN) communication module or a power line communication (PLC) module).

According to an embodiment, the display module220(e.g., the display module112ofFIG.1) may visually provide information to the outside (e.g., a user) of the electronic device110. The display module220may include a display, a hologram device, or a projector and control circuitry to control a corresponding one of the display, hologram device, and projector. According to an embodiment, the display module220may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

In an embodiment, the camera module230may include a camera (e.g., the second camera111ofFIG.1) for capturing still images and moving images. According to an embodiment, the camera module230may include one or more lenses, image sensors, image signal processors, or flashes.

According to an embodiment, the memory240may store various data used by at least one component (e.g., the processor250) of the electronic device110.

According to an embodiment, the memory240may store information for performing the operation of providing content using a marker. According to an embodiment, the memory240may store one or more programs including instructions for performing the operation of providing content using a marker.

According to an embodiment, the processor250may execute, for example, software (e.g., a program) to control at least one other component (e.g., a hardware or software component) of the electronic device110coupled with the processor250, and may perform various data processing or computation.

According to an embodiment, the processor250may control the overall operation for providing content using a marker. According to an embodiment, the processor250may include one or more processors for performing the operation of providing content using a marker. The operation of providing content using a marker by the processor250is described below with reference toFIG.3.

Although it is exemplified that inFIG.2, the electronic device110includes the communication module210, the display module220, the camera module230, the memory240, and/or the processor250, the electronic device110may add other components than those shown inFIG.2or may exclude some of the components shown inFIG.2. For example, the electronic device110may further include an input module (e.g., a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen)) capable of receiving, from the outside (e.g., the user) of the electronic device110, instructions or data to be used by a component (e.g., the processor250) and a sound output module capable of outputting sound signals to the outside of the electronic device110. As another example, in a case where the processor250performs the operation of providing content using a marker based on the image received from the camera device120, the camera module230may not be included.

Although not shown inFIG.2, the external electronic device130may include the same components as those of the electronic device110.

FIG.3is a flowchart300illustrating a method for providing content using a marker according to various embodiments.

FIG.4is a view400illustrating a method for providing a game map using a marker according to various embodiments.

FIG.5is a view500illustrating a method for providing a game map using a marker according to various embodiments.

FIGS.6A and6Bare views601and602illustrating a method for providing a game map using a marker according to various embodiments.

Referring toFIGS.3to6B, in operation301, according to an embodiment, the processor250may obtain an image for a first marker through a camera (e.g., the first camera121or the second camera111).

According to an embodiment, the processor250may execute an application based on a user input. For example, the processor250may execute a puzzle game application that may be performed by a plurality of electronic devices of a plurality of users based on a user input. However, the application executed by the processor250is not limited to the puzzle game application.

According to an embodiment, when an application (e.g., the puzzle game application) is executed, the processor250may split the screen of the display module220to display at least one content corresponding to at least one marker. For example, as shown inFIG.4, when the application is executed, the processor250may split the screen of the display module220into a plurality of screen areas411,412,413, and414respectively corresponding to the positions of the plurality of markers to display a plurality of contents corresponding to the plurality of markers. InFIG.4, four screen areas411,412,413, and414are exemplified, but the embodiments are not limited thereto. The processor250may split the screen of the display module220into a plurality of screen areas (e.g., two screen areas horizontally and one screen area vertically), fewer than four, or a plurality of screen areas (e.g., four screen areas horizontally and four screen areas vertically), more than four, depending on the number of markers recognized by the images obtained by each of the electronic device110and/or the external electronic device130. InFIG.4, the screen areas415,416,417, and418may represent screen areas that may be further split.

According to an embodiment, the processor250may determine (or adjust) the number of the plurality of split screen areas based on the number of markers (and positions of markers) obtained from the information received from the external electronic device130and/or the number of markers (and positions of markers) included in the image obtained through the camera (e.g., the first camera121or the second camera111).

According to an embodiment, when the application is executed, the processor250may obtain an image for a first marker through the camera (e.g., the first camera121or the second camera111). For example, the processor250may obtain the image for the first marker by receiving the image for the first marker obtained using the first camera121of the camera device120, through the communication module210. As another example, the processor250may obtain the image for the first marker through the second camera111.

Hereinafter, for convenience of description, the marker which is the target to be captured by the first camera121and/or the second camera111is denoted as a “first marker.” For example, the first marker may denote a marker used for the user of the electronic device110to obtain (e.g., generate) a map of the puzzle game.

According to an embodiment, the first marker may be an object recognizable by the electronic device110. For example, the first marker may include a three-dimension (3D) object (e.g., a puzzle marker) including at least one surface printed with an image and/or text recognizable by the electronic device110. As another example, the first marker may be a flat plate-shaped card (e.g., a puzzle card) printed with an image and/or text recognizable by the electronic device110.

According to an embodiment, when the first marker150-1is disposed (e.g., placed) on a guide160, the processor250may obtain an image for the first marker150-1and the guide160through the camera. For example, in a state in which the first marker150-1is placed on the guide160, the processor250may obtain an image for at least a portion of the contour of the guide160(or the area of the guide) together with the first marker150-1through the camera (e.g., the first camera121or the second camera111).

According to an embodiment, the guide160(e.g., a rectangular piece of paper) may be used to obtain the position of the first marker150-1and be omitted according to an embodiment.

In operation303, according to an embodiment, the processor250may obtain the position of the first marker and first content corresponding to the first marker based on the image obtained through the camera (hereinafter, denoted as a “first image”).

According to an embodiment, the processor250may obtain the first content corresponding to (e.g., mapped to) the first marker based on the first image. For example, the processor250may recognize the image (and/or text) printed on at least one surface of the first marker in the first image. The processor250may identify the content mapped to the recognized image and stored in the memory240(hereinafter, denoted as a “first content”) (or object).

According to an embodiment, when the application executed on the electronic device110is a puzzle game application, and the first marker is a puzzle marker, the first content may be part of the puzzle map corresponding to the first marker.

According to an embodiment, the processor250may obtain the position of the first marker based on the first image. For example, the processor250may identify the position of the area of the guide in the first image (e.g., the area indicating the guide in the first image) and the position of the area of the first marker (e.g., the image area indicating the first marker in the first image). The processor250may determine that the position of the area of the first marker in the area of the guide is the position of the first marker. As another example, the processor250may identify that the first image does not include the area of the guide. In this case, the processor250may identify the position of the area of the first marker in the first image (e.g., the first image corresponding to the field-of-view of the camera). The processor250may determine that the identified position of the first marker in the first image is the position of the first marker.

In operation305, according to an embodiment, the processor250may obtain the second content corresponding to the second marker and the position of the second marker, based on information received from the external electronic device130through the communication module210.

For convenience of description, the marker which is the target to be captured by the camera module121-1included in the external electronic device130or the camera device120-1obtaining an image and transmitting the obtained image to the external electronic device130is denoted as a “second marker.” For example, the second marker may denote a marker used for the user of the external electronic device130to obtain (e.g., generate) a map of the puzzle game.

According to an embodiment, the processor250may receive information including the second content corresponding to the second marker (hereinafter, denoted as a “second content”) and the position of the second marker, from the external electronic device130(or server) through the communication module120. According to an embodiment, the external electronic device130may perform substantially the same operations as operations301and303described above. For example, the external electronic device130may obtain the image for the second marker through a camera related to the external electronic device130(e.g., the camera device obtaining the image and transmitting the obtained image to the external electronic device130or the camera module included in the external electronic device130). The external electronic device130may obtain the second content corresponding to the second marker and the position of the second marker based on the obtained image. The external electronic device130may transmit information including the obtained second content and position of the second marker to the electronic device110. The electronic device110may receive the information including the second content and the position of the second marker, transmitted by the external electronic device130.

According to an embodiment, the processor250may receive information including the image for the second marker (hereinafter, denoted as a “second image”) from the external electronic device130(or server140) through the communication module210. The processor250may obtain the second content corresponding to the second marker and the position of the second marker based on the second image. For example, the processor250may obtain the second content corresponding to the second marker, based on the second image. The processor250may recognize the image (and/or text) printed on at least one surface of the second marker in the second image. The processor250may identify the second content mapped to the recognized image and stored in the memory240. The processor250may obtain the position of the second marker based on the second image. For example, the processor250may identify the position of the area of the guide in the second image (e.g., the area indicating the guide in the second image) and the position of the area of the second marker (e.g., the image area indicating the second marker in the second image). The processor250may determine that the position of the area of the second marker in the area of the guide is the position of the second marker. As another example, the processor250may determine that the identified position of the second marker in the second image is the position of the second marker.

In operation307, according to an embodiment, the processor250may obtain the third content by combining the first content and the second content based on the position of the first marker and the position of the second marker.

According to an embodiment, the processor250may obtain the third content by synthesizing the first content and the second content based on the position of the first marker and the position of the second marker. For example, the processor250may obtain the third content, which is obtained by synthesizing the first content and the second content, so that the first content is displayed in the screen area corresponding to the position of the first marker, and the second content is displayed in the screen area corresponding to the position of the second marker.

According to an embodiment, the processor250may obtain the third content by changing part of the first content and/or part of the second content based on the position of the first marker and the position of the second marker. For example, the processor250may obtain (e.g., generate) a path in which the game pieces respectively corresponding to the users of the electronic device110and the external electronic device130move, while the puzzle game is played, based on the position of the first marker, the position of the second marker, the part of the puzzle map included in the first content151-1, and the part of the puzzle map included in the second content151-2. The processor250may change the number in the object constituting the path in which the game piece moves on the puzzle map included in the first content and/or the number (e.g., the number “15”521-1ofFIG.5) in the object (e.g., the object521ofFIG.5) constituting the path in which the game piece moves on the puzzle map included in the second content into a number for playing the puzzle game (e.g., change the number “15”521-1ofFIG.5into the number “10” which is the next number to the number “9” in the object connected with the object521). The processor250may obtain the third content based on the obtained path in which the game pieces move and the changed number.

According to an embodiment, the processor250may obtain the third content (a puzzle map in which the puzzle map part corresponding to the first marker and the puzzle map part corresponding to the second marker are combined) by combining the first content corresponding to the first marker (e.g., the puzzle map part corresponding to the first marker) and the second content corresponding to the second marker (e.g., the puzzle map part corresponding to the second marker) based on the position of the first marker and the position of the second marker. The processor250may identify the first screen area and the second screen area of the display module220, respectively corresponding to the position of the first marker and the position of the second marker, for the third content. The processor250may display the third content through the identified first screen area and second screen area.

According to an embodiment, the processor250may identify the first screen area and second screen area of the display module220respectively corresponding to the position of the first marker and the position of the second marker. The processor250may display the first content corresponding to the first marker (e.g., the puzzle map part corresponding to the first marker) and the second content corresponding to the second marker (e.g., the puzzle map part corresponding to the second marker) in the identified first screen area and second screen area, respectively. The processor250may display the third content obtained by combining the first content and the second content (the puzzle map obtained by combining the puzzle map part corresponding to the first marker and the puzzle map part corresponding to the second marker) by displaying the first content and the second content in the first screen area and the second screen area, respectively. For example, referring toFIGS.4and5, according to an embodiment, the processor250may identify that the position of the first marker150-1corresponds to the screen area411of the display module220, and the position of the second marker150-2corresponds to the screen area412of the display module220. The processor250may display the first content (e.g., part of the puzzle map) corresponding to the first marker150-1in the screen area411and display the second content (e.g., part of the puzzle map) corresponding to the second marker in the screen area412. The processor250may display the third content (e.g., puzzle map), obtained by combining the first content and the second content, by displaying the first content and the second content in the screen area411and the screen area412, respectively.

AlthoughFIG.5exemplifies that the processor250obtains the third content based on two markers (e.g., the first marker150-1and the second marker150-2), the embodiments are not limited thereto. According to an embodiment, when at least one additional marker is placed on the guide160(or the guide160-1) after the third content is obtained based on the first marker150-1and the second marker150-2, the processor250may obtain content based on the at least one additional marker along with the first marker150-1and the second marker150-2. For example, when an additional marker is placed on the guide160(or the guide160-1) after the third content is obtained based on the first marker150-1and the second marker150-2, the processor250may obtain an image for the additional marker through the camera. The processor250may obtain content corresponding to the additional marker and the position of the additional marker based on the obtained image. The processor250may obtain the extended content (e.g., the combined content of the first content, the second content, and the content corresponding to the additional marker) of the third content by the content corresponding to the additional marker by combining the first content, the second content, and the content corresponding to the additional marker, based on the position of the first marker, the position of the second marker, and the position of the additional marker.

According to an embodiment, inFIG.5, when the third content is obtained, the processor250may transmit information related to the third content to the external electronic device130through the communication module210to allow the external electronic device130(e.g., the display module220-1) to display the third content as does the electronic device110(e.g., for the external electronic device130and the electronic device110to display the same content).

According to an embodiment, the processor250may obtain content using a connection marker other than the first marker and the second marker. According to an embodiment, the connection marker may be a marker for displaying, in a screen area where content corresponding to a marker (e.g., the puzzle marker) is not displayed on the screen of the display module220, content related to the content displayed in a screen area adjacent to the screen area. The connection marker may have a designated shape (e.g., an L shape) or may be implemented in a form printed with a designated image. For example, as shown inFIG.6A, content obtained based on at least one first marker and at least one second marker may be displayed in a first screen area611, a second screen area612, a third screen area613, a fourth screen area614, and a fifth screen area615. In the case of a sixth screen area616where puzzle maps, such as the first marker150-1and the second marker150-2, are not used, the processor250may obtain content using the connection marker621. The processor250may obtain an image for the connection marker621disposed on the guide160through the camera. The processor250may identify the position of the connection marker621based on the obtained image. As another example, the processor250may identify the position of the connection marker based on information received from the external electronic device130through the communication module210. The processor250may obtain content to be displayed in a screen area (e.g., the screen area616) corresponding to the position of the connection marker621based on content to be displayed in at least one screen area (e.g., the screen area612, the screen area613, and the screen area615) adjacent to the screen area (e.g., the screen area616) corresponding to the position of the connection marker. For example, inFIG.6A, when the position of the connection marker621corresponds to the screen area616adjacent to the screen area612, the screen area613, and/or the screen area615, the processor250may identify the content displayed in the screen area612, the screen area613, and the screen area615adjacent to the screen area616. InFIG.6B, the processor250may display content650matching the identified content displayed in the screen area612, the screen area613, and the screen area615, in the screen area616corresponding to the position of the connection marker621. For example, inFIG.6B, the processor250may display the content650in the screen area616corresponding to the position of the connection marker621so that the path displayed in the identified screen area612, the screen area613, and the screen area615and in which the game piece moves on the puzzle map is connected with the path in which the game piece included in the content650moves.

According to an embodiment, when information (e.g., the content corresponding to the marker and the position of the marker) about the marker having the position corresponding to at least one screen area among the plurality of screen areas of the display module220is not obtained, the processor250may automatically obtain (e.g., generate) content corresponding to the at least one screen area. As shown inFIG.6A, when the information (e.g., the content corresponding to the puzzle marker and the position of the puzzle marker) about the puzzle marker having the position corresponding to the screen area616among the plurality of screen areas of the display module220is not obtained, the processor250may obtain the content (e.g., the content650ofFIG.6B) to be displayed in the screen area616based on the content displayed in at least one screen area (e.g., the screen area612, the screen area613, and the screen area615) adjacent to the screen area616.

According to an embodiment, the processor250may obtain content using an item marker (e.g., a marker having at least one surface printed with an image indicating the item), other than the puzzle marker and the connection marker. For example, inFIG.6A, the processor250may obtain objects641,642,643,644, and645respectively corresponding to item markers631,632,633,634, and635using the item markers631,632,633,634, and635. As shown inFIG.6A, the processor250may display the objects641,642,643,644, and645respectively corresponding to the item markers631,632,633,634, and635in the position on the content660corresponding to the positions of the item markers631,632,633,634, and635, through the display module220. InFIG.6A, the trapezoidal objects641,642,643, and644may be objects mapped with the function for the game pieces to jump the position while the puzzle game is played. InFIG.6A, an uninhabited island-shaped object645may be an object mapped with the function of skipping the user's turn a designated number of times (e.g., three times) while the puzzle game is played.

According to an embodiment, the puzzle game may be a game which is won by the user of the game piece which first reaches the second position672, as the target position, starting with the first position671as the starting position, among the game pieces, on the content representing the puzzle map ofFIG.6B. Although not shown inFIGS.6A and6B, the electronic device110(and the external electronic device130) may move the game piece along the path on the content660(e.g., the puzzle map) based on the image for the dice obtained through the camera.

According to an embodiment, the user of the electronic device110and the user of the external electronic device130may place the first marker150-1and the second marker150-2so that the position of the content corresponding to the position of the first marker150-1(e.g., the screen area corresponding to the position of the first marker150-1) and the position of the content corresponding to the position of the second marker150-2(e.g., the screen area corresponding to the position of the second marker150-2) are identical (e.g., overlap). In such a case, the processor250may assign a higher priority to the marker (or content corresponding to the marker) in the position first obtained of the position of the first marker150-1and the position of the second marker150-2. For example, when the position of the first marker150-1and the position of the second marker150-2both correspond to the screen area614inFIG.6A, the processor250may assign a higher priority to the marker in the position first obtained of the position of the first marker150-1and the position of the second marker150-2while assigning a lower priority to the marker in the position later obtained. The processor250may assign (or display) content corresponding to the marker assigned the higher priority to a corresponding screen area (e.g., the screen area614). The processor may display the content assigned the higher priority in the corresponding screen area and may not display the content corresponding to the marker assigned the lower priority, through the display module220.

According to an embodiment, the processor250may provide various puzzle maps desired by the user of the electronic device110and the user of the external electronic device130by obtaining a puzzle map in which parts of the puzzle map are configured in the positions respectively corresponding to the positions of the puzzle markers, using the puzzle markers. For example, the processor250may obtain different puzzle maps depending on the positions of the puzzle markers disposed by the user of the electronic device110and the user of the external electronic device130.

FIG.7is a flowchart700illustrating a method for providing content using a marker according to various embodiments.

FIG.8is a view801and802illustrating a method for providing content using a marker according to various embodiments.

Referring toFIGS.7and8, in operation701, according to an embodiment, the processor250may obtain an image for a marker through the camera (e.g., the first camera121or the second camera111) while content is provided.

According to an embodiment, in reference number801, the processor250may obtain an image for a marker150related to the hockey game through the camera. The processor250may obtain the content811(e.g., an image portion representing the hockey arena in the hockey game) corresponding to the marker150and the position of the marker150. Although not shown inFIG.8, the processor250may obtain content812related to the hockey game and corresponding to a marker (not shown) different from the marker150and the position of the different marker, based on information obtained from the external electronic device130. The processor250may obtain content (e.g., the image representing the hockey arena where the hockey game is played) based on the content corresponding to the marker150and the position of the marker150and the content812corresponding to the different marker and the position of the different marker and display the obtained content through the display module220.

According to an embodiment, the processor250may obtain the image for the marker (e.g., an item marker) through the camera while content (e.g., the image representing the hockey arena where the hockey game is played) is provided. For example, the processor250may obtain an image for an item marker151movable on the guide160, through the camera.

In operation703, according to an embodiment, the processor250may obtain the object corresponding to the marker and the position of the marker based on the image obtained through the camera (e.g., the first camera121or the second camera111).

According to an embodiment, as shown in reference number802, the processor250may obtain the object151-3corresponding to the item marker151and the position of the item marker151, based on the image for the item marker151obtained through the camera (e.g., the first camera121). For example, the processor250may obtain the object151-3corresponding to the image and/or text printed on the item marker151, from the memory240. The processor250may obtain the position of the item marker151by identifying the area of the item marker151in the area (or the image obtained through the camera) indicating the guide included in the image obtained through the camera (e.g., the first camera121).

According to an embodiment, the processor250may obtain the object (e.g., the object152) corresponding to an item marker different from the item marker151and the position of the different item marker, based on information obtained from the external electronic device130through the communication module210.

In operation705, according to an embodiment, the processor250may provide content based on the position of the marker.

According to an embodiment, in reference number802, the processor250may provide content including the object151-1corresponding to the item marker151and the object152corresponding to the different item marker, based on the position of the item marker151and the position of the different item marker. For example, on the hockey game played through the electronic device110and the external electronic device130, the object151-1corresponding to the item marker151may represent the game piece of the electronic device110, and the oobject152corresponding to the different item marker may represent the game piece of the external electronic device130. According to an embodiment, when the item marker151is moved, the processor250may move and display the object151-1corresponding to the item marker151in the position of the display module220corresponding to the moved position of the item marker151. When the different item marker is moved based on the information received from the external electronic device130, the processor250may move and display the object152corresponding to the different item marker in the position of the display module220corresponding to the moved position of the different item marker. In reference number802, the object153may correspond to the puck (e.g., a virtual puck) of the hockey game. When the object153contacts the object151-1corresponding to the item marker151or the object152corresponding to the different item marker, the object153may be moved from the current position to another position on the display module220.

According to an embodiment, the processor250may play the content (e.g., hockey game) using the marker151(e.g., item marker) even without the marker150and the different marker used for obtaining the content, after obtaining (e.g., generating) the content (e.g., the combined content of the content811and the content812). For example, upon obtaining the content (e.g., the combined content of the content811and the content812) using the marker150and the different marker (e.g., when the hockey arena for playing hockey game is complete), the user of the electronic device110(and/or the user of the external electronic device130) may move the marker150(and different marker) out of the field-of-view of the camera (e.g., the first camera121) and move the marker151within the field-of-view of the camera. the processor250may provide the content using the marker151while the content (e.g., the combined content of the content811and the content812) is provided. However, embodiments are not limited thereto. For example, when the user places or moves the marker151(and different marker) on the marker150(and different marker) in a state in which the position of the marker150(and different marker) is fixed, the processor250may provide the content (e.g., hockey game) based on the position of the marker151(and different marker).

FIG.9is a flowchart900illustrating a method for providing content using a marker according to various embodiments.

FIG.10is a view1000illustrating a method for providing content using a marker according to various embodiments.

FIG.11is a view1101and1102illustrating a method for providing an augmented reality effect using a marker according to various embodiments.

FIG.12is a view1201,1202, and1203illustrating a method for providing an augmented reality effect using a marker according to various embodiments.

Referring toFIGS.9to12, in operation901, according to an embodiment, the processor250may provide content using a marker.

According to an embodiment, the processor250may obtain an image for the marker through a camera (e.g., the first camera121or the second camera111). The processor250may obtain content corresponding to the marker based on the obtained image. The processor250may identify an area indicating the image and/or text printed on the marker, in the image obtained through the camera. The processor250may obtain content (e.g., a game execution screen) corresponding to the identified area. For example, inFIG.10, the processor250may obtain an image for a marker1011(and guide160) printed with a sea-related image through the first camera121. The processor250may identify the area indicating the sea-related image in the obtained image. The processor250may display an execution screen1012of a fishing game, as content corresponding to the sea-related image, through the display module220.

According to an embodiment, the processor250may obtain content corresponding to the marker, based on information received from the external electronic device130through the communication module210. For example, the processor250may receive the image for the marker from the external electronic device130through the communication module210. The processor250may obtain content corresponding to the marker based on the received image. As another example, the processor250may receive the content corresponding to the marker from the external electronic device130through the communication module210.

According to an embodiment, when a plurality of contents respectively corresponding to the plurality of markers, the processor250may assign priorities to the plurality of contents in the order in which the plurality of contents are obtained. For example, when content1corresponding to marker1is obtained based on an image for marker1obtained through the camera (e.g., the first camera121or the second camera111), and content2corresponding to marker2(e.g., a marker as a target to be captured by the camera related to the external electronic device130of another user playing game together with the user of the electronic device110) is obtained based on information received from the external electronic device130, the processor250may assign a higher priority to content1obtained earlier than content2. According to an embodiment, as the marker is first disposed within the field-of-view of the camera related to the external electronic device130and/or the field-of-view of the camera (e.g., the first camera121or the second camera111) related to the electronic device110by the user of the electronic device110and/or the user of the external electronic device130, the content corresponding to the marker may be first obtained.

According to an embodiment, the processor250may provide the content with the highest priority among the plurality of contents respectively corresponding to the plurality of markers. For example, the processor250may display, through the display module220, only the content with the highest priority among the plurality of contents respectively corresponding to the plurality of markers.

According to an embodiment, after providing the content with the highest content among the plurality of contents respectively corresponding to the plurality of markers, the processor250may provide the content with the next highest priority. For example, after the fishing game corresponding to marker1, as the content with the highest priority, is terminated, the processor250may provide a desert exploration game corresponding to marker2as the content with the second highest priority.

In operation903, according to an embodiment, the processor250may obtain an image (hereinafter, referred to as a “first image”) for the first marker through the camera.

According to an embodiment, the processor250may obtain the first image for the first marker through the camera (e.g., the first camera121or the second camera111) while content is provided.

According to an embodiment, the first marker may include a marker having at least one surface printed with an image and/or text related to the item. For example, the first marker may be a marker having at least one surface printed with a character-related image. As another example, the first marker may be a marker having at least one surface printed with an image related to equipment and/or clothes that may be put on the character. However, the first marker is not limited to those described above.

In operation905, according to an embodiment, the processor250may obtain a first object corresponding to the first marker and the position of the first marker.

According to an embodiment, the processor250may obtain the first object corresponding to (e.g., mapped to) the first marker (hereinafter, denoted as a “first object”) based on the first image for the first marker. For example, the processor250may recognize the image (and/or text) e.g., a character-related image) printed on at least one surface of the first marker in the first image. The processor250may identify the object (e.g., the object representing the character) mapped to the recognized image and stored in the memory240.

According to an embodiment, the processor250may obtain the position of the first marker based on the first image. For example, the processor250may identify the position of the area of the guide in the first image (e.g., the area indicating the guide in the first image) and the position of the area of the first marker (e.g., the image area indicating the first marker in the first image). The processor250may determine that the position of the area of the first marker in the area of the guide is the position of the first marker. As another example, the processor250may identify that the first image does not include the area of the guide. In this case, the processor250may identify the position of the area of the first marker in the first image (e.g., the first image corresponding to the field-of-view of the camera). The processor250may determine that the identified position of the first marker in the first image is the position of the first marker.

In operation907, according to an embodiment, the processor may obtain the second object corresponding to the second marker and the position of the second marker, based on information received from the external electronic device130through the communication module.

According to an embodiment, the second marker may be a marker that is a target to be captured by the camera device121-1obtaining an image and transmitting the obtained image to the external electronic device130or the camera module included in the external electronic device130. Identical or similar to the first marker, the second marker may include a marker having at least one surface printed with an image and/or text related to the item.

According to an embodiment, the processor250may receive information including the second object corresponding to the second marker (hereinafter, denoted as a “second object”) and the position of the second marker, from the external electronic device130(or server) through the communication module210. According to an embodiment, the external electronic device130may perform substantially the same operations as operations901and905described above. For example, the external electronic device130may obtain the image for the second marker through a camera related to the external electronic device130(e.g., the camera device obtaining the image and transmitting the obtained image to the external electronic device130or the camera module included in the external electronic device130). The external electronic device130may obtain the second object corresponding to the second marker and the position of the second marker based on the obtained image. The external electronic device130may transmit information including the obtained second object and position of the second marker to the electronic device110. The electronic device110may receive, through the communication module210, the information including the second object and the position of the second marker, transmitted by the external electronic device130.

According to an embodiment, the processor250may receive information including the image for the second marker (hereinafter, denoted as a “second image”) from the external electronic device130(or server) through the communication module210. The processor250may obtain the second object corresponding to the second marker and the position of the second marker based on the second image. For example, the processor250may obtain the second object corresponding to the second marker, based on the second image. The processor250may recognize the image (and/or text) printed on at least one surface of the second marker in the second image. The processor250may identify the second object mapped to the recognized image and stored in the memory210. The processor250may obtain the position of the second marker based on the second image. For example, the processor250may identify the position of the area of the guide in the second image (e.g., the area indicating the guide in the second image) and the position of the area of the second marker (e.g., the image area indicating the second marker in the second image). The processor250may determine that the position of the area of the second marker in the area of the guide is the position of the second marker. As another example, the processor250may determine that the identified position of the second marker in the second image is the position of the second marker.

In operation909, according to an embodiment, the processor250may obtain the third object by combining the first object and the second object based on the position of the first marker and the position of the second marker.

According to an embodiment, the processor250may identify that at least part of the first object and at least part of the second object overlap on the screen displayed through the display module220, based on the position of the first marker and the position of the second marker. When at least part of the first object and at least part of the second object overlap, the processor250may obtain a third object in which the first object and the second object are combined together. For example, referring to reference numbers1101and1102, the processor250may identify that the first object1121corresponding to the first marker1111(e.g., the marker printed with an image representing a character) and the second object1122corresponding to the second marker1114(e.g., the marker printed with an image representing a fishing rod) overlap on the screen1112(e.g., the screen displaying the content provided through operation901) displayed through the display module220. When the first object1121and the second object1122overlap, the processor250may obtain the third object in which the first object1121and the second object1122are combined (e.g., an object representing an image in which the fishing rod represented by the second object1122is mounted on the character represented by the first object1121). Although not shown in reference numbers1101and1102, when the third object is obtained, the processor250may provide content to allow the user of the electronic device110and/or the user of the external electronic device130to play game using the third object. For example, the processor250may provide a game in which the character with the fishing rod is fishing using the fishing rod in the sea-related content to the user of the electronic device101and/or the user of the external electronic device130.

According to an embodiment, as shown in reference numbers1101and1102, when the third object is obtained, the processor250may transmit, to the external electronic device130through the communication module, information related to the third object to allow the external electronic device130to display the screen1113(e.g., a screen including the same object1131as the first object1121and the same object1132as the second object1122) identical to the screen1112displayed on the electronic device110.

Although not shown inFIG.9, according to an embodiment, the processor250may obtain objects using various markers. For example, in reference number1201, the processor250may obtain an object1215which is augmented with an item1215representing an umbrella on the character1214and in which the object corresponding to the marker1211and the object corresponding to the marker1213are combined (e.g., generated based on the object corresponding to the marker1211and the object corresponding to the marker1213), using the marker1211printed with an image representing the character and the marker1213printed with an image representing a water droplet.

Although not shown inFIGS.9to12, according to an embodiment, when an object corresponding to a marker is obtained while content is provided through operation901, the processor250may obtain an object resultant from changing at least part of the obtained object, based on the provided content. For example, when the object1121representing the character and corresponding to the first marker1111printed with the character-related image is obtained while the sea-related content is provided, the processor250may obtain an object in which the sea-related swimsuit is augmented with the character of the object1121. As another example, when an object1121representing a character and corresponding to the first marker1111printed with a character-related image is obtained while the jungle-related content is provided, the processor250may obtain an object in which a jungle-related exploration suit is augmented with the character of the object1121.

According to an embodiment, the processor250may apply an augmented reality effect (e.g., an animation effect) to the content provided through the display module220, using various markers. For example, when the third object is obtained based on the first object and the second object, the processor250may apply an augmented reality effect corresponding to the combination of the first object and the second object to the content being provided.

According to an embodiment, when an object corresponding to the marker1221printed with the character-related image and an object corresponding to the marker1223printed with an image representing a flame while a cave-related content is provided in reference number1202, the processor250may display such an augmented reality effect as if the surroundings of the character brighten along with the object representing an image in which the flame is augmented with the character in the content related to the cave, through the display module220. For example, in reference number1203, when an object corresponding to the marker1233printed with an image representing a flame and an object corresponding to the marker1231printed with a water-related image are obtained while an ice-related content is provided, the processor250may display such an augmented reality effect as if the ice melts into water in the ice-related content, through the display module220.

According to an embodiment, in the above-described examples, the operation in which the electronic device provides content using markers is exemplified, but the embodiments are not limited thereto. In the above-described examples, some of the operations performed by the electronic device may be performed by the server140.

According to an embodiment, a method for providing content using a marker by an electronic device may comprise obtaining an image for a first marker through a camera, obtaining a first content corresponding to the first marker and a position of the first marker, based on the image, obtaining a second content corresponding to a second marker and a position of the second marker, based on information received from an external electronic device, and obtaining a third content by combining the first content and the second content based on the position of the first marker and the position of the second marker.

According to an embodiment, obtaining the image may comprise obtaining the image for the first marker through a camera of a camera device communicatively connected with the electronic device or a camera of the electronic device.

According to an embodiment, the position of the first marker may be a position within a first guide on which the first marker is disposed or a position within a field-of-view of the camera, and the position of the second marker may be a position within a second guide on which the second marker is disposed or a position within a field-of-view of a camera related to the external electronic device.

According to an embodiment, obtaining the third content may comprise obtaining the third content by combining the first content to be displayed in a first screen area corresponding to the position of the first marker among a plurality of screen areas of a display module of the electronic device and the second content to be displayed in a second screen area corresponding to the position of the second marker among the plurality of screen areas.

According to an embodiment, the method may further comprise obtaining a position of a connection marker obtained through the camera, based on an image for the connection marker and obtaining a content to be displayed in a third screen area, based on the first content and the second content, when the position of the connection marker corresponds to the third screen area adjacent to the first screen area and/or the second screen area, wherein obtaining the third content may comprises obtaining the third content by combining the first content, the second content, and the content to be displayed in the third screen area.

According to an embodiment, the first marker and the second marker may include puzzle markers. The first content and the second content may include parts of a puzzle map. The third content may include the puzzle map.

According to an embodiment, the method may further comprise, when a position of the first content is identical to a position of the second content, assigning a higher priority to a marker in a position obtained earlier of the position of the first marker and the position of the second marker and displaying only a content corresponding to the marker assigned the higher priority, on a display module of the electronic device.

According to an embodiment, the method may further comprise obtaining an image for a third marker through the camera while the third content is provided, obtaining an object corresponding to the third marker and a position of the third marker, based on the image for the third marker, and providing the third content using the third marker, based on the position of the third marker.

According to an embodiment, a non-transitory computer-readable medium storing one or more programs may comprise instructions configured to, when executed by at least one processor of an electronic device, enable the electronic device to obtain an image for a first marker through a camera, obtain a first content corresponding to the first marker and a position of the first marker, based on the image, obtain a second content corresponding to a second marker and a position of the second marker, based on information received from an external electronic device, and obtain a third content by combining the first content and the second content based on the position of the first marker and the position of the second marker.

According to an embodiment, the instructions may be configured to, when executed by the at least one processor, enable the electronic device to obtain the image for the first marker through a camera of a camera device communicatively connected with the electronic device or a camera of the electronic device.

According to an embodiment, the position of the first marker may be a position within a first guide on which the first marker is disposed or a position within a field-of-view of the camera, and the position of the second marker may be a position within a second guide on which the second marker is disposed or a position within a field-of-view of a camera related to the external electronic device.

According to an embodiment, the instructions may be configured to, when executed by the at least one processor, enable the electronic device to obtain the third content by combining the first content to be displayed in a first screen area corresponding to the position of the first marker among a plurality of screen areas of a display module of the electronic device and the second content to be displayed in a second screen area corresponding to the position of the second marker among the plurality of screen areas.

According to an embodiment, the instructions may be configured to, when executed by the at least one processor, enable the electronic device to obtain a position of a connection marker obtained through the camera, based on an image for the connection marker, obtain a content to be displayed in a third screen area, based on the first content and the second content, when the position of the connection marker corresponds to the third screen area adjacent to the first screen area and/or the second screen area, and obtain the third content by combining the first content, the second content, and the content to be displayed in the third screen area.

According to an embodiment, the first marker and the second marker may include puzzle markers. The first content and the second content may include parts of a puzzle map. The third content may include the puzzle map.

According to an embodiment, the instructions may be configured to, when executed by the at least one processor, enable the electronic device to, when a position of the first content is identical to a position of the second content, assign a higher priority to a marker in a position obtained earlier of the position of the first marker and the position of the second marker and display only a content corresponding to the marker assigned the higher priority, on a display module of the electronic device.

According to an embodiment, the instructions may be configured to, when executed by the at least one processor, enable the electronic device to obtain an image for a third marker through the camera while the third content is provided, obtain an object corresponding to the third marker and a position of the third marker, based on the image for the third marker, and provide the third content using the third marker, based on the position of the third marker.

According to an embodiment, a method for providing content using a marker by an electronic device may comprise obtaining an image for a first marker through a camera while the content is provided, obtaining a first object corresponding to the first marker and a position of the first marker, based on the image, obtain a second object corresponding to a second marker and a position of the second marker, based on information received from an external electronic device, and obtain a third object by combining the first object and the second object based on the position of the first marker and the position of the second marker.

According to an embodiment, obtaining the third object may comprise obtaining the third object in which the first object and the second object are combined, when at least part of the first object and at least part of the second object overlap each other.

According to an embodiment, the method may further comprise obtaining an object in which at least part of the first object and/or the second object is changed, based on the content when the first object and/or the second object is obtained while the content is provided.

According to an embodiment, the method may further comprise applying an augmented reality effect corresponding to the combination of the first object and the second object to the content when the third object is obtained.

Further, the structure of the data used in embodiments may be recorded in a computer-readable recording medium via various means. The computer-readable recording medium includes a storage medium, such as a magnetic storage medium (e.g., a ROM, a floppy disc, or a hard disc) or an optical reading medium (e.g., a CD-ROM or a DVD).