Method and apparatus for outputting audio in electronic device

A method and device for processing an audio output in consideration of the hearing characteristics of a user and the characteristics of an audio device connected to an electronic device is provided. The electronic device includes a user interface; an audio interface configured to establish a connection to an audio device, a memory, and at least one processor electrically connected to the user interface, the memory, and the audio interface, wherein the at least one processor is configured to acquire at least one of identification information of the audio device and characteristics of the audio device, select audio adaptation information, change an audio signal, at least partially based on the audio adaptation information, and transmit the changed audio signal to the audio device.

PRIORITY

This application claims priority under 35 U.S.C. § 119(a) to Korean Patent Application Serial No. 10-2015-0113979, which was filed in the Korean Intellectual Property Office on Aug. 12, 2015, the entire content of which is incorporated herein by reference.

BACKGROUND

1. Field of the Disclosure

The present disclosure generally relates to a method and device for outputting audio in an electronic device, and more particularly, to a method and device for processing an audio output in consideration of the hearing characteristics of a user and the characteristics of an audio device connected to an electronic device.

2. Description of the Related Art

With the recent development of digital technologies, various types of electronic devices such as a mobile communication terminal, a smart phone, a tablet personal computer (PC), a personal digital assistant (PDA), an electronic notebook, a notebook PC, a wearable device, and a television (TV) are widely used. Further, an electronic device may be connected to various types of audio devices (e.g. audio output devices, such as a wired headphone, a wired earphone, a wireless headphone, and a wireless earphone). The electronic device may output audio data (e.g., a sound source), which is being reproduced, through an audio device connected thereto and a user may listen to audio data of the electronic device through the audio device. The electronic device and the audio device may be connected to each other through a wired interface (e.g. a physical connector connection) or a wireless interface (e.g. Bluetooth connection).

Audio devices, which are used while connected to an electronic device, have different sound qualities and characteristics (e.g. frequency characteristic) according to the type of audio device (e.g. a wireless headphone, a wired headphone, a wireless earphone, and a wired earphone). For example, a low frequency band may be strengthened or a high frequency band may be equalized according to the characteristics of the audio device. Each audio device may have different frequency response characteristics. Therefore, an audio output from the electronic device may be provided to a user with different results according to the characteristics of the audio device. Moreover, when the characteristics of the audio device do not correspond to the hearing characteristics of the user, the user may be provided with different audio reproduction results.

SUMMARY

An aspect of the present disclosure provides a method and apparatus for outputting audio which may automatically convert an audio output in consideration of the characteristics of the audio device and the hearing characteristics of the user in an electronic device.

Another aspect of the present disclosure provides a method and apparatus for outputting audio, which may automatically update, when an audio device is changed, audio compensation information for compensating for the changed audio device and the hearing characteristics of a user in an electronic device.

Another aspect of the present disclosure provides a computer-readable recording medium having a program recorded therein to perform the method by a processor.

According to an aspect of the present disclosure, an electronic device is provided including a user interface, an audio interface configured to establish a connection to an audio device, a memory, and at least one processor electrically connected to the user interface, the memory, and the audio interface, wherein the at least one processor is configured to acquire at least one of identification information of the audio device and characteristics of the audio device, select audio adaptation information, change an audio signal, at least partially based on the audio adaptation information, and transmit the changed audio signal to the audio device.

According to another aspect of the present disclosure, an electronic device is provided including a communication interface configured to establish a connection to an audio device, a memory, and one or more processors that are electrically connected to the communication interface and the memory, wherein the one or more processors perform determining audio adaptation information related to the audio device in response to the connection of the audio device, correcting an audio output corresponding to the audio device on the basis of the audio adaptation information when the audio adaption information has been registered, and updating, when the audio adaption information has not been registered, the audio adaptation information related to the audio device and correcting an audio output corresponding to the characteristics of the audio device on the basis of the updated audio adaptation information.

According to another aspect of the present disclosure, an electronic device is provided including a wired or wireless interface configured to establish a connection to an audio device, a memory, and one or more processors that are electrically connected to the memory and the wired or wireless interface, wherein the memory, at the time of execution, may be configured to store instructions that instruct the one or more processors to, establish audio adaptation information on the basis of the frequency characteristics of the audio device and the hearing characteristics of a user, detect a connection of the audio device, determine audio adaptation information related to a connected audio device, convert a currently established audio output characteristic to an audio output characteristic corresponding to the connected audio device on the basis of the determined audio adaptation information, and process an audio output on the basis of the converted audio output characteristic.

According to another aspects of the present disclosure, an operation method of an electronic device is provided including detecting a connection of an audio device, acquiring at least one of identification information of the audio device and characteristics of the audio device, selecting audio adaptation information, changing an audio signal, at least partially based on the audio adaptation information, and transmitting the changed audio signal to the audio device.

According to another aspect of the present disclosure, an operation method of an electronic device is provided including detecting a connection of an audio device, determining audio adaptation information related to the audio device in response to the connection of the audio device, correcting an audio output corresponding to the audio device on the basis of the audio adaptation information when the audio adaption information has been registered, updating audio adaptation information related to the audio device when the audio adaption information has not been registered, and correcting an audio output corresponding to a characteristic of the audio device on the basis of the updated audio adaptation information.

According to another aspect of the present disclosure, a non-transitory recording medium includes a computer-readable non-transitory recording medium which records a program for executing in an electronic device, detecting a connection of an audio device, acquiring at least one of identification information and characteristics of the audio device, at least partially based on the connection to the audio device, selecting pre-stored audio adaptation information, at least partially based on the acquired information and/or characteristics, changing an audio signal, at least partially based on the audio adaptation information, and transmitting the changed audio signal to the audio device.

DETAILED DESCRIPTION

As used herein, the expressions “have”, “may have”, “include”, or “may include” refers to the existence of a corresponding feature (e.g., numeral, function, operation, or constituent element such as component), and do not exclude one or more additional features.

Hereinafter, an electronic device according to various embodiments of the present disclosure will be described with reference to the accompanying drawings. As used herein, the term “user” may indicate a person who uses an electronic device or a device (e.g., an artificial intelligence electronic device) that uses an electronic device.

FIG. 1illustrates a network environment including an electronic device according to various embodiments of the present disclosure.

An electronic device101within a network environment100, according to various embodiments of the present disclosure, will be described with reference toFIG. 1. The electronic device101includes a bus110, a processor120, a memory130, an input/output interface150, a display160, and a communication interface170. The electronic device101may omit at least one of the above components or may further include other components.

The bus110may include, for example, a circuit which interconnects the components110to170and delivers a communication (e.g., a control message and/or data) between the components110to170.

The processor120may include one or more of a central processing unit (CPU), an application processor (AP), and a communication processor (CP). The processor120may carry out, for example, calculation or data processing relating to control and/or communication of at least one other component of the electronic device101.

The memory130may include a volatile memory and/or a non-volatile memory. The memory130may store, for example, commands or data relevant to at least one other component of the electronic device101. According to an embodiment of the present disclosure, the memory130may store software and/or a program140. The program140includes, for example, a kernel141, middleware143, an application programming interface (API)145, and/or application programs (or “applications”)147. At least some of the kernel141, the middleware143, and the API145may be referred to as an operating system (OS).

The kernel141may control or manage system resources (e.g., the bus110, the processor120, or the memory130) used for performing an operation or function implemented in the other programs (e.g., the middleware143, the API145, or the application programs147). Furthermore, the kernel141may provide an interface through which the middleware143, the API145, or the application programs147may access the individual components of the electronic device101to control or manage the system resources.

The middleware143, for example, may serve as an intermediary for allowing the API145or the application programs147to communicate with the kernel141to exchange data.

The middleware143may process one or more task requests received from the application programs147according to assigned priorities. For example, the middleware143may assign priorities for using the system resources (e.g., the bus110, the processor120, the memory130, and the like) of the electronic device101, to at least one of the application programs147. For example, the middleware143may perform scheduling or load balancing on the one or more task requests by processing the one or more task requests according to the assigned priorities.

The API145is an interface through which the applications147control functions provided from the kernel141or the middleware143, and may include, for example, at least one interface or function (e.g., instruction) for file control, window control, image processing, character control, and the like.

The input/output interface150may function as an interface that transfers commands or data input from a user or another external device to the other element(s) of the electronic device101. Furthermore, the input/output interface150may output the commands or data received from the other element(s) of the electronic device101to the user or another external device.

The display160may include a liquid crystal display (LCD), a light-emitting diode (LED) display, an organic light-emitting diode (OLED) display, a microelectromechanical systems (MEMS) display, and an electronic paper display. The display160may display, for example, various types of content (e.g., text, images, videos, icons, or symbols) to users. The display160may include a touch screen, and may receive, for example, a touch, gesture, proximity, or hovering input using an electronic pen or a user's body part.

The communication interface170may establish communication, for example, between the electronic device101and a first external electronic device102, a second external electronic device104, or a server106. For example, the communication interface170may be connected to a network162through wireless or wired communication, and may communicate with the second external electronic device104or the server106. The wireless communication may use at least one of, for example, long term evolution (LTE), LTE-advanced (LTE-A), code division multiple access (CDMA), wideband CDMA (WCDMA), universal mobile telecommunications system (UMTS), wireless broadband (WiBro), and global system for mobile communications (GSM), as a cellular communication protocol. In addition, the wireless communication may include, for example, short range communication164. The short-range communication164may include at least one of, for example, Wi-Fi, Bluetooth, near field communication (NFC), and global navigation satellite system (GNSS). GNSS may include, for example, at least one of global positioning system (GPS), global navigation satellite system (Glonass), Beidou navigation satellite system (Beidou) or Galileo, and the European global satellite-based navigation system, based on a location, a bandwidth, and the like. Hereinafter, in the present disclosure, the “GPS” may be interchangeably used with the “GNSS”. The wired communication may include, for example, at least one of a universal serial bus (USB), a high definition multimedia interface (HDMI), recommended standard 232 (RS-232), and a plain old telephone service (POTS). The network162may include at least one of a telecommunication network such as a computer network (e.g., a LAN or a WAN), the Internet, and a telephone network.

Each of the first and second external electronic devices102and104, may be of a type identical to or different from that of the electronic device101. According to an embodiment of the present disclosure, the server106may include a group of one or more servers.

According to various embodiments of the present disclosure, all or some of the operations performed in the electronic device101may be executed in another electronic device or a plurality of electronic devices (e.g., the electronic devices102and104or the server106). When the electronic device101has to perform some functions or services automatically or in response to a request, the electronic device101may request another electronic device102or104or the server106, to execute at least some functions relating thereto instead of, or in addition to, autonomously performing the functions or services. Another electronic device102or104, or the server106may execute the requested functions or the additional functions, and may deliver a result of the execution to the electronic device101. The electronic device101may process the received result as it is or additionally, and may provide the requested functions or services. To this end, for example, cloud computing, distributed computing, or client-server computing technologies may be used.

FIG. 2is a block diagram of an electronic device according to various embodiments of the present disclosure.

The electronic device201may include, for example, the entire or a part of the electronic device101shown inFIG. 1. The electronic device201includes one or more processors210(e.g., application processors (AP)), a communication module220, a subscriber identification module (SIM)224, a memory230, a sensor module240, an input device250, a display260, an interface270, an audio module280, a camera module291, a power management module295, a battery296, an indicator297, and a motor298.

The processor210may control a plurality of hardware or software components connected to the processor210by driving an operating system or an application program, and perform processing of various types of data and calculations. The processor210may be embodied as, for example, a system on chip (SoC). According to an embodiment of the present disclosure, the processor210may further include a graphic processing unit (GPU) and/or an image signal processor. The processor210may include at least some (for example, a cellular module221) of the components illustrated inFIG. 2. The processor210may load, into a volatile memory, commands or data received from at least one (e.g., a non-volatile memory) of the other components and may process the loaded commands or data, and may store various data in a non-volatile memory.

The communication module220may have a configuration equal or similar to that of the communication interface170ofFIG. 1. The communication module220includes a cellular module221, a Wi-Fi module223, a BT module225, a GNSS module227(e.g., a GPS module227, a Glonass module, a Beidou module, or a Galileo module), an NFC module228, and a radio frequency (RF) module229.

The cellular module221, for example, may provide a voice call, a video call, a text message service, or an Internet access service through a communication network. According to an embodiment of the present disclosure, the cellular module221may distinguish and authenticate the electronic device201in a communication network using the SIM card224. The cellular module221may perform at least some of the functions that the AP210may provide. The cellular module221may include a communication processor (CP).

Each of the Wi-Fi module223, the BT module225, the GNSS module227, and the NFC module228may include a processor for processing data transmitted/received through a corresponding module. According to an embodiment of the present disclosure, at least some (e.g., two or more) of the cellular module221, the Wi-Fi module223, the BT module225, the GNSS module227, and the NFC module228may be included in one integrated chip (IC) or IC package.

The RF module229, for example, may transmit/receive a communication signal (e.g., an RF signal). The RF module229may include, for example, a transceiver, a power amplifier module (PAM), a frequency filter, a low noise amplifier (LNA), and an antenna. According to another embodiment of the present disclosure, at least one of the cellular module221, the WIFI module223, the BT module225, the GNSS module227, and the NFC module228may transmit/receive an RF signal through a separate RF module.

The SIM224may include a card including an embedded SIM, and may contain unique identification information (e.g., an integrated circuit card identifier (ICCID)) or subscriber information (e.g., an international mobile subscriber identity (IMSI)).

The memory230(e.g., the memory130) includes an embedded memory232or an external memory234. The embedded memory232may include at least one of a volatile memory (e.g., a dynamic random access memory (DRAM), a static RAM (SRAM), a synchronous dynamic RAM (SDRAM), and the like) and a non-volatile memory (e.g., a one time programmable read only memory (OTPROM), a programmable ROM (PROM), an erasable and programmable ROM (EPROM), an electrically erasable and programmable ROM (EEPROM), a mask ROM, a flash ROM, a flash memory (e.g., a NAND flash memory or a NOR flash memory), a hard disc drive, a solid state drive (SSD), and the like).

The external memory234may further include a flash drive, for example, a compact flash (CF), a secure digital (SD), a micro secure digital (Micro-SD), a mini secure digital (Mini-SD), an extreme digital (xD), a multimediacard (MMC), a memory stick, and the like. The external memory234may be functionally and/or physically connected to the electronic device201through various interfaces.

The sensor module240, for example, may measure a physical quantity or detect an operation state of the electronic device201, and may convert the measured or detected information into an electrical signal. The sensor module240includes at least one of a gesture sensor240A, a gyro sensor240B, an atmospheric pressure sensor (barometer)240C, a magnetic sensor240D, an acceleration sensor240E, a grip sensor240F, a proximity sensor240G, a color sensor240H (e.g., red, green, and blue (RGB) sensor), a biometric sensor (medical sensor)240I, a temperature/humidity sensor240J, an illuminance sensor240K, and a ultra violet (UV) sensor240M. Additionally or alternatively, the sensor module240may include, for example, an E-nose sensor, an electromyography (EMG) sensor, an electroencephalogram (EEG) sensor, an electrocardiogram (ECG) sensor, an infrared (IR) sensor, an iris scan sensor, and/or a fingerprint scan sensor. The sensor module240may further include a control circuit for controlling one or more sensors included therein. According to an embodiment of the present disclosure, the electronic device201may further include a processor configured to control the sensor module240, as a part of the processor210or separately from the processor210, and may control the sensor module240while the processor210is in a sleep state.

The input device250may include, for example, a touch panel252, a (digital) pen sensor254, a key256, or an ultrasonic input device258. The touch panel252may use, for example, at least one of a capacitive type, a resistive type, an infrared type, and an ultrasonic type. The touch panel252may further include a control circuit. The touch panel252may further include a tactile layer, and provide a tactile reaction to the user.

The (digital) pen sensor254may include, for example, a recognition sheet which is a part of the touch panel or is separated from the touch panel. The key256may include, for example, a physical button, an optical key or a keypad. The ultrasonic input device258may detect, through a microphone288, ultrasonic waves generated by an input tool, and identify data corresponding to the detected ultrasonic waves.

The display260(e.g., the display160) may include a panel262, a hologram device264, or a projector266. The panel262may include a configuration identical or similar to the display160illustrated inFIG. 1. The panel262may be flexible, transparent, or wearable. The panel262may be embodied as a single module with the touch panel252. The hologram device264may show a three dimensional (3D) image in the air by using an interference of light. The projector266may project light onto a screen to display an image. The screen may be located, for example, in the interior of, or on the exterior of, the electronic device201. According to an embodiment of the present disclosure, the display260may further include a control circuit for controlling the panel262, the hologram device264, or the projector266.

The audio module280, for example, may bidirectionally convert a sound and an electrical signal. At least some components of the audio module280may be included in, for example, the input/output interface150illustrated inFIG. 1. The audio module280may process voice information input or output through, for example, a speaker282, a receiver284, earphones286, or the microphone288.

The camera module291may photograph a still image and a video. According to an embodiment of the present disclosure, the camera module291may include one or more image sensors (e.g., a front sensor or a back sensor), a lens, an image signal processor (ISP) or a flash (e.g., LED or xenon lamp).

The power management module295may manage, for example, power of the electronic device201. According to an embodiment of the present disclosure, the power management module295may include a power management integrated circuit (PMIC), a charger integrated circuit (IC), or a battery gauge. The PMIC may use a wired and/or wireless charging method. Examples of the wireless charging method may include, for example, a magnetic resonance method, a magnetic induction method, an electromagnetic wave method, and the like. Additional circuits (e.g., a coil loop, a resonance circuit, a rectifier, etc.) for wireless charging may be further included. The battery gauge may measure, for example, a residual charge quantity of the battery296, and a voltage, a current, or a temperature while charging. The battery296may include, for example, a rechargeable battery and/or a solar battery.

The indicator297may display a particular state (e.g., a booting state, a message state, a charging state, and the like) of the electronic device201or a part (e.g., the processor210) of the electronic device201. The motor298may convert an electrical signal into a mechanical vibration, and may generate a vibration, a haptic effect, and the like. The electronic device201may include a processing device (e.g., a GPU) for supporting a mobile TV. The processing device for supporting a mobile TV may process, for example, media data according to a certain standard such as digital multimedia broadcasting (DMB), digital video broadcasting (DVB), or mediaFLO™.

Each of the above-described component elements of hardware according to the present disclosure, may be configured with one or more components, and the names of the corresponding component elements may vary based on the type of electronic device. In various embodiments, the electronic device may include at least one of the above-described elements. Some of the above-described elements may be omitted from the electronic device, or the electronic device may further include additional elements. Also, some of the components according to various embodiments may be combined into one entity, which may perform functions identical to those of the relevant components before the combination.

FIG. 3is a block diagram of a program module according to various embodiments of the present disclosure.

According to an embodiment of the present disclosure, the program module310(e.g., the program140) may include an operating system (OS) for controlling resources related to the electronic device (e.g., the electronic device101) and/or various applications (e.g., the application programs147) executed in the operating system. The operating system may be, for example, Android, iOS, Windows, Symbian, Tizen, Bada, and the like.

The program module310includes a kernel320, middleware330, an API360, and/or applications370. At least some of the program module310may be preloaded on an electronic device, or may be downloaded from an external electronic device102or104, or the server106.

The kernel320(e.g., the kernel141) includes a system resource manager321and/or a device driver323. The system resource manager321may control, allocate, or collect system resources. According to an embodiment of the present disclosure, the system resource manager321may include a process management unit, a memory management unit, a file system management unit, and the like. The device driver323may include, for example, a display driver, a camera driver, a Bluetooth driver, a shared memory driver, a USB driver, a keypad driver, a Wi-Fi driver, an audio driver, or an inter-process communication (IPC) driver.

The middleware330may provide a function required in common by the applications370, or may provide various functions to the applications370through the API360so as to enable the applications370to efficiently use the limited system resources in the electronic device. According to an embodiment of the present disclosure, the middleware330(e.g., the middleware143) includes a run time library335, an application manager341, a window manager342, a multimedia manager343, a resource manager344, a power manager345, a database manager346, a package manager347, a connectivity manager348, a notification manager349, a location manager350, a graphic manager351, and a security manager352.

The runtime library335may include a library module that a compiler uses in order to add a new function through a programming language while an application370is being executed. The runtime library335may perform input/output management, memory management, an arithmetic function, and the like.

The application manager341may manage, for example, a life cycle of at least one of the applications370. The window manager342may manage graphical user interface (GUI) resources used by a screen. The multimedia manager343may recognize a format required for reproduction of various media files, and may perform encoding or decoding of a media file by using a codec suitable for the corresponding format. The resource manager344may manage resources of a source code, a memory, and a storage space of at least one of the applications370.

The power manager345may operate together with, for example, a basic input/output system (BIOS) and the like, to manage a battery or power source and may provide power information and the like, required for the operations of the electronic device. The database manager346may generate, search a memory for, and/or change a database to be used by at least one of the applications370. The package manager347may manage installation or an update of an application distributed in a form of a package file.

The connectivity manager348may manage wireless connectivity such as Wi-Fi or Bluetooth. The notification manager349may display or notify of an event such as an arrival message, proximity notification, and the like, in such a way that does not disturb a user. The location manager350may manage location information of an electronic device. The graphic manager351may manage a graphic effect which will be provided to a user, or a user interface related to the graphic effect. The security manager352may provide all security functions required for system security, user authentication, and the like. According to an embodiment of the present disclosure, when the electronic device (e.g., the electronic device101) has a telephone call function, the middleware330may further include a telephony manager for managing a voice call function or a video call function of the electronic device.

The middleware330may include a middleware module that forms a combination of various functions of the above-described components. The middleware330may provide a module specialized for each OS in order to provide a differentiated function. Further, the middleware330may dynamically remove some of the existing components or add new components.

The API360(e.g., the API145) is, for example, a set of API programming functions, and may be provided with a different configuration according to an OS. For example, in the case of Android or iOS, one API set may be provided for each platform. In the case of Tizen, two or more API sets may be provided for each platform.

The applications370include one or more applications which may provide functions such as a home371, a dialer372, an SMS/MMS373, an instant message (IM)374, a browser375, a camera376, an alarm377, contacts378, a voice dial379, an email380, a calendar381, a media player382, an album383, a clock384, health care (e.g., measuring exercise quantity or blood sugar levels), or environment information (e.g., providing atmospheric pressure, humidity, or temperature information).

According to an embodiment of the present disclosure, the applications370may include an information exchange application that supports exchanging information between the electronic device101and an external electronic device102or104. The information exchange application may include, for example, a notification relay application for transferring specific information to an external electronic device or a device management application for managing an external electronic device.

For example, the notification relay application may include a function of transferring, to the external electronic device102or104, notification information generated from other applications of the electronic device101(e.g., an SMS/MMS application, an e-mail application, a health management application, or an environmental information application). Further, the notification relay application may receive notification information from, for example, an external electronic device102or104, and provide the received notification information to a user.

The device management application may manage (e.g., install, delete, or update), for example, at least one function of an external electronic device102or104, communicating with the electronic device (e.g., a function of turning on/off the external electronic device itself (or some components) or a function of adjusting the brightness (or a resolution) of the display), applications operating in the external electronic device, and services provided by the external electronic device (e.g., a call service or a message service).

According to an embodiment of the present disclosure, the applications370may include applications (e.g., a health care application of a mobile medical appliance and the like) designated according to an external electronic device102or104. The applications370may include an application received from an external electronic device102or104or the server106. The applications370may include a preloaded application or a third party application that may be downloaded from a server106. The names of the components of the program module310according to an embodiment of the present disclosure may change according to the type of operating system.

At least a part of the programming module310may be implemented in software, firmware, hardware, or a combination of two or more thereof. At least some of the program module310may be implemented (e.g., executed) by, for example, the processor (e.g., the processor1410). At least some of the program module310may include, for example, a module, a program, a routine, a set of instructions, and/or a process for performing one or more functions.

At least some of the devices (for example, modules or functions thereof) or the method (for example, operations) according to an embodiment of the present disclosure may be implemented by a command stored in a non-transitory computer-readable storage medium in a programming module form. The instruction, when executed by a processor (e.g., the processor120), may cause the one or more processors to execute the function corresponding to the instruction. The non-transitory computer-readable recoding medium may be, for example, the memory130.

Any of the modules or programming modules according to various embodiments of the present disclosure may include at least one of the above described elements, exclude some of the elements, or further include other additional elements. The operations performed by the modules, programming module, or other elements according to various embodiments of the present disclosure may be executed in a sequential, parallel, repetitive, or heuristic manner. Further, some operations may be executed according to another order or may be omitted, or other operations may be added.

Various embodiments disclosed herein are provided merely to describe technical details of the present disclosure and to help the understanding of the present disclosure, and do not limit the scope of the present disclosure. Therefore, it should be construed that all modifications and changes or modified and changed forms based on the technical idea of the present disclosure fall within the scope of the present disclosure.

Various embodiments of the present disclosure disclose a method and apparatus for outputting audio. The method and apparatus may automatically convert an audio output and may output the converted audio output, according to the characteristics (e.g. frequency characteristics) of an audio device, which are combined with hearing characteristics, when a user connects the audio device to an electronic device and uses an audio solution considering the hearing characteristics of the user. Various embodiments of the present disclosure disclose a method and apparatus for outputting audio, which may automatically update and establish audio compensation information in consideration of the characteristics of a connected audio device and the hearing characteristics of a user when a connection of an audio device, in which audio compensation information (or audio adaptation information) (e.g. profile, frequency information) for compensating for an audio output characteristic according to each audio device in an electronic device is not established, is detected.

The electronic device, according to the various embodiments of the present disclosure, may include all information and communication devices, multimedia devices, wearable devices, and all application devices thereof that use one or more various processors, such as an application processor (AP), a communication processor (CP), a Graphic Processing Unit (GPU), a central processing unit (CPU), and the like.

Hereinafter, the method and apparatus for outputting audio will be described with reference to the accompanying drawings. However, since the various embodiments are not restricted or limited by the following description, it should be noted that software applications may be made that will be described below. Hereinafter, various embodiments of the present disclosure will be described based on a hardware approach. However, various embodiments of the present disclosure include a technology that uses both hardware and software and thus, the present disclosure may not exclude the use of software.

FIG. 4illustrates processing an audio output according to a characteristic of a connected audio device in an electronic device according to various embodiments of the present disclosure. Referring toFIG. 4, a system may include an audio device450and an electronic device500.

Referring toFIG. 4, the audio device450may include an audio output device which is wired or wirelessly connected to the electronic device500, receives audio data reproduced in the electronic device500, and outputs the received audio through a speaker in the audio output device. The audio device450includes various devices, such as a wired headphone451, a wireless headphone453(e.g. Bluetooth headphone), a wireless earphone455(e.g. Bluetooth earphone), and a wired earphone457, which may be wired or wirelessly connected to the electronic device500.

Referring toFIG. 4, the electronic device500includes a display400, a housing (or main body) on which the display400is mounted and fastened, and an additional device which is formed on the housing410and performs a function of the electronic device. The additional device includes a first speaker401, a second speaker403, a microphone405, a front camera module407, an illumination sensor409, a charging or data input/output port411, an audio input/output port413, and a button415.

According to various embodiments of the present disclosure, the display400may include a flexible display which may be bent, curved, or rolled without damage through a substrate as thin and flexible as paper. The curved display has a feature of being coupled to the housing410and remaining in a curved form. The electronic device500may also be implemented as a display device, which may be freely bent or unbent, such as a flexible display, including the curved display. The display400may replace a glass substrate covering a liquid crystal with a plastic film so as to provide flexibility by which the display may be folded or unfolded in a liquid crystal display (LCD), a light emitting diode (LED), an organic LED (OLED), and an active matrix OLED (AMOLED). The display400may extend up to at least one side (e.g. at least one of a left side, a right side, an upper side, and a lower side) of the electronic device500, be folded in a radius of curvature (e.g. 5 cm, 1 cm, 7.5 mm, 5 mm, 4 mm, etc.) less than a radius of curvature in which the curved display may be operated, and be fastened at a side of the housing410.

According to various embodiments of the present disclosure, when the audio device450is connected, the electronic device500may determine audio compensation information470(e.g. a profile, frequency information, and the like, which are audio adaptation information) corresponding to the audio device450.

According to an embodiment of the present disclosure, the electronic device500may detect that the audio device450is connected, and may search a memory for and select, in response to the detection of the connection of the audio device450, a particular profile related to the connected audio device450(e.g. audio adaptation information for the audio device450) from among profiles pre-established according to identification information and/or characteristics of the audio device450(e.g. device identifier (e.g. ID)). The electronic device500may automatically change a currently established profile to the selected profile for an audio output and compensate for the audio output according to the changed profile. The profile may be, for example, information which is registered in advance by combining the hearing characteristics of a user with a basic frequency characteristic of the audio device by using such a method as convolution. A profile is used to provide audio having sound quality optimized for a user by considering the characteristics of an audio device and the hearing characteristics of the user, and may indicate information established in order to compensate for an audio output characteristic according to each audio device.

According to an embodiment of the present disclosure, the electronic device500may detect a connection of the audio device450thereto, and may search a memory for and select, in response to the detection of the connection of the audio device450, particular frequency information related specifically to the audio device450from among frequency information pre-established according to a frequency characteristic of the audio device450. The electronic device500may automatically change currently established frequency information to the selected frequency information for an audio output, and may combine the changed frequency information and the hearing characteristics of a user so as to compensate for the audio output. For example, the electronic device500may combine the frequency information of an audio device and the hearing characteristics of a user so as to create a profile related to a currently connected audio device, and may compensate for an audio output on the basis of the created profile.

According to various embodiments of the present disclosure, multiple pieces of information may be stored in the audio compensation information470according to each audio device450. A first audio compensation information471may be established for the wired headphone451, a second audio compensation information473may be established for the wireless headphone453, a third audio compensation information475may be established for the wireless earphone455, and a fourth audio compensation information477may be established for the wired earphone457. The audio compensation information470, such as the first audio compensation information471, the second audio compensation information473, the third audio compensation information475, and the fourth audio compensation information477, may be established in advance in consideration of the hearing characteristics of a user and the characteristics of the audio device450. The audio compensation information477may be created in real time in consideration of the characteristics of the connected audio device450and the hearing characteristics of the user and then stored in the electronic device500.

According to an embodiment of the present disclosure, when the connection of the wireless headphone453is detected through Bluetooth communication, the electronic device500may determine the audio compensation information473(e.g. a profile or frequency information) corresponding to the wireless headphone453from among multiple pieces of pre-established audio compensation information470, and may process an operation related to audio compensation and output audio in response to the determined audio compensation information473. For example, the electronic device500may process an audio output in consideration of an equal loudness curve and thus may improve a sound quality which a user hears. The equal loudness curve may show levels of sounds generated in pure sine waves of different frequencies when a person without hearing impairment listens to the sounds and perceives the sounds as equally loud. Generally, even a sound having physically equal loudness may sound different to a person's ears according to the frequency. For example, in order for the person's ears to hear a 60-phon sound, a 1 KHz sine wave should be at a sound pressure level (SPL) of 60 dB and a 100 Hz sine wave should be at an SPL of 78 dB. As described above, even a sound having equal loudness may be heard different according to a frequency. In consideration of this point, sound pressure levels according to respective frequencies, which sound like sounds having equal loudness, are experimentally determined, the determined sound pressure levels are on an equal loudness curve.

According to various embodiments of the present disclosure, examples of compensating and outputting audio according to the characteristics of the audio device450will be described with reference to the accompanying drawings.

Referring toFIG. 5, an electronic device500according to various embodiments of the present disclosure include a wireless communication unit510, a user input unit520, a touch screen530, an audio processing unit540, a memory550, an interface unit560, a camera module570, a controller580, and a power supply unit590. The electronic device500may include fewer or more elements than the elements ofFIG. 5.

The wireless communication unit510may include a configuration identical to, or similar to, the communication module220ofFIG. 2. The wireless communication unit510may include one or more modules which enable wireless communication between the electronic device500and an external electronic device. For example, the wireless communication unit510may include a mobile communication module511, a wireless local area network (WLAN) module513, a short range communication module515, and a location calculation module517. The wireless communication unit510may include a module (e.g. a short range communication module or a long range communication module) for communicating with an external electronic device.

The mobile communication module511may have a configuration identical to, or similar to, the cellular module221ofFIG. 2. The mobile communication module511may transmit/receive a wireless signal to/from at least one of a base station, an external electronic device104, and various servers (e.g. an integration server, a provider server, a content server, an Internet server, a cloud server, and the like) over a mobile communication network. The wireless signal may include a voice signal, a data signal, or various types of control signals. The mobile communication module511may transmit, in response to a user's request, various pieces of data required for an operation of the electronic device500to the external device104, or the server106.

The wireless LAN module513may have a configuration identical to, or similar to, the Wi-Fi module223ofFIG. 2. The WLAN module513may establish wireless Internet access and a wireless LAN link with another electronic device102or the server106. The WLAN module513may be mounted inside or outside the electronic device500. Wireless Internet access technology may include Wi-Fi, wireless broadband (Wibro), world interoperability for microwave access (WiMax), high speed downlink packet access (HSDPA), millimeter wave (mmWave), and the like. The WLAN module513may be linked with another external electronic device, which is connected through the electronic device500and a network (e.g. a wireless Internet network), so as to transmit or receive various data of the electronic device500to or from an external electronic device104or a server106. The WLAN module513may always maintain an on-state, or may be turned on based on settings of the electronic device500or a user input.

The short range communication module515may be a module for performing short range communication. The short range communication technology may include Bluetooth, Bluetooth low energy (BLE), radio frequency identification (RFID), infrared data association (IrDA), ultrawideband (UWB), ZigBee, near field communication (NFC), etc. The short range communication module515may be linked with another external electronic device (e.g. the audio device450), which is connected to the electronic device500through a network (e.g. a short range communication network), so as to transmit or receive various data of the electronic device500to or from the external electronic device. The short range communication module515may always maintain an on-state, or may be turned on based on settings of the electronic device500or a user input.

The location calculation module517may have a configuration identical to, or similar to, the GNSS module227ofFIG. 2. The location calculation module517is a module for obtaining the location of the electronic device500, and may include a global position system (GPS) module. The location calculation module517may measure the location of the electronic device500through a triangulation principle.

The user input unit520may have a configuration identical to, or similar to, the input device250ofFIG. 2. The user input unit520may generate input data for controlling an operation of the electronic device500in response to a user input. The user input unit520may include at least one input device for detecting various inputs of a user. For example, the user input unit520may include a keypad, a dome switch, a physical button, a touch pad (resistive type/capacitive type), a jog & shuttle, and a sensor (e.g. the sensor module240).

Some elements of the user input unit520may be implemented in the form of a button located outside the electronic device500, or may be implemented in the form of a touch panel. The user input unit520may receive a user input for initiating an operation (e.g. a hearing test function for creating audio compensation information) of the electronic device500according to various embodiments of the present disclosure, and may generate an input signal according to the user input.

The touch screen530is an input/output device which may perform an input function and a display function together, and may include a display531(e.g. the display160or260) and a touch detection unit533. The touch screen530may provide an input/output interface between the electronic device500and the user, may transfer a touch input of the user to the electronic device500, and may display an output from the electronic device500to the user. The touch screen530may display a visual output to the user. The visual output may be displayed in the form of text, graphics, videos, and a combination thereof.

According to various embodiments of the present disclosure, the display531may display (output) various pieces of information processed in the electronic device500. For example, the display531may display a user interface (UI) or a graphical user interface (GUI) related to an operation which the electronic device500performs while being charged or an operation of performing data communication according to a USB interface connection. The display531may use various displays (e.g. the display160). The display531may use a curved display.

According to various embodiments of the present disclosure, the display531may include a display control circuit (e.g. a display driver IC (DDI)) which provides an electrical signal (e.g. a multi high voltage level (MHVL) signal) to a display panel. The display control circuit is an element in the display531, which provides a driving signal and data to the display531by using an electrical signal (e.g. an MHVL signal) so that an image (e.g. text, pictures, still images, dynamic images) is displayed on a screen, and may drive various types displays, such as LCD, PDP and OLED.

The touch detection unit533may have a configuration identical to, or similar to, the touch panel252ofFIG. 2. The touch detection unit533may be mounted on the display531and may detect a user input which touches or is proximate to a surface of the touch screen530. The user input may include a touch event or proximity event, which includes a single touch, a multi-touch, a hovering, and an air gesture. The touch detection unit533may receive a user input for initiating an operation related to the use of the electronic device500and may generate an input signal based on the user input.

The audio processing unit540may have a configuration identical to, or similar to, the audio module280ofFIG. 2. The audio processing unit540may transmit an audio signal received from the controller580to a speaker (SPK)541, and may transfer, to the controller580, an audio signal, such as a voice, which is received from a microphone (MIC)543. The audio processing unit540may convert voice/sound data into audible sound through the speaker541based on the control of the controller580and may output the audible sound and may convert an audio signal, such as a voice, which is received from the microphone543into a digital signal and transfer the digital signal to the controller580. The audio processing unit540may output an audio signal on the basis of audio compensation information which is compensated according to the control of the controller580.

The speaker541may output audio data that is received from the wireless communication unit510or stored in the memory550. The speaker541may output an audio signal associated with various operations (functions) performed by the electronic device500.

The microphone543may receive an input of an external audio signal and process the same as electrical voice data. Various noise reduction algorithms may be implemented in the microphone543or the controller580in order to remove noise from an external audio signal. The microphone543may receive an audio stream, such as a voice instruction (e.g. a voice instruction for initiating data communication).

The memory550(e.g. the memory130or230) may store one or more programs that are executed by the controller580, and may execute a function for temporarily storing input/output data. The input/output data may include, for example, a file or profile, such as a dynamic image, an image, a picture, and audio data. The memory550stores acquired data. Data acquired in real time may be stored in a temporary storage device, and data may be stored in a storage device for a long time.

According to various embodiments of the present disclosure, the memory550may include a profile DB551and audio device information DB553.

According to various embodiments of the present disclosure, the profile DB551may indicate a database (DB) which includes a profile for compensating for an audio output characteristic according to each device identifier (e.g. ID) of an audio device. The profile DB551may have a device identifier of an audio device and a profile created through a hearing test performed by an interaction between the electronic device500and a user and stored memory550. The profile DB551may store a frequency characteristic which reflects a device identifier (e.g. ID) of an audio device and the hearing characteristics of a user. The device identifier may use, for example, a MAC address of a device's Bluetooth chip, and the profile may be stored as a decibel (dB) value of a frequency according to each frequency band.

According to various embodiments of the present disclosure, the audio device information DB553may indicate a DB which includes a device identifier (e.g. ID) of an audio device or frequency information for compensating for an audio output characteristic according to the type of device. The audio device information DB553may have a device name (e.g. product name) of an audio device and the corresponding frequency information, stored in a database. The audio device information DB553may indicate a DB which stores a device identifier (e.g. ID) of an audio device and a unique frequency characteristic of the audio device as frequency information files, respectively, and manages the files in a database.

According to various embodiments of the present disclosure, the profile DB551and the audio device information DB553may be implemented in the controller580or an audio compensation module585of the controller580.

The memory550may have a configuration identical or similar to the memory230ofFIG. 2. According to various embodiments of the present disclosure, the memory550may store one or more programs and data, which are related to executing an audio compensation function. The audio compensation function converts an audio output characteristic in consideration of the characteristics of an audio device and the hearing characteristics of a user. The memory550may store one or more programs and data, which are related to executing a hearing test function. For example, the memory550may store instructions for executing the audio compensation function or the hearing test function. The memory550may store instructions which instruct the controller580(e.g. one or more processors) to acquire the identification information and/or characteristics of an audio device, at least partially based on a connection to the audio device, select pre-stored audio adaptation information, at least partially based on the acquired information and/or characteristics, change an audio signal, at least partially based on the audio adaptation information, and transmit the changed audio signal to the audio device.

According to various embodiments of the present disclosure, the instructions may include instructing the controller580to wirelessly receive identification information of an audio device from the audio device and instructing the controller580to acquire an impedance characteristic of the audio device and/or information on the audio device so as to determine the characteristics of the audio device, when the audio device is connected through the wired interface. The instructions may include instructing the controller580to provide selected audio to an audio device after a connection to the audio device, receive a user response to the audio through a user interface, and create audio adaptation information, at least partially based on the received response. The memory550may include one or more application modules (or software modules).

The interface unit560may have a configuration identical to, or similar to, the interface270ofFIG. 2. The interface unit560may receive data or power from another external electronic device, and may transfer the data or power to each element included in the electronic device500. The interface unit560may enable the data inside the electronic device500to be transmitted to another external electronic device. For example, the interface unit560may include a wired/wireless headphone port, an external charging device port, a wired/wireless data port, a memory card port, an input/output port, a video input/output port, an earphone port, etc.

The camera module570(e.g. the camera module291) supports a photographing function of the electronic device500. The camera module570may photograph an object under control of the controller580, and transfer the photographed data (e.g. images) to the display531and the controller580.

The controller580may control overall operations of the electronic device500. According to various embodiments of the present disclosure, the controller580may have a configuration identical to, or similar to, the processor210ofFIG. 2. The controller580may detect a connection to an audio device, and may process a hearing test in response to the connected audio device or converting and outputting audio characteristics on the basis of audio compensation information.

According to various embodiments of the present disclosure, the controller580may include the audio compensation module585. The audio compensation module585may detect an audio device connection and determine whether to perform a hearing test or perform audio output characteristic conversion. On the basis of a result of the determination, the audio compensation module585may process an operation related to the hearing test or process an operation related to converting the audio output characteristic to output audio. The audio compensation module585may include a memory including at least one DB corresponding to the profile DB551and the audio device information DB553. An operation of the audio compensation module585will be described in detail with reference to the drawings.

The controller580may include one or more processors for controlling an operation of the electronic device500. The controller580may control operations of hardware modules, such as the audio processing unit540, the interface unit560, and the display531. The control operation of the controller580will be described in detail with reference to the drawings.

According to various embodiments of the present disclosure, the controller580may be linked with software modules stored in the memory550so as to perform an audio compensation and hearing test operation based on an audio device characteristic of the electronic device500. The controller580may be embodied as one or more processors that are configured to control an operation of the electronic device500by executing one or more programs stored in the memory550.

The power supply unit590may receive external power or internal power based on the control of the controller580and supply power required for the operation of each element. According to various embodiments of the present disclosure, the power supply unit590may provide, or cut off, power supply to the display531, the camera module570, and the like on the basis of a control of the controller580.

Various embodiments of the present disclosure may be implemented in a computer or a similar non-transitory device-readable recording medium through software, hardware or a combination thereof.

Hereinafter, an operation of processing an audio output will be described according to various embodiments of the present disclosure with reference toFIGS. 6, 7, and 8. A description ofFIGS. 6, 7, and 8will be made by using an example in which the audio compensation module585includes at least one DB corresponding to the profile DB551and the audio device information DB553. However, the present disclosure is not limited to this embodiment. As in the above description made with reference toFIG. 5, the audio compensation module585may receive relevant information stored in the profile DB551and audio device information DB553of the memory550so as to process an audio output.

FIG. 6illustrates processing an audio output in an electronic device according to various embodiments of the present disclosure.

Referring toFIG. 6,FIG. 6illustrates an operation of the controller580(e.g. the audio compensation module585) when the audio device450, which is connected to the electronic device500, is an active audio device. According to various embodiments of the present disclosure, the active audio device is configured to have an internal digital circuit which may establish wireless communication (e.g. Bluetooth) with the electronic device500and may include an audio output device having a device identifier (e.g. ID).

As illustrated inFIG. 6, when the audio device450is connected, the electronic device500may detect (perform ID detection) a device identifier (e.g. ID) of the audio device450through a detector610. The detector610may detect whether the device identifier of the audio device450is a device identifier registered in a profile DB630(e.g. an audio device hearing profile DB) of the electronic device500. The profile DB630may be implemented and used inside the audio compensation module585, or may be implemented (e.g. according toFIG. 5) and used outside (e.g. the memory550) the audio compensation module. Table 1 below shows an example of the profile DB630in which a profile for each audio device is registered.

According to various embodiments of the present disclosure, the profile DB630may include a database for storing a frequency characteristic which reflects a device identifier (e.g. ID) of the audio device450and the hearing characteristics of a user. The device identifier may use, for example, a MAC address of Bluetooth, and the profile may store a decibel (dB) value of a frequency according to each frequency band. The profile DB630may be created by generating a database from a device identifier of an audio device, and the test which has been completed through a hearing test640. The electronic device500may include a measurement device (e.g. hearing test unit) for the hearing test640and may perform measurements by software processing.

When it is determined that the connected audio device450is an audio device registered in the profile DB630, for example, when there is a device identifier of the audio device450existing in the profile DB630, the electronic device500may change a current profile620to the relevant profile registered in the profile DB630.

When it is determined that the connected audio device450is not an audio device registered in the profile DB630, for example, when there is no device identifier of the audio device450in the profile DB630, the electronic device500may perform the hearing test640for creating a profile related to the connected audio device450.

According to an embodiment of the present disclosure, the electronic device500may provide a user interface for a hearing test through the display531and may perform the hearing test640through user interaction using the user interface. The electronic device500may reflect (e.g. convolute) a user's hearing characteristics corresponding to the frequency characteristic of the audio device450connected in response to the user input520and then store the result (e.g. a profile) of the reflection in the profile DB630. In other words, the electronic device500may store a result reflected after a user hearing test is performed according to each audio device450as a profile of each audio device450. Thereafter, when the audio device450accesses the electronic device500, the electronic device500may automatically apply a profile related to the connected audio device450to the current profile620of the current user and output audio as a frequency which reflects the user hearing characteristics related to the connected audio device450. The profile DB630may store profiles related to multiple users of the audio device450.

FIG. 7illustrates processing an audio output in an electronic device according to another embodiment of the present disclosure.

Referring toFIG. 7,FIG. 7illustrates an operation of the controller580(e.g. the audio compensation module585) when the audio device450, which is connected to the electronic device500, is an active audio device. According to various embodiments of the present disclosure, the active audio device is configured to have an internal digital circuit which may establish wireless communication (e.g. Bluetooth) with the electronic device500and may include a device identifier (e.g. ID).

As illustrated inFIG. 7, when the audio device450is connected, the electronic device500may detect a device identifier (e.g. ID) of the connected audio device450through a detector710. According to various embodiments of the present disclosure, the detector710may determine frequency information corresponding to the detected device identifier in an audio device information DB740of the electronic device500. The audio device information DB740may be implemented and used inside the audio compensation module585, or may be implemented (e.g. according toFIG. 5) and used outside (e.g. the memory550) the audio compensation module. The audio device information DB740may store a database including a device name (e.g. product name) and frequency information of the connected audio device450. Table 2 below shows an example of the audio device information DB740.

According to various embodiments of the present disclosure, the audio device information DB740may indicate a DB which stores a device identifier (e.g. ID) of the audio device450or frequency information for compensating for an audio output characteristic according to the type of device. The audio device information DB740may indicate a DB which stores a device identifier (e.g. ID) of an audio device and a unique frequency characteristic of the audio device as frequency information files, respectively, and renders the files into a database to manage the files.

The electronic device500may determine whether the frequency information of the connected audio device450corresponds to currently established frequency information. When the frequency information of the connected audio device450corresponds to the currently established frequency information, the electronic device500may create a user hearing aid profile720on the basis of the corresponding frequency information. For example, the electronic device500may combine the currently established frequency information and a user's pre-established hearing characteristics to create an optimized profile in which the frequency characteristic of the connected audio device450and the user's hearing characteristics are considered and compensated for. The electronic device500may change a current profile730to the created profile.

When the frequency information of the connected audio device450does not correspond to the currently established frequency information, the electronic device500may search for the frequency information of the audio device450from among frequency information according to each audio device registered in the audio device information DB740. The electronic device500may search for the device identifier of the audio device450in the audio device information DB740or may directly search for the corresponding frequency information.

According to various embodiments of the present disclosure, when the audio device information DB740, includes the device identifier of the audio device450and the corresponding frequency information, the electronic device500may change the currently established frequency information to the frequency information in the audio device information converter750. For example, the electronic device500may replace the currently established frequency information with frequency information of the currently connected audio device450, which is stored in the audio device information DB740. The electronic device500may create the user hearing aid profile720on the basis of the replaced frequency information. For example, the electronic device500may combine the changed frequency information and a user's pre-established hearing characteristics to create an optimized profile in which the frequency characteristic of the connected audio device450and the user's hearing characteristics are considered and compensated for. The electronic device500may change the current profile730to the created profile.

According to various embodiments of the present disclosure, when the device identifier of the audio device450and the corresponding frequency information are not in the audio device information DB740, the electronic device500may update (e.g. register) the audio device information DB740. The electronic device500may be connected to (may communicate with) a server which provides audio device information, and may receive the audio device information from the server through wireless communication (e.g. Internet and the like) to update the audio device information DB740. A user may directly input a value corresponding to the audio device information, and the electronic device500may update the audio device information DB740on the basis of the value, which is input by the user, corresponding to the audio device information. The electronic device500may directly download frequency information recorded in an audio device, which is connected through Bluetooth and the like, from the audio device to update the audio device information DB740.

FIG. 8illustrates processing an audio output in an electronic device according to another embodiment of the present disclosure.

Referring toFIG. 8,FIG. 8illustrates of an operation of the controller580(e.g. the audio compensation module585) when the audio device450, which is connected to the electronic device500, is a passive audio device. The passive audio device may establish wired communication (e.g. connector connection) with the electronic device500, may not have an internal digital circuit, and may include audio output devices having different resistances (or impedances).

As illustrated inFIG. 8, when the audio device450is connected, the electronic device500may determine the resistance of the audio device450through impedance detection in a detector810. The electronic device500may determine, on the basis of the determined resistance, frequency information related to the currently connected audio device450. According to various embodiments of the present disclosure, the frequency information related to the audio device450may be determined on the basis of a mapping table in which frequency information is mapped according to various resistances of the passive audio device. The audio device450may utilize a resistance of an existing 3-pole or 4-pole ear jack and may also utilize any one pole among 3 poles (or terminals) or 4 poles (or terminals) as a pole for transferring an ID for identification of an audio device. The audio device450having 5 poles or more may utilize any one terminal of the 5 poles as a pole for transferring an ID for identification of an audio device.

According to various embodiments of the present disclosure, the detector810may determine frequency information corresponding to the currently connected audio device450in an audio device information DB840of the electronic device500. The audio device information DB840may be implemented and used inside the audio compensation module585, or may be implemented (e.g. in the form ofFIG. 5) and used outside (e.g. the memory550) the audio compensation module. The audio device information DB840may store a database including a device name (e.g. product name) and frequency information of the connected audio device450. Table 3 below shows an example of the audio device information DB840.

According to various embodiments of the present disclosure, the audio device information DB840may indicate a DB which stores a device identifier (e.g. a resistance value) of the audio device450or frequency information for compensating for an audio output characteristic according to the type (e.g. a device name) of device. The audio device information DB840may indicate a DB which stores a device identifier (e.g. resistance value) of an audio device and a unique frequency characteristic of the audio device as frequency information files, respectively, and renders the files into a database to manage the files.

The electronic device500may determine whether the frequency information of the connected audio device450corresponds to currently established frequency information. When the frequency information of the connected audio device450corresponds to the currently established frequency information, the electronic device500may create a user hearing aid profile820on the basis of the corresponding frequency information. For example, the electronic device500may combine the currently established frequency information and a user's pre-established hearing characteristics to create an optimized profile in which the frequency characteristic of the connected audio device450and the user's hearing characteristics are considered and compensated for. The electronic device500may change a current profile830to the created profile.

When the frequency information of the connected audio device450does not correspond to the currently established frequency information, the electronic device500may provide, to the user, frequency information according to each audio device registered in the audio device information DB840. For example, the electronic device500may display a list of audio devices registered in the audio device information DB840through a user interface by using the display531. The electronic device500may receive the user input520which selects a particular audio device (e.g. a model corresponding to the currently connected audio device) from the user through the user interface. The user may select an item (e.g. device name) corresponding to the currently connected audio device450from the list provided through the user interface. In the case of a passive audio device, the user may manually select frequency information because there is no device identifier (e.g. ID). The operation of the electronic device is not limited thereto, and the electronic device may be operated to detect each resistance included in the passive audio device as a unique device identifier and then automatically select frequency information.

When the frequency information of the audio device450is selected, the electronic device500may change the currently established frequency information to the selected frequency information through an audio device information converter850. For example, the electronic device500may change the currently established frequency information to frequency information of the currently connected audio device450, which is selected from the audio device information DB840. The electronic device500may create the user hearing aid profile820on the basis of the changed frequency information. For example, the electronic device500may combine the changed frequency information and a user's pre-established hearing characteristics to create an optimized profile in which the frequency characteristic of the connected audio device450and the user's hearing characteristics are considered and compensated for. The electronic device500may change the current profile830to the created profile.

FIG. 9Aillustrates the result of a change in an audio output characteristic in an electronic device according to an embodiment of the present disclosure.

FIG. 9Billustrates the result of a change in an audio output characteristic in an electronic device according to another embodiment of the present disclosure.

Referring toFIGS. 9A and 9B, an audio device used while being connected to the electronic device500may include a wired audio device (e.g. a wired earphone, a wired headphone) and a wireless audio device (e.g. a wireless earphone, a wireless headphone). The wired audio device (e.g. a passive audio device) may have a difference in sound quality and characteristics on the basis of various resistances (e.g. 16 ohm, 32 ohm, 300 ohm, etc.). Further, the wireless audio device (e.g. an active audio device) may also show various characteristics according to the type or the manufacturer thereof. For example,FIG. 9Ashows an example of the frequency characteristic of a first audio device andFIG. 9Bshows an example of the frequency characteristic of a second audio device. In a frequency comparison in the 1 KHz band, a volume difference may be generated according to each audio device, causing a change which a user may hear.

FIG. 10Aillustrates the result of a change in an audio output characteristic in an electronic device according to another embodiment of the present disclosure.

FIG. 10Billustrates the result of a change in an audio output characteristic in an electronic device according to another embodiment of the present disclosure.

Referring toFIGS. 10A and 10B, according to various embodiments of the present disclosure, the characteristics of an audio device may be changed on the basis of a user's hearing characteristics. For example, as illustrated inFIG. 10A, it may possible to create an anti-phase frequency (dotted line) (e.g. compensation frequency) of a frequency (solid line) of a preregistered audio device and make a frequency converge to zero by multiplying a basic frequency and the compensation frequency. Thereafter, new frequency information may be created through multiplying the frequency information of the connected audio device by the created frequency information and mapping and storing the result as a characteristic of the audio device. In other words, the frequency characteristic of the audio device may be changed in consideration of the user's hearing characteristics. Therefore, the user may configure sound quality optimized to the user's hearing characteristics according to each audio device, and, when the user makes a call or listens to audio of music or video while an audio device is connected, the user may listen to audio having an optimized sound quality.

According to various embodiments of the present disclosure, an electronic device may include a user interface, a wired or wireless interface configured to establish a connection to an audio device, a memory, and one or more processors that are electrically connected to the user interface, the memory, and the wired or wireless interface, wherein the memory, at the time of execution, stores instructions that instruct the one or more processors to, acquire identification information and/or characteristics of the audio device, at least partially based on the connection to the audio device, select pre-stored audio adaptation information, at least partially based on the acquired information and/or characteristics, change an audio signal, at least partially based on the audio adaptation information, and transmit the changed audio signal to the audio device.

According to various embodiments of the present disclosure, the electronic device store instructions which may include instructing the processors to wireless receive the identification information of the audio device from the audio device. The instructions may include instructing the processors to acquire an impedance characteristic of the audio device and/or audio device information to determine the characteristics of the audio device, when the audio device is connected to the wired interface. The instructions may include instructing the processors to provide a selected audio to the audio device after a connection to the audio device, receive a user response to the audio through the user interface, and create the audio adaptation information, at least partially based on the received response.

As described above, according to various embodiments of the present disclosure, the electronic device includes a communication interface configured to establish a connection to an audio device, a memory, and one or more processors that are electrically connected to the memory and the communication interface, wherein the one or more processors perform determining audio adaptation information related to the audio device in response to the audio device connection, correcting an audio output corresponding to the audio device on the basis of the audio adaptation information when the audio adaption information has been registered, and updating, when the audio adaption information has not been registered, the audio adaptation information related to the audio device and correcting an audio output corresponding to the characteristics of the audio device on the basis of the updated audio adaptation information.

According to various embodiments of the present disclosure, an electronic device includes a wired or wireless interface configured to establish a connection to an audio device, a memory, and one or more processors that are electrically connected to the memory and the wired or wireless interface, wherein the memory, at the time of execution, stores instructions that instruct the one or more processors to, establish audio adaptation information on the basis of a frequency characteristic of the audio device and a user's hearing characteristics, detect a connection of the audio device, determine audio adaptation information related to a connected audio device, convert a currently established audio output characteristic to an audio output characteristic corresponding to the connected audio device on the basis of the determined audio adaptation information, and process an audio output on the basis of the converted audio output characteristic.

According to various embodiments of the present disclosure, the audio adaptation information may be configured to include a profile for compensating for an audio output characteristic according to each audio device, or frequency information of the audio device. The memory may be configured to include a profile DB which stores device information of the audio device and a profile, and an audio device information DB which stores device information and frequency information of the audio device.

According to various embodiments of the present disclosure, the one or more processors may be configured to combine a unique frequency characteristic of the audio device and a user's hearing characteristics to establish audio adaption information.

According to various embodiments of the present disclosure, the one or more processors may be configured to determine whether to perform, in response to the detection of the audio device connection, a hearing test or perform audio output characteristic conversion based on pre-established audio adaptation information.

According to various embodiments of the present disclosure, the one or more processors may be configured to provide a user interface when determining to perform the hearing test, perform a hearing test which combines the frequency characteristic of a connected audio device and a user's hearing characteristics according to an interaction with the user based on the user interface, and create a profile related to the connected audio device on the basis of the result of the hearing test. The one or more processors may be configured to convert a currently established profile to the created profile.

According to various embodiments of the present disclosure, the one or more processors may be configured to determine the frequency information of a connected audio device in response to the audio device connection, combine currently established frequency information and a user's hearing characteristics when the frequency information of the audio device corresponds to the currently established frequency information, automatically search for the frequency information of the connected audio device in the audio device information DB when the frequency information of the audio device does not correspond to the currently established frequency information, convert the currently established frequency information to the stored frequency information; and combine the converted frequency information and the user's hearing characteristics.

According to various embodiments of the present disclosure, the one or more processors may be configured to provide a list of audio devices with reference to the audio device information DB when the frequency information of the audio device does not correspond to the currently established frequency information, and convert the currently established frequency information to frequency information manually selected by the user on the basis of the list.

According to various embodiments of the present disclosure, the one or more processors may be configured to create a profile by the combination of the converted frequency information and the user's hearing characteristics and convert a current profile currently established in the electronic device to the created profile.

According to various embodiments of the present disclosure, the one or more processors may be configured to perform detecting an audio device connection, determining audio adaptation information related to the audio device in response to the audio device connection, correcting an audio output corresponding to the audio device on the basis of the audio adaptation information when the audio adaption information has been registered, updating the audio adaptation information related to the audio device when the audio adaption information has not been registered, and correcting an audio output corresponding to a characteristic of the audio device on the basis of the updated audio adaptation information.

According to various embodiments of the present disclosure, the one or more processors, at the time of updating, may be configured to perform providing a user interface when determining to perform the hearing test, carrying out the hearing test which combines the characteristics of a connected audio device and a user's hearing characteristics according to an interaction with the user based on the user interface, and creating a profile related to the connected audio device on the basis of the result of the hearing test.

According to various embodiments of the present disclosure, the one or more processors, at the time of updating, may be configured to perform determining the frequency information of a connected audio device in response to an audio device connection, combining currently established frequency information and a user's hearing characteristics when the frequency information of the audio device corresponds to the currently established frequency information, automatically searching for frequency information of the connected audio device in the audio device information DB when the frequency information of the audio device does not correspond to the currently established frequency information, converting the currently established frequency information to the stored frequency information; and combining the converted frequency information and the user's hearing characteristics.

According to various embodiments of the present disclosure, the one or more processors, at the time of updating, may be configured to perform providing a list of audio devices with reference to the audio device information DB when the frequency information of the audio device does not correspond to the currently established frequency information, converting the currently established frequency information to frequency information manually selected by the user on the basis of the list, and combining the converted frequency information and the user's hearing characteristics.

According to various embodiments of the present disclosure, the one or more processors may be configured to perform creating a profile by the combination of the converted frequency information and the user's hearing characteristics and converting a current profile currently established in the electronic device to the created profile, and converting and outputting audio on the basis of the characteristics of the converted profile.

FIG. 11is a flowchart illustrating a method for outputting audio in an electronic device according to various embodiments of the present disclosure.

Referring toFIG. 11, in step1101, the controller580establishes audio compensation information on the basis of the characteristics (e.g. frequency characteristic) of an audio device and a user's hearing characteristics. For example, the user may perform compensation (e.g. hearing test for a connected audio device) according to a user's hearing characteristics with respect to various audio devices by using the electronic device500, and the electronic device500may create audio compensation information (e.g. a profile) related to the audio device on the basis of the result of the hearing test. The audio compensation information according to each audio device may be managed as a DB, as described above.

In step1103, the controller580detects the connection of the audio device. For example, the user may connect an audio device, to the electronic device500. On the basis of the type of audio device, the user may connect the audio device to the electronic device500through wireless communication (e.g. Bluetooth) or may connect the audio device to the electronic device500through wired communication (e.g. connector).

In step1105, the controller580changes an audio output characteristic to correspond to the audio device on the basis of pre-established audio compensation information corresponding to the audio device. The controller580may change a currently established audio output characteristic (e.g. a current profile) to an audio output characteristic corresponding to the connected audio device in response to the detection of the audio device connection.

In step1107, the controller580outputs audio on the basis of the changed audio output characteristic and transfers the output audio to the connected audio device.

FIG. 12is a flowchart illustrating a method for correcting an audio output in an electronic device according to various embodiments of the present disclosure.

Referring toFIG. 12, in step1201, the controller580may detect the connection of an audio device.

In step1203, the controller580determines audio compensation information related to a connected audio device. For example, the controller580may determine whether there is audio compensation information (e.g. a profile, frequency information) related to the connected audio device in a pre-established DB (e.g. a profile DB, an audio device information DB).

When the controller580determines, in step1203, that there is audio compensation information related to the audio device, the controller580performs, in step1211, audio output correction corresponding to a currently connected audio device by using the audio compensation information.

When the controller580does not determine, in step1203, that there is audio compensation information related to the audio device, the controller580determines, in step1221, whether to update the audio compensation information related to the connected audio device and provide a guide for the updating. For example, the controller580may determine whether audio is established, and may output a relevant user interface in response to a user selection (e.g. approval/rejection). Step1221may be excluded and the method may immediately proceed to step1223to perform updating, depending on the setting of the electronic device500.

In step1223, the controller580updates the audio compensation information related to the audio device. For example, the controller580may output a user interface, as inFIG. 17described below, and may perform a hearing test in response to a user input, which is input through the user interface, and determine the result (e.g. audio compensation information) of the hearing test.

In step1225, the controller580registers information (e.g. device information, device identifier) on a currently connected audio device and the audio compensation information. For example, the controller580may update the information on the audio device and relevant audio compensation information in a pre-established DB.

In step1227, the controller580performs audio output correction corresponding to the currently connected audio device by using the audio compensation information.

FIG. 13is a flowchart illustrating processing an audio output in an electronic device according to various embodiments of the present disclosure.

Referring toFIG. 13, in step1301, the controller580detects the connection of an audio device.

In steps1303and1305, the controller580identifies an audio device and determines whether a currently connected audio device corresponds to a pre-registered audio device. For example, the controller580may detect a device identifier (e.g. ID, resistance value) of the connected audio device in response to the detection of the audio device connection, and may determine whether the detected device identifier is registered in the pre-established DB.

When the controller580determines, in step1305, that the connected audio device is a registered audio device (“Yes” in step1305), the controller580determines, in step1307, audio compensation information corresponding to the audio device.

In step1309, the controller580converts an audio output characteristic related to the currently connected audio device on the basis of audio compensation information according to the result of the determination.

When the controller580determines, in step1305, that the connected audio device is an unregistered audio device (“No” in step1305), the controller580determines the type of connected audio device in step1311. For example, the controller580may determine whether the connected audio device is an active audio device or a passive audio device. In addition, the controller580may determine whether the connected audio device is wirelessly connected or is wired connected. Further, when it is determined that the connected audio device is an active audio device, the controller580may determine whether the device identifier (e.g. ID) of the audio device is registered in a profile DB or the device information (e.g. frequency information) of the audio device is registered in an audio device information DB.

In step1313, the controller580determines an updating mode corresponding to the determined type of audio device and performs the determined updating mode. The controller580may provide a user interface for a hearing test, as inFIG. 17described below, and may perform the updating mode, such as performing the hearing test by interaction with a user based on the user interface. Further, the controller580may search the audio device information DB for frequency information of the currently connected audio device, and may perform the updating mode, such as combining a user's hearing characteristics with the stored frequency information.

According to various embodiments of the present disclosure, when the device identifier of the audio device and the corresponding frequency information are not in the audio device information DB, the controller580may update (e.g. register) the audio device information DB. The controller580may be connected to (may communicate with) a server which provides audio device information, and may receive the audio device information from the server through wireless communication (e.g. Internet and the like) to update the audio device information DB. The user may directly input a value corresponding to the audio device information, and the controller580may update the audio device information DB on the basis of the value, which is input by the user, corresponding to the audio device information. The controller580may directly download frequency information recorded in an audio device, which is connected through Bluetooth and the like, from the audio device to update the audio device information DB.

In step1315, the controller580creates audio compensation information on the basis of the result of performing the updating mode and registers the created audio compensation information.

In step1317, the controller580converts an audio output characteristic related to the current connected audio device on the basis of the created audio compensation information.

In step1319, the controller580processes an audio output on the basis of the audio output characteristic converted in step1309or step1317.

FIG. 14is a flowchart illustrating a method for creating audio compensation information in an electronic device according to various embodiments of the present disclosure.

Referring toFIG. 14,FIG. 14illustrates an example of performing an updating mode on the basis of a hearing test.

In step1401, when an audio device is connected, the controller580detects an ID of the connected audio device. For example, a user may operate an active audio device, such as a Bluetooth headphone, to be connected to the electronic device500through Bluetooth communication. When detecting the audio device connection through the Bluetooth communication, the controller580may confirm a device identifier which is provided from the audio device at the time of establishing Bluetooth communication connection (e.g. a pairing process).

In step1403, the controller580determines whether the ID of the connected audio device is registered in a pre-established profile DB. For example, the controller580may determine whether the ID of the audio device is registered in a profile DB of the electronic device500, such as the above-described Table 1.

When it is determined, in step1403, that the ID of the audio device is registered in the profile DB (“Yes” in step1403), the controller580changes, in step1411, a currently established profile by using a profile registered in the profile DB, as described above, without performing an update.

When it is not determined in step1403that the ID of the audio device is registered in the profile DB, the controller580performs, in step1405, a hearing test for testing a user's hearing. For example, when an ID corresponding to the connected audio device is not found in the profile DB, the controller580performs the update. When performing the update, the controller580may provide a user interface, as shown inFIG. 17described below, and may perform a hearing test through interaction with the user on the basis of the user interface. The user may be wearing an audio device connected to the electronic device500(e.g. wearing a Bluetooth headphone or headset).

In step1407, the controller580determines the result of the user's hearing test related to the audio device. For example, the controller580may determine the user's hearing characteristics related to the currently connected audio device, and may create a profile corresponding to the determined hearing characteristics.

In step1409, the controller580updates the profile DB on the basis of the result of the hearing test. The controller580may additionally register, in the profile DB, an ID of the connected audio device and a profile in which the user's hearing characteristics are considered with respect to the corresponding audio device. For example, the profile DB, such as shown in Table 1, may be updated by adding the ID of the audio device and the profile to the profile DB.

In step1411, the controller580changes the currently established profile by using a profile registered in the profile DB.

FIG. 15is a flowchart illustrating a method for creating audio compensation information in an electronic device according to various embodiments of the present disclosure.

Referring toFIG. 15,FIG. 15illustrates an example of automatically performing an update on the basis of device information (e.g. frequency information) of an audio device.

In step1501, when an audio device is connected, the controller580detects an ID of the connected audio device. For example, a user may operate an active audio device, such as a Bluetooth headphone, connected to the electronic device500through Bluetooth communication. When it is detected that the audio device has been connected through Bluetooth communication, the controller580may confirm a device identifier and device information (e.g. frequency information), which are provided from the audio device at the time of establishing Bluetooth communication connection (e.g. a pairing process).

In step1503, the controller580determines whether the device information (e.g. frequency information) of the connected audio device corresponds to the currently established device information. The controller580may determine whether the device information of the connected audio device matches the device information currently established in the electronic device500.

When it is determined, in step1503, that the device information of the audio device corresponds to the currently established device information (“Yes” in step1503), the controller580changes, in steps1509and1511, a current profile by using the currently established device information, as described above, without performing an update. The controller580may combine, in step1509, frequency information of an audio device, which is connected to the electronic device, and a user's pre-established hearing characteristics by a method such as convolution to create a profile, and may change, in step1511, a currently established profile by using the created profile. A profile, in which the frequency information of the audio device and the user's hearing characteristics are combined by a method such as convolution, may be registered in advance, or may be created in real time, as illustrated inFIG. 17.

According to various embodiments of the present disclosure, a convolution method for creating a profile may be implemented, and will be described below with reference toFIGS. 18, 19, and 20.

FIG. 18Aillustrates a convolution method for creating a profile in an electronic device according to an embodiment of the present disclosure.

FIG. 18Billustrates a convolution method for creating a profile in an electronic device according to another embodiment of the present disclosure.

FIG. 18Cillustrates a convolution method for creating a profile in an electronic device according to another embodiment of the present disclosure.

Referring toFIGS. 18A to 18C, the convolution is a method for analyzing a signal in a time domain. For example, in the case where one signal (frequency information) has a relative time change with reference to another signal (e.g. hearing characteristics), the convolution may indicate a signal (e.g. profile) calculated through integration. Examples of such a convolution are shown in Equation (1) and Equation (2) below.
y(t)=x(t)*h(t)=∫−∝+∝x(τ)h(t−τ)dτEquation (1)
x(t)*h(t)=X(w)×H(w)  Equation (2)

In Equation (1), when h(t) is a signal which represents an operation of a system, y(t) may represent a state in which a signal passed through the system is changed. y(t) may refer to a process of synthesizing (combining) two different signals. For example, a convolutional integration of a time domain is converted via Fourier transform (FT) or fast Fourier transform (FFT) into a frequency domain as shown in Equation (1) and a value may be calculated through a multiplication calculation as shown in Equation (2). In Equations (1) and (2), the symbol “*” may indicate a convolution calculation and the symbol “×” may indicate a multiplication calculation.

According to an embodiment of the present disclosure, in a convolution method, various signals are convoluted to analyze a signal in the time domain. For example, referring toFIGS. 18A to 18C, when two signals (e.g. x(t), h(t)) are completely overlapped as in the graph ofFIG. 18Aand the graph ofFIG. 18B, a signal as in the graph ofFIG. 18Cmay be output. For example, a cycle is changed to be twice as long (2w) and a triangular wave signal, a peak (or maximum value, peak value, which is a value of a signal when the signal is maximized) of which is “1”, may be created.

FIG. 19illustrates a convolution method for creating a profile in an electronic device according to another embodiment of the present disclosure.

FIG. 20illustrates a convolution method for creating a profile in an electronic device according to another embodiment of the present disclosure.

According to an embodiment of the present disclosure, as illustrated inFIG. 19, a square wave may be used as an input signal. When a Fourier transform is performed on the square wave on a time axis, the square wave may be represented as a Sinc (sinus cardinalis (cardinal sine)) signal (function) on the frequency axis. For example, a shape may be shown on the frequency axis according to a Fourier transform on a triangular wave. In other words, multiplication on the time axis may indicate a convolution on the frequency axis, and multiplication on the frequency axis may indicate a convolution on the time axis. In other words, multiplication and convolution may have a relation of duality (e.g. principle of duality) between them. Referring toFIG. 20, a convolution of two square waves on the time axis is shown as a triangular wave on the time axis. This may indicate that an area overlapping when one figure is symmetrical about the “y” axis is expressed as a value. Further, the convolution may be shown as Sinc2(square of Sinc) on the frequency axis.

Referring toFIG. 19again, when the device information (e.g. frequency information) of the audio device does not correspond to the currently established device information in step1503(“No” in step1503), the controller580may automatically search for device information in step1505. For example, the controller580may search for device information of a connected audio device in the audio device information DB, such as in Table 2. According to various embodiments of the present disclosure, when the device information of the connected audio device is not stored in the audio device information DB, the device information of the connected audio device may be replaced with the currently established device information or device information established as a default. Further, when the device information of the connected audio device is not stored in the audio device information DB, the controller580may be connected to another external electronic device (e.g. an external server for managing device information according to each audio device) to acquire the device information. The controller580may map an ID of the connected audio device and the acquired device information to update the audio device information DB. For example, the controller580may additionally store the ID of the audio device and the acquired frequency information in the audio device information DB, such as in Table 2.

In step1507, the controller580may change the currently established device information by using the stored device information. For example, the controller580may establish the stored device information as current device information of the electronic device500.

In step1509, the controller580may combine the device information and the user's pre-established hearing characteristics by such a method as convolution. According to an embodiment of the present disclosure, the controller580may combine frequency information and the user's hearing characteristics by such a method as convolution to create a profile.

In step1511, the controller580may change a current profile on the basis of a profile in which device information and hearing characteristics are considered and compensated for.

FIG. 16is a flowchart illustrating creating audio compensation information in an electronic device according to various embodiments of the present disclosure.

Referring toFIG. 16,FIG. 16illustrates an example of manually performing an updating mode on the basis of device information (e.g. frequency information) of an audio device in various embodiments.

In step1601, the controller580detects the connection of a wired audio device. For example, the user may connect a passive audio device, such as a wired earphone, through an interface (e.g. connector) of the electronic device500. When detecting the connection of the audio device through the interface, the controller580may detect the corresponding resistance information (e.g. resistance values, such as 16 ohm, 32 ohm, 300 ohm) in response to resistance configured in the audio device. According to various embodiments of the present disclosure, when detecting the connection of the wired audio device, the controller580may determine the resistance of each audio device by using impedance detection, and may determine device information (e.g. frequency information) related to the corresponding audio device on the basis of the determined resistance. Device information of each passive audio device may be determined on the basis of a mapping table in which device information is mapped according to various resistances of the passive audio device.

In step1603, the controller580determines whether the device information (e.g. frequency information) of the connected audio device corresponds to the currently established device information. According to an embodiment of the present disclosure, the controller580may determine whether the device information of the currently connected audio device matches the device information currently established in the electronic device500.

When it is determined, in step1603, that the device information of the audio device corresponds to the currently established device information (“Yes” in step1603), the controller580changes, in steps1609and1611, a profile by using the currently established device information, as described above, without performing an update. According to an embodiment of the present disclosure, the controller580combines, in step1609, frequency information of an audio device, which is connected to the electronic device, and a user's pre-established hearing characteristics by a method such as convolution to create a profile, and changes, in step1611, a currently established profile by using the created profile. A profile, in which the frequency information of the audio device and the user's hearing characteristics are combined by a method such as convolution, may be registered in advance, or may be created in real time, as illustrated inFIG. 16. The convolution method as described with respect toFIGS. 18A, 18B, 18C, 19, and 20in the above-describedFIG. 15may be used.

When the device information (e.g. frequency information) of the audio device does not correspond to the currently established device information in step1603(“No” in step1603), the controller580manually selects device information in step1605. For example, the controller580may display, through a user interface, a list of device information corresponding to an audio device information DB, such as in Table 3, and may receive selection of particular device information from a user through the user interface. According to an embodiment of the present disclosure, the user may select device information corresponding to a wired earphone connected to the electronic device500in the user interface of the electronic device500, while wearing the wired earphone. The user may select, on the basis of a device name (e.g. product name), the device information corresponding to the connected audio device in the user interface.

In step1607, the controller580changes the currently established device information by using the selected device information. For example, the controller580may establish the selected device information as current device information of the electronic device500.

In step1609, the controller580combines the changed established device information and the user's pre-established hearing characteristics by a method such as convolution. According to an embodiment of the present disclosure, the controller580may combine frequency information and the user's hearing characteristics by a method such as convolution to create a profile.

In step1611, the controller580changes a current profile on the basis of a profile in which device information and hearing characteristics are considered and compensated for.

FIG. 17Aillustrates a user interface for establishing an audio output in an electronic device according to an embodiment of the present disclosure;

FIG. 17Billustrates a user interface for establishing an audio output in an electronic device according to another embodiment of the present disclosure;

Referring toFIGS. 17A and 17B,FIGS. 17A and 17Billustrate, in various embodiments, an example of a user interface for a hearing test for applying a user's hearing characteristics to an audio device connected to the electronic device500. Examples ofFIGS. 17A and 17Bmay be to show screenshots in which the hearing test is completed, a profile related to the corresponding audio device is registered in a profile DB, and the result of the registration is provided in response to a user selection or the detection of the audio device connection.

As illustrated inFIGS. 17A and 17B, the user interface includes a configuration area1710that may configure sound quality optimized to a user's ears and configure (e.g. turn on/turn off) whether to use a function of outputting audio (e.g. adapt sound function), a first information area1720that provides an optimized sound quality state to an audio device through a hearing test, a function selection area1730including a button (e.g. RETRY button) for reconfiguring sound quality optimized to the audio device (e.g. performing the hearing test again) and a button (e.g. PREVIEW button) for previewing audio which is output on the basis of currently configured optimized sound quality (e.g. profile), a second information area1740that provides configured information in a direction (side) which is frequently used by the user, and a notification window1750or1760that provides information on an audio device currently connected to the electronic device500.

According to various embodiments of the present disclosure, the notification window1750or1760may be provided when the audio device is connected, and may provide information corresponding to the connected audio device. For example,FIG. 17Aillustrates a case in which an active audio device (e.g. Bluetooth headphone) is connected and information thereon (e.g. Samsung Premium Headset) is provided through the notification window1750.FIG. 17Billustrates a case in which a passive audio device (e.g. wired earphone) is connected and information thereon (e.g. earphone) is provided through the notification window1760. The notification windows1750and1760may provide information on a currently connected audio device in the form of a pop-up window.

According to various embodiments of the present disclosure, an operation method of an electronic device includes detecting a connection to an audio device, acquiring identification information and/or characteristics of the audio device, at least partially based on the connection to the audio device, selecting pre-stored audio adaptation information, at least partially based on the acquired information and/or characteristics, changing an audio signal, at least partially based on the audio adaptation information, and transmitting the changed audio signal to the audio device.

According to various embodiments of the present disclosure, the operation method further includes wirelessly receiving the identification information of the audio device from the audio device. The operation method further includes acquiring an impedance characteristic of the audio device and/or audio device information and determining the characteristics of the audio device, when the audio device is connected through the wired interface. The operation method further includes providing a selected audio to the audio device after a connection to the audio device, receiving a user response to the audio through the user interface, and creating the audio adaptation information, at least partially based on the received response.

An operation method of an electronic device, according to various embodiments of the present disclosure, include detecting a connection to an audio device, determining audio adaptation information related to the audio device in response to the connection of the audio device, correcting an audio output corresponding to the audio device on the basis of the audio adaptation information when the audio adaption information has been registered, updating the audio adaptation information related to the audio device when the audio adaption information has not been registered, and correcting an audio output corresponding to a characteristic of the audio device on the basis of the updated audio adaptation information.

According to various embodiments of the present disclosure, the audio adaptation information includes a profile for compensating for an audio output characteristic according to each audio device, or frequency information of the audio device.

According to various embodiments of the present disclosure, the updating of the audio adaptation information of the electronic device includes combining a unique frequency characteristic of the audio device and a user's hearing characteristics by a method such as convolution to update the audio adaptation information.

According to various embodiments of the present disclosure, the updating of the audio adaptation information of the electronic device includes providing a user interface when determining to perform the hearing test, performing a hearing test which combines the frequency characteristic of a connected audio device and a user's hearing characteristics by a method such as convolution according to an interaction with the user based on the user interface, and creating a profile related to the connected audio device on the basis of the result of the hearing test. The operation method of the electronic device further includes converting a current profile currently established in the electronic device to the created profile, and converting and outputting audio characteristics on the basis of the converted profile.

According to various embodiments of the present disclosure, the determining of the audio adaptation information of the electronic device includes determining whether to perform, in response to the detection of the audio device connection, a hearing test or perform audio output characteristic conversion based on pre-established audio adaptation information.

According to various embodiments of the present disclosure, the updating of the audio adaptation information of the electronic device includes determining the frequency information of a connected audio device in response to the audio device connection, combining currently established frequency information and a user's hearing characteristics by a method such as convolution when the frequency information of the audio device corresponds to the currently established frequency information, automatically searching for the frequency information of the connected audio device in an audio device information DB when the frequency information of the audio device does not correspond to the currently established frequency information, converting the currently established frequency information to the stored frequency information, and combining the converted frequency information and the user's hearing characteristics by a method such as convolution.

According to various embodiments of the present disclosure, the updating of the audio adaptation information of the electronic device includes providing a list of audio devices with reference to the audio device information DB when the frequency information of the audio device does not correspond to the currently established frequency information, converting the currently established frequency information to frequency information manually selected by the user on the basis of the list, and combining the converted frequency information and the user's hearing characteristics by a method such as convolution. The operation method of the electronic device includes creating a profile by a combination through a method such as convolution and converting a current profile established in the electronic device to the created profile, and converting and outputting audio characteristics on the basis of the converted profile.

According to various embodiments of the present disclosure, the electronic device includes a wired or wireless interface configured to establish a connection to an audio device, a memory, and one or more processors electrically connected to the memory and the wired or wireless interface. The memory includes a profile DB which stores device information of the audio device and a profiles and an audio device information DB which stores the device information and frequency information of the audio device.

According to various embodiments of the present disclosure, an operation method of an electronic device may be configured such that the one or more processors performs establishing audio adaptation information on the basis of a frequency characteristic of an audio device and a user's hearing characteristics, detecting a connection to the audio device, determining audio adaptation information related to a connected audio device, converting a currently established audio output characteristic to an audio output characteristic corresponding to the connected audio device on the basis of the determined audio adaptation information, and processing an audio output on the basis of the converted audio output characteristic.

In order to solve the above-described technical problem, a method and apparatus for outputting audio in an electronic device according to various embodiments of the present disclosure may reflect a user's hearing characteristics according to each audio device to automatically compensate for the user's hearing characteristics and provide an output audio. A user may listen to audio optimized on the basis of the characteristics of an audio device and the user's hearing characteristics. Therefore, the user may listen to audio which has better sound quality and volume.

The embodiments of the present disclosure disclosed herein and shown in the drawings are examples presented in order to describe technical details of the present disclosure and to help the understanding of the present disclosure, but do not limit the scope of the present disclosure. Therefore, it should be construed that, in addition to the embodiments disclosed herein, all modifications and changes or modified and changed forms derived from the technical idea of the present disclosure fall within the scope of the present disclosure as defined by the appended claims and their equivalents.