Patent ID: 12219235

DETAILED DESCRIPTION OF ILLUSTRATIVE EMBODIMENTS

The term “a plurality of” in this specification means two or more. The term “and/or” in this specification describes only an association relationship for describing associated objects and represents that three relationships may exist. For example, A and/or B may represent the following three cases: A alone, both A and B, and B alone. In addition, the character “/” in this specification generally indicates that there is an “or” relationship between associated objects; and in a formula, the character “/” indicates that there is a “division” relationship between associated objects.

It can be understood that numbers in the embodiments of this application are merely used for differentiation for ease of description, and are not intended to limit the scope of the embodiments of this application.

It can be understood that, in the embodiments of this application, sequence numbers of the foregoing processes do not mean an execution sequence. The execution sequence of the processes should be determined based on functions and internal logic of the processes, and should not constitute any limitation on the implementation processes in the embodiments of this application.

With the development of terminal technologies, functional requirements of users for electronic devices are becoming increasingly diversified. To satisfy shooting requirements of the users, a relatively large quantity of electronic devices support a shooting function. In addition, with the improvement of shooting capabilities of electronic devices, the electronic devices have become an important tool for people to shoot photographs or videos.

During shooting, a user may trigger a shooting or recording function of an electronic device. The electronic device acquires image or video data by using a camera and further performs image or video optimization by using a preprocessing chip. For example, the electronic device may perform an optimization operation such as light filling, beautifying, or deburring on the image or video data by using the preprocessing chip. The preprocessing chip includes, for example, an image signal processor (image signal processor, ISP) integrated circuit (integrated circuit, IC).

In a possible implementation, the preprocessing chip is disposed in a main board (main board) of the electronic device, and the camera is disposed in a camera module (camera module). Image or video data acquired in the camera module may be transmitted to the preprocessing chip in the main board. The preprocessing chip further processes the image or video data.

For example,FIG.1is a schematic diagram of a structure in which a camera module is connected to a main board.

As shown inFIG.1, the camera module110is connected to the main board120via a flexible printed circuit (flexible printed circuit, FPC)130. The camera module110includes an image sensor (image sensor)11and a board-to-board connector (board to board connectors, BTB)112, and the image sensor may also be referred to as a camera. The main board120includes an ISP IC121, a system on chip (system on chip, SOC)122, a BTB123, a switch SW1, and a switch SW2.

Two ends of the FPC130may be respectively inserted into the BTB112and the BTB123. The SW1and the SW2each may be a single pole double throw switch. After image or video data acquired by the image sensor111is transmitted to the main board through the FPC130, based on selection of the SW1and the SW2, the image or video data may be directly transmitted to the SOC122through a path1; or the image or video data may be processed by the ISP IC121in a path2and then processed image or video data may be transmitted to the SOC122.

For example, if an electronic device performs image preview, video recording without beautification, or other steps, the electronic device may control the SW1and SW2to enable the path1to be connected, so that the image or video data acquired by the image sensor111is transmitted to the main board through the FPC130, and then directly transmitted to the SOC122through the path1. If the electronic device performs shooting, video recording with beautification, or other steps, the electronic device may control the SW1and the SW2to enable the path2to be connected, so that the image or video data acquired by the image sensor111is transmitted to the main board through the FPC130and processed by using the ISP IC121in the path2, and then processed image or video data is transmitted to the SOC122.

However, in the electronic device, process complexity of the main board is usually relatively high, and costs of the main board are also relatively high. For example, the main board may include approximately twelve layers of plates, there are a relatively large quantity of devices at each layer, and a circuit layout is relatively complex. The ISP IC, the SW1, and the SW2are disposed in the main board. This not only increases an area of the main board and costs of the main board, but also increases circuit complexity of the main board, putting forward a higher requirement on a manufacturing process of the main board. As a result, the costs of the main board are further increased.

Based on this, in this embodiment of this application, the ISP IC is disposed in the camera module, and some or both of the SW1and the SW2are also disposed in the camera module. Process complexity of the camera module is low, costs of the camera module are relatively low. For example, the camera module may include approximately six layers of plates, there are a relatively small quantity of devices at each layer, and a circuit layout is relatively simple. In addition, there may usually be a vacant region in the camera module. Therefore, a manufacturing process of the camera module is not excessively difficult when the ISP IC is disposed in the camera module and some or both of the SW1and the SW2are also disposed in the camera module. In addition, in a specific implementation, the ISP IC, the SW1, and/or the SW2may alternatively be disposed in the vacant region of the camera module. In this way, a quantity of devices can be increased without increasing an area of the camera module.

Therefore, compared with the implementation in which the ISP IC, the SW1, and the SW2are disposed in the main board, the implementation in which the ISP IC and the SW1and/or the SW2are disposed in the camera module can reduce costs and reduce an area of the main board. In addition, by making the ISP IC and the switch devices integrated in the camera module, decoupling between the camera module and the main board can be implemented. In this way, the camera module can be applied to a universal main board, and main boards of a same type can be compatible with an ordinary camera module and a camera module with a preprocessing chip switching path, thereby improving universality of the main board.

Further, during assembly of the electronic device, a metal shield may be added around the camera module, so that a probability that a signal acquired by the camera is interfered with can be reduced. The metal shield may be a closed region defined by metal. For example, the metal shield around the camera module may be a metal sheet disposed around the camera module. It can be understood that the closed region defined by the metal may be similar to an uncapped region of a fence, or may be a fully closed region. This is not specifically limited in this embodiment of this application.

For example,FIG.2is a schematic diagram of a structure of an electronic device according to an embodiment of this application.

As shown inFIG.2, the electronic device200may include a system on chip (system on chip, SOC)201, a master power management unit (master power management unit, master PMU) IC202, a charging chip203, a universal serial bus (universal serial bus, USB) connector (connector)204, a power on button (power on key)206, a battery (battery)207, a slave PMU IC (slave PMU IC)208, a front camera (front camera)209, a rear camera (rear camera)210, an ISP IC205, a rear camera211, a rear camera212, a modem (modem)213, a radio frequency (radio frequency, RF) IC214, an antenna (antenna)215, a low power memory (low power double data rate, LPDDR)216, a universal flash storage (universal flash storage, UFS)217, a touch panel (touch panel)/liquid crystal display (liquid crystal display, LCD) module218, a fingerprint module (fingerprint module)219, an audio codec (audio codec)220, a sensor (sensor)221, a motor (motor)222, a speaker (speaker)223, a microphone (MIC)224, and a receiver (receiver)225.

It should be noted that the ISP IC205and the rear camera210in this embodiment of this application may be integrated in a camera module. In this way, costs can be reduced, and an area of a main board can be reduced. It can be understood that some or all of the front camera209, the rear camera211, and the rear camera212may be respectively integrated with corresponding ISP ICs in their respective camera modules (not shown in the figure). A quantity of cameras and specific forms of the camera modules are not limited in this embodiment of this application.

It can be understood that the structure illustrated in this embodiment of this application does not constitute a specific limitation on the electronic device200. In some other embodiments of this application, the electronic device200may include more or fewer components than those shown in the figure, a combination of some components, splitting of some components, or components in different arrangements. The components shown in the figure may be implemented by using hardware, software, or a combination of software and hardware.

The SOC201may be a processor, and the SOC201may include one or more processing units. For example, the SOC201may include an application processor (application processor, AP), a modem213, a graphics processing unit (graphics processing unit, GPU), a controller, a video codec, a digital signal processor (digital signal processor, DSP), a baseband processor, and/or a neural-network processing unit (neural-network processing unit, NPU). Different processing units may be separate devices or may be integrated in one or more processors.

The SOC201may be provided with a controller. The controller may generate an operation control signal based on instruction operation code and a timing signal, to complete control of instruction fetching and execution.

The SOC201may be further provided with a memory configured to store instructions and data. In some embodiments, the memory in the SOC201is a cache. The memory may store instructions or data just used or repeatedly used by the SOC201. If the SOC201needs to use the instructions or data again, the SOC201may directly invoke the instructions or data from the memory. This avoids repeated access and reduces waiting time of the SOC201, thereby improving system efficiency.

In some embodiments, the SOC201may include one or more interfaces. The interface may include an inter-integrated circuit (inter-integrated circuit, I2C) interface, an inter-integrated circuit sound (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal asynchronous receiver/transmitter (universal asynchronous receiver/transmitter, UART) interface, a mobile industry processor interface (mobile industry processor interface, MIPI), a general-purpose input/output (general-purpose input/output, GPIO) interface, a subscriber identity module (subscriber identity module, SIM) interface, and/or the like.

The I2C interface is a bidirectional synchronous serial bus and includes a serial data line SDA and a serial clock line (serial clock line, SCL). In some embodiments, the SOC201may include a plurality of groups of I2C buses. The SOC201may be coupled to a touch sensor, a charger, a flash, a camera, and the like through different I2C bus interfaces. For example, the SOC201may be coupled to the touch sensor through the I2C interface, so that the SOC201communicates with the touch sensor through the I2C bus interface to implement a touch function of the electronic device200.

The I2S interface may be configured to perform audio communication. In some embodiments, the SOC201may include a plurality of groups of I2S buses. The SOC201may be coupled to the audio codec220through an I2S bus to implement communication between the SOC201and the audio codec220. In some embodiments, the audio codec220may transmit an audio signal to a wireless communication module through the I2S interface, so as to implement a function of answering calls through a Bluetooth earphone.

The PCM interface may also be configured to perform audio communication to sample, quantize, and encode an analog signal. In some embodiments, the audio codec220may be coupled to the wireless communication module through a PCM bus interface. In some embodiments, the audio codec220may alternatively transmit an audio signal to the wireless communication module through the PCM interface, so as to implement a function of answering calls through a Bluetooth earphone. Both the I2S interface and the PCM interface may be configured to perform audio communication.

The UART interface is a universal serial data bus and is configured to perform asynchronous communication. The bus may be a bidirectional communication bus that converts to-be-transmitted data between serial communication and parallel communication. In some embodiments, the UART interface is usually configured to connect the SOC201and the wireless communication module. For example, the SOC201communicates with a Bluetooth module of the wireless communication module through the UART interface to implement a Bluetooth function. In some embodiments, the audio codec220may transmit an audio signal to the wireless communication module through the UART interface, so as to implement a function of playing music by using a Bluetooth earphone.

The MIPI interface may be configured to connect the SOC201to a peripheral device such as a display and a camera. The MIPI interface includes a camera serial interface (camera serial interface, CSI), a display serial interface (display serial interface, DSI), and the like. In some embodiments, the SOC201communicates with the camera through the CSI interface to implement a shooting function of the electronic device200. The SOC201communicates with the display through the DSI interface to implement a display function of the electronic device200.

The GPIO interface may be configured by using software. The GPIO interface may be configured as a control signal interface or a data signal interface. In some embodiments, the GPIO interface may be configured to connect the SOC201to the camera, the display, the wireless communication module, the audio codec220, the sensor, and the like. The GPIO interface may alternatively be configured as an I2C interface, an I2S interface, a UART interface, an MIPI interface, or the like.

It can be understood that an interface connection relationship between the modules illustrated in this embodiment of this application is merely used as an example for description, and does not constitute any limitation on the structure of the electronic device200. In some other embodiments of this application, the electronic device200may alternatively use an interface connection manner different from that in the foregoing embodiments or a combination of a plurality of interface connection manners.

The master PMU202and the slave PMU208each may be referred to as a power management module. A PMU in this embodiment of this application may be the master PMU202or the slave PMU208. This is not specifically limited in this embodiment of this application. For ease of description, in this embodiment of this application, a description is provided by using an example in which the PMU is the master PMU202.

The master PMU202may be connected to the power on button206, the charging chip203, and the SOC201. The master PMU202is configured to receive an input from the battery207and/or the charging chip203to supply power to the SOC201, an internal memory, the display, the camera, the wireless communication module, and the like. The master PMU202may be further configured to monitor parameters such as a battery capacity, a battery cycle count, and a battery health status (electric leakage or impedance). The master PMU202may be further configured to: during charging or when the power on button206is pressed, trigger the electronic device200to perform a power-on process or a system wake-up process. In some embodiments, the master PMU202may alternatively be disposed in the SOC201. In some other embodiments, the master PMU202and the charging chip203may alternatively be disposed in a same device.

The charging chip203may also be referred to as a charging management module or a charger chip, and the charger chip includes, for example, a charger IC. The charging chip203is configured to receive a charge input from a charger (or referred to as an adapter). The charger may be a wireless charger or a wired charger. In some embodiments of wired charging, the charging chip203may receive a charge input from a wired charger through the USB connector204. In some embodiments of wireless charging, the charging chip203may receive a wireless charge input by using a wireless charging coil of the electronic device. When charging the battery207, the charging chip203may further supply power to the electronic device by using the master PMU202.

The USB connector204is a connector that complies with the USB standard specification, and may specifically be a mini USB connector, a micro USB connector, a USB Type C connector, or the like. The USB connector may be configured to connect a charger to charge the electronic device200, may be configured to transmit data between the electronic device200and a peripheral device, and may also be configured to connect an earphone to play audio by using the earphone. The connector may be further configured to connect another electronic device.

The power on button206may be a mechanical button or a touch button. The electronic device200may receive an input from the power on button to implement a power-on process or a system wake-up process.

The electronic device200may implement a shooting function by using the ISP IC205, the camera, the video codec, the graphics processing unit (graphics processing unit, GPU), the display, the application processor, and the like. The camera may include the front camera209and three rear cameras210to212, and any one of the cameras may be integrated with the ISP IC and the switch devices in a camera module. It can be understood that a quantity of cameras and specific forms of the cameras may be adjusted depending on actual application.

The ISP IC205is configured to process data obtained by the camera. For example, the ISP IC205may perform algorithm-based optimization on noise, brightness, and skin tune of an image. The ISP IC205may further optimize parameters such as exposure and color temperature of a shooting scene.

The camera is configured to capture a static image or a video. An optical image of an object is generated by using a lens and is projected to a photosensitive element. The photosensitive element may be a charge coupled device (charge coupled device, CCD) or a complementary metal-oxide semiconductor (complementary metal-oxide semiconductor, CMOS) phototransistor. The photosensitive element converts an optical signal into an electrical signal, and then the electronic device converts the electrical signal into a digital image signal. The DSP processes the digital image signal. For example, the DSP converts the digital image signal into an image signal in a standard format such as RGB or YUV. Further, the ISP IC205may further optimize the image signal processed by the DSP. In some embodiments, the electronic device200may include one or N cameras, where N is a positive integer greater than 1.

The digital signal processor is configured to process digital signals, including not only digital image signals but also other digital signals. For example, when the electronic device200selects a frequency, the digital signal processor is configured to perform Fourier transform and the like on energy of frequencies.

The video codec is configured to compress or decompress a digital video. The electronic device200may support one or more types of video codecs, so that the electronic device200can play or record videos in a plurality of coding formats such as moving picture experts group (moving picture experts group, MPEG)-1, MPEG-2, MPEG-3, and MPEG-4.

The neural-network processing unit (neural-network processing unit, NPU) is a neural-network (neural-network, NN) computing processor that quickly processes input information by emulating a biological neural network structure, for example, by emulating a mode of transfer between human-brain neurons, and may further perform self-learning constantly. With the NPU, the electronic device200can implement intelligent cognition and other applications such as image recognition, face recognition, voice recognition, and text understanding.

A wireless communication function of the electronic device200may be implemented by using the modem213, the radio frequency chip214, the antenna215, the mobile communication module, the wireless communication module, the baseband processor, and the like.

The antenna215may transmit and receive electromagnetic wave signals based on the radio frequency chip214. Each antenna in the electronic device200may be configured to cover one or more communication bands. Different antennas may be reused to improve antenna utilization. For example, the antenna215may be reused as a diversity antenna of a wireless local area network. In some other embodiments, the antenna may be used in combination with a tuning switch.

The mobile communication module may provide wireless communication solutions including 2G/3G/4G/5G and the like to be applied to the electronic device200. The mobile communication module may include at least one filter, a switch, a power amplifier, a low noise amplifier (low noise amplifier, LNA), and the like. The mobile communication module may receive an electromagnetic wave by using an antenna1, perform processing such as filtering and amplification on the received electromagnetic wave, and then transmit a processed electromagnetic wave to the modem213for demodulation. The mobile communication module may further amplify a signal modulated by the modem213, and convert the amplified signal into an electromagnetic wave and radiate the electromagnetic wave by using the antenna1. In some embodiments, at least some functional modules of the mobile communication module may be provided in the processor. In some embodiments, at least some functional modules of the mobile communication module and at least some modules of the processor may be provided in a same device.

The modem213may include a modulator and a demodulator. The modulator is configured to modulate a to-be-transmitted low frequency baseband signal into a medium or high frequency signal. The demodulator is configured to demodulate a received electromagnetic wave signal into a low frequency baseband signal. Then, the demodulator transmits the low frequency baseband signal obtained through demodulation to the baseband processor for processing. After the low frequency baseband signal is processed by the baseband processor, a processed low frequency baseband signal is transmitted to the application processor. The application processor outputs a sound signal by using an audio device (not limited to the speaker223, the receiver225, and the like), or displays an image or a video by using the display. In some embodiments, the modem213may be a separate device. In some other embodiments, the modem213may be separate from the processor and provided in a same device together with the mobile communication module or another function module.

The wireless communication module may provide wireless communication solutions applied to the electronic device200and including wireless local area network (wireless local area network, WLAN) (for example, wireless fidelity (wireless fidelity, Wi-Fi) network), Bluetooth (Bluetooth, BT), global navigation satellite system (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field communication (near field communication, NFC), infrared (infrared, IR) technologies, and the like. The wireless communication module may be one or more devices integrating at least one communication processing module. The wireless communication module receives an electromagnetic wave by using an antenna, performs frequency modulation and filtering processing on an electromagnetic wave signal, and transmits a processed signal to the processor. The wireless communication module may also receive a to-be-transmitted signal from the processor, perform frequency modulation and amplification on the signal, and convert a processed signal into an electromagnetic wave and radiate the electromagnetic wave by using the antenna.

An external memory interface may be configured to connect to an external storage card, for example, a micro SD card, to expand a storage capacity of the electronic device200. The external storage card communicates with the SOC201through the external memory interface to implement a data storage function. For example, files such as music and video files are stored in the external storage card.

The internal memory may be configured to store computer executable program code, where the executable program code includes instructions. The internal memory may include a program storage area and a data storage area. The program storage area may store an operating system, an application program required by at least one function (for example, a sound playing function and an image playing function). The data storage area may store data (for example, audio data and a phone book) created during use of the electronic device200and the like. In addition, the internal memory may include a high-speed random access memory, and may further include a non-volatile memory, for example, at least one magnetic disk storage device, a flash memory device, the LPDDR 216, and the UFS217. By running the instructions stored in the internal memory and/or the instructions stored in the memory that is provided in the processor, the SOC201executes various functional applications and data processing of the electronic device200.

The display is configured to display an image, a video, and the like. The display includes a display panel. The display panel may be the LCD module218, an organic light-emitting diode (organic light-emitting diode, OLED), an active-matrix organic light-emitting diode (active-matrix organic light-emitting diode, AMOLED), a flex light-emitting diode (flex light-emitting diode, FLED), MiniLED, Micro LED, MicroOLED, a quantum dot light-emitting diode (quantum dot light-emitting diode, QLED), or the like. In some embodiments, the electronic device200may include one or N displays, where N is a positive integer greater than 1. The LCD module218may be a touchscreen, and a touch operation performed by a user may also be received based on the LCD module.

The fingerprint module219is configured to collect fingerprints. The electronic device200may implement fingerprint unlocking, application lock access, fingerprint-based shooting, fingerprint-based call answering, and the like by using characteristics of a collected fingerprint.

The electronic device200may use the audio codec220, the speaker223, the receiver225, the microphone224, the earphone jack, the application processor, and the like to implement an audio function such as music playing and sound recording.

The audio codec220is configured to convert digital audio information into an analog audio signal for output, and is also configured to convert an analog audio input into a digital audio signal. The audio codec220may be further configured to encode and decode audio signals. In some embodiments, the audio codec220may be provided in the SOC201, or some functional modules of the audio codec220may be provided in the SOC201.

The speaker223, also referred to as a “loudspeaker”, is configured to convert an audio electrical signal into a sound signal. The electronic device200may be used for listening to music or answering a hands-free call by using the speaker170A.

The receiver225, also referred to as an “earpiece”, is configured to convert an audio electrical signal into a sound signal. When the electronic device200receives a call or voice message, the receiver170B may be placed near a human ear for listening to a voice.

The microphone224, also referred to as a “mic” or “mike”, is configured to convert a sound signal into an electrical signal. When making a call or sending voice message, a user may input a sound signal into the microphone224by speaking close to the microphone224. The electronic device200may be provided with at least one microphone224. In some other embodiments, the electronic device200may be provided with two microphones224to implement a noise reduction function in addition to acquiring a sound signal. In some other embodiments, the electronic device200may alternatively be provided with three, four, or more microphones224to acquire sound signals, reduce noise, identify sound sources, implement directional recording, and the like.

The motor222may generate a vibration alert. The motor222may be configured to provide a vibration alert for an incoming call, and may also be configured to provide a vibration feedback for a touch. For example, touch operations performed on different applications (for example, shooting and audio playback) may correspond to different vibration feedback effects. For touch operations performed on different regions of the display, the motor222may also correspondingly provide different vibration feedback effects. Different application scenarios (for example, time reminder, information receiving, alarm clock, and gaming) may also correspond to different vibration feedback effects. In addition, touch vibration feedback effects can be user-defined.

The electronic device200may further include various sensors221(not shown in the figure) and the like. A specific structure of the electronic device200is not limited in this embodiment of this application.

The electronic device200in this embodiment of this application may further include switch devices SW1and SW2(not shown in the figure), and some or both of the SW1and the SW2are also disposed in the camera module. Details are not described again.

To sum up, in this embodiment of this application, the ISP IC is disposed in the camera module, and some or both of the SW1and the SW2are also disposed in the camera module. In this way, costs can be reduced, and an area of the main board can be reduced. In addition, the ISP IC and the switch devices can be integrated in the camera module to implement decoupling between the camera module and the main board. In this way, the camera module can be applied to a universal main board, and main boards of a same type can be compatible with an ordinary camera module and a camera module with a preprocessing chip switching path, thereby improving universality of the main board.

A possible implementation of a structure in which a camera module is connected to a main board in an embodiment of this application is described in detail below with reference toFIG.3toFIG.7.

For example,FIG.3is a schematic diagram of a structure in which a camera module is connected to a main board according to an embodiment of this application.

As shown inFIG.3, the camera module310is connected to the main board320via an FPC330. The camera module310includes an image sensor311, a BTB312, an ISP IC313, a first switch314, and a second switch315. The main board320includes a BTB321and an SOC322.

Two ends of the FPC330may be respectively inserted into the BTB312and the BTB321to implement a connection between the camera module310and the main board320. It can be understood that, because the FPC has advantages such as good flexibility and small occupancy space, in this embodiment of this application, an example in which the connection between the camera module310and the main board320is implemented via the FPC330, the BTB312, and the BTB321is used for description. In a possible implementation, the camera module310may be electrically connected to the main board320in any other manners. This is not specifically limited in this embodiment of this application.

Based on selection of the first switch314and the second switch315, image or video data acquired by the image sensor311may be transmitted from the FPC330to the SOC322through a path1, or the image or video data acquired by the image sensor311may be processed by the ISP IC313in a path2, and then processed image or video data may be transmitted from the FPC330to the SOC322. The ISP IC313may be a separate chip, or may be integrated in the image sensor311. A specific implementation of the ISP IC313is not limited in this application.

For example, if an electronic device performs image preview, video recording without beautification, or other steps, the electronic device may control the first switch314and the second switch315to enable the path1to be connected, so that the image or video data acquired by the image sensor311is transmitted from the FPC330to the SOC322through the path1. If the electronic device performs shooting, video recording with beautification, or other steps, the electronic device may control the first switch314and the second switch315to enable the path2to be connected, so that the image or video data acquired by the image sensor311is processed by using the ISP IC313in the path2, and then processed image or video data is transmitted from the FPC330to the SOC322.

In this embodiment of this application, the first switch314and the second switch315in the camera module310each are configured to implement a single pole double throw switch function. A single pole double throw switch may include one movable terminal and two fixed terminals, and connections between the movable terminal and the two fixed terminals may be switched. The first switch314is used as an example. One end that is of the first switch314and that is connected to the image sensor311is a movable terminal, and ends that are of the first switch314and that are connected to the path1and the path2are fixed terminals.

Both the first switch314and the second switch315may be separate chips. The first switch314and/or the second switch315may alternatively be integrated in the image sensor311. In this way, a size of the camera module310may be reduced through integration. The first switch314and/or the second switch315may alternatively be implemented by a circuit constructed by electrical devices. For example, specific devices of the first switch314and the second switch315include but are not limited to the following several devices: a single metal-oxide-semiconductor field-effect transistor (metal-oxide-semiconductor field-effect transistor, MOSFET), a plurality of MOSFETs that jointly implement a single pole double throw switch function, and a circuit that is constructed by using an integrated circuit and that implements a switch function. The MOSFET may be an N-type field-effect transistor (negative channel MOS, NMOS) or a P-type field-effect transistor (positive channel MOS, NMOS). A specific implementation of the first switch314and the second switch315is not limited in this embodiment of this application.

It should be noted that, in the embodiment corresponding toFIG.3, the SOC322may receive, via one interface, data transmitted through the path1or data transmitted through the path2. By using the first switch314and the second switch315, the path1and the path2can be used at different time points. In addition, when the path2is used for data transmission, both ends of the path1are disconnected from a circuit to avoid radiation caused because either end of the path1is connected to the circuit. Similarly, when the path1is used to transmit data, both ends of the path2are disconnected from the circuit, to avoid a radiation phenomenon caused because any end of the path2is connected to the circuit.

In a possible implementation, the second switch315may be omitted. However, when the second switch315is omitted, and the path2is selected for data transmission, a right end of the path1is connected to the SOC322. As a result, one end of the path1floats and the other end of the path1is connected to the circuit, and a state similar to an antenna occurs, resulting in radiation and interference to data transmitted through the path2.

Therefore, in another alternative solution, as shown inFIG.4, an anti-interference module316may be provided in the path1. Interference caused when the path1is not used may be suppressed by using the anti-interference module316, so that the second switch315can be omitted. It can be understood that an anti-interference module (not shown in the figure) may also be provided in the path2inFIG.4to suppress interference caused when the path2is not used. The anti-interference module may include a device such as a resistor or a capacitor. This is not limited in this embodiment of this application. Costs of the anti-interference module may be lower than those of the second switch315. In the manner inFIG.4, costs can be further reduced.

In still another alternative solution, as shown inFIG.5, after the second switch315is omitted, data in the path1and the path2may be transmitted to the SOC322through two routes. Adaptively, in the SOC322, data transmitted through the path1or data transmitted through the path2may be respectively received through two interfaces. Logic of disconnecting an interface from a circuit and connecting the interface to the circuit may be controlled in the SOC322. Therefore, by using the SOC322, when the path2is used for data transmission, both ends of the path1can be disconnected from the circuit to avoid radiation caused because either end of the path1is connected to the circuit. Similarly, when the path1is used to transmit data, both ends of the path2are disconnected from the circuit, to avoid a radiation phenomenon caused because any end of the path2is connected to the circuit.

In yet another alternative solution, the second switch may be disposed on the main board. For example,FIG.6is a schematic diagram of a structure in which another camera module is connected to a main board according to an embodiment of this application.

As shown inFIG.6, the camera module410is connected to the main board420via an FPC430. The camera module410includes an image sensor411, a BTB412, an ISP IC413, and a fourth switch414. The main board420includes a BTB421, an SOC422, and a third switch423.

Two ends of the FPC430may be respectively inserted into the BTB412and the BTB421to implement a connection between the camera module410and the main board420.

Based on selection of the fourth switch414, image or video data acquired by the image sensor411may be transmitted from the FPC430to the main board420through a path3, and then transmitted to the SOC422through one path of the third switch423. Based on selection of the fourth switch414, alternatively, image or video data acquired by the image sensor411may be processed by the ISP IC413in a path4, and processed image or video data may be transmitted from the FPC430to the main board420and then transmitted to the SOC422through the other path of the third switch423. The ISP IC413may be a separate chip, or may be integrated in the image sensor411. A specific implementation of the ISP IC413is not limited in this application.

For example, if an electronic device performs image preview, video recording without beautification, or other steps, the electronic device may control the fourth switch414to enable the path3to be connected, so that the image or video data acquired by the image sensor411is transmitted from the FPC430and one path of the third switch423to the SOC422through the path3. If the electronic device performs shooting, video recording with beautification, or other steps, the electronic device may control the fourth switch414to enable the path4to be connected, so that the image or video data acquired by the image sensor411is processed by using the ISP IC413in the path4, and then processed image or video data is transmitted from the FPC430and the other path of the third switch423to the SOC422.

In this embodiment of this application, the fourth switch414and the third switch423in the camera module410each are configured to implement a single pole double throw switch function. Both the fourth switch414and the third switch423may be separate chips.

In a possible implementation, the fourth switch414may be integrated in the image sensor411. In this way, a size of the camera module410may be reduced through integration. The third switch423may be integrated in the SOC422. In this way, a size of the SOC422may be reduced through integration.

It should be noted that, by using the third switch423and the fourth switch414, the path3and the path4can be used at different time points. In addition, when the path4is used for data transmission, both ends of the path3are disconnected from a circuit to avoid radiation caused because either end of the path3is connected to the circuit. Similarly, when the path3is used to transmit data, both ends of the path4are disconnected from the circuit, to avoid a radiation phenomenon caused because any end of the path4is connected to the circuit.

For example,FIG.7is a schematic diagram of a structure in which a camera module is connected to a main board when a third switch and an ISP IC are integrated in an image sensor and a fourth switch is integrated in an SOC.

As shown inFIG.7, the camera module510is connected to the main board520via an FPC530. The camera module510includes the image sensor511, a BTB512, an ISP block (block)513, and a buffer (buffer)514. The main board520includes a BTB521and an SOC522.

It should be noted that the image sensor511, the BTB512, the ISP block513, and the buffer514may be integrated together. In a possible implementation, integrated devices may also be collectively referred to as an image sensor or a camera. This is not specifically limited in this embodiment of this application.

Two ends of the FPC530may be respectively inserted into the BTB512and the BTB521to implement a connection between the camera module510and the main board520.

Image or video data acquired by the image sensor511may be stored in the buffer514in a RAW format and transmitted from the FPC530to the SOC522of the main board520. Alternatively, the image or video data acquired by the image sensor511may be processed by the ISP, and processed image or video data may be stored in the buffer514and transmitted from the FPC530to the SOC522of the main board520.

It should be noted that, in this embodiment of this application, the switch devices are respectively integrated in the image sensor511and the SOC522, and therefore the switch devices are not shown inFIG.7. However, processing logic of the data acquired by the image sensor511inFIG.7is still similar to that inFIG.6, and whether the data is processed by the ISP may be selected depending on different scenarios. Details are not described herein again.

The following further describes an image processing process of an electronic device in the embodiments of this application with reference toFIG.8.

FIG.8is a schematic diagram of an internal structure of an SOC of an electronic device.

The SOC may include a camera interface (camera interface) o to a camera interface3, an image processor (image processor) DSP, a video buffer (video buffer), a video encoder (video codec), and a file system (file system).

The camera interface o to the camera interface3are configured to connect camera modules. It can be understood that, in this embodiment of this application, a description is provided by using an example in which the electronic device includes four camera modules. Therefore, there are four camera interfaces. In a possible implementation, the electronic device may include N camera modules. In this case, a quantity of camera interfaces may also be N. N is a natural number.

Video data acquired by each camera may be transmitted to the DSP through a camera interface for processing, and processed data may be output in two paths. In one path, the processed data may be configured in the video buffer to form a preview video that can be displayed in a display channel (display panel). It can be understood that the processed data in this path may be data that has not been processed by the ISP and that is in the path1, the path3or the like in the foregoing embodiments. In the other path, the processed data may be processed by the video encoder and the file system to form a shot file to be stored in a UFS. The processed data in this path may be data that has been processed by the ISP and that is in the path2, the path4, or the like in the foregoing embodiments.

It should be noted that, in this embodiment of this application, connection manners between camera modules in the electronic device and the SOC may be different. Alternatively, it can be understood that the electronic device may include any one or more connection manners shown inFIG.1andFIG.3toFIG.7.

For example, with reference toFIG.2, a connection manner between the SOC and a camera module in which the front camera209in the electronic device200is located may be the connection manner shown inFIG.1. Adaptively, for devices included in the SOC and the camera module in which the front camera209in the electronic device200is located, refer to the description aboutFIG.1. A connection manner between the SOC and a camera module in which the rear camera210in the electronic device200is located may be the connection manner shown inFIG.3. Adaptively, for devices included in the SOC and the camera module in which the rear camera210in the electronic device200is located, refer to the description aboutFIG.3. A connection manner between the SOC and a camera module in which the rear camera211in the electronic device200is located may be the connection manner shown inFIG.4. Adaptively, for devices included in the SOC and the camera module in which the rear camera211in the electronic device200is located, refer to the description aboutFIG.4. A connection manner between the SOC and a camera module in which the rear camera212in the electronic device200is located may be the connection manner shown inFIG.5. Adaptively, for devices included in the SOC and the camera module in which the rear camera212in the electronic device200is located, refer to the description aboutFIG.5.

Certainly, a specific connection relationship between the SOC and a camera module in which each camera in the electronic device200is located may be any connection manner shown inFIG.1,FIG.3,FIG.4,FIG.5,FIG.6, andFIG.7. Connection relationships between any two or more camera modules and the SOC may be the same or different. This is not specifically limited in this embodiment of this application.

To sum up, in this embodiment of this application, the ISP IC is disposed in the camera module, and some or all of the switch devices are also disposed in the camera module. In this way, costs can be reduced, and an area of the main board can be reduced. In addition, the ISP IC and the switch devices can be integrated in the camera module to implement decoupling between the camera module and the main board. In this way, the camera module can be applied to a universal main board, and main boards of a same type can be compatible with an ordinary camera module and a camera module with a preprocessing chip switching path, thereby improving universality of the main board.

The electronic device in this embodiment of this application may be a device that can process various image data signals, for example, a handheld device or a vehicle-mounted device with a wireless connection function. Currently, some examples of the terminal include a mobile phone (mobile phone), a tablet computer, a notebook computer, a palmtop computer, a mobile internet device (mobile internet device, MID), a wearable device, a virtual reality (virtual reality, VR) device, an augmented reality (augmented reality, AR) device, a wireless terminal in industrial control (industrial control), a wireless terminal in self-driving (self-driving), a wireless terminal in a remote medical surgery (remote medical surgery), a wireless terminal in a smart grid (smart grid), a wireless terminal in transportation safety (transportation safety), a wireless terminal in a smart city (smart city), a wireless terminal in a smart home (smart home), a cellular phone, a cordless phone, a session initiation protocol (session initiation protocol, SIP) phone, a wireless local loop (wireless local loop, WLL) station, a personal digital assistant (personal digital assistant, PDA), a handheld device and a computing device with a wireless communication function, another processing device, a vehicle-mounted device, or a wearable device connected to a wireless modem, an electronic device in a 5G network, or an electronic device in a future evolved public land mobile communication network (public land mobile network, PLMN). This is not limited in this embodiment of this application.

By way of example and not limitation, in this embodiment of this application, the electronic device may alternatively be a wearable device. The wearable device may also be referred to as a wearable smart device and is a general term of wearable devices that are developed through intelligent design of daily wear by using a wearable technology, for example, glasses, gloves, watches, clothing, and shoes. The wearable device is a portable device that is worn directly on a body or integrated into clothing or accessories of a user. The wearable device is not only a type of hardware device, but also achieves a powerful function through software support, data exchange, and cloud interaction. Generalized wearable smart devices include devices that have full functions and large sizes and that implement complete or partial functions without relying on a smart phone, for example, smart watches or smart glasses; and include devices that are focused only on one type of application function and that need to be used in cooperation with another device such as a smart phone, for example, various smart bands and smart jewelry for physical sign monitoring.

In addition, in this embodiment of this application, the electronic device may alternatively be an electronic device in an internet of things (internet of things, IoT) system. The IoT is an important part of future information technology development. A main technical feature of the IoT is to connect an object to a network by using a communication technology, so as to implement an intelligent network with a man-machine interconnection and an object interconnection.

In this embodiment of this application, the electronic device may also be referred to as user equipment (user equipment, UE), a mobile station (mobile station, MS), a mobile terminal (mobile terminal, MT), an access terminal, a subscriber unit, a subscriber station, a mobile station, a mobile console, a remote station, a remote terminal, a mobile device, a user terminal, a terminal, a wireless communication device, a user agent, a user apparatus, or the like.

In this embodiment of this application, the electronic device or each network device includes a hardware layer, an operating system layer running over the hardware layer, and an application layer running over the operating system layer. The hardware layer includes hardware such as a central processing unit (central processing unit, CPU), a memory management unit (memory management unit, MMU), and a memory (also referred to as a main memory). The operating system may be any one or more computer operating systems that implement service processing through a process (process), for example, a Linux operating system, a Unix operating system, an Android operating system, an IOS operating system, or a windows operating system. The application layer includes applications such as a browser, an address book, word processing software, and instant messaging software.

For example,FIG.9is a schematic diagram of a structure of a specific electronic device.

The electronic device may include a processor110, an internal memory121, a universal serial bus (universal serial bus, USB) connector, a charge management module140, a power management module141, an antenna1, an antenna2, a mobile communication module150, a wireless communication module160, an audio module170, a speaker170A, a receiver170B, a sensor module180, a button190, an indicator192, a camera193, a display194, and the like. The sensor module180may include a pressure sensor180A, a gyro sensor180B, a barometric pressure sensor180C, a magnetic sensor180D, an acceleration sensor180E, an inductance sensor180F, an optical proximity sensor180G, a temperature sensor180J, a touch sensor180K, an ambient light sensor180L, a bone conduction sensor180M, and the like.

It can be understood that the structure illustrated in this embodiment of this application does not constitute a specific limitation on the electronic device. In some other embodiments of this application, the electronic device may include more or fewer components than those shown in the figure, a combination of some components, splitting of some components, or components in different arrangements. The components shown in the figure may be implemented by using hardware, software, or a combination of software and hardware.

The processor110may include one or more processing units. Different processing units may be separate devices or may be integrated in one or more processors. A memory may be further provided in the processor110for storing instructions and data.

The charge management module140is configured to receive a charge input from a charger. The charger may be a wireless charger or a wired charger. The power management module141is configured to connect the charge management module140and the processor110.

A wireless communication function of the electronic device may be implemented by using the antenna1, the antenna2, the mobile communication module150, the wireless communication module160, a modem processor, a baseband processor, and the like.

The antenna1and the antenna2are configured to transmit and receive electromagnetic wave signals. The antennas in the electronic device may be configured to cover one or more communication bands. Different antennas may be reused to improve antenna utilization.

The mobile communication module150may provide wireless communication solutions including 2G/3G/4G/5G and the like to be applied to the electronic device. The mobile communication module150may include at least one filter, a switch, a power amplifier, a low noise amplifier (low noise amplifier, LNA), and the like. The mobile communication module150may receive an electromagnetic wave by using the antenna1, perform processing such as filtering and amplification on the received electromagnetic wave, and transmit a processed electromagnetic wave to the modem processor for demodulation.

The wireless communication module160may provide wireless communication solutions to be applied to the electronic device.

The electronic device may implement a display function by using a GPU, the display194, an application processor, and the like. The GPU is a microprocessor for image processing, and is connected to the display194and the application processor. The GPU is configured to perform mathematical and geometric computation for graphics rendering.

The display194is configured to display an image, a video, and the like. The display194includes a display panel. In some embodiments, the electronic device may include one or N displays194, where N is a positive integer greater than 1.

The electronic device may implement a shooting function by using the ISP, the camera193, the video codec, the GPU, the display194, the application processor, and the like.

The camera193is configured to capture a static image or a video. In some embodiments, the electronic device may include one or N cameras193, where N is a positive integer greater than 1.

The internal memory121may be configured to store computer executable program code, where the executable program code includes instructions. The internal memory121may include a program storage area and a data storage area.

The electronic device may use the audio module170, the speaker170A, the receiver170B, the application processor, and the like to implement an audio function such as music playing and sound recording.

It should be noted that, for the structural part of the electronic device inFIG.9, reference may be made to the description in the embodiment corresponding toFIG.2. Details are not described herein again.

The above embodiments, schematic structural diagrams, or schematic simulation diagrams are only used as examples to describe the technical solutions of this application, and a size ratio therein does not constitute any limitation on the protection scope of the technical solutions. Any modifications, equivalent replacements, improvements, and the like made within the spirit and principle of the above embodiments shall fall within the protection scope of the technical solutions.