Patent Publication Number: US-2023135842-A1

Title: Data processing method, device, and system

Description:
CROSS-REFERENCE TO RELATED APPLICATION 
     This application claims priority to Chinese Patent Application No. 202111284257.0, filed on Nov. 1, 2021, the entire content of which is incorporated herein by reference. 
     TECHNICAL FIELD 
     The present disclosure relates to the data processing technology field and, more particularly, to a data processing method, device, and system. 
     BACKGROUND 
     Smart devices are widely used. For example, through a touch screen of a smart device or an electronic drawing board connected to the smart device, a user can draw a required graphic through an input tool such as a stylus. The graphic will be displayed on a screen of the smart device for a subsequent application. 
     However, when an input signal is transmitted to a processing device of the smart device, and signal preprocessing and trajectory identification and processing are required, a delay will occur for image display due to limitation of a computation rate of the processing device, which reduces user experience. 
     SUMMARY 
     Embodiments of the present disclosure provide a data processing method. The method includes obtaining input information inputted by the input device for display on a display device and transmitting the input information to a display driver chip of the display device to cause the display driver chip to generate a first image output on the display device based on the input information. 
     Embodiments of the present disclosure provide a data processing device, including an acquisition circuit and a first transmission circuit. The acquisition circuit is configured to obtain input information input by an input device and for display on a display device. A first transmission circuit is configured to transmit the input information to a display driver chip of the display device to cause the display driver chip to generate a first image output on the display device based on the input information. 
     Embodiments of the present disclosure provide a data processing system. The system includes an input device and a display device. The input device is configured to obtain input information. The display device, which is able to connect to the input device, includes a display driver chip, and is configured to output a first image. The display driver chip is configured to generate the first image based on the input information. 
    
    
     
       BRIEF DESCRIPTION OF THE DRAWINGS 
         FIG.  1    illustrates a schematic flowchart of a data processing method according to embodiments of the present disclosure. 
         FIG.  2    illustrates a schematic diagram showing a data flow direction of another data processing method according to embodiments of the present disclosure. 
         FIG.  3    illustrates a schematic structural diagram of a data processing device according to embodiments of the present disclosure. 
         FIG.  4    illustrates a schematic structural diagram of a data processing system according to embodiments of the present disclosure. 
     
    
    
     DETAILED DESCRIPTION OF THE EMBODIMENTS 
     The technical solutions in embodiments of the present disclosure will be described in detail below with reference to the drawings in the embodiments of the present disclosure. Apparently, the described embodiments are only some embodiments of the present disclosure, not all embodiments. Based on embodiments of the present disclosure, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall be within the scope of the present disclosure. 
     A data processing method of embodiments of the present disclosure can be applied to an electronic apparatus. The electronic apparatus includes an input device and a display device. Correspondingly, the electronic apparatus can be provided with an input device and a display device. For example, the electronic apparatus may be a display device having a touch screen. A target object may perform information input based on the touch screen. Correspondingly, the touch screen may also display relevant image data. In another manner, the electronic apparatus may also be connected to the input device and the display device with the display function through a communication connection module to realize the functions of information input and image data display. 
       FIG.  1    illustrates a schematic flowchart of a data processing method according to embodiments of the present disclosure. The method includes the following processes. 
     At S 101 , input information inputted by the input device for display on the display device is obtained. 
     At S 102 , the input information is transmitted to a display driver chip of the display device to cause the display driver chip to generate a first image output on the display device based on the input information. 
     The input information generated by the input device in process S 101  may need to be displayed on the display device. In embodiments of the present disclosure, the input information may be processed by the display driver chip of the display device. Thus, the input device may need to be connected to the display device. That is, the input information generated by the input device can be transmitted to the display driver chip of the display device. 
     A processing parameter matching the input information may be stored in the display driver chip of the display device. Thus, the input information can be processed through the processing parameter. The processing parameter can be a parameter in a corresponding processing algorithm that can convert input information into corresponding image data. The corresponding processing algorithm may include but is not limited to a scan conversion algorithm for a straight line segment, a numerical differentiation method, an anti-aliased line drawing algorithm, etc. 
     Correspondingly, the input information may be information such as an input trajectory, an input graphic, input text, and a symbol generated by the target object through the input device. The input device may include a stylus, a smart drawing board, a touch screen, etc., that can generate the input information. A display driver chip (Driver IC) may be a main functional member in the display device that generates and outputs the display image and can be configured to process the input information to generate the image data that can be output by the display device. In embodiments of the present disclosure, the display driver chip of the display device may be configured to directly process the input information to generate the first image. Then, the first image may be output through an output assembly of the display device. 
     In embodiments of the present disclosure, the input information may be directly input into the display driver chip of the display device and processed by the display driver chip to obtain the first image output by the display device. The processing device may usually need to process and execute a lot of information, and available processing resources may be limited. The processing efficiency of the input information may be reduced to cause an image data generation speed to slow down, which cannot satisfy an input information preview requirement of the target object. Thus, by using the disclosed method, the processing device corresponding to the display device of the electronic apparatus may not need to be waited to process the input information. In embodiments of the present disclosure, the display driver chip may be configured to directly process the input information to generate the corresponding image, which reduces the delay of the apparatus and satisfies a rapid display requirement of the image corresponding to the input information. 
     In order to generate image data matching the input information generated by an operation object of the input device, the input information may need to be processed according to the corresponding configuration information when the image data is generated. In embodiments of the present disclosure, the data processing method may further include responding to an input trigger instruction, controlling the display driver chip of the display device to obtain the configuration information related to the input information matching the input trigger instruction, and processing the input information based on the configuration information to obtain the first image. 
     The input trigger instruction may be a start instruction for the target object for the input device, an instruction for starting a corresponding input application in the electronic apparatus, or an instruction generated by a target controller. For example, the input trigger instruction may be an instruction generated by triggering an on-button of the stylus or an instruction generated by an operation of pulling the stylus out of a fixture. Correspondingly, the configuration information related to the input information may refer to information that can be used to configure the input information to generate the corresponding image. For example, the configuration information may include line shape configuration information, line width configuration information, and line color configuration information for an input trajectory. In some embodiments, the configuration information related to the input information can be determined by the target object that operates the input device, by default configuration information of the input device, or according to predetermined configuration information corresponding to different target objects. For example, the configuration information related to the input matching the input trigger instruction may include that a line color is red, and a shape is a dotted line. If the input device is a stylus, when the user draws a circle with the stylus, the circle may be processed according to the above configuration information. Thus, the image displayed on the display device may be a red dotted line circle. 
     In some embodiments, the configuration information related to the input information matching the input trigger instruction may be configuration information pre-stored in the display driver chip or configuration information obtained by a processing device connected to the display driver chip. In some embodiments, the display driver chip of the display device may be controlled to obtain the configuration information related to the input information matching the input trigger instruction from the configuration information stored in the display driver chip. If no configuration information related to the input information matching the input trigger instruction is stored in the display driver chip, the display driver chip may be controlled to obtain the configuration information related to the input information matching the input trigger instruction in the processing device. 
     After the input trigger instruction is obtained, the input trigger instruction may be parsed to obtain the configuration information related to the input information corresponding to the input trigger instruction. Then, inquiry may be performed on the configuration information stored in the display driver chip to determine whether the configuration information related to the input information exists. If the configuration information exists, the configuration information related to the input information may be directly retrieved from the configuration information pre-stored in the display driver chip. If the configuration information does not exist, the display driver chip may be controlled to obtain the configuration information related to the input information matching the input trigger instruction in the processing device. For example, the display driver chip may send a configuration information acquisition request to the processing device. After receiving the acquisition request, the processing device may feed back the configuration information related to the corresponding input information to the display driver chip. Thus, the display driver chip can process the input information based on the configuration information related to the input information to obtain the first image. 
     In embodiments of the present disclosure, the processing device or the controller may be a central processing unit (CPU) of the electronic apparatus or a graphics processing unit (GPU) of the electronic apparatus. Both the CPU and the GPU can be connected to the display device. That is, the generated image data or the corresponding information may be sent to the display device. 
     In some other embodiments of the present disclosure, when the input information is transmitted to the display driver chip of the display device, the input information may also be transmitted to the processing device connected to the display device. The processing device may be configured to generate a second image based on the input information. 
       FIG.  2    illustrates a schematic diagram showing a data flow direction of another data processing method according to embodiments of the present disclosure. The input information generated by the input device  201  may be transmitted to the display device  202  and the processing device  203  simultaneously. Then, the display device  202  may be configured to process the input information based on the display driver chip based on the display driver chip  2021  in the display device to generate a first image, and then the first image will be generated. The output is performed through an output component of the display device to generate the first image. Then, the first image may be output through the output assembly corresponding to the display device. For example, when the output assembly is a screen, the first image may be displayed on the screen. Meanwhile, the processing device may process the input information to generate the second image. Since the processing device executes a lot of processing information, or the processing device may need to combine other application information when processing the input information, time for generating the second image may be later than processing time of generating the first image by the display driver chip. Thus, the display device may first output the first image to cause the user to be able to obtain the image corresponding to the input information more quickly. 
     In some embodiments, in response to the first image output by the display device satisfying a target condition, the processing device may be controlled to output the second image to the display device to replace the first image with the second image. 
     The target condition may refer to a condition of replacing the first image with the second image, which may be a condition after time for outputting the first image that satisfies a predetermined display time period, or a corresponding operation matching condition of an operation for the first image. 
     In some embodiments, the target condition may refer to a condition after the second image is generated. That is, in response to the processing device generating the second image, the processing device may be controlled to output the second image to the display device to replace the first image with the second image. The processing efficiency of generating the image based on the input information by the processing device is lower than the processing efficiency of generating the image based on the input information by the display driver chip. Thus, even if the input information is input to the display driver chip and the processing device simultaneously, the display driver chip may generate the first image first. The time when the processing device generates the second image may be later than the time when the display driver chip generates the first image. Therefore, in order to ensure fast output of images, the display device will output the first image first. After the second image is generated, the first image may be replaced with the second image. Thus, the image corresponding to the input information may subsequently be further processed. 
     In some other embodiments, in response to the received trigger instruction satisfying the instruction condition, the processing device may be controlled to output the second image to the display device. The trigger instruction may be an instruction for the first image, for example, a refresh instruction of the target object for the first image, an automatic refresh instruction of the apparatus for the first image, or an optimization instruction for the first image. In some embodiments, since the processing capability of the display driver chip is not as good as the processing capability of the image processor or the central processing unit, the image processor and/or the central processing unit may be selected to perform more advanced processing on the displayed image. For example, the generated image may be added with the corresponding text information, or the generated display image may be changed, etc. Therefore, after receiving the above trigger instruction, the processing device may be controlled to output the second image to the display device to replace the first image with the second image. 
     In embodiments of the present disclosure, the second image may merely be cached without replacing the first image. In some embodiments, whether the first image needs to be replaced with the second image may be determined according to the actual application scenario. 
     The second image generated by the processing device may include an image fused by a first sub-image and a second sub-image. The first sub-image is generated by the processing device based on the input information. The second sub-image may be generated by the processing device based on the target application information. 
     The processing device may include a CPU or a GPU. When generating the image data based on the input information, the CPU or GPU may generate the first sub-image based on the input information and the second sub-image based on the target application information corresponding to the input information. The final first sub-image may be the image fused by the first sub-image and the second sub-image. The target application (APP) information may be associated information used to generate the input information, such as input cursor information. The target APP information may also be the information of a current input APP. For example, the input APP corresponding to the input device may be a drawing App, and the corresponding target APP information may be the information when the drawing app receives the input information, such as image editing and display menu information, etc. A corresponding fusion manner may include an image layer processing manner. Each image layer may include many pixels. The image layers may be stacked to form a whole image. That is, when the processing device renders and generates the second image, the first sub-image and the second sub-image may be used as layers in the whole second image, respectively. 
     Thus, when the second image generated by the processing device is used to replace the first image, the whole image may be replaced, or the second sub-image generated by the processing device based on the target APP information may be stacked on the first image to obtain the second image. Thus, when rapidly outputting and inputting the object simultaneously, the display device may further input the image that satisfies the requirement of the subsequent operation. 
     In some other embodiments of the present disclosure, in response to the display device outputting the first image, the processing device may be controlled to obtain an image adjustment instruction matching the first image. Thus, the processing device may perform an adjustment on the first image based on the image adjustment instruction. The processing device may be controlled to output the adjusted target image. 
     After the display device generates the first image, if the first image needs to be further processed, such as modification, adjustment, and optimization, the image adjustment instruction matching the first image may be received. The display control chip may be configured to respond to the image adjustment instruction. In some embodiments, processing algorithms or processing parameters stored in the display control chip may be limited. Therefore, the image adjustment instruction may be usually adjusted by a more powerful processing device. That is, the processing device may perform parsing on the image adjustment instruction to obtain corresponding adjustment information. The processing device may further perform an adjustment on the first image based on the adjustment information to obtain the target image. The processing device may be controlled to output the target image to the display device for display. For example, the image adjustment instruction may include performing image turning on the current first image. Thus, the display device may perform turning on the first image according to a corresponding image-turning processing process to output the image after being turned to the display device. 
     In some embodiments, if the display driver chip includes the configuration information matching the image adjustment instruction, the adjustment configuration information obtained by the processing device based on parsing of the image adjustment instruction may be sent to the display driver chip. Thus, the display driver chip may perform the adjustment on the first image based on the adjustment configuration information to obtain the target image. 
     When the display driver chip responds to the image adjustment instruction, the display driver chip may need to store the configuration information corresponding to the image adjustment instruction. For example, if the image adjustment instruction includes performing the adjustment on line width, the display driver chip may include a line width parameter, such as optional line width parameters or exemplary images that represent different line widths, etc. The processing device may perform parsing on the image adjustment instruction to obtain corresponding adjustment configuration information. The adjustment configuration information may be used to adjust the first image through the display driver chip to obtain the target image. For example, the image adjustment instruction may include adjusting the line width of the first image from No. 5 to No. 6. The display driver chip may store line display images corresponding to different line widths. Therefore, the processing device can send the configuration information of adjusting to No. 6 obtained by parsing to the display driver chip. Then, the display driver chip may be configured to retrieve the line matching No. 6 to adjust the first image to obtain the target image. 
     In embodiments of the present disclosure, the display device may be a touch screen. An input trajectory generated by sliding an input object such as a finger or a stylus on the touch screen may be processed based on the display processing chip in the screen to obtain a corresponding image that is displayed on the screen immediately, without waiting for the processing device (such as CPU or GPU) to process a large number of operations to generate and output the corresponding image, which can break through the image processing limit of the processing device, reduce the delay of the input device, and satisfy the requirement of the user to rapidly obtain the display image. 
       FIG.  3    illustrates a schematic structural diagram of a data processing device according to embodiments of the present disclosure. The data processing device includes an acquisition unit  301  and a first transmission unit  302 . 
     The acquisition unit  301  may be configured to obtain the input information inputted by the input device and used to be displayed on the display device. 
     The first transmission unit  302  may be configured to transmit the input information to the display driver chip of the display device. Thus, the display driver chip may generate the first image output on the display device based on the input information. 
     In the data processing device of embodiments of the present disclosure, the input information of the input device may be directly processed by the display driver chip of the display device to generate the first image. The first image may be output to the display device for display. The processing device that executes a lot of processing information may not need to be waited to perform the processing on the input information. Thus, the image corresponding to the input information may be rapidly displayed to satisfy the actual display requirement. 
     Further, the data processing device may further also include a first controller. 
     The first controller may be configured to control the display driver chip of the display device to obtain the configuration information related to the input information matching the input trigger instruction in response to the input trigger instruction and perform processing on the input information based on the configuration information to obtain the first image. 
     In some embodiments, the first controller may include a first control sub-unit and a second control sub-unit. 
     The first control sub-unit may be configured to control the display driver chip of the display device to obtain the configuration information related to the input information matching the input trigger instruction from the configuration information stored in the display driver chip. 
     The second control sub-unit may be configured to control the display driver chip to obtain the configuration information related to the input information matching the input trigger instruction in the processing device if the display driver chip does not include the configuration information related to the input information matching the input trigger instruction. 
     In some embodiments, the data processing device may further include a second transmission unit and a second controller. 
     The second transmission unit may be configured to transmit the input information to the display driver chip of the display device and to the processing device connected to the display device. The processing device may be configured to generate the second image based on the input information. 
     The second controller may be configured to control the processing device to output the second image to the display device in response to the first image output by the display device satisfying the target condition to replace the first image with the second image. 
     Further, the second controller may include a third control sub-unit or a fourth control sub-unit. 
     The third control sub-unit may be configured to control the processing device to output the second image to the display device in response to the processing device generating the second image. 
     The fourth control sub-unit may be configured to control the processing device to output the second image to the display device in response to the received trigger instruction satisfying the instruction condition. 
     In some embodiments, the second image may include the image obtained by fusing the first sub-image and the second sub-image. The processing device may be configured to generate the first sub-image based on the input information and the second sub-image based on the target APP information. 
     Further, the data processing device may further include a third controller. 
     The third controller may be configured to control the processing device to obtain the image adjustment instruction matching the first image in response to the display device outputting the first image to cause the processing device to perform the adjustment on the first image based on the image adjustment instruction. 
     The fourth controller may be configured to control the processing device to output the adjusted target image. 
     In some embodiments, the data processing device may also include an information transmission circuit. 
     The information transmission circuit may be configured to transmit the adjustment configuration information obtained based on parsing of the image adjustment instruction by the processing device to the display driver chip if the display driver chip includes the configuration information matching the image adjustment instruction. Thus, the display driver chip may be configured to perform the adjustment on the first image based on the adjustment configuration information to obtain the target image. 
     For specific implementations of each unit of embodiments of the present disclosure, reference may be made to the corresponding content above, which is not repeated here. 
       FIG.  4    illustrates a schematic structural diagram of a data processing system according to embodiments of the present disclosure. The system includes an input device  401  and a display device  402 . 
     The input device  401  may be configured to obtain the input information. 
     The display device  402  may be connected to the input device. The display device  402  may include a display driver chip. The display driver chip may be configured to generate the first image based on the input information. 
     The display device  402  may be further configured to output the first image. 
     Correspondingly, the data processing system may further include a processing device. 
     The processing device may be configured to generate the second image based on the input information. 
     For specific implementations of the input device, the display device, and the processing device of embodiments of the present disclosure, reference may be made to the corresponding content above, which is not repeated here. 
     Embodiments of the present disclosure are described in a progressive manner. Each embodiment focuses on differences from other embodiments. Same and similar parts between embodiments may be referred to each other. For the device disclosed in embodiments of the present disclosure, since the device corresponds to the method of embodiments of the present disclosure, the description may be relatively simple. For the relevant part, reference may be made to the description of the method. 
     Those skills in the art may further realize that the units and algorithm steps of examples described in connection with embodiments of the present disclosure may be implemented by electronic hardware, computer software, or a combination thereof. In order to clearly illustrate the interchangeability of the hardware and the software, the composition and steps of the examples may be generally described according to the functions above. Whether these functions are executed by hardware or software may depend on a specific application of the technical solution and design constraint condition. Those skilled in the art may implement the described functions by using different methods for each specific application. This implementation should not be considered beyond the scope of the present disclosure. 
     The steps of the method or algorithm of embodiments of the present disclosure may be directly implemented in hardware, a software module executed by a processor, or a combination thereof. The software module may be arranged in random access memory (RAM), internal memory, read-only memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, a removable disk, CD-ROM, or a storage medium in any other form in the technical field. 
     The above description of the disclosed embodiments enables those skilled in the art to implement or use the present disclosure. Various modifications to these embodiments may be apparent to those skilled in the art. The generic principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present disclosure. Therefore, the present disclosure is not limited to embodiments of the present disclosure but conforms to the widest scope consistent with the principles and novel features of the present disclosure.