Patent ID: 11971882
Assignee: THE FOURTH PARADIGM (BEIJING) TECH CO LTD
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 13:
14. A non-transitory computer readable storage medium storing instructions, wherein the instructions, when executed by at least one computing device, cause the at least one computing device to execute following steps of a method for batch and real-time feature computation:
receiving a script which unifies batch feature computing logics and real-time feature computing logics, wherein the batch feature computing is feature computation on batch data to obtain sample data for model training or batch prediction, and the real-time feature computing is feature computation on real-time data to obtain sample data for online prediction; and
in a batch feature computing scenario, selecting a batch feature computing unit for batch feature computation from batch feature computing units registered with a management server to start the batch feature computation such that the selected batch feature computing unit generates a batch computing task, and transmitting the batch computing task to one or more distributed computing units such that the one or more distributed computing units execute the batch computing task to perform the batch feature computation based on the script and data stored in an offline database, wherein the script is run by the management server to be converted to be codes implementing the batch feature computing logics and executable by at least one of the batch feature computing unit and the one or more distributed computing units, or
in a real-time feature computing scenario, deploying the script to real-time feature computing units registered with the management server to generate a real-time computing plan, and selecting a real-time feature computing unit used when executing the real-time computing plan from the real-time feature computing units registered with the management server such that the selected real-time feature computing unit performs the real-time feature computation based on data stored in a real-time database and the script, wherein the script is run by the management server to be converted to be codes implementing the batch feature computing logics and executable by the real-time feature computing unit,
wherein the data stored in the offline database is data for the batch feature computation, and the data stored in the real-time database is data for the real-time feature computation obtained from the offline database, and
wherein the data in the offline database and the data in the real-time database are at least partially synchronized, and the real-time database and the offline database perform data synchronization based on data changes in the real-time database or the offline database or based on a master-slave synchronization mechanism periodically or in response to user triggering.