Patent application EP21173133A (EP), filed 2021-05-10
Publication number: EP3923203A1
Title: UPDATING A NEURAL NETWORK MODEL ON A COMPUTATION DEVICE
Abstract: [0001]    A method is provided for updating a neural network model on a computation device. The method comprises estimating (301) a bandwidth for data download from a server device to the computation device; estimating (302) a time point of available computation capacity of the computation device; computing (303) a maximum partition size as a function of the bandwidth and the time point; and causing (304) download of a selected partition of the neural network model from the server device to the computation device, the selected partition being determined based on the maximum partition size. The method enables the selected partition to be executed by the computation device upon downloading and thereby provides for seamless updating of the neural network model while it is being executed on the computation device.
IPC codes: G06F   9/    50            A I
G06N   3/    04            A I
H04L  29/    08            A I
Claims: number: 1
text: A method of updating a neural network model (11) on a computation device (10), said method comprising:
number: 2
text: The method of claim 1, wherein the selected partition is determined to have a size substantially equal to or less than the maximum partition size.
number: 3
text: The method of claim 1 or 2, which is performed while the neural network model (11) is being executed on the computation device (10).
number: 4
text: The method of any preceding claim, further comprising, upon said download, updating and executing (305) the selected partition of the neural network model (11) on the computation device (10).
number: 5
text: The method of claim 4, wherein execution of the selected partition is initiated at the time point of available computation capacity.
number: 6
text: The method of any preceding claim, wherein the maximum partition size is computed as a function of a product of the bandwidth and a time interval (Δt) from a selected time to the time point.
number: 7
text: The method of any preceding claim, wherein one or more existing partitions of the neural network model (11) have been executed on the computation device (10) at said time point.
number: 8
text: The method of claim 7, wherein the selected partition is determined as a function of the one or more existing partitions.
number: 9
text: The method of claim 7 or 8, wherein the selected partition is determined as a function of a dependence within the neural network model on output generated by the one or more existing partitions.
number: 10
text: The method of any one of claims 7-9, wherein the selected partition is determined so as to operate on the output generated by the one or more existing partitions.
number: 11
text: The method of any one of claims 7-10, further comprising: evaluating the output generated by the one or more existing partitions to identify one or more partitions to be excluded from execution, wherein the selected partition is determined while excluding the one or more partitions.
number: 12
text: The method of any one of claims 7-11, wherein said causing (304) the download comprises: transmitting (304A'), by the computation device (10) to the server device (20), size data indicative of the maximum partition size and status data indicative of the one or more existing partitions that have been executed at the time point.
number: 13
text: The method of any preceding claim, wherein the selected partition is determined as a function of the available computation capacity of the computation device (10) at the time point.
number: 14
text: The method of any preceding claim, which is repeatedly performed at consecutive current time points to update the neural network model (11) on the computation device (10), and wherein said causing (304), at a respective current time point, results in download of partition data of a size substantially equal to the maximum partition size estimated at the respective current time point, said partition data comprising the selected partition, and optionally one or more further selected partitions.
number: 15
text: A computation device comprising a communication circuit (73) for communicating with a server device (20), and logic (71, 72) to control the computation device to perform the method in accordance with any one of claims 1-14.
Office action: search_report, dated 2021-12-15
Prior art cited: ref_id: WO2019185981A1
ref_type: patent
severity: background
ref_id: WO2019185981
ref_type: patent
severity: background
Final disposition: pending (2021-12-15)