Patent ID: 11881014
Assignee: HEBEI UNIVERSITY OF TECHNOLOGY
Field: Computer technology (Electrical engineering)
Classification: CPC G  Y | IPC G

Claim 0:
1. An intelligent image sensing device for sensing-computing-cloud integration based on a federated learning framework, comprising: intelligent image sensors, edge servers and a remote cloud;
wherein the intelligent image sensor is used for perceiving and generating images, and uploading the images to the edge server; the edge server is used as a client; and the remote cloud is used as a server;
the client trains a convolutional fuzzy rough neural network based on the received images and the proposed federated learning framework; and the intelligent image sensor downloads the weight parameters of the trained convolutional fuzzy rough neural network from the client, and classifies and recognizes the images based on the trained weight parameters;
wherein the federated learning framework is:
1) the training improvement frequency, stagnation frequency or accuracy increase degree of each client is checked every certain number of epochs; and if any of the three conditions reaches a corresponding threshold, the current client is used as a candidate client;
2) after all clients are checked, if the number of the candidate clients is higher than half of the total number of the clients, the training information of the candidate clients is updated;
3) the candidate clients upload the weight parameters of a deep learning (DL) model to the server, and the server aggregates the weight parameters and sends the aggregated weight parameters back to all the candidate clients;
4) steps 1) to 3) are repeated until the predefined number of training epochs is reached, and the process is ended;
wherein the convolutional fuzzy rough neural network is:
an expansion layer is replaced by a fuzzification layer, and the next three layers are a fuzzy rule layer, a rough layer and an output layer;
in the fuzzification layer, two membership functions are used for transforming each feature value into two membership degrees, so that the number of channels is doubled;
each feature map is reduced to a single value by using global pooling, which is regarded as the fuzzy rule layer; and the membership degree of the same map is averaged to obtain the activation intensity of fuzzy rules;
the rough layer uses a plurality of 1×1 filters to mix input features; a filtering weight is a rough membership degree; because the membership degree is a positive value from 0 to 1, the filtering weight is an absolute value;
a classifier layer is used as an output layer, wherein the absolute value of the connection weight is used, and the bias unit is eliminated.