Intelligent photo album sorting and privacy protection method

Disclosed in the present invention is an intelligent photo album sorting and privacy protection method. The method is applied to an image recognition model, and includes the following steps: obtaining shooting time and shooting locations of images, and acquiring latitude and longitude information of a shooting device; extracting feature information in the images; performing classification and sorting based on the shooting time and the shooting locations of the images and the extracted feature information in the images, and when a designated classified photo album exists in the shooting device, moving the images into the designated classified photo album; otherwise, creating a designated classified photo album, and moving the images into the designated classified photo album; after moving the images to the designated classified photo album, determining whether the recognition model has been stored in a model.

CROSS-REFERENCE TO RELATED APPLICATIONS

The application claims priority to Chinese patent application No. 2023117418165, filed on Dec. 18, 2023, the entire contents of which are incorporated herein by reference.

TECHNICAL FIELD

The present invention relates to the field of photo album sorting technologies, more specifically to an intelligent photo album sorting and privacy protection method.

BACKGROUND

When there are a large number of pictures in a smart terminal (such as a mobile phone) of a user who has no habit of sorting the pictures, suddenly one day it will be very troublesome to look for a previously captured photo such as an identity card. By means of automatic sorting, data, persons, documents, and the like can be quickly found or searched for. In addition, the private information such as the identity card stored in a photo album of the mobile phone may be abused by malicious applications and is desired to be automatically protected. Moreover, in the existing technical solution, the user performs manual sorting, which is equivalent to no sorting for users who have no habit of sorting. Furthermore, images of different scenes such as multiple persons and different locations cannot be sorted or the sorting effect is unsatisfactory by a facial recognition technology.

There are the following drawbacks in the prior art:

1. Various technologies are not fully utilized or combined for processing.

2. There is a lack of privacy control, which leads to abuse of data by malicious applications.

3. A confidential device is uncontrollable.

SUMMARY

In view of this, an objective of the present invention is to provide an intelligent photo album sorting and privacy protection method, which overcomes the shortcomings in the prior art that captured photos cannot be automatically sorted and need to be manually sorted by a user, and a confidential device is uncontrollable, such that the method can automatically sort photos in a photo album, and can effectively control confidential and private content and prevent the risk of abuse by malicious applications.

To achieve the above objective, the present invention provides the following technical solution:

Further, the method for image recognition in the Step 3 includes:

Further, the method for classifying the characters includes:

Further, the method for classifying the locations in the Step 4 includes:

Further, the method for classifying the content includes:

Further, performing image encryption on the images by an encryption algorithm in the Step 8 includes the following steps:

Further, a method for recognizing controlled content in the step S82 includes:

Further, a method for managing the operation behavior for the encrypted images in the Step 87 includes:

The method further includes: providing the user with a one-click function to delete junk photos, where general screenshots and images that cannot be clearly classified, are fuzzy, or are randomly written by malicious applications are recognized as junk image data for one-click deletion, which helps the user quickly release a storage space.

The method further includes: enabling the user to perform quick retrieval based on tags added to the image data, which is convenient for the user to quickly find required content in a large amount of image data.

According to the specific embodiments provided by the present invention, the present invention discloses the following technical effects: the present invention provides a universal and highly intelligent photo album sorting and privacy protection method, which can effectively control confidential and private content and prevent the risk of abuse by malicious applications.

1. By recognizing characters, locations, and content, different photos can be sorted into different photo album content. For example, a separate photo album is automatically generated from photos captured at a tourist spot visited by a user. For another example, birthdays spent with relatives can be sorted into a separate photo album.

2. The user is provided with a high-level function to protect privacies such as various personal privacy-related documents (an identity card, a driver's license, a vehicle registration certificate, etc.) stored in the photo album, and such image data is automatically protected through content recognition.

3. In combination with locating, device authentication, content recognition and other technologies, image data generated by confidential institutions, persons, devices, etc. is automatically protected to prevent the leakage of state secrets.

4. The user is provided with a one-click function to delete junk photos. For example, recognized general screenshots or saved images and images that cannot be clearly classified can be recognized as junk image data for one-click deletion.

5. By adding tags to the image data, the user is provided with an ability of quick retrieval, such as document positioning, search by person, and search by trip.

DETAILED DESCRIPTION OF THE EMBODIMENTS

Specific implementations of the present invention are further described in detail below in conjunction with the accompanying drawings and embodiments. The embodiments below are used to illustrate the present invention, but not to limit the scope of the present invention.

The present invention proposes an intelligent photo album sorting and privacy protection method. When there are a large number of pictures in a smart terminal (such as a mobile phone) of a user who has no habit of sorting the pictures, suddenly one day it will be very troublesome to look for a previously captured photo such as an identity card. By means of automatic sorting, data, persons, documents, and the like can be quickly found or searched for. In addition, the private information such as the identity card stored in a photo album of the mobile phone may be abused by malicious applications and is desired to be automatically protected. In the present invention, automatic tagging and sorting are performed after photos are captured or a photo album is opened. A specific implementation solution is as follows:

1. Images are automatically tagged and sorted using a series of technologies such as image recognition, large-scale modeling, natural language processing, and geographical location tagging.

2. The user is guided to tag the images recognized as persons or objects and perform modeling on the tagged content for automatic recognition in the next use, which is actually a process of artificial intelligence training.

In order to better understand the objective, structure, and function of the present invention, the present invention is further described in detail below with reference to the accompanying drawings.

As shown in FIG. 1, the present invention provides an intelligent photo album sorting and privacy protection method, where the method is applied to an image recognition model, and includes the following steps:

In order to further optimize the above technical effects, in the present invention, the number of the images of the same type is detected in intelligent video generation, and when the plurality of images are found, video documents, videos, dubs, or the like are intelligently generated based on the extracted content (locations, characters, text content, scenes, or the like); and the user can share the generated videos to a video platform or a social system.

Exemplarily, as shown in FIG. 2, the method for image recognition in the Step 3 includes:

For example, an image recognition engine has different built-in recognition algorithms such as CNN, RNN, R-CNN, Faster R-CNN, CTPN, CRNN, and CTC Loss. The engine can select different algorithms based on different recognition features for recognition. For example: when the texts are detected, the system conducts recognition using CTPN+CRNN+CTC Loss or other algorithms to obtain the text content, determines whether the texts are documents, contracts, or other texts based on the text content, and performs corresponding classification on corresponding texts; or when no texts are detected, target recognition is performed using Faster R-CNN or other algorithms to acquire a classification.

Exemplarily, as shown in FIG. 3, the method for classifying the characters includes:

Step 413: monitoring private information of the character information in the images, and generating private tags.

In order to further optimize the above technical solution, in the present invention, if the images are exposed, the images are directly authenticated as private content.

Exemplarily, as shown in FIG. 4, the method for classifying the locations in the step S4 includes:

In order to further optimize the above technical solution, in the present invention, when it is recognized whether the locations are confidential, scenes such as homes or office locations can be determined by geographical locations, time, and frequencies of occurrence.

Exemplarily, as shown in FIG. 5, the method for classifying the content includes:

In order to further optimize the above technical solution, in the present invention, as shown in FIG. 3, the method for recognizing by the image recognition model and comparing with the character database in the Step 412 includes:

Exemplarily, as shown in FIG. 1, performing image encryption on the images by an encryption algorithm in the Step 8 includes the following steps:

Exemplarily, as shown in FIG. 6, a method for recognizing controlled content in the Step 82 includes:

Exemplarily, as shown in FIG. 7, a method for managing the operation behavior for the encrypted images in the Step 87 includes:

The method further includes: providing the user with a one-click function to delete junk photos, where general screenshots and images that cannot be clearly classified, are fuzzy, or are randomly written by malicious applications are recognized as junk image data for one-click deletion, which helps the user quickly release a storage space.

The method further includes: enabling the user to perform quick retrieval based on tags added to the image data, which is convenient for the user to quickly find required content in a large amount of image data. The above description of the disclosed embodiments enables those skilled in the art to implement or use the present invention. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present invention. Therefore, the present invention will not be limited to these embodiments shown herein, but will fall within the widest scope consistent with the principles and novel characteristics disclosed herein.