Preventing image capture data leaks

When a first device computer is placed in privacy aware mode, specific events are monitored for, and a program can instantaneously blur or mask data being displayed on a screen of a second device computer. Therefore, if a snapshot is triggered, contents of the snapshot are blurred or masked, such that the contents are not recognizable or readable by another user or by a receiver. The contents of the snapshot which are blurred or masked preferably include only confidential information.

BACKGROUND

The present invention relates to image capture of information, and more specifically to preventing image capture of information data leakage.

It is a common practice for users to capture information currently being viewed on a screen of a device by using image capturing software of the device to store the information as an image. This may be referred to as a “snapshot”. Users use snapshots to store evidence or records they may need to reference at a later time. The information captured can be confidential or non-confidential in nature. When the snapshot includes confidential information, which is stored on the user's device, there is a possibility of a breach of privacy of the confidential data present within the image of the snapshot stored on the device. Snapshots may be taken programmatically.

SUMMARY

According to an embodiment of the present invention, a method of preventing snapshot data leaks of data confidential to a first user sent from a first device computer of the first user to a second device computer through an application in a privacy mode and displayed on a screen of the second device computer through an application is disclosed. The method comprising the steps of: the first device computer monitoring for snapshots triggered on the second device computer through the application on the second device computer displaying the data confidential to the first user and when a snapshot is triggered on the second device computer, the first device computer: notifying the applications in privacy mode; analyzing existing rendered contents on the screen in the application of the second device computer in privacy mode as confidential or non-confidential; and masking the confidential information on the screen in the application of the second device computer in privacy mode and masking the confidential information present within the snapshot triggered on the second device computer.

According to another embodiment of the present invention, a computer program product for preventing snapshot data leaks of data confidential to a first user sent from a first device computer of the first user to a second device computer through an application in a privacy mode and displayed on a screen of the second device computer through an application is disclosed. The first device computer and the second device computer comprising at least one processor, one or more memories, one or more computer readable storage media, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by the computer to perform a method comprising: monitoring, by the first device computer, for snapshots triggered on the second device computer through the application on the second device computer displaying the data confidential to the first user and when a snapshot is triggered on the second device computer: notifying, by the first device computer, the applications in privacy mode; analyzing, by the first device computer, existing rendered contents on the screen in the application of the second device computer in privacy mode as confidential or non-confidential; and masking, by the first device computer, the confidential information on the screen in the application of the second device computer in privacy mode and masking, by the first device computer, the confidential information present within the snapshot triggered on the second device computer.

According to another embodiment of the present invention, a computer system for preventing snapshot data leaks of data confidential to a first user sent from a first device computer of the first user to a second device computer through an application in a privacy mode and displayed on a screen of the second device computer through an application is disclosed. The computer system comprising at least a first device computer and a second device computer, the first device computer and the second device computer each comprising at least one processor, one or more memories, one or more computer readable storage media having program instructions executable by the computer to perform the program instructions. The program instructions comprising: monitoring, by the first device computer, for snapshots triggered on the second device computer through the application on the second device computer displaying the data confidential to the first user and when a snapshot is triggered on the second device computer: notifying, by the first device computer, the applications in privacy mode; analyzing, by the first device computer, existing rendered contents on the screen in the application of the second device computer in privacy mode as confidential or non-confidential; and masking, by the first device computer, the confidential information on the screen in the application of the second device computer in privacy mode and masking, by the first device computer, the confidential information present within the snapshot triggered on the second device computer.

DETAILED DESCRIPTION

It is recognized that since snapshots may be taken programmatically on a device, and software may be used to transmit the snapshot of the data captured to a server computer for access by an unauthorized user.

In an embodiment of the present invention, a user controls snapshot prevention on a device for specific applications or programs of the device through the application. The user may provide input regarding what, if any, data of a snapshot can be copied or viewable once the snapshot has been transmitted to a receiver and the receiver's associated device, allowing the owner of the data to control the data of the snapshot at the receiving end.

In an embodiment of the present invention, applications or programs on a first device computer of the user register snapshot interrupt actions (i.e. print screen press, snapshot short-cut keys, API/System Call interrupts) when the user's first device computer or any associated applications have been placed in privacy aware mode. Privacy aware mode is a mode on the device in which specific files or data is marked or designated as not being accessible to a user other than the owner without providing specific authentication. Applications of the device may also be placed into privacy aware mode.

When the first device computer is placed in privacy aware mode, specific events are monitored for, and a program can instantaneously blur or mask data being displayed on a screen of a second device computer. Therefore, if a snapshot is triggered, contents of the snapshot are blurred or masked, such that the contents are not recognizable or readable by another user or by a receiver. The contents of the snapshot which are blurred or masked preferably include confidential information only. The information designated as confidential may be determined by the user providing the information. It should be noted that information designated as confidential can vary between users.

FIG. 1is an exemplary diagram of a possible data processing environment provided in which illustrative embodiments may be implemented. It should be appreciated thatFIG. 1is only exemplary and is not intended to assert or imply any limitation with regard to the environments in which different embodiments may be implemented. Many modifications to the depicted environments may be made.

Referring toFIG. 1, network data processing system51is a network of computers in which illustrative embodiments may be implemented. Network data processing system51contains network50, which is the medium used to provide communication links between various devices and computers connected together within network data processing system51. Network50may include connections, such as wire, wireless communication links, or fiber optic cables.

In the depicted example, a first device computer52, a second device computer56, a repository53, and a server computer54connect to network50. In other exemplary embodiments, network data processing system51may include additional client or device computers, storage devices or repositories, server computers, and other devices not shown.

The first device computer52may contain an interface55, which may accept commands and data entry from a user. The commands may be regarding an activation or inactivation of a privacy aware mode of an application of the device. The commands may also be regarding what content should be tagged as confidential. The interface can be, for example, a command line interface, a graphical user interface (GUI), a natural user interface (NUI) or a touch user interface (TUI). The first device computer52preferably includes a snapshot interrupt program66. The first device computer may be a mobile device, smartphone, tablet or other device with a screen. While not shown, it may be desirable to have the snapshot interrupt program66be present on the server computer54. The first device computer52includes a set of internal components800aand a set of external components900a, further illustrated inFIG. 4.

The second device computer56may contain an interface57, which may accept commands and data entry from a user. The commands may be regarding an initiation of data capture of information on the screen of the device (i.e. snapshot). The interface can be, for example, a command line interface, a graphical user interface (GUI), a natural user interface (NUI) or a touch user interface (TUI). The device computer may be a mobile device, smartphone, tablet or other device with a screen64. The second device computer56includes a set of internal components800cand a set of external components900c, further illustrated inFIG. 4.

Server computer54includes a set of internal components800band a set of external components900billustrated inFIG. 4. In the depicted example, server computer54provides information, such as boot files, operating system images, and applications to the first device computer52and the second device computer56. Server computer54can compute the information locally or extract the information from other computers on network50. The server computer54may contain the snapshot interrupt program66.

Program code and programs such as snapshot interrupt program66may be stored on at least one of one or more computer-readable tangible storage devices830shown inFIG. 4, on at least one of one or more portable computer-readable tangible storage devices936as shown inFIG. 4, or on storage unit53connected to network50, or may be downloaded to a first device computer52, a second device computer56or server computer54, for use. For example, program code and programs such as snapshot interrupt program66may be stored on at least one of one or more storage devices830on server computer54and downloaded to first device computer52or a second device computer56over network50for use. Alternatively, server computer54can be a web server, and the program code, and programs such as snapshot interrupt program66may be stored on at least one of the one or more storage devices830on server computer54and accessed by the first device computer52and/or the second device computer56. In other exemplary embodiments, the program code, and programs such as snapshot interrupt program66may be stored on at least one of one or more computer-readable storage devices830on first device computer52, second device computer56, or distributed between two or more servers.

FIG. 2shows a flow diagram of a method of preventing snapshot data leaks on a second device computer56which has received data from a first device computer52. The owner of the data, through the first device computer52, is able to dictate the privacy policies relating to data captured (via a snapshot) when the data is displayed or sent to the receiver (second device computer56) via a snapshot interrupt program66of the first device computer52and associated with the application displaying the information.

For example, the user or owner of the data may set a policy that blurs or masks all confidential data in a snapshot if a snapshot is triggered by the receiver through the second device computer56. The snapshot interrupt program66is activated when an application of a first device computer56is placed in privacy aware mode and the information is displayed on the second device computer56. In other words, the application on the second device computer56and displaying the information from the first device computer52receives the policy associated with the data with the transfer or data being sent to the second device computer56and the application on the second device computer56which is displaying the information executes the policy, for example through the snapshot interrupt program66of the first device computer52. The method described below occurs after data has been shared between the first device computer52and the second device computer56.

The snapshot interrupt program66of the first device computer52monitors for snapshot interrupts on the second device computer (step102), for example through the application on the second device computer56which is displaying the information from the first device computer52.

The snapshot interrupts which are monitored may include, but are not limited to “Pressing print screen in windows”, receiving an input of “Command+Shift+3” dependent keyboard shortcuts, or other application program interface (API) interrupts. These interrupts can be collected through crowd sourcing or stored in a repository, such as repository53ofFIG. 1. The interrupts may be associated or registered with specific events, such as events associated or registered for taking snapshots. Alternatively, instead of monitoring for the snapshot interrupts, specific events can be monitored for continuously.

If a snapshot interrupt is not triggered on the second device computer (step104), the method returns to step102.

When a snapshot interrupt is triggered on the second device computer (step104), applications in privacy aware mode are notified (step106), for example by the snapshot interrupt program66.

The snapshot interrupt program66analyzes existing rendered contents on the screen in the applications in privacy aware mode of the second device computer to determine whether the contents are confidential or non-confidential (step108).

Confidential information shared between the first device computer52and the second device computer56may be implicitly tagged by the user supplying the confidential information. For example, the user may indicate that all text which is in italics, bold, or marked with specific characters at the beginning and end of specified information to be considered confidential. Furthermore, existing tools may also be used to auto-identify confidential data.

The snapshot interrupt program66from the first device computer52blurs confidential information within the rendered contents on the screen (step110), such that the snapshot captures blurred contents, thereby preventing the confidential data designated by the user of the first device computer to be leaked in a snapshot image and the method ends. It should be noted that only the confidential information rendered on the screen is blurred and that the blurring only occurs once a snapshot interrupt is received by the receiver of the confidential information.

The confidential information may be blurred by image processing and convolving the image of the data with a Gaussian function, resulting in a Gaussian blur or smoothing. Other blurring effects or masking may also be used to hide the confidential information or prevent the confidential information from displaying in a readable manner to a user on the receiving end of the information. For example, symbols can be placed over the confidential information blocking or preventing all readability of the confidential information when captured by a snapshot of the second device computer56.

For example, and referring toFIGS. 3a-3b, a first user, User A of a first device computer is conversing with a second user, User B, of a second device computer56through an application. User A can control what of the data shared during the conversation can be captured clearly in a snapshot by User B through the second device computer56.

If User A provides User B with information in which User A wishes to keep private, i.e. home address—123 Cherry Lane, User A can indicate that the information is private by encapsulating the information in italics or including a series of characters which are set to indicate the beginning and end of confidential information. Alternatively, the snapshot interrupt program66of the first device computer52may determine that the home address is confidential information based on User A settings.

Prior to a snapshot interrupt occurring, the confidential information60is readable by User B on a screen64of the second device computer56through the same application used by User A.

If User B attempts to capture the home address information through a snapshot, or a snapshot is remotely triggered through the second device computer56, the snapshot interrupt program66from the first device computer52analyzes the contents displayed on the screen64of the second device computer56of User B and blurs only the confidential information61of the home address in the snapshot as shown inFIG. 3b.

Therefore, the snapshot interrupt program66allows the user sharing information (User A) to control what data can be copied through a snapshot by the device on which the data is being displayed, on a receiving end (User B).

It should be noted that while the application being used by User A and User B in the above example is the same application, different applications for reading the same file types may be used by User A and User B, and the snapshot interrupt program66can be associated with the information itself and how it is viewed by an application on the second device computer56.

FIG. 4illustrates internal and external components of a first device computer52, a second device computer56, and server computer54in which illustrative embodiments may be implemented. InFIG. 4, a first device computer52, a server computer54, and a second device computer56include respective sets of internal components800a,800b,800cand external components900a,900b,900c. Each of the sets of internal components800a,800b,800cincludes one or more processors820, one or more computer-readable RAMs822and one or more computer-readable ROMs824on one or more buses826, and one or more operating systems828and one or more computer-readable tangible storage devices830. The one or more operating systems828and snapshot interrupt program66are stored on one or more of the computer-readable tangible storage devices830for execution by one or more of the processors820via one or more of the RAMs822(which typically include cache memory). In the embodiment illustrated inFIG. 4, each of the computer-readable tangible storage devices830is a magnetic disk storage device of an internal hard drive. Alternatively, each of the computer-readable tangible storage devices830is a semiconductor storage device such as ROM824, EPROM, flash memory or any other computer-readable tangible storage device that can store a computer program and digital information.

Each set of internal components800a,800b,800calso includes a R/W drive or interface832to read from and write to one or more portable computer-readable tangible storage devices936such as a CD-ROM, DVD, memory stick, magnetic tape, magnetic disk, optical disk or semiconductor storage device. Snapshot interrupt program66can be stored on one or more of the portable computer-readable tangible storage devices936, read via R/W drive or interface832and loaded into hard drive830.

Each set of internal components800a,800b,800calso includes a network adapter or interface836such as a TCP/IP adapter card. Snapshot interrupt program66can be downloaded to the first device computer52, a second device computer56, and server computer54from an external computer via a network (for example, the Internet, a local area network or other, wide area network) and network adapter or interface836. From the network adapter or interface836, snapshot interrupt program66is loaded into hard drive830. Snapshot interrupt program66can be downloaded to the server computer54from an external computer via a network (for example, the Internet, a local area network or other, wide area network) and network adapter or interface836. From the network adapter or interface836, snapshot interrupt program66is loaded into hard drive830. The network may comprise copper wires, optical fibers, wireless transmission, routers, firewalls, switches, gateway computers and/or edge servers.

Each of the sets of external components900a,900b,900cincludes a computer display monitor920, a keyboard930, and a computer mouse934. Each of the sets of internal components800a,800b,800calso includes device drivers840to interface to computer display monitor920, keyboard930and computer mouse934. The device drivers840, R/W drive or interface832and network adapter or interface836comprise hardware and software (stored in storage device830and/or ROM824).

Snapshot interrupt program66can be written in various programming languages including low-level, high-level, object-oriented or non object-oriented languages. Alternatively, the functions of a snapshot interrupt program66can be implemented in whole or in part by computer circuits and other hardware (not shown).