Office Action 1: Non-Final Rejection (2023-12-26)
Rejection types: 101 - Patent-Eligible Subject Matter, 102 - Lack of Novelty, 103 - Obviousness

CLAIMS:
WHAT IS CLAIMED IS:

1\. A security control system, comprising:
at least one storage device storing a set of instructions; and
one or more processors in communication with the at least one storage device, wherein when executing the set of instructions, the one or more processors are configured to direct the system to:
obtain first data from a first device;
obtain second data from a second device; and
associate and process the first data and/or the second data.

2\. The system of claim 1, wherein the one or more processors are further configured to direct the system to:
send the processed first data and second data to a server and/or a user terminal.

3\. The system of claim 1, wherein the first device includes a monitoring data obtaining device, and the second device includes an access switch device or a smart lock.

4\. The system of claim 3, wherein the second data includes at least one of operation instructions, execution results of operation instructions, identification information of the second device, identity information, or a password.

5\. The system of claim 1 or 2 or 3, wherein to associate and process the first data and/or the second data, the one or more processors are further configured to direct the system to:
in response to a determination that the second device detects the second data, control the first device to collect the first data and integrate an association identifier related to the second data into the first data; or
in response to a determination that the first device detects the first data, obtain an association identifier related to the first data, and in response to a determination that the second device detects the second data within a preset time, integrate the association identifier related to the first data into the second data.

6\. The system of claim 1 or 5, wherein to associate and process the first data and/or the second data, the one or more processors are further configured to direct the system to:
establish an association relationship between the first data and the corresponding second data based on the association identifier carried by the first data and/or the second data.

7\. The system of claim 1, wherein to associate and process the first data and/or the second data, the one or more processors are further configured to direct the system to:
integrate an obtaining time of the first data and an obtaining time of the second data into the first data and the second data, respectively.

8\. The system of claim 1 or 7, wherein to associate and process the first data and/or the second data, the one or more processors are further configured to direct the system to:
determine, based on the obtaining time carried by the second data, whether the obtaining time carried by the first data from a same security device includes the obtaining time carried by the second data; and
in response to a determination that the obtaining time carried by the first data includes the obtaining time carried by the second data, establish an association relationship between the first data and the corresponding second data.

9\. The system of claim 1 or 2 or 3, wherein to associate and process the first data and/or the second data, the one or more processors are further configured to direct the system to:
recognize an operator image from the first data using an image recognition algorithm;
obtain identity information in the second data associated with the first data; and obtain the operator image marked with the identity information by establishing an association relationship between the identity information and the operator image in the first data.

10\. The system of claim 9, wherein the one or more processors are further configured direct the system to:
receive the first data obtained by the first device;
recognize a current operator image from the first data using the image recognition algorithm; and
determine an identity of a current operator based on the current operator image and the operator image marked with the identity information.

11\. The system of claim 10, wherein the one or more processors are further configured to direct the system to:
take corresponding measures based on the identity of the current operator;
wherein the measures include at least one of: sending at least a portion of the first data and/or at least a portion of the second data to a user terminal associated with the first device for confirmation, switching a state of the second device, or generating alarm information.

12\. The system of claim 3, wherein the one or more processors are further configured to direct the system to:
obtain a first sensing signal through one or more first sensing units, the first sensing signal being configured to indicate whether there is any person within a preset range of the first device;
control the first device to obtain the first data based on the first sensing signal;
obtain a second sensing signal through one or more second sensing units, the second sensing signal being configured to indicate whether there is any person within a preset range of a display unit; and control the display unit to be turned on or off based on the first sensing signal and the second sensing signal, wherein the first data is displayed when the display unit is turned on.

13\. The system of claim 12, wherein to control the display unit to be turned on or off based on the first sensing signal and the second sensing signal, the one or more processors are further configured to direct the system to:
in response to a determination that the first sensing signal indicates that there is a person within the preset range of the first device, and the second sensing signal indicates that there is a person within the preset range of the display unit, turn on the display unit.

14\. The system of claim 13, wherein to control the display unit to be turned on or off based on the first sensing signal and the second sensing signal, the one or more processors are further configured to direct the system to:
time a screen-on duration of the display unit when the display unit is turned on; and
turn off the display unit when the display unit is in a screen-on state and the screen- on duration reaches a duration threshold.

15\. The system of claim 14, wherein the duration threshold has an initial value, and the duration threshold is dynamically set.

16\. The system of claim 15, wherein to set the duration threshold, the one or more processors are further configured to direct the system to:
obtain the first sensing signal again when the display unit is in a screen-on state;
in response to a determination that the first sensing signal indicates there is a person within the preset range of the first device, add a delay increment to a timing result of the screen-on duration of the display unit, and in response to a determination that the timing result plus the delay increment is greater than the initial value of the duration threshold, determine the timing result plus the delay increment as an updated duration threshold.

17\. The system of claim 1, wherein the one or more processors are further configured to direct the system to:
in response to a determination that an alarm button is triggered, send alarm information to an associated user terminal; or
in response to a determination on a basis of the first data that there is an abnormal condition, send alarm information to the associated user terminal.

18\. The system of claim 17, wherein the one or more processors are further configured to direct the system to:
receive a data request sent by the associated user terminal; and
provide the first data and/or the second data to the associated user terminal.

19\. A security control method, comprising:
obtaining first data from a first device;
obtaining second data from a second device; and
associating and processing the first data and/or the second data.

20\. A computer readable storage medium, wherein the storage medium stores computer instructions, when executed by one or more processors of the system, the instructions direct the system to:
obtain first data from a first device;
obtain second data from a second device; and
associate and process the first data and/or the second data.

21\. A data association method applied to a server, comprising: obtaining door lock data uploaded by a smart door lock and peephole viewer data uploaded by a smart peephole viewer associated with a same user identifier;
determining door lock data and peephole viewer data associated with a same unlocking operation; and
associating the door lock data and the peephole viewer data associated with the same unlocking operation to obtain associated data.

22\. A data association method applied to a smart peephole viewer, comprising:
receiving a video trigger instruction sent by a smart door lock associated with the smart peephole viewer, wherein the video trigger instruction is generated after the smart door lock detects an unlocking operation, and the video trigger instruction carries an association identifier of door lock data that is generated after the smart door lock detects the unlocking operation;
recording video data of an outside environment according to the video trigger instruction, and marking the association identifier associated with the door lock data in the video data to obtain peephole viewer data; and
uploading the peephole viewer data to a server to facilitate the server to determine, according to the association identifier, the door lock data and the peephole viewer data associated with the unlocking operation and associate the door lock data and the peephole viewer data.

23\. A data association method applied to a smart door lock, comprising:
generating door lock data after detecting an unlocking operation, and sending a video trigger instruction to a smart peephole viewer associated with the smart door lock, wherein the video trigger instruction is configured to trigger the smart peephole viewer to take videos or photos of outside environment, and carries an association identifier of the door lock data; and
uploading the door lock data to a server to facilitate the server to determine, according to the association identifier of the door lock data, the door lock data and the peephole viewer data associated with the unlocking operation and associate the door lock data and the peephole viewer data.

24\. A data association device applied to a server, comprising:
an obtaining module configured to obtain door lock data uploaded by a smart door lock and peephole viewer data uploaded by a smart peephole viewer, the smart door lock and the smart peephole viewer being associated with a same user identifier;
a determination module configured to determine door lock data and peephole viewer data associated with a same unlocking operation; and
an association module configured to associate the door lock data and the peephole viewer data associated with the same unlocking operation to obtain associated data.

25\. A data association device, applied to a smart peephole viewer, comprising:
a receiving module configured to receive a video trigger instruction sent by a smart door lock associated with the smart peephole viewer, wherein the video trigger instruction is generated after the smart door lock detects an unlocking operation, and
the video trigger instruction carries an association identifier of door lock data that is generated after the smart door lock detects the unlocking operation;
a marking module configured to record video data of an outside environment according to the video trigger instruction, and mark the association identifier associated with the door lock data in the video data to obtain peephole viewer data; and
an uploading module configured to upload the peephole viewer data to a server to facilitate the server to determine, according to the association identifier, the door lock data and the peephole viewer data associated with the unlocking operation and associate the door lock data and the peephole viewer data.

26\. A data association device applied to a smart door lock, comprising:
an instruction sending module configured to generate door lock data after detecting an unlocking operation, and send a video trigger instruction to a smart peephole viewer associated with the smart door lock, wherein the video trigger instruction is configured to trigger the smart peephole viewer to take videos or photos of outside environment, and carries an association identifier of the door lock data; and
an uploading module configured to upload the door lock data to a server to facilitate the server to determine, according to the association identifier of the door lock data, the door lock data and the peephole viewer data associated with the unlocking operation and associate the door lock data and the peephole viewer data.

27\. A method for marking a user identity attribute of data applied to a server, comprising:
obtaining door lock data and peephole viewer data associated with a same user identifier, wherein the door lock data carries an identity attribute of an unlocker;
determining door lock data and peephole viewer data associated with a same unlocking operation;
recognizing a face image included in the peephole viewer data using a face recognition algorithm; and
obtaining a marked face image by establishing an association relationship between the identity attribute carried by the door lock data and the face image included in the peephole viewer data associated with the same unlocking operation.

28\. A method for marking a user identity attribute of data applied to a server, comprising:
receiving peephole viewer data sent by a smart peephole viewer, wherein the peephole viewer data carries an identity attribute of an unlocker, and the peephole viewer data is generated after the smart peephole viewer receives a video trigger instruction that is sent by an associated smart door lock and carries the identity attribute of the unlocker;
recognizing a face image included in the peephole viewer data; and
obtaining a marked face image by establishing an association relationship between the identity attribute of the unlocker and the face image.

29\. A device for marking a user identity attribute of data applied to a server, comprising:
an obtaining module configured to obtain door lock data and peephole viewer data associated with a same user identifier, wherein the door lock data carries an identity attribute of an unlocker;
a determination module configured to determine door lock data and peephole viewer data associated with a same unlocking operation;
a face recognition module configured to recognize a face image included in the peephole viewer data using a face recognition algorithm; and
an identity marking module configured to obtain a marked face image by establishing an association relationship between the identity attribute carried by the door lock data and the face image included in the peephole viewer data associated with the same unlocking operation.

30\. A device for marking a user identity attribute of data applied to a server, comprising:
a receiving module configured to receive peephole viewer data sent by a smart peephole viewer, wherein the peephole viewer data carries an identity attribute of an unlocker, and the peephole viewer data is generated after the smart peephole viewer receives a video trigger instruction that is sent by an associated smart door lock and carries the identity attribute of the unlocker;
a recognition module configured to recognize a face image included in the peephole viewer data; and
an identity marking module configured to obtain a marked face image by establishing an association relationship between the identity attribute of the unlocker and the face image.

31\. A monitoring system, comprising:
a monitoring device including a slave machine installed outside a door and a master machine installed inside the door, the master machine being communicatively connected with the slave machine; wherein the slave machine includes a passive infrared sensor (PIR) and a camera and the master machine includes a controller, at least one infrared ranging sensor and a display screen; and
the controller is communicatively connected with the PIR, the camera, the infrared ranging sensor, and the display screen, respectively.

32\. A method for screen controlling of a monitoring device applied to a monitoring device, comprising:
in response to a determination that a passive infrared sensor (PIR) is triggered, turning on a camera installed outside a door for videoing;
determining whether there is any person within a preset range inside the door;
in response to a determination that there is a person and a display screen of the monitoring device is turned off, turning on the display screen, and displaying real-time videos collected by the camera, wherein the display screen is in a screen-on state after being turned on; or
in response to a determination that there is no person, refraining from turning on the display screen when the display screen of the monitoring device is turned off, and
turning off the display screen when the display screen is in a screen-on state. 84 85 86 87 88 89 90 91 92 93

OFFICE ACTION:
DETAILED ACTION
Notice of Pre-AIA  or AIA  Status
The present application, filed on or after March 16, 2013, is being examined under the first inventor to file provisions of the AIA .
Priority
Receipt is acknowledged of certified copies of papers required by 37 CFR 1.55.
Information Disclosure Statement
The information disclosure statement (IDS) submitted on 07/26/2021 is in compliance with the provisions of 37 CFR 1.97.  Accordingly, the information disclosure statement is being considered by the examiner.
Claim Rejections - 35 USC § 101
35 U.S.C. 101 reads as follows:
Whoever invents or discovers any new and useful process, machine, manufacture, or composition of matter, or any new and useful improvement thereof, may obtain a patent therefor, subject to the conditions and requirements of this title.
Claims 1-14, 17-19, 21 and 33-34 rejected under 35 U.S.C. 101 because the claimed invention is directed to an abstract idea without significantly more.
Regarding Claim 1,
Step 1 Analysis: Claim 1 is directed to a machine, which falls within one of the four statutory categories.
Step 2A Prong 1 Analysis: Claim 1 recites, in part, obtain first data from a first device; obtain second data from a second device; and associate and process the first data and/or the second data. The limitations of obtain first data from a first device; obtain second data from a second device; and associate and process the first data and/or the second data, as drafted, are processes that, under broadest reasonable interpretation, covers the performance of the limitation in the mind which falls within the “Mental Processes” grouping of abstract ideas. The limitations of:
associate and process the first data and/or the second data can be considered to be an evaluation in the human mind
Accordingly, the claim recites an abstract idea.
Step 2A Prong 2 Analysis: This judicial exception is not integrated into a practical application. In particular, the claim recites the additional elements – “a processor” and “a storage device”. Thus, the elements in the claim are recited at a high level of generality (i.e., as a generic processor performing a generic computer function of generating an index) such that it amounts to no more than mere instructions to apply the exception using a generic computer component. Accordingly, these additional elements do not integrate the abstract idea into a practical application because they do not impose any meaningful limits on practicing the abstract idea. The claim as a whole is directed to an abstract idea. Accordingly, these additional element does not integrate the abstract idea into a practical application because it does not impose any meaningful limits on practicing the abstract idea. Please see MPEP §2106.04.(a)(2).III.C. The claim is directed to an abstract idea.
The claim further recites obtain first data from a first device; obtain second data from a second device. These limitations are insignificant extra-solution activities and are mere data gathering steps. Accordingly, these additional elements do not integrate the abstract idea into a practical application because they do not impose any meaningful limits on practicing the abstract idea.
Step 2B Analysis: The claim does not include additional elements that are sufficient to amount to significantly more than the judicial exception. As discussed above with respect to integration of the abstract idea into a practical application, the additional elements of utilizing a processor and a storage device to perform the steps of the claimed process amount to no more than mere instructions to apply the exception using a generic computer component. Mere instructions to apply an exception using a generic computer component cannot provide an inventive concept. Please see MPEP §2106.05(b). The claim is not patent eligible.
Regarding dependent claims 1-14, 17-18 and 33-34, they do not overcome the deficiencies of the rejected independent claim 1 and they are also rejected.
Regarding Claim 19,
Step 1 Analysis: Claim 19 is directed to a process, which falls within one of the four statutory categories.
Step 2A Prong 1 Analysis: Claim 19 recites, in part, obtain first data from a first device; obtain second data from a second device; and associate and process the first data and/or the second data. The limitations of obtain first data from a first device; obtain second data from a second device; and associate and process the first data and/or the second data, as drafted, are processes that, under broadest reasonable interpretation, covers the performance of the limitation in the mind which falls within the “Mental Processes” grouping of abstract ideas. The limitations of:
associate and process the first data and/or the second data can be considered to be an evaluation in the human mind
Accordingly, the claim recites an abstract idea.
Step 2A Prong 2 Analysis: This judicial exception is not integrated into a practical application. In particular, the claim recites the additional elements – “a first device” and “a second device”. Thus, the elements in the claim are recited at a high level of generality (i.e., as a generic processor performing a generic computer function of generating an index) such that it amounts to no more than mere instructions to apply the exception using a generic computer component. Accordingly, these additional elements do not integrate the abstract idea into a practical application because they do not impose any meaningful limits on practicing the abstract idea. The claim as a whole is directed to an abstract idea. Accordingly, these additional element does not integrate the abstract idea into a practical application because it does not impose any meaningful limits on practicing the abstract idea. Please see MPEP §2106.04.(a)(2).III.C. The claim is directed to an abstract idea.
The claim further recites obtain first data from a first device; obtain second data from a second device. These limitations are insignificant extra-solution activities and are mere data gathering steps. Accordingly, these additional elements do not integrate the abstract idea into a practical application because they do not impose any meaningful limits on practicing the abstract idea.
Step 2B Analysis: The claim does not include additional elements that are sufficient to amount to significantly more than the judicial exception. As discussed above with respect to integration of the abstract idea into a practical application, the additional elements of utilizing a processor and a storage device to perform the steps of the claimed process amount to no more than mere instructions to apply the exception using a generic computer component. Mere instructions to apply an exception using a generic computer component cannot provide an inventive concept. Please see MPEP §2106.05(b). The claim is not patent eligible.
Regarding Claim 21,
Step 1 Analysis: Claim 21 is directed to a machine, which falls within one of the four statutory categories.
Step 2A Prong 1 Analysis: Claim 21 recites, in part, obtaining door lock data uploaded by a smart door lock and peephole viewer data uploaded by a smart peephole viewer associated with a same user identifier; determining door lock data and peephole viewer data associated with a same unlocking operation; and associating the door lock data and the peephole viewer data associated with the same unlocking operation to obtain associated data, as drafted, are processes that, under broadest reasonable interpretation, covers the performance of the limitation in the mind which falls within the “Mental Processes” grouping of abstract ideas. The limitations of:
determining door lock data and peephole viewer data associated with a same unlocking operation can be considered to be an evaluation in the human mind,
and associating the door lock data and the peephole viewer data associated with the same unlocking operation to obtain associated data can be considered to be an evaluation in the human mind
Accordingly, the claim recites an abstract idea.
Step 2A Prong 2 Analysis: This judicial exception is not integrated into a practical application. In particular, the claim recites the additional elements – “a server”. Thus, the elements in the claim are recited at a high level of generality (i.e., as a generic processor performing a generic computer function of generating an index) such that it amounts to no more than mere instructions to apply the exception using a generic computer component. Accordingly, these additional elements do not integrate the abstract idea into a practical application because they do not impose any meaningful limits on practicing the abstract idea. The claim as a whole is directed to an abstract idea. Accordingly, these additional element does not integrate the abstract idea into a practical application because it does not impose any meaningful limits on practicing the abstract idea. Please see MPEP §2106.04.(a)(2).III.C. The claim is directed to an abstract idea.
The claim further recites obtaining door lock data uploaded by a smart door lock and peephole viewer data uploaded by a smart peephole viewer associated with a same user identifier. This limitation is insignificant extra-solution activities and are mere data gathering steps. Accordingly, this additional element does not integrate the abstract idea into a practical application because they do not impose any meaningful limits on practicing the abstract idea.
Step 2B Analysis: The claim does not include additional elements that are sufficient to amount to significantly more than the judicial exception. As discussed above with respect to integration of the abstract idea into a practical application, the additional elements of utilizing a server device to perform the steps of the claimed process amount to no more than mere instructions to apply the exception using a generic computer component. Mere instructions to apply an exception using a generic computer component cannot provide an inventive concept. Please see MPEP §2106.05(b). The claim is not patent eligible.
Claim Rejections - 35 USC § 102
In the event the determination of the status of the application as subject to AIA  35 U.S.C. 102 and 103 (or as subject to pre-AIA  35 U.S.C. 102 and 103) is incorrect, any correction of the statutory basis (i.e., changing from AIA  to pre-AIA ) for the rejection will not be considered a new ground of rejection if the prior art relied upon, and the rationale supporting the rejection, would be the same under either status.
The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that form the basis for the rejections under this section made in this Office action:
A person shall be entitled to a patent unless –
(a)(1) the claimed invention was patented, described in a printed publication, or in public use, on sale, or otherwise available to the public before the effective filing date of the claimed invention.
Claims 1-14, 19 and 21 are rejected under 35 U.S.C. 102(a)(1) as being anticipated by Siminoff et al. US PG-Pub(US 20180220108 A1).
Regarding Claim 1, Siminoff teaches a security control system, comprising: at least one storage device storing a set of instructions(¶[0239] The computer system 900 may include at least one processor 910, memory 920, at least one storage device 930,); and one or more processors in communication with the at least one storage device, wherein when executing the set of instructions, the one or more processors are configured to direct the system(¶[0237], The memory 854 may store instructions for communicating with other systems, such as a computer. The memory 854 may store, for example, a program (e.g., computer program code) adapted to direct the processor 852 in accordance with the present embodiments. The instructions also may include program elements, such as an operating system. While execution of sequences of instructions in the program causes the processor 852 to perform the process steps described herein,) to: obtain first data from a first device(¶[0008], receiving, from an A/V recording and communication device of the plurality of A/V recording and communication devices, first data including image data generated by a camera of the A/V recording and communication device); obtain second data from a second device(¶[0008], receiving, from an additional source, second data. ¶[0009], wherein the additional image data comprises the second data and is captured by a camera of a second A/V recording and communication device of the plurality of A/V recording and communication devices); and associate and process the first data and/or the second data (¶[0281], the data analysis module 1182 may configure the processor 1172 to analyze the first image data 1060 with the analysis resulting in recognition of a person in the image data. The data analysis module 1182 may then configure the processor 1172 to compare characteristics of the person to the second image data 1090, e.g., to determine whether the person was also included in the second image data 1090 captured by the second A/V recording and communication device 1012.)
Regarding Claim 2, Siminoff teaches the system of claim 1, wherein the one or more processors are further configured to direct the system to: send the processed first data and second data to a server and/or a user terminal. (¶[0127,], The A/V recording and communication doorbell 100 may also communicate with one or more remote storage device(s) 116 (may be referred to interchangeably as “cloud storage device(s)”), one or more servers 118, and/or a backend API (application programming interface) 120 via the user's network 110.)
Regarding Claim 3, Siminoff teaches the system of claim 1, wherein the first device includes a monitoring data obtaining device(¶[0126], The A/V recording and communication doorbell 100 includes a camera 102, a microphone 104, and a speaker 106. The camera 102 may comprise, for example, a high definition (HD) video camera, such as one capable of capturing video images at an image display resolution of 720p or better.), and the second device includes an access switch device or a smart lock. (¶[0256] The one or more automation devices 1038(b) may include, for example, at least one of an outdoor lighting system, an indoor lighting system, and indoor/outdoor lighting system, a temperature control system (e.g., a thermostat), a shade/blind control system, a locking control system (e.g., door lock, window lock, etc.),)
Regarding Claim 4, Siminoff teaches the system of claim 3, wherein the second data includes at least one of operation instructions, execution results of operation instructions, identification information of the second device, identity information, or a password. (¶[0262], the backend server 1030 may search the output signal 1096 to find a match of the entity of interest identified in the share signal, as further described below. For example, in some embodiments, the backend server 1030 may receive first image data 1060 of an entity of interest and may search and find a match of the entity of interest in the second image data 1090. In a further example, in some embodiments, the backend server 1030 may receive a text-based 1064 description of an entity of interest and may search and find a match of the entity of interest in second image data 1090.)
Regarding Claim 5, Siminoff teaches the system of claim 1, wherein to associate and process the first data and/or the second data, the one or more processors are further configured to direct the system to: in response to a determination that the second device detects the second data, control the first device to collect the first data and integrate an association identifier related to the second data into the first data(¶[0281], the data analysis module 1182 may configure the processor 1172 to analyze the first image data 1060 with the analysis resulting in recognition of a person in the image data. The data analysis module 1182 may then configure the processor 1172 to compare characteristics of the person to the second image data 1090, e.g., to determine whether the person was also included in the second image data 1090 captured by the second A/V recording and communication device 1012.); or in response to a determination that the first device detects the first data, obtain an association identifier related to the first data, and in response to a determination that the second device detects the second data within a preset time, integrate the association identifier related to the first data into the second data. (¶[0311], In some embodiments, a match (block B1312) of the person of interest in the second image data 1090 may be confirmed by a human operator. In addition, searching (block B1310) the second image data 1090 for the match (block B1314) of the person of interest may be restricted to a subset of the second image data 1090, such as a subset of the second image data captured during a predetermined length of time before and/or the capture of the first image data 1060 that includes the person of interest)
Regarding Claim 6, Siminoff teaches the system of claim 1, wherein to associate and process the first data and/or the second data, the one or more processors are further configured to direct the system to: establish an association relationship between the first data and the corresponding second data based on the association identifier carried by the first data and/or the second data([0311] In further reference to FIG. 53, the process 1300 may include searching (block B1310) the second image data 1090 for a match (block B1312) of the person of interest in the first image data 1060. In many embodiments, the search (block B1310) of the second image data 1090 for a match (block B1312) of the person of interest in the first image data 1060 may be automated using various imaging processing techniques and/or machine learning processes. For example, in some embodiments, searching (block B1310) the second image data 1090 for the match (block B1312) of the person of interest may be performed using facial recognition processes, color matching schemes, and/or using a body build score. In some embodiments, a match (block B1312) of the person of interest in the second image data 1090 may be confirmed by a human operator. In addition, searching (block B1310) the second image data 1090 for the match (block B1314) of the person of interest may be restricted to a subset of the second image data 1090, such as a subset of the second image data captured during a predetermined length of time before and/or the capture of the first image data 1060 that includes the person of interest. As described in ¶[0311], the prior art is determining a relationship between the first and second image data and determining if a person of interest is in both images.)
Regarding Claim 7, Siminoff teaches the system of claim 1, wherein to associate and process the first data and/or the second data(¶[0281], the data analysis module 1182 may configure the processor 1172 to analyze the first image data 1060 with the analysis resulting in recognition of a person in the image data. The data analysis module 1182 may then configure the processor 1172 to compare characteristics of the person to the second image data 1090, e.g., to determine whether the person was also included in the second image data 1090 captured by the second A/V recording and communication device 1012.), the one or more processors are further configured to direct the system to: integrate an obtaining time of the first data and an obtaining time of the second data into the first data and the second data, respectively(0038] In another embodiment of the second aspect, the method further includes receiving at least one of a time or a location associated with the image data. As described in further detail in ¶[0161], the prior art is able to determine a time in which the image data is captured and records that data and uploads it onto a cloud server.).
Regarding Claim 8, Siminoff teaches the system of claim 1, wherein to associate and process the first data and/or the second data(¶[0281], the data analysis module 1182 may configure the processor 1172 to analyze the first image data 1060 with the analysis resulting in recognition of a person in the image data. The data analysis module 1182 may then configure the processor 1172 to compare characteristics of the person to the second image data 1090, e.g., to determine whether the person was also included in the second image data 1090 captured by the second A/V recording and communication device 1012.), the one or more processors are further configured to direct the system to: determine, based on the obtaining time carried by the second data([0038] In another embodiment of the second aspect, the method further includes receiving at least one of a time or a location associated with the image data), whether the obtaining time carried by the first data from a same security device includes the obtaining time carried by the second data; and in response to a determination that the obtaining time carried by the first data includes the obtaining time carried by the second data, establish an association relationship between the first data and the corresponding second data. (¶0247], the realization that users of audio/video (A/V) recording and communication devices may from time to time desire to share video footage recorded by their devices. For example, when an A/V recording and communication device records video footage of suspicious activity, or even criminal activity, a user viewing the footage may desire to alert his or her neighbors to the possible danger posed by the person(s) involved in the suspicious or criminal activity. As described in ¶[0247], the prior art is able to determine a timing between the devices and if the user desires they can share the images and times captured to different users to report suspicious activities.)
Regarding Claim 9, Siminoff teaches the system of claim 1, wherein to associate and process the first data and/or the second data, the one or more processors are further configured to direct the system to: recognize an operator image from the first data using an image recognition algorithm(¶[0274] In addition to determining whether the first image data 1060, the second image data 1090, and/or the additional image data 1160 contains an object, in any of the present embodiments, the data may be analyzed to determine object data 1196. In some of the present embodiments, one or more of the image data 1060, 1090, 1160, the audio data 1062, 1092, 1162, the text data 1064, 1094, 1164, and/or motion data may be used to determine the object data 1196. The computer vision and/or image processing may be executed using computer vision and/or image processing algorithms); obtain identity information in the second data associated with the first data(¶[0311], In addition, searching (block B1310) the second image data 1090 for the match (block B1314) of the person of interest may be restricted to a subset of the second image data 1090, such as a subset of the second image data captured during a predetermined length of time before and/or the capture of the first image data 1060 that includes the person of interest.); and obtain the operator image marked with the identity information by establishing an association relationship between the identity information and the operator image in the first data([0311] In further reference to FIG. 53, the process 1300 may include searching (block B1310) the second image data 1090 for a match (block B1312) of the person of interest in the first image data 1060. In many embodiments, the search (block B1310) of the second image data 1090 for a match (block B1312) of the person of interest in the first image data 1060 may be automated using various imaging processing techniques and/or machine learning processes. For example, in some embodiments, searching (block B1310) the second image data 1090 for the match (block B1312) of the person of interest may be performed using facial recognition processes, color matching schemes, and/or using a body build score. In some embodiments, a match (block B1312) of the person of interest in the second image data 1090 may be confirmed by a human operator.).
Regarding Claim 10, Siminoff teaches the system of claim 9, wherein the one or more processors are further configured direct the system to: receive the first data obtained by the first device(¶[0008], receiving, from an A/V recording and communication device of the plurality of A/V recording and communication devices, first data including image data generated by a camera of the A/V recording and communication device); recognize a current operator image from the first data using the image recognition algorithm(¶[0274] In addition to determining whether the first image data 1060, the second image data 1090, and/or the additional image data 1160 contains an object, in any of the present embodiments, the data may be analyzed to determine object data 1196. In some of the present embodiments, one or more of the image data 1060, 1090, 1160, the audio data 1062, 1092, 1162, the text data 1064, 1094, 1164, and/or motion data may be used to determine the object data 1196. The computer vision and/or image processing may be executed using computer vision and/or image processing algorithms); and determine an identity of a current operator based on the current operator image and the operator image marked with the identity information([0311] In further reference to FIG. 53, the process 1300 may include searching (block B1310) the second image data 1090 for a match (block B1312) of the person of interest in the first image data 1060. In many embodiments, the search (block B1310) of the second image data 1090 for a match (block B1312) of the person of interest in the first image data 1060 may be automated using various imaging processing techniques and/or machine learning processes. For example, in some embodiments, searching (block B1310) the second image data 1090 for the match (block B1312) of the person of interest may be performed using facial recognition processes, color matching schemes, and/or using a body build score. In some embodiments, a match (block B1312) of the person of interest in the second image data 1090 may be confirmed by a human operator.).
Regarding Claim 11, Siminoff teaches the system of claim 10, wherein the one or more processors are further configured to direct the system to: take corresponding measures based on the identity of the current operator(¶[0172], a first user may view video footage that was recorded by his or her doorbell and determine that the person or persons in the video footage are, or may be, engaged in criminal activity. The first user may then share that video footage with other users who, after viewing the shared video footage, may be alerted to be on the lookout for the person or persons in the shared video footage and, if one or more such other users observe the person or persons in the shared video footage engaged in further suspicious activity, they may be more likely to report the person or persons to law enforcement.); wherein the measures include at least one of: sending at least a portion of the first data and/or at least a portion of the second data to a user terminal associated with the first device for confirmation(¶[0029], the method further includes transmitting, to the first client device, the additional image data and a request to confirm that the additional image data includes the person of interest.), switching a state of the second device, or generating alarm information(¶[0172], a first user may view video footage that was recorded by his or her doorbell and determine that the person or persons in the video footage are, or may be, engaged in criminal activity. The first user may then share that video footage with other users who, after viewing the shared video footage, may be alerted to be on the lookout for the person or persons in the shared video footage and, if one or more such other users observe the person or persons in the shared video footage engaged in further suspicious activity, they may be more likely to report the person or persons to law enforcement.).
Regarding Claim 12. (Original) The system of claim 3, wherein the one or more processors are further configured to direct the system to: obtain a first sensing signal through one or more first sensing units, the first sensing signal being configured to indicate whether there is any person within a preset range of the first device (¶[0273], the first A/V recording and communication device 1002 may do some initial analysis, e.g., to identify an entity in first image data 1060 in the field of view of the first A/V recording and communication device 1002, but the first image data 1060 may be further processed by the backend server 1030, e.g., to determine additional attributes of the first image data 1060 and/or to compare the first image data 1060 to the second image data 1090, the additional image data 1160, and/or other data)control the first device to obtain the first data based on the first sensing signal(¶0264], the user control may cause the client application 1118 to configure the processor 1112 to generate the share signal 1048, for instance. An additional example user interface 1120 may be configured to display a plurality of comments (described below) generated for association with captured data, and allow a user to select one or more of the comments for sharing with the data, e.g., to other users. Selection of the comment(s) may cause the client application 1118 to configure the processor 1112 to generate an output signal 1122 that transmits the comment selection to the backend server 1030..); obtain a second sensing signal through one or more second sensing units, the second sensing signal being configured to indicate whether there is any person within a preset range of a display unit(¶0009], a request to analyze additional image data for the entity of interest, wherein the additional image data comprises the second data and is captured by a camera of a second A/V recording and communication device of the plurality of A/V recording and communication devices associated with the third client device.); and control the display unit to be turned on or off based on the first sensing signal and the second sensing signal, wherein the first data is displayed when the display unit is turned on. (¶[0044], In an embodiment of the third aspect, the indication of the request is generated by the first client device in response to a user interaction with a graphical user interface presented on a display of the first client device.)
Regarding Claim 13, Siminoff teaches the system of claim 12, wherein to control the display unit to be turned on or off based on the first sensing signal and the second sensing signal, the one or more processors are further configured to direct the system to: in response to a determination that the first sensing signal indicates that there is a person within the preset range of the first device, and the second sensing signal indicates that there is a person within the preset range of the display unit, turn on the display unit. (¶[0130], In response to the detection of the visitor, the A/V recording and communication doorbell 100 sends an alert to the user's client device 114 (FIG. 1) via the user's network 110 and the network 112. The A/V recording and communication doorbell 100 also sends streaming video, and may also send streaming audio, to the user's client device 114. If the user answers the alert, two-way audio communication may then occur between the visitor and the user through the A/V recording and communication doorbell 100 and the user's client device 114.)
Regarding Claim 14, Siminoff teaches the system of claim 13, wherein to control the display unit to be turned on or off based on the first sensing signal and the second sensing signal (¶[0044], In an embodiment of the third aspect, the indication of the request is generated by the first client device in response to a user interaction with a graphical user interface presented on a display of the first client device.), the one or more processors are further configured to direct the system to:  time a screen-on duration of the display unit when the display unit is turned on  and turn off the display unit when the display unit is in a screen-on state and the screen-on duration reaches a duration threshold. (¶[0161], at block B310a the live audio/video data may be displayed on the user's client device 114, thereby allowing the user surveillance from the perspective of the doorbell 130. When the user is satisfied with this function, the user may sever the connection at block B312, whereby the session ends. If, however, at block B308 the user denies the notification, or ignores the notification and a specified time interval elapses, then the connection between the doorbell 130 and the user's client device 114 is terminated and the audio/video data is recorded and stored at a cloud server at block B310b, such that the user may view the audio/video data later at their convenience)
Regarding Claim 19, Siminoff teaches a security control method, comprising: obtaining first data from a first device(¶[0008], receiving, from an A/V recording and communication device of the plurality of A/V recording and communication devices, first data including image data generated by a camera of the A/V recording and communication device); obtaining second data from a second device(¶[0008], receiving, from an additional source, second data. ¶[0009], wherein the additional image data comprises the second data and is captured by a camera of a second A/V recording and communication device of the plurality of A/V recording and communication devices); and associating and processing the first data and/or the second data(¶[0281], the data analysis module 1182 may configure the processor 1172 to analyze the first image data 1060 with the analysis resulting in recognition of a person in the image data. The data analysis module 1182 may then configure the processor 1172 to compare characteristics of the person to the second image data 1090, e.g., to determine whether the person was also included in the second image data 1090 captured by the second A/V recording and communication device 1012.).
Regarding Claim 21, Siminoff teaches a data association method applied to a server, comprising: obtaining door lock data uploaded by a smart door lock and peephole viewer data uploaded by a smart peephole viewer associated with a same user identifier([0130] In response to the detection of the visitor, the A/V recording and communication doorbell 100 sends an alert to the user's client device 114 (FIG. 1) via the user's network 110 and the network 112.); determining door lock data and peephole viewer data associated with a same unlocking operation(¶[0254], Smart home devices (e.g., the hub device 1036, the sensors 1038(a), the automation devices 1038(b), the A/V recording and communication devices 1002, etc.), when remotely monitored and controlled via the network (Internet/PSTN) 1010, may be considered to be components of the Internet of Things. Smart home systems may include switches and/or sensors (e.g., the sensors 1038(a) connected to a central hub such as the smart-home hub device 1036, sometimes called a gateway, from which the system may be controlled with a user interface. [0256] The one or more automation devices 1038(b) may include, for example, at least one of an outdoor lighting system, an indoor lighting system, and indoor/outdoor lighting system, a temperature control system (e.g., a thermostat), a shade/blind control system, a locking control system (e.g., door lock, window lock, etc.), As disclosed in ¶[0254]-¶[0256], the prior art is using data from the image data and based on that data they can control a door locking system.); and associating the door lock data and the peephole viewer data associated with the same unlocking operation to obtain associated data.( ¶[0262], in some embodiments, the backend server 1030 may receive first image data 1060 of an entity of interest and may search and find a match of the entity of interest in the second image data 1090. In a further example, in some embodiments, the backend server 1030 may receive a text-based 1064 description of an entity of interest and may search and find a match of the entity of interest in second image data 1090. In some embodiments, the backend server 1030 may first transmit to a second client device 1014, 1016 associated with the second A/V recording and communication device 1012, e.g., via a second hub device, a request to check the second image data 1090 for an entity of interest before searching the second image data 1090, as further described below. As disclosed in ¶[0262], the prior art is determining if the image data contains a person of interest in which the home owner can control if the person is allowed entry.)
Claim Rejections - 35 USC § 103
In the event the determination of the status of the application as subject to AIA  35 U.S.C. 102 and 103 (or as subject to pre-AIA  35 U.S.C. 102 and 103) is incorrect, any correction of the statutory basis (i.e., changing from AIA  to pre-AIA ) for the rejection will not be considered a new ground of rejection if the prior art relied upon, and the rationale supporting the rejection, would be the same under either status.
The following is a quotation of 35 U.S.C. 103 which forms the basis for all obviousness rejections set forth in this Office action:
A patent for a claimed invention may not be obtained, notwithstanding that the claimed invention is not identically disclosed as set forth in section 102, if the differences between the claimed invention and the prior art are such that the claimed invention as a whole would have been obvious before the effective filing date of the claimed invention to a person having ordinary skill in the art to which the claimed invention pertains. Patentability shall not be negated by the manner in which the invention was made.
The factual inquiries for establishing a background for determining obviousness under 35 U.S.C. 103 are summarized as follows:
1. Determining the scope and contents of the prior art.
2. Ascertaining the differences between the prior art and the claims at issue.
3. Resolving the level of ordinary skill in the pertinent art.
4. Considering objective evidence present in the application indicating obviousness or nonobviousness.
Claims 17-18 are rejected under 35 U.S.C. 103 as being unpatentable over Siminoff et al. US PG-Pub(US 20180220108 A1) in view of Han et al.  US PG-Pub(US 20180181797 A1).
Regarding Claim 17, while Siminoff teaches the system of claim 1, Siminoff does not explicitly, wherein the one or more processors are further configured to direct the system to: in response to a determination that an alarm button is triggered, send alarm information to an associated user terminal; or in response to a determination on a basis of the first data that there is an abnormal condition, send alarm information to the associated user terminal.
Han teaches wherein the one or more processors are further configured to direct the system to: in response to a determination that an alarm button is triggered, send alarm information to an associated user terminal; or in response to a determination on a basis of the first data that there is an abnormal condition, send alarm information to the associated user terminal. (¶[0162] For example, the recognition result providing unit 1440 may display information regarding a recognized user, or may output an alarm or a warning message when the recognized user is not a fair user. Alternatively, when the recognized user is a fair user, a predetermined service may be provided.)
It would have been obvious to one of ordinary skill in the art before the effective filing date to modify the claimed invention as taught by Siminoff with Han in order to generate an alarm once an unauthorized person is detected. One skilled in the art would have been motivated to modify Siminoff in this manner in order to search for a criminal suspect and surveillance of a crime-ridden district. (Han, ¶[0005])
Regarding Claim 18, the combination of Siminoff and Han teaches the system of claim 17, where Siminoff further teaches wherein the one or more processors are further configured to direct the system to: receive a data request sent by the associated user terminal; and provide the first data and/or the second data to the associated user terminal. ([0027] In another embodiment of the second aspect, the additional source comprises a second A/V recording and communication device, and the method further comprising: transmitting, to a third client device associated with the second A/V recording and communication device, a request to at least one of receive or access the additional image data, wherein the additional image data is captured by a camera of the second A/V recording and communication device.)
Claims 33-34 are rejected under 35 U.S.C. 103 as being unpatentable over Siminoff et al. US PG-Pub(US 20180220108 A1) in view of Tan et al. US PG-Pub(US 20200014552 A1).
Regarding Claim 33, while Siminoff teaches the system of claim 1, Siminoff does not explicit teach wherein the first data and the second data are associated with a same user identifier, and the second data carries an identity attribute of an unlocker, the one or more processors are further configured to direct the system to: determine first data and second data associated with a same unlocking operation; recognize a face image included in the first data using a face recognition algorithm; and obtain a marked face image by establishing an association relationship between the identity attribute carried by the second data and the face image included in the first data associated with the same unlocking operation.
Tan teaches wherein the first data and the second data are associated with a same user identifier, and the second data carries an identity attribute of an unlocker, the one or more processors are further configured to direct the system to: determine first data and second data associated with a same unlocking operation([0082] In another aspect, the guest may have established a set of faces that, when recognized, unlock a smart-lock, disarm a security system or both. The set of faces for facial recognition are included in the preferences that are applied for the smart-home devices of the rental property 410 during the stay. For example, the facial recognition from images provided by the entry interface system, cameras, or both are used to unlock the smart-lock of an entry door to the rental property 410 or disarm the security system 410 of the rental property 410.); recognize a face image included in the first data using a face recognition algorithm([0056] In another aspect, the entry interface system and the smart-home service 412 apply facial recognition to images of people captured by the camera included in the entry interface system at the rental property 410.); and obtain a marked face image by establishing an association relationship between the identity attribute carried by the second data and the face image included in the first data associated with the same unlocking operation([0056] In another aspect, the entry interface system and the smart-home service 412 apply facial recognition to images of people captured by the camera included in the entry interface system at the rental property 410. The captured images are compared with facial recognition data from the user account of the guest to provide announcements of family members' arrivals at the rental property 410. Additionally or optionally, the guest may add facial recognition associated with the rental property 410 that is retained only for the duration of the stay at the rental property 410 or retained for future visits.)
It would have been obvious to one of ordinary skill in the art before the effective filing date to modify the claimed invention as taught by Siminoff with Tan in order to perform an unlocking operation when a face image is recognized. One skilled in the art would have been motivated to modify Siminoff in this manner in order to monitor environmental and security conditions. (Tan, ¶[0003])
Regarding Claim 34, while Siminoff teaches the system of claim 1, Siminoff does not explicitly teach wherein the second data carries an identity attribute of an unlocker, and the first data is generated after the first device receives a video trigger instruction that is sent by the associated second device and carries the identity attribute of the unlocker, the one or more processors are further configured to direct the system to; recognize a face image included in the first data; and obtain a marked face image by establishing an association relationship between the identity attribute of the unlocker and the face image.
Tan teaches wherein the second data carries an identity attribute of an unlocker, and the first data is generated after the first device receives a video trigger instruction that is sent by the associated second device and carries the identity attribute of the unlocker([0055] An entry interface system (e.g., video doorbell) installed at the rental property 410 provides enhanced security for the guest during the stay at the rental property 410. In aspects, based on motion detection, proximity detection, or a push of a button on the entry interface system, the guest receives a push alert, in the smart-home application 406, to the presence of persons at the entry of the rental property 410.), the one or more processors are further configured to direct the system to; recognize a face image included in the first data([0056] In another aspect, the entry interface system and the smart-home service 412 apply facial recognition to images of people captured by the camera included in the entry interface system at the rental property 410.); and obtain a marked face image by establishing an association relationship between the identity attribute of the unlocker and the face image. ([0056] In another aspect, the entry interface system and the smart-home service 412 apply facial recognition to images of people captured by the camera included in the entry interface system at the rental property 410. The captured images are compared with facial recognition data from the user account of the guest to provide announcements of family members' arrivals at the rental property 410. Additionally or optionally, the guest may add facial recognition associated with the rental property 410 that is retained only for the duration of the stay at the rental property 410 or retained for future visits.)
It would have been obvious to one of ordinary skill in the art before the effective filing date to modify the claimed invention as taught by Siminoff with Tan in order to use a push notification when a person is detected by the system. One skilled in the art would have been motivated to modify Siminoff in this manner in order to monitor environmental and security conditions. (Tan, ¶[0003])
Conclusion


NEXT OFFICE ACTION: DETAILED ACTION
Notice of Pre-AIA  or AIA  Status
The present application, filed on or after March 16, 2013, is being examined under the first inventor to file provisions of the AIA .
Information Disclosure Statement
The information disclosure statement (IDS) submitted on 03/21/2024 is in compliance with the provisions of 37 CFR 1.97.  Accordingly, the information disclosure statement is being considered by the examiner.
Response to Arguments
Applicant’s arguments with respect to the rejection under 35 USC § 101 has been considered and the rejection is now withdrawn due to the amendments to the independent claims.
Applicant’s arguments with respect to claims 1-2, 4-14, 17-19, 21 and 33-35 have been considered but are moot because the new ground of rejection set forth below.
The applicant argues on page 20 of the remarks that the prior art of Siminoff does not explicitly disclose a first device including a monitoring data obtaining device and  second device including an access switch device or a smart lock. The Examiner respectfully disagrees as in ¶[0126], the prior discloses obtaining video image data from a doorbell camera security system which serves as a first device and in ¶[0256] “The one or more automation devices 1038(b) may include, for example, at least one of an outdoor lighting system, an indoor lighting system, and indoor/outdoor lighting system, a temperature control system (e.g., a thermostat), a shade/blind control system, a locking control system (e.g., door lock, window lock, etc.),” , ¶[0256], discloses multiple devices that could be interpreted as a second device and listed in the type of devices includes a locking control system. Thus the applicant’s arguments are not persuasive.
The applicant further argues on page 21 of the remarks that the prior art of Siminoff does not explicitly disclose encapsulate the processed first data and second data in a data packet and store the data packet in a storage device. The examiner agrees Siminoff doesn’t appear to disclose this newly added limitation however after further search the prior art of Kim US PG-Pub(US 20170200356 A1) would disclose this limitation. Please see updated 35 USC § 103 rejection below.
Claim Rejections - 35 USC § 103
In the event the determination of the status of the application as subject to AIA  35 U.S.C. 102 and 103 (or as subject to pre-AIA  35 U.S.C. 102 and 103) is incorrect, any correction of the statutory basis (i.e., changing from AIA  to pre-AIA ) for the rejection will not be considered a new ground of rejection if the prior art relied upon, and the rationale supporting the rejection, would be the same under either status.
The following is a quotation of 35 U.S.C. 103 which forms the basis for all obviousness rejections set forth in this Office action:
A patent for a claimed invention may not be obtained, notwithstanding that the claimed invention is not identically disclosed as set forth in section 102, if the differences between the claimed invention and the prior art are such that the claimed invention as a whole would have been obvious before the effective filing date of the claimed invention to a person having ordinary skill in the art to which the claimed invention pertains. Patentability shall not be negated by the manner in which the invention was made.
The factual inquiries for establishing a background for determining obviousness under 35 U.S.C. 103 are summarized as follows:
1. Determining the scope and contents of the prior art.
2. Ascertaining the differences between the prior art and the claims at issue.
3. Resolving the level of ordinary skill in the pertinent art.
4. Considering objective evidence present in the application indicating obviousness or nonobviousness.
Claims 1-2 and 4-14, 19, 21 and 35 are rejected under 35 U.S.C. 103 as being unpatentable over Siminoff et al. US PG-Pub(US 20180220108 A1) in view of Kim US PG-Pub(US 20170200356 A1).
Regarding Claim 1, Siminoff teaches a security control system, comprising: at least one storage device storing a set of instructions(¶[0239], “The computer system 900 may include at least one processor 910, memory 920, at least one storage device 930,” , ¶[0239] discloses a memory and storage device.); and one or more processors in communication with the at least one storage device, wherein when executing the set of instructions, the one or more processors are configured to direct the system(¶[0237], “The memory 854 may store instructions for communicating with other systems, such as a computer. The memory 854 may store, for example, a program (e.g., computer program code) adapted to direct the processor 852 in accordance with the present embodiments. The instructions also may include program elements, such as an operating system. While execution of sequences of instructions in the program causes the processor 852 to perform the process steps described herein,”, ¶[0237], discloses a memory that stores a program that a processor uses to execute.) to: obtain first data from a first device(¶[0008], “receiving, from an A/V recording and communication device of the plurality of A/V recording and communication devices, first data including image data generated by a camera of the A/V recording and communication device”, ¶[0008], discloses image data obtained by a camera of the recording device.);  the first device including a monitoring data obtaining device(¶[0126], “The A/V recording and communication doorbell 100 includes a camera 102, a microphone 104, and a speaker 106. The camera 102 may comprise, for example, a high definition (HD) video camera, such as one capable of capturing video images at an image display resolution of 720p or better.”, ¶[0126], discloses obtaining video image data from a doorbell camera security system.),obtain second data from a second device(¶[0008],”receiving, from an additional source, second data.” ¶[0009], “wherein the additional image data comprises the second data and is captured by a camera of a second A/V recording and communication device of the plurality of A/V recording and communication devices.”, ¶[0008]-¶[0009] disclose second data is received from a second recording device.) the second device including an access switch device or a smart lock. (¶[0256] “The one or more automation devices 1038(b) may include, for example, at least one of an outdoor lighting system, an indoor lighting system, and indoor/outdoor lighting system, a temperature control system (e.g., a thermostat), a shade/blind control system, a locking control system (e.g., door lock, window lock, etc.),” , ¶[0256], discloses multiple devices that could be interpreted as a second device and listed in the type of devices includes a locking control system.)associate and process the first data and the second data (¶[0281], “the data analysis module 1182 may configure the processor 1172 to analyze the first image data 1060 with the analysis resulting in recognition of a person in the image data. The data analysis module 1182 may then configure the processor 1172 to compare characteristics of the person to the second image data 1090, e.g., to determine whether the person was also included in the second image data 1090 captured by the second A/V recording and communication device 1012.”, ¶[0281], discloses the data analysis module obtains data from the devices and uses the data to determine if a person appears in both devices.)
Siminoff does not explicitly teach encapsulate the processed first data and second data in a data packet and store the data packet in a storage device
Kim teaches encapsulate the processed first data and second data in a data packet([0049], “The surveillance server 200 is an apparatus capable of sensing an abnormal situation of the surveillance camera 100 and handling the sensed abnormal situation. The surveillance server 200 may be connected to a plurality of surveillance cameras 100 over the Internet network and receive network packets from the surveillance cameras 100. The received network packet is a packet containing, for example, a compressed video data, a sensing data or a control data requesting to perform a specific operation.” As disclosed in ¶[0049], the prior art is generating a network packet from the surveillance cameras and the packet contains compressed video data, sensing data or control data.); and store the data packet in a storage device (¶[0044], “In addition, the surveillance camera 100 may sense various type of intrusions from the outside and abnormal situations occurring in a space in which the surveillance camera 100 is installed and transmit a network packet containing a sensing data according thereto over the Internet network. The network packet of the sensing data is transferred to the surveillance server 200” as disclosed in ¶[0044], the prior art transmits a data packet to a surveillance server which is a storage device.).
It would have been obvious to one of ordinary skill in the art before the effective filing date to modify the claimed invention as taught by Siminoff with Kim in order to encapsulate the first and second data into a data packet. One skilled in the art would have been motivated to modify Siminoff in this manner in order to convert data of the network packet into a video data to be output to the display unit. (Kim, ¶[0013])
Regarding Claim 2, the combination of Siminoff and Kim teach the system of claim 1, where Siminoff further teaches wherein the one or more processors are further configured to direct the system to: send the processed first data and second data to a server and/or a user terminal. (¶[0127,], The A/V recording and communication doorbell 100 may also communicate with one or more remote storage device(s) 116 (may be referred to interchangeably as “cloud storage device(s)”), one or more servers 118, and/or a backend API (application programming interface) 120 via the user's network 110.)
Regarding Claim 4, the combination of Siminoff and Kim teach the system of claim 1, where Siminoff further teaches wherein the second data includes at least one of operation instructions, execution results of operation instructions, identification information of the second device, identity information, or a password. (¶[0262], the backend server 1030 may search the output signal 1096 to find a match of the entity of interest identified in the share signal, as further described below. For example, in some embodiments, the backend server 1030 may receive first image data 1060 of an entity of interest and may search and find a match of the entity of interest in the second image data 1090. In a further example, in some embodiments, the backend server 1030 may receive a text-based 1064 description of an entity of interest and may search and find a match of the entity of interest in second image data 1090.)
Regarding Claim 5, the combination of Siminoff and Kim teach the system of claim 1, where Siminoff further teaches wherein to associate and process the first data and/or the second data, the one or more processors are further configured to direct the system to: in response to a determination that the second device detects the second data, control the first device to collect the first data and integrate an association identifier related to the second data into the first data(¶[0281], the data analysis module 1182 may configure the processor 1172 to analyze the first image data 1060 with the analysis resulting in recognition of a person in the image data. The data analysis module 1182 may then configure the processor 1172 to compare characteristics of the person to the second image data 1090, e.g., to determine whether the person was also included in the second image data 1090 captured by the second A/V recording and communication device 1012.); or in response to a determination that the first device detects the first data, obtain an association identifier related to the first data, and in response to a determination that the second device detects the second data within a preset time, integrate the association identifier related to the first data into the second data. (¶[0311], In some embodiments, a match (block B1312) of the person of interest in the second image data 1090 may be confirmed by a human operator. In addition, searching (block B1310) the second image data 1090 for the match (block B1314) of the person of interest may be restricted to a subset of the second image data 1090, such as a subset of the second image data captured during a predetermined length of time before and/or the capture of the first image data 1060 that includes the person of interest)
Regarding Claim 6, the combination of Siminoff and Kim teach the system of claim 1, where Siminoff further teaches wherein to associate and process the first data and/or the second data, the one or more processors are further configured to direct the system to: establish an association relationship between the first data and the corresponding second data based on the association identifier carried by the first data and/or the second data([0311] In further reference to FIG. 53, the process 1300 may include searching (block B1310) the second image data 1090 for a match (block B1312) of the person of interest in the first image data 1060. In many embodiments, the search (block B1310) of the second image data 1090 for a match (block B1312) of the person of interest in the first image data 1060 may be automated using various imaging processing techniques and/or machine learning processes. For example, in some embodiments, searching (block B1310) the second image data 1090 for the match (block B1312) of the person of interest may be performed using facial recognition processes, color matching schemes, and/or using a body build score. In some embodiments, a match (block B1312) of the person of interest in the second image data 1090 may be confirmed by a human operator. In addition, searching (block B1310) the second image data 1090 for the match (block B1314) of the person of interest may be restricted to a subset of the second image data 1090, such as a subset of the second image data captured during a predetermined length of time before and/or the capture of the first image data 1060 that includes the person of interest. As described in ¶[0311], the prior art is determining a relationship between the first and second image data and determining if a person of interest is in both images.)
Regarding Claim 7, the combination of Siminoff and Kim teach the system of claim 1, where Siminoff further teaches wherein to associate and process the first data and/or the second data(¶[0281], the data analysis module 1182 may configure the processor 1172 to analyze the first image data 1060 with the analysis resulting in recognition of a person in the image data. The data analysis module 1182 may then configure the processor 1172 to compare characteristics of the person to the second image data 1090, e.g., to determine whether the person was also included in the second image data 1090 captured by the second A/V recording and communication device 1012.), the one or more processors are further configured to direct the system to: integrate an obtaining time of the first data and an obtaining time of the second data into the first data and the second data, respectively(0038] In another embodiment of the second aspect, the method further includes receiving at least one of a time or a location associated with the image data. As described in further detail in ¶[0161], the prior art is able to determine a time in which the image data is captured and records that data and uploads it onto a cloud server.).
Regarding Claim 8, the combination of Siminoff and Kim teach the system of claim 1, where Siminoff further teaches wherein to associate and process the first data and/or the second data(¶[0281], the data analysis module 1182 may configure the processor 1172 to analyze the first image data 1060 with the analysis resulting in recognition of a person in the image data. The data analysis module 1182 may then configure the processor 1172 to compare characteristics of the person to the second image data 1090, e.g., to determine whether the person was also included in the second image data 1090 captured by the second A/V recording and communication device 1012.), the one or more processors are further configured to direct the system to: determine, based on the obtaining time carried by the second data([0038] In another embodiment of the second aspect, the method further includes receiving at least one of a time or a location associated with the image data), whether the obtaining time carried by the first data from a same security device includes the obtaining time carried by the second data; and in response to a determination that the obtaining time carried by the first data includes the obtaining time carried by the second data, establish an association relationship between the first data and the corresponding second data. (¶0247], the realization that users of audio/video (A/V) recording and communication devices may from time to time desire to share video footage recorded by their devices. For example, when an A/V recording and communication device records video footage of suspicious activity, or even criminal activity, a user viewing the footage may desire to alert his or her neighbors to the possible danger posed by the person(s) involved in the suspicious or criminal activity. As described in ¶[0247], the prior art is able to determine a timing between the devices and if the user desires they can share the images and times captured to different users to report suspicious activities.)
Regarding Claim 9, the combination of Siminoff and Kim teach the system of claim 1, where Siminoff further teaches wherein to associate and process the first data and/or the second data, the one or more processors are further configured to direct the system to: recognize an operator image from the first data using an image recognition algorithm(¶[0274] In addition to determining whether the first image data 1060, the second image data 1090, and/or the additional image data 1160 contains an object, in any of the present embodiments, the data may be analyzed to determine object data 1196. In some of the present embodiments, one or more of the image data 1060, 1090, 1160, the audio data 1062, 1092, 1162, the text data 1064, 1094, 1164, and/or motion data may be used to determine the object data 1196. The computer vision and/or image processing may be executed using computer vision and/or image processing algorithms); obtain identity information in the second data associated with the first data(¶[0311], In addition, searching (block B1310) the second image data 1090 for the match (block B1314) of the person of interest may be restricted to a subset of the second image data 1090, such as a subset of the second image data captured during a predetermined length of time before and/or the capture of the first image data 1060 that includes the person of interest.); and obtain the operator image marked with the identity information by establishing an association relationship between the identity information and the operator image in the first data([0311] In further reference to FIG. 53, the process 1300 may include searching (block B1310) the second image data 1090 for a match (block B1312) of the person of interest in the first image data 1060. In many embodiments, the search (block B1310) of the second image data 1090 for a match (block B1312) of the person of interest in the first image data 1060 may be automated using various imaging processing techniques and/or machine learning processes. For example, in some embodiments, searching (block B1310) the second image data 1090 for the match (block B1312) of the person of interest may be performed using facial recognition processes, color matching schemes, and/or using a body build score. In some embodiments, a match (block B1312) of the person of interest in the second image data 1090 may be confirmed by a human operator.).
Regarding Claim 10, the combination of Siminoff and Kim teach the system of claim 9, where Siminoff further teaches wherein the one or more processors are further configured direct the system to: receive the first data obtained by the first device(¶[0008], receiving, from an A/V recording and communication device of the plurality of A/V recording and communication devices, first data including image data generated by a camera of the A/V recording and communication device); recognize a current operator image from the first data using the image recognition algorithm(¶[0274] In addition to determining whether the first image data 1060, the second image data 1090, and/or the additional image data 1160 contains an object, in any of the present embodiments, the data may be analyzed to determine object data 1196. In some of the present embodiments, one or more of the image data 1060, 1090, 1160, the audio data 1062, 1092, 1162, the text data 1064, 1094, 1164, and/or motion data may be used to determine the object data 1196. The computer vision and/or image processing may be executed using computer vision and/or image processing algorithms); and determine an identity of a current operator based on the current operator image and the operator image marked with the identity information([0311] In further reference to FIG. 53, the process 1300 may include searching (block B1310) the second image data 1090 for a match (block B1312) of the person of interest in the first image data 1060. In many embodiments, the search (block B1310) of the second image data 1090 for a match (block B1312) of the person of interest in the first image data 1060 may be automated using various imaging processing techniques and/or machine learning processes. For example, in some embodiments, searching (block B1310) the second image data 1090 for the match (block B1312) of the person of interest may be performed using facial recognition processes, color matching schemes, and/or using a body build score. In some embodiments, a match (block B1312) of the person of interest in the second image data 1090 may be confirmed by a human operator.).
Regarding Claim 11, the combination of Siminoff and Kim teach the system of claim 10, where Siminoff further teaches wherein the one or more processors are further configured to direct the system to: take corresponding measures based on the identity of the current operator(¶[0172], a first user may view video footage that was recorded by his or her doorbell and determine that the person or persons in the video footage are, or may be, engaged in criminal activity. The first user may then share that video footage with other users who, after viewing the shared video footage, may be alerted to be on the lookout for the person or persons in the shared video footage and, if one or more such other users observe the person or persons in the shared video footage engaged in further suspicious activity, they may be more likely to report the person or persons to law enforcement.); wherein the measures include at least one of: sending at least a portion of the first data and/or at least a portion of the second data to a user terminal associated with the first device for confirmation(¶[0029], the method further includes transmitting, to the first client device, the additional image data and a request to confirm that the additional image data includes the person of interest.), switching a state of the second device, or generating alarm information(¶[0172], a first user may view video footage that was recorded by his or her doorbell and determine that the person or persons in the video footage are, or may be, engaged in criminal activity. The first user may then share that video footage with other users who, after viewing the shared video footage, may be alerted to be on the lookout for the person or persons in the shared video footage and, if one or more such other users observe the person or persons in the shared video footage engaged in further suspicious activity, they may be more likely to report the person or persons to law enforcement.).
Regarding Claim 12, the combination of Siminoff and Kim teach the system of claim 1, where Siminoff further teaches wherein the one or more processors are further configured to direct the system to: obtain a first sensing signal through one or more first sensing units, the first sensing signal being configured to indicate whether there is any person within a preset range of the first device (¶[0273], the first A/V recording and communication device 1002 may do some initial analysis, e.g., to identify an entity in first image data 1060 in the field of view of the first A/V recording and communication device 1002, but the first image data 1060 may be further processed by the backend server 1030, e.g., to determine additional attributes of the first image data 1060 and/or to compare the first image data 1060 to the second image data 1090, the additional image data 1160, and/or other data)control the first device to obtain the first data based on the first sensing signal(¶0264], the user control may cause the client application 1118 to configure the processor 1112 to generate the share signal 1048, for instance. An additional example user interface 1120 may be configured to display a plurality of comments (described below) generated for association with captured data, and allow a user to select one or more of the comments for sharing with the data, e.g., to other users. Selection of the comment(s) may cause the client application 1118 to configure the processor 1112 to generate an output signal 1122 that transmits the comment selection to the backend server 1030..); obtain a second sensing signal through one or more second sensing units, the second sensing signal being configured to indicate whether there is any person within a preset range of a display unit(¶0009], a request to analyze additional image data for the entity of interest, wherein the additional image data comprises the second data and is captured by a camera of a second A/V recording and communication device of the plurality of A/V recording and communication devices associated with the third client device.); and control the display unit to be turned on or off based on the first sensing signal and the second sensing signal, wherein the first data is displayed when the display unit is turned on. (¶[0044], In an embodiment of the third aspect, the indication of the request is generated by the first client device in response to a user interaction with a graphical user interface presented on a display of the first client device.)
Regarding Claim 13, the combination of Siminoff and Kim teach the system of claim 12, where Siminoff further teaches wherein to control the display unit to be turned on or off based on the first sensing signal and the second sensing signal, the one or more processors are further configured to direct the system to: in response to a determination that the first sensing signal indicates that there is a person within the preset range of the first device, and the second sensing signal indicates that there is a person within the preset range of the display unit, turn on the display unit. (¶[0130], In response to the detection of the visitor, the A/V recording and communication doorbell 100 sends an alert to the user's client device 114 (FIG. 1) via the user's network 110 and the network 112. The A/V recording and communication doorbell 100 also sends streaming video, and may also send streaming audio, to the user's client device 114. If the user answers the alert, two-way audio communication may then occur between the visitor and the user through the A/V recording and communication doorbell 100 and the user's client device 114.)
Regarding Claim 14, the combination of Siminoff and Kim teach the system of claim 13, where Siminoff further teaches wherein to control the display unit to be turned on or off based on the first sensing signal and the second sensing signal (¶[0044], In an embodiment of the third aspect, the indication of the request is generated by the first client device in response to a user interaction with a graphical user interface presented on a display of the first client device.), the one or more processors are further configured to direct the system to:  time a screen-on duration of the display unit when the display unit is turned on  and turn off the display unit when the display unit is in a screen-on state and the screen-on duration reaches a duration threshold. (¶[0161], at block B310a the live audio/video data may be displayed on the user's client device 114, thereby allowing the user surveillance from the perspective of the doorbell 130. When the user is satisfied with this function, the user may sever the connection at block B312, whereby the session ends. If, however, at block B308 the user denies the notification, or ignores the notification and a specified time interval elapses, then the connection between the doorbell 130 and the user's client device 114 is terminated and the audio/video data is recorded and stored at a cloud server at block B310b, such that the user may view the audio/video data later at their convenience)
Regarding Claim 19, Siminoff teaches a security control method implemented on at least one machine each of which has at least one processor and at least one storage device(¶[0239], “The computer system 900 may include at least one processor 910, memory 920, at least one storage device 930,” , ¶[0239] discloses a processor, memory and storage device.);, the method comprising: obtaining first data from a first device(¶[0008], “receiving, from an A/V recording and communication device of the plurality of A/V recording and communication devices, first data including image data generated by a camera of the A/V recording and communication device”, ¶[0008], discloses image data obtained by a camera of the recording device.);  the first device including a monitoring data obtaining device(¶[0126], “The A/V recording and communication doorbell 100 includes a camera 102, a microphone 104, and a speaker 106. The camera 102 may comprise, for example, a high definition (HD) video camera, such as one capable of capturing video images at an image display resolution of 720p or better.”, ¶[0126], discloses obtaining video image data from a doorbell camera security system.),obtaining second data from a second device(¶[0008],”receiving, from an additional source, second data.” ¶[0009], “wherein the additional image data comprises the second data and is captured by a camera of a second A/V recording and communication device of the plurality of A/V recording and communication devices.”, ¶[0008]-¶[0009] disclose second data is received from a second recording device.) the second device including an access switch device or a smart lock. (¶[0256] “The one or more automation devices 1038(b) may include, for example, at least one of an outdoor lighting system, an indoor lighting system, and indoor/outdoor lighting system, a temperature control system (e.g., a thermostat), a shade/blind control system, a locking control system (e.g., door lock, window lock, etc.),” , ¶[0256], discloses the second device includes a locking control system.)associating and processing the first data and the second data (¶[0281], “the data analysis module 1182 may configure the processor 1172 to analyze the first image data 1060 with the analysis resulting in recognition of a person in the image data. The data analysis module 1182 may then configure the processor 1172 to compare characteristics of the person to the second image data 1090, e.g., to determine whether the person was also included in the second image data 1090 captured by the second A/V recording and communication device 1012.”, ¶[0281], discloses the data analysis module obtains data from the devices and uses the data to determine if a person appears in both devices.)
Siminoff does not explicitly teach encapsulate the processed first data and second data in a data packet and store the data packet in a storage device
Kim teaches encapsulate the processed first data and second data in a data packet([0049], “The surveillance server 200 is an apparatus capable of sensing an abnormal situation of the surveillance camera 100 and handling the sensed abnormal situation. The surveillance server 200 may be connected to a plurality of surveillance cameras 100 over the Internet network and receive network packets from the surveillance cameras 100. The received network packet is a packet containing, for example, a compressed video data, a sensing data or a control data requesting to perform a specific operation.” As disclosed in ¶[0049], the prior art is generating a network packet from the surveillance cameras and the packet contains compressed video data, sensing data or control data.); and store the data packet in a storage device (¶[0044], “In addition, the surveillance camera 100 may sense various type of intrusions from the outside and abnormal situations occurring in a space in which the surveillance camera 100 is installed and transmit a network packet containing a sensing data according thereto over the Internet network. The network packet of the sensing data is transferred to the surveillance server 200” as disclosed in ¶[0044], the prior art transmits a data packet to a surveillance server which is a storage device.).
It would have been obvious to one of ordinary skill in the art before the effective filing date to modify the claimed invention as taught by Siminoff with Kim in order to encapsulate the first and second data into a data packet. One skilled in the art would have been motivated to modify Siminoff in this manner in order to convert data of the network packet into a video data to be output to the display unit. (Kim, ¶[0013])
Regarding Claim 21, Siminoff teaches a data association method implemented on at least one machine each of which has at least one processor and at least one storage device(¶[0239], “The computer system 900 may include at least one processor 910, memory 920, at least one storage device 930,” , ¶[0239] discloses a processor, memory and storage device.), the method, comprising: obtaining door lock data uploaded by a smart door lock and peephole viewer data uploaded by a smart peephole viewer, the door lock data and the peephole viewer data being associated with a same user identifier([0130] “In response to the detection of the visitor, the A/V recording and communication doorbell 100 sends an alert to the user's client device 114 (FIG. 1) via the user's network 110 and the network 112.” ¶[0130], discloses sending an alert to a user based on the identification of the visitor through the doorbell camera.); determining, from the door lock data and the peephole viewer data, a set of door lock data and a set of peephole viewer data associated with a same unlocking operation(¶[0254], “Smart home devices (e.g., the hub device 1036, the sensors 1038(a), the automation devices 1038(b), the A/V recording and communication devices 1002, etc.), when remotely monitored and controlled via the network (Internet/PSTN) 1010, may be considered to be components of the Internet of Things. Smart home systems may include switches and/or sensors (e.g., the sensors 1038(a) connected to a central hub such as the smart-home hub device 1036, sometimes called a gateway, from which the system may be controlled with a user interface. [0256] The one or more automation devices 1038(b) may include, for example, at least one of an outdoor lighting system, an indoor lighting system, and indoor/outdoor lighting system, a temperature control system (e.g., a thermostat), a shade/blind control system, a locking control system (e.g., door lock, window lock, etc.), As disclosed in ¶[0254]-¶[0256], the prior art is using data from the image data and based on that data they can control a door locking system.); and associating the set of door lock data and set of the peephole viewer data associated with the same unlocking operation to obtain associated data.( ¶[0262], in some embodiments, the backend server 1030 may receive first image data 1060 of an entity of interest and may search and find a match of the entity of interest in the second image data 1090. In a further example, in some embodiments, the backend server 1030 may receive a text-based 1064 description of an entity of interest and may search and find a match of the entity of interest in second image data 1090. In some embodiments, the backend server 1030 may first transmit to a second client device 1014, 1016 associated with the second A/V recording and communication device 1012, e.g., via a second hub device, a request to check the second image data 1090 for an entity of interest before searching the second image data 1090, as further described below. As disclosed in ¶[0262], the prior art is determining if the image data contains a person of interest in which the home owner can control if the person is allowed entry.)
Siminoff does not explicitly teach encapsulate the processed first data and second data in a data packet and store the data packet in a storage device
Kim teaches encapsulate the processed first data and second data in a data packet([0049], “The surveillance server 200 is an apparatus capable of sensing an abnormal situation of the surveillance camera 100 and handling the sensed abnormal situation. The surveillance server 200 may be connected to a plurality of surveillance cameras 100 over the Internet network and receive network packets from the surveillance cameras 100. The received network packet is a packet containing, for example, a compressed video data, a sensing data or a control data requesting to perform a specific operation.” As disclosed in ¶[0049], the prior art is generating a network packet from the surveillance cameras and the packet contains compressed video data, sensing data or control data.); and store the data packet in a storage device (¶[0044], “In addition, the surveillance camera 100 may sense various type of intrusions from the outside and abnormal situations occurring in a space in which the surveillance camera 100 is installed and transmit a network packet containing a sensing data according thereto over the Internet network. The network packet of the sensing data is transferred to the surveillance server 200” as disclosed in ¶[0044], the prior art transmits a data packet to a surveillance server which is a storage device.).
It would have been obvious to one of ordinary skill in the art before the effective filing date to modify the claimed invention as taught by Siminoff with Kim in order to encapsulate the first and second data into a data packet. One skilled in the art would have been motivated to modify Siminoff in this manner in order to convert data of the network packet into a video data to be output to the display unit. (Kim, ¶[0013])
Regarding Claim 35, the combination of Siminoff and Kim teach the system of claim 5, where Siminoff further teaches wherein the association identifier includes at least one of an ID, a factory number, an event tag, or a customized association tag of the first device or the second device (¶[0272], “the data analysis module 1182 may configure the processor 1172 to identify the entity with more specificity. For example, analyzing the first image data 1060 may include determining an identification of a person or a license plate number of a vehicle, e.g., using image processing and/or computer vision processing.”, as disclosed in ¶[0272], the data analysis module can be used to determine the ID of a person or license plate number of a vehicle when captured by the devices.)
Claims 17-18 are rejected under 35 U.S.C. 103 as being unpatentable over Siminoff et al. US PG-Pub(US 20180220108 A1) in view of Han et al.  US PG-Pub (US 20180181797 A1).
Regarding Claim 17, while the combination of Siminoff and Kim teach the system of claim 1, they do not explicitly teach wherein the one or more processors are further configured to direct the system to: in response to a determination that an alarm button is triggered, send alarm information to an associated user terminal; or in response to a determination on a basis of the first data that there is an abnormal condition, send alarm information to the associated user terminal.
Han teaches wherein the one or more processors are further configured to direct the system to: in response to a determination that an alarm button is triggered, send alarm information to an associated user terminal; or in response to a determination on a basis of the first data that there is an abnormal condition, send alarm information to the associated user terminal. (¶[0162] For example, the recognition result providing unit 1440 may display information regarding a recognized user, or may output an alarm or a warning message when the recognized user is not a fair user. Alternatively, when the recognized user is a fair user, a predetermined service may be provided.)
It would have been obvious to one of ordinary skill in the art before the effective filing date to modify the claimed invention as taught by Siminoff and Kim with Han in order to generate an alarm once an unauthorized person is detected. One skilled in the art would have been motivated to modify Siminoff and Kim in this manner in order to search for a criminal suspect and surveillance of a crime-ridden district. (Han, ¶[0005])
Regarding Claim 18, the combination of Siminoff, Kim and Han teach the system of claim 17, where Siminoff further teaches wherein the one or more processors are further configured to direct the system to: receive a data request sent by the associated user terminal; and provide the first data and/or the second data to the associated user terminal. ([0027] In another embodiment of the second aspect, the additional source comprises a second A/V recording and communication device, and the method further comprising: transmitting, to a third client device associated with the second A/V recording and communication device, a request to at least one of receive or access the additional image data, wherein the additional image data is captured by a camera of the second A/V recording and communication device.)
Claims 33-34 are rejected under 35 U.S.C. 103 as being unpatentable over Siminoff et al. US PG-Pub(US 20180220108 A1) in view of Kim US PG-Pub(US 20170200356 A1) in further view of Tan et al. US PG-Pub(US 20200014552 A1).
Regarding Claim 33, while the combination of Siminoff and Kim teach the system of claim 1, they do not explicitly teach they do not explicit teach wherein the first data and the second data are associated with a same user identifier, and the second data carries an identity attribute of an unlocker, the one or more processors are further configured to direct the system to: determine first data and second data associated with a same unlocking operation; recognize a face image included in the first data using a face recognition algorithm; and obtain a marked face image by establishing an association relationship between the identity attribute carried by the second data and the face image included in the first data associated with the same unlocking operation.
Tan teaches wherein the first data and the second data are associated with a same user identifier, and the second data carries an identity attribute of an unlocker, the one or more processors are further configured to direct the system to: determine first data and second data associated with a same unlocking operation([0082] In another aspect, the guest may have established a set of faces that, when recognized, unlock a smart-lock, disarm a security system or both. The set of faces for facial recognition are included in the preferences that are applied for the smart-home devices of the rental property 410 during the stay. For example, the facial recognition from images provided by the entry interface system, cameras, or both are used to unlock the smart-lock of an entry door to the rental property 410 or disarm the security system 410 of the rental property 410.); recognize a face image included in the first data using a face recognition algorithm([0056] In another aspect, the entry interface system and the smart-home service 412 apply facial recognition to images of people captured by the camera included in the entry interface system at the rental property 410.); and obtain a marked face image by establishing an association relationship between the identity attribute carried by the second data and the face image included in the first data associated with the same unlocking operation([0056] In another aspect, the entry interface system and the smart-home service 412 apply facial recognition to images of people captured by the camera included in the entry interface system at the rental property 410. The captured images are compared with facial recognition data from the user account of the guest to provide announcements of family members' arrivals at the rental property 410. Additionally or optionally, the guest may add facial recognition associated with the rental property 410 that is retained only for the duration of the stay at the rental property 410 or retained for future visits.)
It would have been obvious to one of ordinary skill in the art before the effective filing date to modify the claimed invention as taught by Siminoff and Kim with Tan in order to perform an unlocking operation when a face image is recognized. One skilled in the art would have been motivated to modify Siminoff and Kim in this manner in order to monitor environmental and security conditions. (Tan, ¶[0003])
Regarding Claim 34, while the combination of Siminoff and Kim teach the system of claim 1, they do not explicitly teach wherein the second data carries an identity attribute of an unlocker, and the first data is generated after the first device receives a video trigger instruction that is sent by the associated second device and carries the identity attribute of the unlocker, the one or more processors are further configured to direct the system to; recognize a face image included in the first data; and obtain a marked face image by establishing an association relationship between the identity attribute of the unlocker and the face image.
Tan teaches wherein the second data carries an identity attribute of an unlocker, and the first data is generated after the first device receives a video trigger instruction that is sent by the associated second device and carries the identity attribute of the unlocker([0055] An entry interface system (e.g., video doorbell) installed at the rental property 410 provides enhanced security for the guest during the stay at the rental property 410. In aspects, based on motion detection, proximity detection, or a push of a button on the entry interface system, the guest receives a push alert, in the smart-home application 406, to the presence of persons at the entry of the rental property 410.), the one or more processors are further configured to direct the system to; recognize a face image included in the first data([0056] In another aspect, the entry interface system and the smart-home service 412 apply facial recognition to images of people captured by the camera included in the entry interface system at the rental property 410.); and obtain a marked face image by establishing an association relationship between the identity attribute of the unlocker and the face image. ([0056] In another aspect, the entry interface system and the smart-home service 412 apply facial recognition to images of people captured by the camera included in the entry interface system at the rental property 410. The captured images are compared with facial recognition data from the user account of the guest to provide announcements of family members' arrivals at the rental property 410. Additionally or optionally, the guest may add facial recognition associated with the rental property 410 that is retained only for the duration of the stay at the rental property 410 or retained for future visits.)
It would have been obvious to one of ordinary skill in the art before the effective filing date to modify the claimed invention as taught by Siminoff and Kim with Tan in order to use a push notification when a person is detected by the system. One skilled in the art would have been motivated to modify Siminoff and Kim in this manner in order to monitor environmental and security conditions. (Tan, ¶[0003])
Conclusion
Applicant's amendment necessitated the new grounds of rejection presented in this Office action.  Accordingly, THIS ACTION IS MADE FINAL.  See MPEP § 706.07(a).  Applicant is reminded of the extension of time policy as set forth in 37 CFR 1.136(a).
A shortened statutory period for reply to this final action is set to expire THREE MONTHS from the mailing date of this action.  In the event a first reply is filed within TWO MONTHS of the mailing date of this final action and the advisory action is not mailed until after the end of the THREE-MONTH shortened statutory period, then the shortened statutory period will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 CFR 1.136(a) will be calculated from the mailing date of the advisory action.  In no event, however, will the statutory period for reply expire later than SIX MONTHS from the date of this final action.

CITED REFERENCE SUMMARIES: Ref US20180220108A1: Claims:
A method for a network device, the network device communicatively coupled to a plurality of audio/video (A/V) recording and communication devices, the method comprising: receiving, from an A/V recording and communication device of the plurality of A/V recording and communication devices, first data including image data generated by a camera of the A/V recording and communication device; analyzing the first data to determine one or more characteristics of the first data; receiving, from an additional source, second data; analyzing the second data to determine that the second data includes at least one of the one or more characteristics; based on the determining that the second data includes the at least one of the one or more characteristics, determining at least one textual message for association with the first data, the at least one textual message indicative of the at least one of the one or more characteristics; transmitting, to a first client device associated with the A/V recording and communication device, the image data and the at least one textual message; receiving, from the first client device, consent for sharing the image data with a geographic area network, the consent indicating a selection of a textual message from the at least one textual message; and transmitting, to a second client device, the image data and the textual message.
receiving, from an A/V recording and communication device of the plurality of A/V recording and communication devices, first data including image data generated by a camera of the A/V recording and communication device;
analyzing the first data to determine one or more characteristics of the first data;
receiving, from an additional source, second data;
analyzing the second data to determine that the second data includes at least one of the one or more characteristics;
based on the determining that the second data includes the at least one of the one or more characteristics, determining at least one textual message for association with the first data, the at least one textual message indicative of the at least one of the one or more characteristics;
transmitting, to a first client device associated with the A/V recording and communication device, the image data and the at least one textual message;
receiving, from the first client device, consent for sharing the image data with a geographic area network, the consent indicating a selection of a textual message from the at least one textual message; and
transmitting, to a second client device, the image data and the textual message.
The method of claim 1 , further comprising: based on the one or more characteristics of the first data, determining that the image data includes an entity of interest; and transmitting, to a third client device, a request to analyze additional image data for the entity of interest, wherein the additional image data comprises the second data and is captured by a camera of a second A/V recording and communication device of the plurality of A/V recording and communication devices associated with the third client device.
based on the one or more characteristics of the first data, determining that the image data includes an entity of interest; and
transmitting, to a third client device, a request to analyze additional image data for the entity of interest, wherein the additional image data comprises the second data and is captured by a camera of a second A/V recording and communication device of the plurality of A/V recording and communication devices associated with the third client device.
The method of claim 1 , wherein the at least one textual message comprises a textual description of an entity having the one or more characteristics.
The method of claim 1 , wherein the at least one textual message comprises a textual description of at least one of a time or a location associated with the image data.
The method of claim 1 , wherein the network device comprises at least one of a backend server, an application programming interface (API), a storage device, or a hub device.
The method of claim 1 , wherein the one or more characteristics of the first data comprises ate least one of at least one characteristic of a person of interest or at least one characteristic of an object of interest.
The method of claim 1 , wherein the additional source comprises a database associated with a law enforcement agency.
The method of claim 1 , wherein the determining the at least one textual message comprises: scoring a plurality of messages based on the one or more characteristics; and selecting a predetermined number of the plurality of messages based on the scoring.
scoring a plurality of messages based on the one or more characteristics; and
selecting a predetermined number of the plurality of messages based on the scoring.
The method of claim 8 , wherein the selecting the predetermined number of the plurality of messages based on the scoring comprises selecting at least one of a predetermined number of messages having highest scores or selecting a predetermined number of messages having a score equal to or above a threshold score.
A method for a network device, the method comprising: receiving, from an audio/video (A/V) recording and communication device, image data; transmitting, to a first client device associated with the A/V recording and communication device, the image data; receiving, from the first client device, an indication of a request to share the image data with a geographic area network; in response to receiving the indication, analyzing the image data to determine one or more characteristics of the image data; obtaining additional data from an additional data source; analyzing the additional data to determine that the additional data includes at least one of the one or more characteristics from the image data; based on the image data and the additional data, determining at least one textual comment corresponding to the at least one of the one or more characteristics; transmitting, to the first client device, the at least one textual comment; receiving, from the first client device, consent for sharing the image data with the geographic area network, the consent indicating a selection of a comment from the at least one comment; and transmitting, to a second client device, the image data and the comment.
receiving, from an audio/video (A/V) recording and communication device, image data;
transmitting, to a first client device associated with the A/V recording and communication device, the image data;
receiving, from the first client device, an indication of a request to share the image data with a geographic area network;
in response to receiving the indication, analyzing the image data to determine one or more characteristics of the image data;
obtaining additional data from an additional data source;
analyzing the additional data to determine that the additional data includes at least one of the one or more characteristics from the image data;
based on the image data and the additional data, determining at least one textual comment corresponding to the at least one of the one or more characteristics;
transmitting, to the first client device, the at least one textual comment;
receiving, from the first client device, consent for sharing the image data with the geographic area network, the consent indicating a selection of a comment from the at least one comment; and
transmitting, to a second client device, the image data and the comment.
The method of claim 10 , wherein the indication of the request is generated by the first client device in response to a user interaction with a graphical user interface presented on a display of the first client device.
The method of claim 10 , further comprising: based on the one or more characteristics of the image data, determining that the image data includes an entity of interest; and transmitting, to a third client device, a request to analyze additional image data for the entity of interest, wherein the additional image data is captured by a camera of a second A/V recording and communication device and is associated with the third client device.
based on the one or more characteristics of the image data, determining that the image data includes an entity of interest; and
transmitting, to a third client device, a request to analyze additional image data for the entity of interest, wherein the additional image data is captured by a camera of a second A/V recording and communication device and is associated with the third client device.
The method of claim 12 , further comprising: receiving, from the third client device, consent for sharing the additional image data with the geographic area network; and transmitting, to the second client device, the additional image data.
receiving, from the third client device, consent for sharing the additional image data with the geographic area network; and
transmitting, to the second client device, the additional image data.
The method of claim 13 , wherein the additional image data is appended to the image data and the textual message for sharing with the network of users.
A method for a network device, the method comprising: receiving, from an audio/video (A/V) recording and communication device, image data representing an image; analyzing the image data to determine one or more objects depicted by the image data; based on the analyzing the image data, determining at least one comment associated with the one or more objects; transmitting, to a first client device associated with the A/V recording and communication device, the image data representing the image and the at least one comment; receiving, from the first client device, consent for sharing the image data with a geographic area network, the consent indicating a selection of a comment from the at least one comment; and transmitting, to a second client device, the image data representing the image and the comment.
receiving, from an audio/video (A/V) recording and communication device, image data representing an image;
analyzing the image data to determine one or more objects depicted by the image data;
based on the analyzing the image data, determining at least one comment associated with the one or more objects;
transmitting, to a first client device associated with the A/V recording and communication device, the image data representing the image and the at least one comment;
receiving, from the first client device, consent for sharing the image data with a geographic area network, the consent indicating a selection of a comment from the at least one comment; and
transmitting, to a second client device, the image data representing the image and the comment.
The method of claim 15 , wherein the analyzing the image data comprises comparing the image data to additional image data.
The method of claim 16 , further comprising receiving, from an additional source, the additional image data
The method of claim 17 , wherein the additional source comprises a second A/V recording and communication device, and the method further comprising: transmitting, to a third client device associated with the second A/V recording and communication device, a request to at least one of receive or access the additional image data, wherein the additional image data is captured by a camera of the second A/V recording and communication device.
transmitting, to a third client device associated with the second A/V recording and communication device, a request to at least one of receive or access the additional image data,
wherein the additional image data is captured by a camera of the second A/V recording and communication device.
The method of claim 15 , further comprising: determining that at least one of the one or more objects is an object of interest, wherein the message is a textual message associated with the object of interest.
determining that at least one of the one or more objects is an object of interest,
wherein the message is a textual message associated with the object of interest.
The method of claim 19 , wherein the object of interest comprises at least one of a person of interest, a vehicle of interest, or an animal of interest.
Ref US20200014552A1: Claims:
A method for dynamic inclusion of smart-home devices installed at a rental property into an account of a guest by a smart-home service, the method comprising: receiving a booking for the rental property from a booking service, the booking including an indication of one or more smart-home devices installed at the rental property and an indication of a check-in date and time; determining that the check-in date and time match a current date and time; in response to the determining that the check-in date and time match the current date and time, enabling access, by the guest, to the one or more smart-home devices installed at the rental property by: including the one or more smart-home devices installed at the rental property into the account of the guest with the smart-home service; and populating a user interface of a smart-home application on a user device of the guest with one or more user interface elements for access to the one or more smart-home devices installed at the rental property, the smart-home application being associated with the account of the guest at the smart-home service.
receiving a booking for the rental property from a booking service, the booking including an indication of one or more smart-home devices installed at the rental property and an indication of a check-in date and time;
determining that the check-in date and time match a current date and time;
in response to the determining that the check-in date and time match the current date and time, enabling access, by the guest, to the one or more smart-home devices installed at the rental property by: including the one or more smart-home devices installed at the rental property into the account of the guest with the smart-home service; and populating a user interface of a smart-home application on a user device of the guest with one or more user interface elements for access to the one or more smart-home devices installed at the rental property, the smart-home application being associated with the account of the guest at the smart-home service.
including the one or more smart-home devices installed at the rental property into the account of the guest with the smart-home service; and
populating a user interface of a smart-home application on a user device of the guest with one or more user interface elements for access to the one or more smart-home devices installed at the rental property, the smart-home application being associated with the account of the guest at the smart-home service.
The method of claim 1 , comprising: determining that a check-out date and time, included in the booking, match the current date and time; in response to the determining that the check-out date and time in the booking match the current date and time, disabling access, by the guest, to the one or more smart-home devices installed at the rental property by: excluding the one or more smart-home devices installed at the rental property from the account of the guest with the smart-home service; and causing the smart-home application to depopulate the one or more user interface elements for access to the one or more smart-home devices installed at the rental property from the user interface of the smart-home application.
determining that a check-out date and time, included in the booking, match the current date and time;
in response to the determining that the check-out date and time in the booking match the current date and time, disabling access, by the guest, to the one or more smart-home devices installed at the rental property by: excluding the one or more smart-home devices installed at the rental property from the account of the guest with the smart-home service; and causing the smart-home application to depopulate the one or more user interface elements for access to the one or more smart-home devices installed at the rental property from the user interface of the smart-home application.
excluding the one or more smart-home devices installed at the rental property from the account of the guest with the smart-home service; and
causing the smart-home application to depopulate the one or more user interface elements for access to the one or more smart-home devices installed at the rental property from the user interface of the smart-home application.
The method of claim 1 , comprising: applying one or more preferences for a smart-home device installed at a home property of the guest to a smart-home device installed at the rental property.
applying one or more preferences for a smart-home device installed at a home property of the guest to a smart-home device installed at the rental property.
The method of claim 3 , wherein the smart-home device installed at the rental property is one of: a thermostat, a hazard detector, a smart-lock, an entry interface system, a camera, a security hub, a motion sensor, a light sensor, a contact sensor, a Wi-Fi access point, a smart-speaker, a lighting controller, or a media streaming device.
The method of claim 3 , comprising: sending an alert to the smart-home application that is effective to display a user interface prompt to the guest that indicates that the one or more preferences from the smart-home device installed at the home property can be applied to the smart-home device installed at the rental property; and in response to the display of the user interface prompt, receiving an indication from the guest to apply the one or more preferences from the smart-home device at the home property to the smart-home device installed at the rental property.
sending an alert to the smart-home application that is effective to display a user interface prompt to the guest that indicates that the one or more preferences from the smart-home device installed at the home property can be applied to the smart-home device installed at the rental property; and
in response to the display of the user interface prompt, receiving an indication from the guest to apply the one or more preferences from the smart-home device at the home property to the smart-home device installed at the rental property.
The method of claim 3 , wherein the one or more preferences are preferences associated with one or more of: an occupancy state, a time-of-day, a temperature, a geofence, an estimated time of arrival (ETA), a path light brightness, a lighting brightness, an entry code, a time schedule, face data for facial recognition, a camera state, an activity zone, account information, a Service Set Identifier (SSID), voice recognition, voice commands, or any combination thereof.
The method of claim 1 , comprising: receiving from the guest a new preference to apply to at least one of the one or more smart-home devices installed at the rental property; applying, by the smart-home service, the new preference to the at least one of the one or more smart-home devices installed at the rental property.
receiving from the guest a new preference to apply to at least one of the one or more smart-home devices installed at the rental property;
applying, by the smart-home service, the new preference to the at least one of the one or more smart-home devices installed at the rental property.
The method of claim 1 , wherein a host for the rental property determines which smart-home devices installed at the rental property will be included in the indication of the one or more smart-home devices installed at the rental property, and wherein the one or more smart-home devices installed at the rental property includes all of the smart-home devices installed at the rental property or less than all of the one or more smart-home devices installed at the rental property.
The method of claim 1 , wherein a host for the rental property determines which properties of e
[Truncated to input limit]