A system, comprising: a data processing system comprising memory and one or more processors to: receive, via an interface of the data processing system, data packets comprising an input audio signal detected by a microphone of a client device; parse, by a natural language processor, NLP, component of the data processing system, the input audio signal to identify a request and a trigger keyword corresponding to the request; select, by a direct action API of the data processing system, based on the trigger keyword, a template for an action data structure responsive to the request, the direct action API to package one or more parameters into an action data structure processed by a third party provider device to perform an operation to provide a type of service or a type of product, the template comprising a first field; identify, by a sensor management component of the data processing system, a plurality of available sensors configured to obtain information for the first field of the action data structure and that are coupled to one or more client devices different from the client device that i) are each associated with an end user account associated with the client device, ii) each have location information within a tolerance level of location information of the client device, and iii) have each successfully performed a handshaking process with the data processing system using credentials of the end user account and are currently online; select a first sensor of the plurality of available sensors of a second client device of the one or more client devices to use for data corresponding to the first field of the action data structure processed by the third party provider device to perform the operation to provide the type of service or the type of product; generate the action data structure with the data received from the first sensor to provide the type of service or the type of product based on the first field of the template; and transmit, by the direct action API of the data processing system, the action data structure to the third party provider device to cause the third party provider device to perform one or more actions that provide the type of service or the type of product based on the one or more parameters packaged in the action data structure. receive, via an interface of the data processing system, data packets comprising an input audio signal detected by a microphone of a client device; parse, by a natural language processor, NLP, component of the data processing system, the input audio signal to identify a request and a trigger keyword corresponding to the request; select, by a direct action API of the data processing system, based on the trigger keyword, a template for an action data structure responsive to the request, the direct action API to package one or more parameters into an action data structure processed by a third party provider device to perform an operation to provide a type of service or a type of product, the template comprising a first field; identify, by a sensor management component of the data processing system, a plurality of available sensors configured to obtain information for the first field of the action data structure and that are coupled to one or more client devices different from the client device that i) are each associated with an end user account associated with the client device, ii) each have location information within a tolerance level of location information of the client device, and iii) have each successfully performed a handshaking process with the data processing system using credentials of the end user account and are currently online; select a first sensor of the plurality of available sensors of a second client device of the one or more client devices to use for data corresponding to the first field of the action data structure processed by the third party provider device to perform the operation to provide the type of service or the type of product; generate the action data structure with the data received from the first sensor to provide the type of service or the type of product based on the first field of the template; and transmit, by the direct action API of the data processing system, the action data structure to the third party provider device to cause the third party provider device to perform one or more actions that provide the type of service or the type of product based on the one or more parameters packaged in the action data structure.