When we use the term “inferencing” in context of Artificial Intelligence, we’re referring to the process of running or executing a trained neural network model in order to make a prediction. Hybrid inferencing describes the ability to run these trained models on either “the edge” (locally on a physical device) or in “the cloud” (remotely in an Azure VM). The ability to do either is a powerful concept as the cloud gives us advantages such as infinite size and compute whereas the edge can be advantageous when it comes to latency, economics and security.