OpenVINO

OpenVINO toolkit (Open Visual Inference and Neural network Optimization) is a free toolkit facilitating the optimization of a Deep Learning model from a framework and deployment using an inference engine onto Intel hardware.  The tookit has two versions: OpenVINO tookit, which is supported by open source community and Intel(R) Distribution of OpenVINO toolkit, which is supported by Intel.  OpenVINO was developed by Intel.  The toolkit is cross-platform and free for use under Apache License Version 2.0. 

Overview
The high level pipeline of OpenVINO consists of two parts: generate IR (Intermediate Representation) files via Model Optimizer using your trained model or public one and execute inference on Inference Engine on specified plugins (CPU, Intel Processor Graphics, VPU, FPGA, GNA, Multi-Device plugin, Heterogeneous plugin)

Similar to the TensorRT framework from Nvidia, the main purpose of the OpenVino project is to sell the underlying hardware to the customer.  It's not surprising, that the software runs great with the Intel Neural Compute Stick 2 which was developed by the Movidius company.  What OpenVino is doing internally, is to store the weights of a neural network in a “.bin” file  and executes it on the usb-stick which acts as a Vision processing unit. 

Supported Frameworks and Formats 

 Caffe (most public branches)
 TensorFlow
 MXNet
 Kaldi
 ONNX
 and other frameworks that can be serialized to ONNX format (Pytorch, Caffe2, PaddlePaddle and others)

Programming language 
OpenVINO is written in C++ and Python. 

OS support 
OpenVINO runs on the following desktop operation systems: Windows, Linux, MacOS. 

See also
 Comparison of deep learning software

References 

 
 
 

Category:Free statistical software
Category:Applied machine learning