Microsoft.ML.Scoring (nuget): Microsoft Machine Learning Scoring library for deep learning model inference. Current version of the library supports inferencing on ONNX v1.3 and TensorFlow v1.10.0 models. The library supports CPU execution with MKL/MKLDNN acceleration. Also supports CUDA GPU devices. For CPU execution of ONNX models, no extra libraries are required. However for scoring TensorFlow models, the CUDA libraries are needed for both CPU and GPU execution. Download and install CUDA 9.2 toolkit, CUDNN and device drivers separately. This package provides a .Net standard 1.3 compatible module for maximum portability. Currently supported platforms include x64 CPU on Windows OS only.
Keywords: Microsoft|Machine|Learning|Scoring|Deep|Model|Inference|ONNX|TensorFlow|C#|.Net|Standard|Library