OpenVINO

Short description: Toolkit for deploying inference neural network model on Intel hardware

OpenVINO

OpenVINO logo

Original author(s)| Intel Corporation,
Developer(s)| Intel Corporation
Initial release| May 16, 2018; 5 years ago (2018-05-16)
Stable release|

2023.3 / January 2024.[1]

Repository| github.com/openvinotoolkit/openvino
Written in| C++, Python
Operating system| Cross-platform
License| Apache License 2.0
Website| docs.openvino.ai

OpenVINO toolkit (Open Visual Inference and Neural network Optimization) is a free toolkit facilitating the optimization of a deep learning model from a framework and deployment using an inference engine onto Intel hardware.[2] The toolkit has two versions: OpenVINO toolkit, which is supported by open source community and Intel Distribution of OpenVINO toolkit, which is supported by Intel. OpenVINO was developed by Intel. The toolkit is cross-platform and free for use under Apache License version 2.0.[3] The toolkit enables a write-once, deploy-anywhere approach to deep learning deployments on Intel platforms, including CPU, integrated GPU, Intel Movidius VPU, and FPGAs.

## Contents

* 1 Overview
* 2 Supported frameworks and formats
* 3 Programming language
* 4 OS support
* 5 See also
* 6 References

## Overview

The high level pipeline of OpenVINO consists of two parts: generate IR (Intermediate Representation) files via Model Optimizer using your trained model or public one and execute inference on Inference Engine on specified plugins (CPU, Intel Processor Graphics, VPU, GNA, Multi-Device plugin, Heterogeneous plugin)[4]

The toolkit’s Model Optimizer is a cross-platform tool that transforms a trained model from the original framework to OpenVINO format (IR) and optimizes it for future inference on supported devices. As a result, Model Optimizer produces two files: *.bin and *.xml, which contain weights and model structures respectively.

The toolkit’s Inference Engine is a C++ library for inferring input on devices and getting results. To better understand OpenVINO API there are a lot of samples, that demonstrate how to work with OpenVINO.

OpenVINO has different sample types: classification, object detection, style transfer, speech recognition, etc. It is possible to try inference on public models. There are a variety of models for tasks, such as:

* classification
* segmentation
* object detection
* face recognition
* human pose estimation
* monocular depth estimation
* image inpainting
* style transfer
* action recognition
* colorization

All these models are available for learning purpose or for development deep learning software. Open Model Zoo is licensed under Apache License version 2.0.

Along with the primary components of model optimization and runtime within Intel® Distribution of OpenVINO toolkit, the toolkit also includes a user-friendly web browser interface called the Deep Learning Workbench to aid in model analysis and experimentation; a tool called the Post-Training Optimization Tool to accelerate inference by converting models into low-precision and that do not require re-training (e.g., post-training quantization); and, additional add-ons, such as the Deep Learning Streamer to aid in streaming analytics pipeline interoperability, the OpenVINO Model Server to enable scalability via a serving microservice, Training Extensions like the Neural Network Compression Framework, and the Computer Vision Annotation Tool, an online interactive video and image annotation tool.

OpenVINO has two webpages: one for documentation another for downloads.

## Supported frameworks and formats

* Caffe (most public branches)
* TensorFlow
* MXNet
* Kaldi
* ONNX
* and other frameworks that can be serialized to ONNX format (PyTorch, Caffe2, PaddlePaddle and others)

## Programming language

OpenVINO is written in C++ and Python.

## OS support

OpenVINO runs on the following desktop operation systems: Windows, Linux and MacOS.

OpenVINO also runs on Raspberry Pi.[5]

## See also

* Comparison of deep learning software

## References

1. ↑ "Release Notes for Intel Distribution of OpenVINO toolkit 2023.3". January 2024. https://www.intel.com/content/www/us/en/developer/articles/release-notes/openvino-lts/2023-3.html.
2. ↑ Nanjappa (2019), p. 91.
3. ↑ "OpenVINO Toolkit: Welcome to OpenVINO". https://docs.openvinotoolkit.org/.
4. ↑ "Introduction to Intel Deep Learning Deployment Toolkit – OpenVINO Toolkit". https://docs.openvino.ai/latest/openvino_docs_IE_DG_Deep_Learning_Inference_Engine_DevGuide.html.
5. ↑ Wilbur, Marcia. "Use the Model Downloader and Model Optimizer for the Intel® Distribution of OpenVINO™ Toolkit on Raspberry Pi*". https://software.intel.com/content/www/us/en/develop/articles/model-downloader-optimizer-for-openvino-on-raspberry-pi.html.

* Agrawal, Vasu (2019). Ground Up Design of a Multi-modal Object Detection System (PDF) (MSc). Carnegie Mellon University Pittsburgh, PA. Archived (PDF) from the original on 26 January 2020.
* Driaba, Alexander; Gordeev, Aleksei; Klyachin, Vladimir (2019). Recognition of Various Objects from a Certain Categorical Set in Real Time Using Deep Convolutional Neural Networks. Institute of Mathematics and Informational Technologies Volgograd State University. http://ceur-ws.org/Vol-2500/paper_5.pdf. Retrieved 26 January 2020.
* Nanjappa, Ashwin (31 May 2019). Caffe2 Quick Start Guide: Modular and scalable deep learning made easy. Packt. pp. 91–98. ISBN 978-1789137750.

* v
* t
* e

Intel Software

Items in italics are no longer maintained or have planned end-of-life dates.

Development|

* Parallel Studio
* C++ Compiler
* Fortran Compiler
* Debugger
* Advisor
* Inspector
* VTune
* Array Visualizer
* Cilk Plus

Components|

* Concurrent Collections for C++ (CnC)
* Data Analytics Acceleration Library (DAAL)
* Indeo
* Integrated Performance Primitives (IPP)
* Math Kernel Library (MKL)
* Parallel Building Blocks (PBB)
* Intel Array Building Blocks (ArBB)
* Ct
* Threading Building Blocks (TBB)

Open source|

* Cilk Plus
* Concurrent Collections for C++ (CnC)
* Data Analytics Acceleration Library (DAAL)
* MeeGo
* Moblin
* Threading Building Blocks (TBB)
* Tizen

Software programs|

* Telekinesys Research1
* Havok1
* Vision1
* Wind River Systems
* Simics
* VxWorks

Organizations|

* Developer Zone
* AppUp
* Research

* 1Sold to Microsoft

* v
* t
* e

Deep learning software

Open-source|

* Apache SINGA
* Caffe
* Deeplearning4j
* Dlib
* Keras
* Microsoft Cognitive Toolkit
* MXNet
* OpenNN
* PyTorch
* TensorFlow
* Theano
* Torch
* ONNX

Proprietary|

* Maple
* Neural Designer
* Wolfram Mathematica
* Apple Core ML

* Category
* Comparison

0.00

(0 votes)

Original source: https://en.wikipedia.org/wiki/OpenVINO. Read more

|

Retrieved from "https://handwiki.org/wiki/index.php?title=Software:OpenVINO&oldid=3469365"
*[v]: View this template
*[t]: Discuss this template
*[e]: Edit this template