Purpose-Built Inference Acceleration Takes AI Everywhere
Inference is where the transformative power of AI meets real-world applications. It’s how a smart speaker recognizes a plethora of different human voices, and how…
Library
Building What’s Next: Scaling Complex Deep Learning Workloads
The recent advancements in artificial intelligence has been driven by abundant compute, large data sets, and the re-emergence of deep learning (DL) techniques using labeled…
Q8BERT, a Quantized 8bit Version of BERT-Base
Background Pre-trained transformer language models (GPT, XLNet, XLM, BERT) have demonstrated State-of-the-Art (SOTA) results for a variety of Natural Language Processing (NLP) tasks such as…
NLP Architect: Efficient Training and Optimized Inference of Transformer Models
In the past year, we’ve seen major advances in the field of natural language processing (NLP) with the rise of pre-trained language models such as…
Automatic Multi-Device Inference with Intel® Distribution of OpenVINO™ toolkit
Along with the rise of convolutional neural networks, we are starting to see the emergence of dedicated inference accelerators. Many edge and cloud inference workloads…
CVAT: Speeding Up Image Annotation since 2018
We began the Computer Vision Annotation Tool (CVAT) project a few years ago in order to speed up the annotation of digital images and videos…
Apache* MXNet* v1.5.0 Gets a Lift with Intel® DL Boost
The Apache MXNet community recently announced the v1.5.0 release of the Apache MXNet* deep learning framework. This version of Apache MXNet introduces a series of…
Delivering on the Promise of Real-World Reinforcement Learning
Reinforcement learning (RL)—the branch of artificial intelligence (AI) that deals with sequential decision making to maximize rewards in an environment—is an exciting area of AI.…
Introducing Intel® Nervana™ Neural Network Processors for Training
With an all-new architecture that maximizes the re-use of on-die data, the Intel® Nervana™ NNP-T was purpose-built to train complex deep learning models at massive…
Introducing Intel® Nervana™ Neural Network Processors for Inference
The Intel® Nervana™ NNP-I is built for intensive, near-real-time, high-volume compute. By combining a CPU core and purpose-built AI inferencing engine, Intel® Nervana™ NNP-I delivers…