Skip navigation
GPUs and Deep Learning

GPUs and Deep Learning

Download this article in .PDF format
This file type includes high resolution graphics and schematics when applicable.

Deep learning, or deep neural nets (DNNs), is the technical craze these days. It is targeting everything from self-driving cars to tagging photos. DNNs are just one of many artificial intelligence (AI) research areas. It has become more popular as processor performance has increased, allowing more complex systems.

1. NVidia’s Tesla P100 GPU is designed to tackle applications like deep learning neural nets.

​DNNs require matrix number-crunching capabilities found in FPGAs and GPUs. GPUs are now the target for a number of DNN platforms. NVidia’s Tesla P100 GPU (Fig. 1) is designed to tackle applications like deep learning neural nets. The Tesla P100 can deliver 21 TFLOPS of 16-bit floating point that is ideal for DNN applications. It employs CoWoS (Chip-on Wafer-on-Substrate) with HBM2 (high-bandwidth memory version 2) technology. AMD used HBM on its Radeon R9 GPU (see “Best of 2015: High Bandwidth Memory Helps GPU Deliver on Performance ” on The Tesla P100 has four NVLinks, allowing multiple chips to be combined into a single compute node.

NVidia’s chip supports the CUDA programming environment. The Cuda DNN (cuDNN) runtime targets DNN frameworks like TensorFlow, an open-source software library for numerical computation. You can check out the TensorFlow Playground (Fig. 2) website to see how TensorFlow and neural networks operate by changing variables such as the number of nodes and layers.

2. The Tensorflow webpage demonstrates different neural net configurations.


DNN will not solve all AI problems and it is not necessarily a magic bullet for applications, but it is a valuable tool that is becoming more practical for general use.  

Looking for parts? Go to SourceESB.

Hide comments


  • Allowed HTML tags: <em> <strong> <blockquote> <br> <p>

Plain text

  • No HTML tags allowed.
  • Web page addresses and e-mail addresses turn into links automatically.
  • Lines and paragraphs break automatically.