Ed Jul Aug Lab Bench Promo

Getting Started with Fast Embeddable AI Hardware

May 20, 2022
NVIDIA’s software is what makes the Jetson AGX Orin development kit so compelling.

NVIDIA’s Jetson AGX Orin Development Kit is a great embedded platform for delivering 275 TOPS of raw performance. It targets applications like robotics, but works equally well for any embedded application that needs artificial intelligence (AI) and machine learning (ML) support in the field.

The Jetson AGX Orin module (see figure) is built around a dozen, 64-bit Arm Cortex-A78AE v8.2 cores that have access to a 3-MB L2 and 6-MB L3 cache as well as a GPU based on NVIDIA's new Ampere architecture. This includes 2,048 NVIDIA CUDA cores and 64 Tensor cores plus a pair of NVIDIA Deep Learning Accelerators (NDLAs) v2.0 for AI/ML applications. The Programmable Vision Accelerator (PVA) streamlines video processing of multiple video streams, which is a common task for the platform.

The hardware is impressive, but it’s the encompassing NVIDIA software that really makes the difference. The Jetson Jetpack SDK is built on Ubuntu Linux, including UEFI-based bootloader support and OP-TEE as the Trusted Execution Environment. The dev kit comes with everything installed, which makes getting started much easier. It includes support for the underlying CUDA, CuDNN, TensorRT, and DeepStream tools.

Two items that stand out in the latest kit are the NVIDIA Train-Adapt-Optimize (TAO) and NVIDIA RIVA. The latter targets speech AI, while TAO builds on pre-trained models from NVIDIA. These can be customized in Microsoft’s Azure cloud.

Sponsored Recommendations

What are the Important Considerations when Assessing Cobot Safety?

April 16, 2024
A review of the requirements of ISO/TS 15066 and how they fit in with ISO 10218-1 and 10218-2 a consideration the complexities of collaboration.

Wire & Cable Cutting Digi-Spool® Service

April 16, 2024
Explore DigiKey’s Digi-Spool® professional cutting service for efficient and precise wire and cable management. Custom-cut to your exact specifications for a variety of cable ...

DigiKey Factory Tomorrow Season 3: Sustainable Manufacturing

April 16, 2024
Industry 4.0 is helping manufacturers develop and integrate technologies such as AI, edge computing and connectivity for the factories of tomorrow. Learn more at DigiKey today...

Connectivity – The Backbone of Sustainable Automation

April 16, 2024
Advanced interfaces for signals, data, and electrical power are essential. They help save resources and costs when networking production equipment.


To join the conversation, and become an exclusive member of Electronic Design, create an account today!