Electronicdesign 20818 Arm Ml Promo
Electronicdesign 20818 Arm Ml Promo
Electronicdesign 20818 Arm Ml Promo
Electronicdesign 20818 Arm Ml Promo
Electronicdesign 20818 Arm Ml Promo

Arm Extends Reach to Machine-Learning Blocks

Feb. 17, 2018
The company is now delivering IP that's able to handle machine learning and object recognition.

Arm’s Project Trillium addresses machine learning (ML) and it includes a number of components, including the new ML processor (Fig. 1). This platform will support the Arm CPU complexes in a fashion similar to the GPGPU support, like the Mali GPU family that’s already available and being used for many ML applications. The advantage of the ML processor over the CPUs and GPGPUs is its power efficiency and performance when applied to deep neural networks (DNNs).

1. Arm’s machine-learning subsystem uses two different engines to address the typical neural-network machine-learning algorithms.

Arm’s support isn’t surprising given the interest in ML and DNN. It’s also likely to be a technology that will be incorporated into hardware that already uses Arm processors, such as smartphones where audio and video interaction is becoming the norm.

The other piece to the project is the second-generation Object Detection (OD) processor. This is a fixed-function, vision pipeline designed to scan HD video streams in real time, up to 60 frames/s. Objects need to be at least 50 by 60 pixels. It provides a list of detected objects and attributes such as which way a person might be facing. The system can also detect gestures and poses. It’s an ideal complement to the ML processor.

The ML processor is able to operate standalone. It has an ACE-Lite interface so that it can be integrated with Arm’s DynamiQ cluster.

2. OD and ML processors developed by Arm will often be combined to processor video streams.

Designers will be able to combine Arm IP (Fig. 2) to create system-on-chip (SoC) platforms like Intel’s Movidius, which has a video-processing front end for handling streaming data from cameras, a set of ML processors, and a pair of RISC CPUs to manage the system.

The Arm Neural Network (NN) software development kit (SDK) allows developers to take advantage of ML support whether the support is provided by an Arm CPU, GPU, or ML processor (Fig. 3). It provides support for neural-network frameworks like Caffe and TensorFlow. The software takes advantage of Arm’s Compute Library.

3. Arm’s Neural Network (NN) software development kit bridges the interface between ML software and the underlying hardware, whether it’s an Arm CPU, GPU, or ML processor.

Arm’s new ML and OD processors are designed for ML applications on the edge, versus the training of DNNs that’s typically done in the cloud using ML hardware like Google’s tensor processing unit (TPU) and Nvidia’s Tesla V100. Google’s TPU board (Fig. 4) is designed for the cloud.

4. Google’s GPU board can be used to process data sets to train DNNs. The training information can then be employed on ML platforms on the edge of the internet.

Many ML applications run in the cloud, such as Amazon’s Alexa that ships voice streams for analysis in the cloud. Moving ML inference hardware support to the edge will allow this type of processing to be done locally, which will be key for standalone operation. Devices like Amazon’s Echo will not work without a connection to the internet and the Alexa servers in the cloud.

Arm hasn’t released all of the details, but we do know the theoretical efficiency of the ML processor is on the order of 4.6 teraoperations per second (TOPS)/W with a target power envelope of 3 TOPS/W using 7-nm implementations. Arm partners will be gaining access to the IP this year.

Sponsored Recommendations

Understanding Thermal Challenges in EV Charging Applications

March 28, 2024
As EVs emerge as the dominant mode of transportation, factors such as battery range and quicker charging rates will play pivotal roles in the global economy.

Board-Mount DC/DC Converters in Medical Applications

March 27, 2024
AC/DC or board-mount DC/DC converters provide power for medical devices. This article explains why isolation might be needed and which safety standards apply.

Use Rugged Multiband Antennas to Solve the Mobile Connectivity Challenge

March 27, 2024
Selecting and using antennas for mobile applications requires attention to electrical, mechanical, and environmental characteristics: TE modules can help.

Out-of-the-box Cellular and Wi-Fi connectivity with AWS IoT ExpressLink

March 27, 2024
This demo shows how to enroll LTE-M and Wi-Fi evaluation boards with AWS IoT Core, set up a Connected Health Solution as well as AWS AT commands and AWS IoT ExpressLink security...

Comments

To join the conversation, and become an exclusive member of Electronic Design, create an account today!