Edge AI Solution Captures Audio for Smart-City Apps

June 20, 2024
This application example uses the B-U585I-IOT02A Discovery Kit, STM32Cube.AI Developer Cloud, and AWS’ solutions to run an audio classification model on an STM32U5 MCU.
William Wong | Electronic Design

STMicroelectronics and AWS (Amazon Web Services) have created the AWS STM32 ML at the Edge Accelerator. The application demonstrator leverages the B-U585I-IOT02A Discovery Kit, the STM32Cube.AI Developer Cloud, and AWS’ solutions to run an audio classification model on an STM32U5 microcontroller. This application demo shows how ST technologies like the Model Zoo and Board Farm can expand AI at the edge.

It starts with the YAMNet-256, an Audio Event Detection model found in the ST Model Zoo that uses the B-U585-IOT2A Discovery Kit along with the X-CUBE-AWS, an extension pack integrating FreeRTOS with AWS IoT Core for seamless cloud connectivity. The architecture supports the entire MLOps process, and the machine-learning stack handles data processing, model training, and evaluation. The IoT stack deals with automatic device flashing using over-the-air (OTA) updates to ensure that all devices are running the latest secure firmware.

The pipeline stack coordinates the CI/CD (continuous integration/continuous delivery) workflow, ensuring the work is always updated and the code optimized. Developers can automate the deployment of the ML and IoT stacks to address the entire development lifecycle.

To monitor the devices involved and visualize the data, Amazon Grafana was used to create dynamic and interactive dashboards for real-time monitoring and analysis. This demo features a Yamnet audio classification model optimized for the STM32 MCUs running an audio event detection program. It's able to distinguish between a wide range of noises, from dogs barking to birdsong, to people coughing or sneezing, and other sounds.

Related links:

About the Author

Alix Paultre | Editor-at-Large, Electronic Design

An Army veteran, Alix Paultre was a signals intelligence soldier on the East/West German border in the early ‘80s, and eventually wound up helping launch and run a publication on consumer electronics for the US military stationed in Europe. Alix first began in this industry in 1998 at Electronic Products magazine, and since then has worked for a variety of publications in the embedded electronic engineering space. Alix currently lives in Wiesbaden, Germany.

Also check out his YouTube watch-collecting channel, Talking Timepieces

Sponsored Recommendations


To join the conversation, and become an exclusive member of Electronic Design, create an account today!