Stereoscopic Cameras Use AI to Get Smarter

Dec. 1, 2022

Luxonis' OAK-D stereoscopic cameras can run artificial-intelligence models, offloading the host.

Check out more Technology Talks videos.

Luxonis sells intelligent cameras that can implement machine-learning (ML) models directly instead of handing off raw video streams to a host (Fig. 1). Adding artificial intelligence (AI) to a camera offloads the host and reduces communication overhead. It also can simplify host software by providing processed data only when it's needed.

I talked with Luxonis' Bradley Dillon about the company's intelligent and stereoscopic cameras (see the video above).

1. Luxonis' OAK-1 is an intelligent, single camera (left) while the OAK-D is a stereoscopic camera with a regular color camera (right).

The OAK-1 and OAK-D are just two of the cameras in Luxonis' collection of products. The OAK-1 is a single 4K camera with a system that delivers 4 TOPS of compute power in the camera. The OAK-D provides similar performance, but it has two cameras for stereoscopic support as well as a central camera that provides video like the OAK-1 does on its own. Data from all three cameras is available for the computational subsystem, allowing for an ML model to combine all three when it's analyzing a video stream.

Intelligent cameras can address a range of applications without loading down the host with additional ML processing (Fig. 2).

2. Intelligent cameras can handle processing such as person detection, pose estimation, or smart dashcam applications with host processing.

Luxonis provides tools such as its DepthAI SDK, which supports the cameras and the creation of models to run on the systems. Most of the cameras employ a USB interface, though some are available with other interfaces such as Ethernet.

Links

About the Author

William G. Wong | Senior Content Director - Electronic Design and Microwaves & RF

I am Editor of Electronic Design focusing on embedded, software, and systems. As Senior Content Director, I also manage Microwaves & RF and I work with a great team of editors to provide engineers, programmers, developers and technical managers with interesting and useful articles and videos on a regular basis. Check out our free newsletters to see the latest content.

You can send press releases for new products for possible coverage on the website. I am also interested in receiving contributed articles for publishing on our website. Use our template and send to me along with a signed release form.

Check out my blog, AltEmbedded on Electronic Design, as well as his latest articles on this site that are listed below.

You can visit my social media via these links:

I earned a Bachelor of Electrical Engineering at the Georgia Institute of Technology and a Masters in Computer Science from Rutgers University. I still do a bit of programming using everything from C and C++ to Rust and Ada/SPARK. I do a bit of PHP programming for Drupal websites. I have posted a few Drupal modules.

I still get a hand on software and electronic hardware. Some of this can be found on our Kit Close-Up video series. You can also see me on many of our TechXchange Talk videos. I am interested in a range of projects from robotics to artificial intelligence.