Talking CMOS Image Sensors with SmartSens’ Leo Bai

Talking CMOS Image Sensors with SmartSens’ Leo Bai

Feb. 12, 2019
CMOS image sensor usage is ramping up across multiple application areas. Technology Editor Bill Wong chatted with Leo Bai, SmartSens’ AI BU General Manager, about the latest in the technology.

CMOS image sensors are going into applications from machine-vision systems to smartphones. I talked with Leo Bai, SmartSens AI BU General Manager, about how the company’s image sensors are being used in machine-learning applications.

What are some examples of current mainstream technologies in CMOS image sensors?

Currently, there are two mainstream technologies in CMOS image sensors: FSI (front-side illuminated) and BSI (back-side illuminated).

FSI complies with the traditional semiconductor manufacturing process, so the FSI process is more mature and typically has lower production costs and higher yield. With pixels, light enters between the front metal wiring and then focuses on the photosensitive area. For larger pixels, FSI’s performance meets the requirements because the ratio between the height of the pixel's optical stack and the pixel area is small, and the photosensitive area is relatively guaranteed. However, the sensor’s performance and application scenarios will be limited.

With the rapid development of imaging technology in different application fields, people always want to use high-resolution CMOS image sensors with excellent performance in a small package size. That means the pixel size is reduced, the fill factor gets smaller, the optical path is elongated, and the metal wiring reflection absorption loss is larger—all of the factors that diminish performance.

The main advantage of BSI is that it separates electrical components from light, which allows the optical path to be independently optimized, avoiding absorption, reflection, and flare of the FSI metal wiring layer. The optical stack in the BSI pixel is also greatly reduced. Compared with FSI, BSI has a large fill factor of almost 100%, so BSI can achieve higher QE (quantum efficiency). However, the BSI manufacturing process is more complex and difficult than FSI.

In the early development of BSI, yield was a big challenge. With the advanced development of semiconductor technology, though, the BSI technique is becoming more and more mature, with a much higher yield.

What are the main applications for CMOS image sensors?

There are a variety of applications for different CMOS image sensor technologies.

The CMOS image sensor with BSI technology is suitable for applications that need high resolution with limited optical size, as well as small pixel size, high sensitivity, and low-light performance. For example, these applications include high-end security and surveillance, ITS (Intelligent Transportation System), FA (factory automation), and cell phones.

The manufacturing process of FSI is mature and low cost. The CMOS image sensor with FSI technology is more sensitive to system cost, rather than high performance. For example, these applications include smart-home and low-end video-monitoring products.

What are the customer benefits and technological advantages of using CMOS image sensors over CCDs, for example?

CMOS image sensors and CCDs are two different types of image sensor technologies used for digital imaging. CMOS image sensor technology has had great success due to its advantages over CCD.

First, CMOS image sensors are more cost-effective and power-efficient than CCD. CMOS image sensors are also easier to use, which means that users do not need to use external AD and design complex analog circuits. In addition, CMOS image sensors have a higher frame rate, which is a great feature not only for the FA market, but also for consumer products such as sport cameras and cell-phone cameras.

Can you share a few AI and machine-vision specific applications/case studies?  

Factory automation is one of the fields that has a high demand for AI. High-performance, industrial-grade global-shutter CMOS image sensors combined with BSI pixel design can provide better signal-to-noise ratio, higher sensitivity, and greater dynamic range. Such technology can be widely applied to improve factory-automated functions, such as inspection, quality control, optical character recognition, and robot arm guidance.

In other intelligent sensing applications such as drones, global-shutter CMOS image sensors are used for obstacle avoidance and optical flow. CMOS image sensors are also used for recognition-based AI applications like vSLAM in robotic applications, which makes gesture recognition, face recognition, and iris recognition more accurate and faster.

In addition, CMOS image sensor technology can be used beyond industrial applications. From barcode scanning (e.g., 1D or 2D code) at a grocery store to a lane-departure warning from an automobile, high-performance CMOS image sensor technology is greatly improving user experience and efficiency.

Furthermore, single-frame HDR Global Shutter technology is better for image-recognition-based AI applications than conventional CMOS image sensors that use Multiple-Exposure HDR technology. Combined with a DVP/MIPI/LVDS interface, single-frame HDR Global Shutter technology can be adapted to various types of SoC platforms.

What are the trends you foresee in the CMOS image sensor industry?

With the advanced development of emerging technologies like AI and machine learning, customers are trying to provide new product forms and better user experiences to meet market demands.

1. This image was taken with a CMOS image sensor’s HDR feature from the SmartSens SmartClarity family.

2. This image was taken without a CMOS image sensor’s HDR feature from the SmartClarity family.

The use of AI technology is inseparable from the processing of data. And image data is the most objective and direct expression for the real world, so it is also the most closely linked with AI technology. Therefore, CMOS image sensors, as one of the most important means of image data acquisition, will achieve broader market and rapid development in the AI era (Figs. 1 and 2).

As a separate trend, adoption of global-shutter technology is growing rapidly, in comparison to rolling-shutter technology. One of the main reasons is that a global-shutter CMOS image sensor is able to achieve excellent real-time performance without the jelly effect, especially in AI and machine-vision applications. With advanced manufacturing process technology and reduced cost, it’s expected to see increasing market demand for global-shutter CMOS image sensors.

About the Author

William G. Wong | Senior Content Director - Electronic Design and Microwaves & RF

I am Editor of Electronic Design focusing on embedded, software, and systems. As Senior Content Director, I also manage Microwaves & RF and I work with a great team of editors to provide engineers, programmers, developers and technical managers with interesting and useful articles and videos on a regular basis. Check out our free newsletters to see the latest content.

You can send press releases for new products for possible coverage on the website. I am also interested in receiving contributed articles for publishing on our website. Use our template and send to me along with a signed release form. 

Check out my blog, AltEmbedded on Electronic Design, as well as his latest articles on this site that are listed below. 

You can visit my social media via these links:

I earned a Bachelor of Electrical Engineering at the Georgia Institute of Technology and a Masters in Computer Science from Rutgers University. I still do a bit of programming using everything from C and C++ to Rust and Ada/SPARK. I do a bit of PHP programming for Drupal websites. I have posted a few Drupal modules.  

I still get a hand on software and electronic hardware. Some of this can be found on our Kit Close-Up video series. You can also see me on many of our TechXchange Talk videos. I am interested in a range of projects from robotics to artificial intelligence. 

Sponsored Recommendations

Comments

To join the conversation, and become an exclusive member of Electronic Design, create an account today!