Ambarella launches computer vision chips for edge AI

Venture BeatThis post was originally published by Dean Takahashi at Venture Beat

The new CV28M camera system on chip (SoC) is the latest in the company’s CVflow family. It combines advanced image processing, high-resolution video encoding, and computer vision processing in a single, low-power chip.

Ambarella packed a lot of AI processing power into the chip to anticipate the way computer networks will evolve as everything gets connected to the internet. Since networks could become inundated with data traffic, self-driving cars, for example, will have to do their processing at the edge of the network, or in the car itself, rather than interacting heavily with datacenter processors.

This means the sensors and image processors in edge devices will have to be very powerful, Ambarella VP Chris Day said in an interview with VentureBeat. “We’re working on new markets, including IP security cameras, consumer home monitoring cameras, drones, automobiles, and autonomous vehicles,” Day said. “This [chip] is at the low end, and it enables us to do applications at different price points and features.”

Above: Ambarella’s sensor chips can detect things in images.

Image Credit: Ambarella

Day said possible applications for the CV28M include home security, retail monitoring, consumer robotics, and occupancy monitoring. As privacy laws tighten and people grow more concerned about their personal data, processing at the edge will become an even more attractive option.

“The significance of this chip for the consumer video market is its ability to process more on the camera,” Blake Kosak, an analyst at market researcher Omdia, said in an email to VentureBeat. “Today, most consumer security cameras send video to the cloud for processing, which is expensive for the camera manufacturer. Chips that allow for more edge-based processing will benefit brands that are looking to avoid charging customers monthly for cloud storage and advanced analytics, like D-Link and Logitech that provide cameras mostly free of monthly subscriptions while Arlo, Ring and others charge for similar analytics and cloud storage.”

Kosak added, “As privacy concerns mount across Europe and North America, reducing reliance sending video to a remote server is a positive step for the market. Analytics at the edge will also allow for faster response times not only for cameras but other smart home products, like robot vacuums. The next big trend in robot vacuums will be computer vision that detects objects in the room, from socks to toys, so the vacuum can avoid these items.”

Use cases that involve sensitive information include cameras that monitor the elderly and detect when a person has fallen down in their home. Nothing would be recorded until the sensors detect a fall, when the camera would turn on and ask the person if they are okay, Day said.

Some elderly-monitoring devices use radio to detect falls, but Day said it’s important to have video communication with the person to eliminate false positives. “The privacy of the person you’re monitoring is not impacted,” Day said. “You can’t and you don’t want to be monitoring them 24 hours a day. But you do want to know when there is a problem.”

Above: CV28M chip design

Image Credit: Ambarella

For internet-connected security cameras, the CV28M features AI-based rate control to optimize image quality while reducing video storage and network bandwidth requirements. Ambarella’s AI Timelapse scene-aware recording also saves users from having to scan through video timelines to retrieve moments of interest.

“AI Timelapse reduces the storage requirements and means you don’t have to record and watch a whole lot of video when nothing is happening,” Day said. “In retail monitoring, we can actually monitor shopper behavior, and see how many people are in the store and where people are congregating in a particular area. We can create heat maps based on that.”

In consumer robotics applications, the CV28M can be connected to visible structured light and time-of-flight (ToF) sensors to capture and process the data required for navigation. And with the pandemic, the cameras could be used to detect whether people are standing at least six feet apart, Day said.

The CV28M only consumes around 500 milliwatts of power, and it can do efficient video encoding in both AVC and HEVC formats. The chip is fabricated in 10-nanometer manufacturing and has a dual-core 1GHz ARM Cortex-A53 processor. It shares a common SDK and computer vision (CV) tools with Ambarella’s CV25, CV22, and CV2 CVflow SoC families.

Kosak said that Ambarella competes in this market with Hisilicon, OmniVision, and a few other proprietary technologies.

“This new [Ambarella] chipset allows more to be done at the edge while maintaining the high-quality analytics that are typically sent to the cloud for processing,” Kosak said. “This will benefit privacy advocates and consumers looking to keep costs down. The AI time-lapse will also benefit those offering continuous video recording by analyzing scenes locally. Lastly, battery-life is becoming increasingly important so any chip that can prolong battery life will have a competitive advantage, similar to what EUfy and the latest Arlo cameras that are 100% wire-free.”

The Santa Clara, California-based company, which went public in 2012, started out making low-power chips for video cameras. But it parlayed that capability into computer vision expertise and in 2018 launched its CVflow architecture to create low-power artificial intelligence chips. Now the company has 800 employees and is competing with the likes of Intel and Nvidia, though with a focus on low-power applications. Ambarella generated $220 million in revenue in 2019.

The CV28M chips are available in sample quantities now, but the company did not say when they would be in mass production.

Spread the word

This post was originally published by Dean Takahashi at Venture Beat

Related posts