A 0.82 mu W CIS-Based Action Recognition SoC With Self-Adjustable Frame Resolution for Always-on IoT Devices

Cited 0 time in webofscience Cited 0 time in scopus
  • Hit : 122
  • Download : 0
An always-on video-based human action recognition (HAR) system on chip (SoC) integrated with a CMOS image sensor (CIS) is proposed for the Internet of Things (IoT) devices. The proposed SoC is the first always-on integrated circuit (IC) performing the full process of HAR in a single chip. To resolve large power consumption from vision sensor and compute-intensive DNN operation, the proposed SoC operates in two different modes; 1) in adaptive frame resolution based human action recognition (AFR-HAR) mode, CIS resolution prediction algorithm and self-adjustable CIS reduce 42.9-91.8% of readout power by adaptively adjusting frame resolution. 2) In motion event detection (MED) mode, the motion event detection unit (MEDU) skips unnecessary imaging and DNN computation by monitoring motion events and leads to over 99% power saving. The proposed HAR SoC is simulated in 65-nm CMOS technology and occupies 8.56 mm(2). It consumes only 0.82 mu W when no motion is detected and 0.31-8.52 mW for evaluating human actions on the ActivityNet dataset.
Publisher
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
Issue Date
2021-05
Language
English
Article Type
Article
Citation

IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, v.68, no.5, pp.1700 - 1704

ISSN
1549-7747
DOI
10.1109/TCSII.2021.3067151
URI
http://hdl.handle.net/10203/285459
Appears in Collection
EE-Journal Papers(저널논문)
Files in This Item
There are no files associated with this item.

qr_code

  • mendeley

    citeulike


rss_1.0 rss_2.0 atom_1.0