Integrated photonic convolution acceleration core for wearable devices
用于可穿戴设备的集成光子卷积加速核心
ウェアラブルデバイス用の統合フォトニック畳み込み加速コア
웨어러블 장치용 통합 광자 볼륨 가속 코어
Núcleo de aceleración de convolución fotónica integrado para dispositivos portátiles
Noyau d'accélération de convolution photonique intégré pour wearables
Интегрированное ядро ускорения свертывания фотонов для носимых устройств
¹ Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology, Wuhan 430074, China
中国 武汉 华中科技大学 武汉光电国家实验室
² Optics Valley Laboratory, Wuhan 430074, China
中国 武汉 湖北光谷实验室
With the advancement of deep learning and neural networks, the computational demands for applications in wearable devices have grown exponentially. However, wearable devices also have strict requirements for long battery life, low power consumption, and compact size.
In this work, we propose a scalable optoelectronic computing system based on an integrated optical convolution acceleration core. This system enables high-precision computation at the speed of light, achieving 7-bit accuracy while maintaining extremely low power consumption. It also demonstrates peak throughput of 3.2 TOPS (tera operations per second) in parallel processing.
We have successfully demonstrated image convolution and the typical application of an interactive first-person perspective gesture recognition application based on depth information. The system achieves a comparable recognition accuracy to traditional electronic computation in all blind tests.
