Integrated photonic convolution acceleration core for wearable devices
웨어러블 장치용 통합 광자 볼륨 가속 코어
Núcleo de aceleración de convolución fotónica integrado para dispositivos portátiles
Noyau d'accélération de convolution photonique intégré pour wearables
Интегрированное ядро ускорения свертывания фотонов для носимых устройств
With the advancement of deep learning and neural networks, the computational demands for applications in wearable devices have grown exponentially. However, wearable devices also have strict requirements for long battery life, low power consumption, and compact size.
In this work, we propose a scalable optoelectronic computing system based on an integrated optical convolution acceleration core. This system enables high-precision computation at the speed of light, achieving 7-bit accuracy while maintaining extremely low power consumption. It also demonstrates peak throughput of 3.2 TOPS (tera operations per second) in parallel processing.
We have successfully demonstrated image convolution and the typical application of an interactive first-person perspective gesture recognition application based on depth information. The system achieves a comparable recognition accuracy to traditional electronic computation in all blind tests.