Fast-zoom and high-resolution sparse compound-eye camera based on dual-end collaborative optimization
基于双端协同优化的快速变焦高分辨率稀疏复眼相机
デュアルエンドコラボレーティブ最適化に基づく高解像度のスパースコンポインドアイカメラ
이중 엔드 협업 최적화를 기반으로 빠른 빠빠빠른 더더블 더더블 엔드 협업 최적화를 기반으로 고해상도의 희미한 복합 눈 카메라
Cámara de ojos compuestos escasos de zoom rápido y alta resolución basada en la optimización colaborativa de doble extremo
Caméra à œil composé à zoom rapide et à haute résolution basée sur l'optimisation collaborative à double extrémité
Быстромасштабная и высокоразрешающая камера с редкими смешанными глазами на основе совместной оптимизации с двумя концами
Yi Zheng 郑奕 ¹, Hao-Ran Zhang 张浩然 ¹, Xiao-Wei Li 李晓为 ¹, You-Ran Zhao 赵悠然 ¹, Zhao-Song Li 李赵松 ¹, Ye-Hao Hou 侯页好 ¹, Chao Liu 刘超 ¹ ², Qiong-Hua Wang 王琼华 ¹ ²
¹ School of Instrumentation and Optoelectronic Engineering, Beihang University, Beijing 100191, China
中国 北京 北京航空航天大学仪器科学与光电工程学院
² State Key Laboratory of Virtual Reality Technology and Systems, Beihang University, Beijing 100191, China
中国 北京 北京航空航天大学虚拟现实技术与系统国家重点实验室
Due to the limitations of spatial bandwidth product and data transmission bandwidth, the field of view, resolution, and imaging speed constrain each other in an optical imaging system. Here, a fast-zoom and high-resolution sparse compound-eye camera (CEC) based on dual-end collaborative optimization is proposed, which provides a cost-effective way to break through the trade-off among the field of view, resolution, and imaging speed.
In the optical end, a sparse CEC based on liquid lenses is designed, which can realize large-field-of-view imaging in real time, and fast zooming within 5 ms. In the computational end, a disturbed degradation model driven super-resolution network (DDMDSR-Net) is proposed to deal with complex image degradation issues in actual imaging situations, achieving high-robustness and high-fidelity resolution enhancement.
Based on the proposed dual-end collaborative optimization framework, the angular resolution of the CEC can be enhanced from 71.6" to 26.0", which provides a solution to realize high-resolution imaging for array camera dispensing with high optical hardware complexity and data transmission bandwidth. Experiments verify the advantages of the CEC based on dual-end collaborative optimization in high-fidelity reconstruction of real scene images, kilometer-level long-distance detection, and dynamic imaging and precise recognition of targets of interest.
