Amplitude-Phase Recombination: Rethinking Robustness of Convolutional Neural Networks in Frequency Domain
폭 상 복합:권 적 신경 망 주파수 영역 노 스틱 성의 재고
Composición de amplitud y fase: repensar la robustez del dominio de frecuencia de las redes neuronales de convolución
Composition Amplitude - phase: repenser la robustesse du domaine de fréquence des réseaux neuronaux convolutifs
амплитудно - фазовая рекомбинация: повторное осмысление рутинности в частотном диапазоне свёртывающей нервной сети
Guangyao Chen 陈光耀 ¹, Peixi Peng 彭佩玺 ¹ ³, Li Ma 马力 ¹ ³, Jia Li 李甲 ² ³, Lin Du ⁴, Yonghong Tian 田永鸿 ¹ ³
¹ Department of Computer Science and Technology, Peking University
² State Key Laboratory of Virtual Reality Technology and Systems, SCSE, Beihang University
北京航空航天大学 虚拟现实技术与系统国家重点实验室
³ Peng Cheng Laborotory
⁴ AI Application Research Center, Huawei
arXiv, 19 August 2021

Recently, the generalization behavior of Convolutional Neural Networks (CNN) is gradually transparent through explanation techniques with the frequency components decomposition. However, the importance of the phase spectrum of the image for a robust vision system is still ignored. In this paper, we notice that the CNN tends to converge at the local optimum which is closely related to the high-frequency components of the training images, while the amplitude spectrum is easily disturbed such as noises or common corruptions.

In contrast, more empirical studies found that humans rely on more phase components to achieve robust recognition. This observation leads to more explanations of the CNN's generalization behaviors in both robustness to common perturbations and out-of-distribution detection, and motivates a new perspective on data augmentation designed by re-combing the phase spectrum of the current image and the amplitude spectrum of the distracter image. That is, the generated samples force the CNN to pay more attention to the structured information from phase components and keep robust to the variation of the amplitude.

Experiments on several image datasets indicate that the proposed method achieves state-of-the-art performances on multiple generalizations and calibration tasks, including adaptability for common corruptions and surface variations, out-of-distribution detection, and adversarial attack.
Reviews and Discussions
An overview on the principle of inkjet printing technique and its application in micro-display for augmented/virtual realities
Nonlinear optics with structured light
Femtosecond laser-induced periodic structures: mechanisms, techniques, and applications
Giant and light modifiable third-order optical nonlinearity in a free-standing h-BN film
New approach for the digital reconstruction of complex mine faults and its application in mining
p62/SQSTM1 Participates in the Innate Immune Response of Macrophages Against Candida albicans Infection
Configurable topological beam splitting via antichiral gyromagnetic photonic crystal
Single-molecule optoelectronic devices: physical mechanism and beyond
Functional nonlinear optical nanoparticles synthesized by laser ablation
The m6A methylation regulates gonadal sex differentiation in chicken embryo
A new species in the genus Synanthedon (Lepidoptera: Sesiidae) from China
A review on the forward osmosis applications and fouling control strategies for wastewater treatment

Previous Article                                Next Article
Copyright © Hot Paper