Victor Zrobustramblings.hashnode.dev·Dec 14, 2024Paper summary - Impact of Aliasing on Generalization in Deep Convolutional NetworksTL; DR by carefully selecting where to put aliasing mitigation in a CNN it is possible to limit anti-aliasing information loss. Aliasing negatively impact performances in a way that is not evident from validation loss. Another paper on the effect of ...AI Natural Robustness
Victor Zrobustramblings.hashnode.dev·Dec 8, 2024Does anti-aliasing smooth spatial loss surface?The last two posts (1, 2) I published were on the topic of spatial robustness, i.e. the stability of a neural network prediction with respect to small translation and rotation. A curious observation from [1] states that first order adversary seem to ...AI Natural Robustness
Victor Zrobustramblings.hashnode.dev·Nov 30, 2024Paper summary - Making Convolutional Networks Shift-Invariant AgainTL; DR Many operations in a typical convolutional neural network down-sample the signal without accounting for aliasing. Aliasing causes frequency content that makes a classifier vulnerable to rotation and translations. Aliasing in CNNs Aliasing is a...AI Natural Robustness
Victor Zrobustramblings.hashnode.dev·Nov 24, 2024Paper review - Exploring the landscape of spatial robustnessTL; DR Image classification model (probably vision models in general) are spatially brittle. Small combination of rotation and translation can radically change model output. Introduction The focus in on spatial robustness, i.e. small spatial transfor...AI Natural Robustness
