Reproducing Sequential Attention
TL;DR
Implemented Google's Sequential Attention feature-selection algorithm (ICLR 2023) from scratch in PyTorch (seq-attention/), faithful to Algorithm 1: a softmax mask over per-feature attention lo
vijay-ram.hashnode.dev9 min read