Completely agree. GradCAM is a hypothesis rather than confirmation on its own, especially given its spatial coarseness. Running foreground-preserving control transformations with independently sampled backgrounds is the right way to avoid confounding artefacts and validate the shortcut. Appreciate the detailed feedback.
