Adapting Auxiliary Losses Using Gradient Similarity

Adaptive Auxiliary Losses through Gradient Alignment Motivation and framing At first glance the idea is simple yet practical: rather than blindly combining objectives, decide whether an auxiliary signal should influence learning by checking how its g...