Your computer-use agent clicks 20 pixels off: screenshots vs the accessibility tree

Originally published on dev.to. Every computer-use agent has to answer one question before it can click anything: what is on the screen right now? There are two ways to answer it. Send the model a scr