Accessibility APIs Are the Cheat Code for Computer Control

Most AI computer control tools work like this: capture a screenshot, send it to a vision model, get back pixel coordinates, simulate a click at those coordinates. It works, technically. But it is slow