I cut EmbeddingGemma 2's vectors to a sixth of their size. It got more answers right, and that was the worrying part.

A computer cannot compare meanings. It can compare numbers. So if you want a search box that understands "why can't you make good tea at the top of Everest", you first need something that turns words