How do you decide if your project needs a Frontend framework?

I keep hearing that opting for a framework is a big decision and that you should only use a framework when the project is "big enough”. How do you decide if your project needs a frontend framework?