How far can you go with Vanilla JS?

Of course, ultimately, all frameworks become vanilla js under the hood, but given the advances of HTML, CSS, and ES6 - how far can we go to build great websites without the need for Library/Framework X?