Just followed your guide to sucessfully migrate to vite. It's so fast and I'm really happy to finally have gotten rid of cra. (not being able to update to ts5 was the final straw).
Here's a tipp though: Vite recommends using vite-plugin-checker for checking types.
I also added it and it works great. This removes your only "disadvantage".