Depends on how your static file server is configured.
Here is what I usually do.
Every time react runs "build" it generates a new hash for css and js file. These paths are included in index.thml. Since index.html is no-cache, it's sure that always new css and js file are loaded (if there is a new build), otherwise from the cache