You need to force each request to serve the index file. You may want to look into the .htaccess file. In here you can define rewrites that allow each request to be served by the index file. Using the HTML5 History API, React router will know how to correctly render the page.
Zeit's serve also provides setting rewrites in their configuration file. Have a look at the following link: github.com/zeit/serve-handler