We pretty much keep them as plain HTML, unless we feel there is a possibility to reuse some parts of the page elsewhere. Also, it gives that little performance lift as there is no rendering to string involved. Making such parts of your app a React component just for the sake of it would yield no major benefit.
Don't pre-optimise. You could always refactor the plain HTML into a component in future if you feel it needs to be.