Use ember as workflow for "normal" html project?

Correct: there’s an older thread with some nginx config snippets for achieving this here: How to serve all routes on a production server exactly? - #2 by nightire

Else a tiny HTTP server in the language of your choice should be able to handle a wildcard path and serve up index.html