This tutorial: https://medium.com/swlh/converting-a-react-app-to-typescript-f72b65d798bc
Is awesome but there were some dependency conflicts. I updated the dependencies and switched to webpack serve instead of webpack-dev-server and now everything works.
See the branch for my version of the tutorial's code.