• Web Browser: Chrome 86
• Local OS: Mac OS X
• Remote OS: Ubuntu 20.04 (using docker)
• Remote Architecture:
• code-server --version: 3.5.0 de41646

I'm running a vanilla react project created via create-react-app. I'm trying to use code-server's built-in proxy to view my application. I set my sites 'website' field as expected by react to be http://<code-server-machine-ip>:8443/proxy/3000. However, when I go to that address, every one of the assets loaded (all .js files, the favicon) seem to be the index.html. I get an error like this in the console:

Uncaught SyntaxError: Unexpected token '<' bundle.js:1

This feels like a bug in the proxy layer of code-server, but I'm hoping I just have something configured incorrectly. I'm running code-server via docker image if that makes a difference.