webserver docker is running nginx, you can mount other setting into the docker, like ssl certificates, and an 443 definition.
or you can start your own nginx and point the reverse proxy to the webserver docker exposed port.
if the reverse proxy uses a location other then root (like /clearml ), you will need more setting to get the UI to work form that path