In the future if anyone is reading this - apparently all it takes is reading the documentation properly: https://github.com/parse-community/parse-dashboard#security-considerations
I needed to set trustProxy: 1 in the dashboard config and that was enough to get it to work.