But isn't this is only relevant if you accept incoming connections? If I'm not mistaken, Bitcoin will not accept connections when running behind a proxy, except if you define listen=1.
Yes, that is correct.
Binding that address will make your Core instance to only listen on that address so that connections from others to your node can only be done through the address that you've specified but connections to other nodes are already routed through the proxy.