it depends on how you are setting up and using that "electrum server". for example if it is on the same computer then you are right, there is no point.
It depends, few people simply prefer using Electrum over Bitcoin Core to manage their Bitcoin due to Electrum UI or feature (e.g. mnemonic backup/restore).