Sometimes the progress gets so bad I have to restart Bitcoin Core many times.
I don't think that helps. If anything, it makes it worse.
"Being slow" can have 2 main causes: slow internet, or slow hardware. If the problem is your internet, restarting Bitcoin Core won't help. If it's your hardware, all you can do is shut down other programs. Restarting a web browser can (temporarily) help to reduce it's memory consumption.