It's possible the remote node you are connected to is slow, so you can try changing it. Otherwise, if you are restoring from a seed, try to make sure that the block height you restore from is from just slightly before you generated the wallet.

For example, if you generated a wallet 3 weeks ago, set the restore block height to 357,000, which is roughly 4 weeks ago