Does it mean we have to have fast CPU or powerful computer to do that? Is that required for ordinary Core wallet holders?
Define 'ordinary Core wallet holders'? If you are using Bitcoin Core, then you need to sync up with the network in order to send out/see received transactions. However, unless you're running full nodes you don't really need to bother yourself with the requirements.