Even on gigabyte internet in an uncongested area, it still takes your website a few seconds to load.   I can imagine people with non-fibre would have it even worse, and people that have a lot of windows open and are going through VPN/TOR.

I understand the way you built it, and I like the design, but maybe you could add a loading indicator of some kind?   

I also do not understand how such a page load affects Google, because that will affect your SEO.   
https://webmasters.stackexchange.com/questions/26679/why-does-google-think-that-pages-load-slow