For now it's just Google - if Apple does this too it's game over for a lot of users.
It would be damaging or more like inconvenient but
notI don't think it would be game over since all of these popular wallets have a website where they self-host their binaries and also there is github where they share the source code and some of the also publish the binaries there as a mirror.