Well and how he from a transaction the public key received? sent a bit bitcoin to the address? What prevents him from doing the same thing with 56? I gave him an approximate search space.
To use the baby-step giant-step algorithm you need the actual public key, the address (P2PKH) is not enough. The public key is exposed when someone (e.g. the owner) makes a transfer out of the account.