The chance of someone correctly guessing your password, your 2FA code, your credit card number, and the key to your house simultaneously is 4.4*1061, which is still around 2 thousand trillion times more likely than them guessing your private key.
You have public key, you can try and find the private key for it. You have a (valid) private key, you can try and find other public keys for it. As you say the odds are slim, but they are still odds. Apart from time, CPU power and storage, there is nothing stopping you from generating a list of all the pairs in existence.