Your might face an issue if you're wanting a public key instead of an address though as they're only given when funds are spent from them and not when funds are received as those are sent to addresses
On very old addresses, the public key can be seen even without outgoing transactions.