I do agree that having you wallet in your sig is akin to just casually asking every passer by if he can spare some change frankly. You don't expect anything but maybe he likes your outfit? Who knows! It's not really panhandling is it?