you may want to rephrase your question because it isnt very clear what youre asking.
why its not clear? because once an address belongs to a wallet, it will forever belong to that wallet, so used to is not a tense that applies
that aside, the only way an address can be verified as belonging to a wallet (which is really a private key) is by having access to the private key