The only solution is the check the entire address. Address reuse is bad for privacy anyway, so memorizing the address doesn't make sense.