actually that is a good ideas but there is a risk where Telegram Username can be changed anytimes you want. so how about when someone got mistake misspelling the name? or telegram got hacked? that could be a problem.
The address of the cryptocurrency wallet will be linked to the contact from your address book by the phone number.