It is hardly secure. Not really from a technical point of view, but from a social engineering standpoint.

As you probably know, telegram is a haven and congregation point for crypto scammers. So the first place they are going to target now is all of the bitcoins in the internal wallet.

Also, if somebody steals your phone and it has Telegram, they will also try to drain out all the bitcoins from the Telegram wallet.