Thanks a lot,this makes a few things clear for me.
I wish I could use the same wallet on the phone and use somehow the benefits of the ledger to protect it
Like the other member posting along with you I have no direct experience with a Ledger. I do with a Trezor, which of course is another hardware wallet. Using this model you can easily work with a "phone" and a Trezor using MyCellium. Very fast and safe as can be. Then you can still use the Trezor with Electrum on your home computer. Versatile and safe as can be. It would surprise me some if Ledger did not have the same option. In both applications the private key is never revealed to a computer or phone, not ever.
That functionality exists! I use Electrum with my Nano on my PC and also use Mycelium with my Nano on my Android device. It works quite well!