It seems like this feature won't be implemented by Ledger (judging by their response on the GitHub page). I tried to find the json file that they mentioned contains transaction history (accounts.json) but got no result. Anybody knows where it is? I'm running the latest Ledger Live (still at 1.4.2).

OP, I think you should switch to Trezor for the sake of simplicity.