I would be careful with using an old smartphone. Their hardware may fail at any time or your OS may get stuck in a bootloop. Atleast make sure you have proper back-ups of the wallet.

I guess your idea would work well though. The scans are very easy to use then. I think it would be best to do a full hard reset of the phone data, download the app and then go offline for ever.