Ideally, and in most scenarios, it is probably not necessary to use a clean environment with a hardware wallet. The hardware wallet is designed to defend against these external threats well. In view of this, a refurbished one is more than enough. You should wipe it and install your own OS as well.