... I need to verify I can access it using my private key. But how can I do it in a safe and private way? Preferably offline.
What you need is independent software to validate the address and the private key and verify that the address is derived from the private key. That is effectively what happens when you import a private key into a wallet.
Anyway, there are many software programs that will do that offline including the one listed above and any wallet software.