Yeah I guess it's not really a cold storage then, I created it with wi-Fi on and it was connected to the Internet for a few days. But that first one is now deleted. Maybe I can create another one completely off-line and transfer the coins
Ah! Yes, you need to talk off all internet connection while creating cold wallet.