Just hitting back and getting to the main wallet screen is enough to wipe the Cold Storage key from memory.