If you can make sure that there's no downtime and that the shed is well isolated, especially from humidity, then there shouldn't have any problem.
yeah, it would be really good actually, you have a win win situation, your home isn't 500 degrees and you got free cooling for your miners. It shouldn't be a problem unless your shed is badly isolated, which i mean by that is that snow/rain/water/condens can come in, then you're fucked..