Do you have the correct ports open on your server to accept the callback connection?

Also this could be a service problem since blockchain.info has had some service problems in the past. If you can ping your callback URL from another computer, then it is probably open and working as it should. In that case then contact blcokchain.info's support since that would be their service not sending the callbacks.