Yes, it is possible to withdraw from a bitcoin debit card.
I've ordered a Bit-X card and intend to take it for a spin.

Been reading up on the available cards, and it looks like the Bit-X one lets you spend from your bitcoin balance directly. The others require you to convert your bitcoin to fiat first before you can use the card.