There are physical bitcoins. Basically, a physical bitcoin is a coin or a bill containing a private key. They don't work well as currency because the production cost is generally more than the value, but people like to collect them.

Here is a thread about the ones that are recently available:

https://bitcointalk.org/index.php?topic=921095.0