It is compatible, yes--you can sign and encrypt messages that PGP users will be able to verify and decrypt, and you can verify and decrypt messages from users of PGP.

it is not a drop-in replacement, so if you have scripts that rely on calling pgp in certain ways, you'll need to adapt them to gpg.