They are fine to use as long as you appreciate their risks and drawbacks. The two main ones are malicious similar addresses as described above (although an attacker can do that for any address, not just vanity addresses) and the fact they encourage address reuse.