You only broadcast that to your miners (if you are a pool) not to everyone else (you do know how this stuff works or don't you?).

And as stated before if you don't validate the txs in a block then you are going to be easily tricked into mining on an invalid fork.