Even more, nobody forces you use HD wallet if you don't trust it. You can still generate a private key in the old fashion way. Just you will not gain anything in security (you will get numbers from the same range as from a HD wallet actually).
I think you will lose privacy by doing so, as it will be very hard to generate many new addresses (specially change) .
You will probably reuse addresses by doing so..