The issue here is the vast majority of people dealing with cryptos don't know what micro and milli mean. I can't count the number of times people look at me dumbfounded because they can't convert between the amounts because they don't know basic conversion. Anyone who has been to elementary school should already know the meaning of micro/milli, but sadly that just isn't the case. "Bit" takes away this "difficulty" people often have with trying to figure out the values.
Anyone who doesn't know metric prefixes will not know what a bit is. Why introduce an arbitrary definition when the metric system or satoshis work perfectly fine? Seems like adding difficulty to me.