One more question regarding the block header.

Of all the 6 elements, is it the Block Time alone that guarantees everyone is working on a random hash?  To ask another way, if Block Time wasn't part of the header, would everyone be working on the same hash making it a contest of which miner is the fastest?