Using that example, if difficulty 2 is nowhere close to what's needed to solve a block, that means that all work submitted while on a low difficulty is just worthless?
Correct it is worthless, hence the term "proof of work". It is just proving to the pool that you are working because you can't fake those shares..