Public chain can be upgraded but it doesn't happen easily or quickly, and before it happens there will be glaring need for it. Hence, soft fork and hard fork.
Have you not seen some systems that undergoes an update, and the former update betters the current?
Though difficult to implement in Bitcoin, yet that's the nature.
As for the poor efficacy of blockchain, I'm yet to understand.