It's better for your own privacy and security to have a password with your bitcoin wallets. It takes half a minute to set one up and you can literally enter whatever you want. If you try to save time on something as insignificant as this, it will become a habit and you will decide to take shortcuts elsewhere. Better not do it.
Some people really doesn't want to complicate things and doesn't want to abide security for them to just easily access things. But i understand OP's point, it's only a watched-only address after all. It's really much better to access the wallet so easily without password.