No, you don't have to keep it open. Next time you open it up it'll sync and you'll get the messages sent to your BM address. Note that this only applies to the computer that has keys.dat and messages.dat in your PyBitmessage config folder (~/.config/PyBitmessage by default on Linux). It takes a while to sync.