A wallet backup running on the older version 4.1.5, let me export the labels (menu option). I then imported these labels into the wallet running on the new version 4.2
I now have what I want - wallet on newest version, and labels too.
Shame on me, I managed to miss that feature, although I'm using Electrum for quite some years. Thanks for sharing.