Oh, ...yes, I suppose deleting the entire wallet.dat and starting with an empty one is one way to delete your addresses and labels.  Of course, you'ld only want to do that after making a backup in case you ever would receive coins at an old address at some point in the future.