Good idea, but that will open a chance to robber to stole your money, could be meet up place has been designed to trap you, and our privacy is not private anymore.
The security app is should be considered.
And also there are localbitcoin which can use for face to face transaction.
Yes this could be possible problem and adding more security barriers like Verified Photo ID and proof of address will make it more difficult for people.