It's not possible since additionnal information are needed to transfer Blackbytes, these are usually transmitted privately between 2 paired devices.
If the Blackbytes are sent to a middleman, the 12 words can be used to access it again, and the middleman can sent them again.