Not just only a USB miner, you can potentially also run a CPU mining software and submit shares. If you are extremely lucky even the first share could find the block, the question is only if your device is able to submit shares. Also it need to submit the block that was found to the network quite fast.

In general this is the Beaty of the bitcoin network. You can participate with every device. This makes bitcoin truly decentralized.