Who did we scam?
Only time will tell.

I totally agree with the first part of your post.
He means that time will tell which of your victims end up losing and which get lucky - not that time will tell whether anyone loses or not. That is already a foregone conclusion.