That is not necessarily correct, it could be a multi-sig address(not segwit), you can't tell unless they spend something from that address.

Of course, given that he is the owner, he probably knows -- but we don't.

For more info, read this.