-snip-
Which is why I said "consistently". You said he's only been to your house once, which would explain his IP matching yours once. If his IP matches yours consistently, then we know you are lying.
But as I said, IPs not matching doesn't prove your innocence.