OK I think found the problem? I had forwarded the port in my router, but I updated the rule from the one I had for QQBcoin, and only changed the internal port! So my router was forwarding BBQcoin stuff from the external port 59333 to the smallchange client! People must still have had my IP in the bbq network and were trying to connect to me.
This explains a lot, why my blockchain kept thinking it was much larger, the 60+ connections etc. I wonder if I mined any BBQcoins to my smallchange address!? haha!
This has been possible because the SMC client got data from BBQ nodes and accepted it. All this with a bad receiving port.
So I guess someone with BBQ clients could easily send stuff to SMC client on purpose (just changing a port) to achieve the same things for all SMC nodes, right?