BitcoinTalk is using a modified version of SMF, which is open-source. Theymos (and others, at his direction) have made modifications to the code, mostly that are specific to the forum, the merit system for example. I suspect that theymos is weary of releasing the full source code of the forum out of fear that security issues will be found, and exploited (that might otherwise not be found).