There are thermal pads under the heatsink. I have replacements ordered, but I'm only running myr-gr, so not too worried about heat. You could probably replace the thermal pads with Arctic silver, but I'd be worried about it getting on the board.
There's a small heatsink on one side, and a large one on the other. The chips are all under the small one, so dont worry about taking them both off.