I think I figured out why I thought I was getting the wrong amount in my wallet. I think it's displaying my lifetime amount, even though it's no longer in my wallet of course instead of just showing what I actually have. Switching away from the tracking key and loading up the .wallet file gives me my actual balance. I guess the tracking key needs some work.
EDIT: Scratch that I'm missing the point of the tracking wallet. It's meant to track all your incoming transactions. Kinda wish it would just act as the normal wallet, but without the ability to send COAL.