That is expected behavior - the card lowers the clock speeds when it is not under load to save energy.  All of my GPUs do that.