Yes, you can picture it as mining and gaming each using a percent of your GPU's cabability.
That being said, not all games and coins are the same. For example, a 3D shooter will affect your graphics card more than an simpler RTS game with older graphics.