I don't think it'll be a problem. I don't start my bitcoin client up everytime I boot up my computer (and yes, my bitcoin client is on a different computer than my miner). I only start my bitcoin client, maybe 2-3 times a week to get the latest blocks. You don't want to get too far behind because then, you'll have wait for a few hours before getting to the most recent blocks.