Make sure that the munin plugins gpu_* (/etc/munin/plugin-conf.d/munin-node) are run as the user logged into X. That should help