I might be wrong, but I think it's about RAM on the graphics card, and that's part of the reason why Scrypt-N11 performs at half the hashrate of Scrypt-N10 on the same hardware. I'm running my rigs with the same 4GB as always, it doesn't seem to require any more system RAM.
But no, all people talk about having 8 gigs of ram.