I'm going to run a rig with 2 7970s, and I'm going to run 1x4GB stick (the exact one you have actually).
Mining doesn't really need RAM. So long as the OS can operate on 4GB of RAM, 1 stick will be just fine.
LTC scripting does use RAM
https://bitcointalk.org/index.php?topic=163306