It is possible to use both Nvidia and AMD cards simultaneously.
For AMD cards, changing RAM timing with atiflash has a major role in GPU tuning.
Afterburner setting is also possible, but it has a little effect and you could ignore afterburner if it makes some problems.
Go mining with 580.
Will there be any issues like system crash/performance issue while using AMD and NVIDIA card on the same machine?