I noticed the burning smell might be coming from the GPU. Is there anything I can do about that or should I just buy a new PSU?
If your PSU smells then you must assume it will fail. Do not use subpar off-brand cheap power supplies. When power supplies fail they have the potential to take the whole system with it.