The problem with making the system only applicable to previously signed transactions is that you would only be able to rate people who agree to it. If you are going to end up giving a negative rating to somebody, why would they agree to let you give them a rating?