No one is going to use your directory if you allow affiliate links.  :/

People will promote those sites they have a financial interest in, no matter how good they are.