Should I send the difference back or punish this little scammer for what he did?
Yes you should. Because you are not a scammer like him. After deducting the amount he scammed you, the rest are his money not yours. So, from moral point of view I will suggest you to send the money back to his wallet and move on. His account is already tagged so at least from this account he can not do any trade.