iota does not have fees and when a new transaction arrives it must approve two previous transactions.
There are many more differences but I think that's the major one. Im not sure how byteball system about witnesses work but it still has transaction fees. In iota the need for miners is eliminated and users do the proof of work themselfs