Banks don't pay interest rates. They are just (taken we're talking about classic "depository & loans" operations) intermediaries.

Borrowers pay interest rates. They can pay them because they make a good business with the capital and come out on top (investment).

There's also the possibility of default, that's why money doesn't concentrate in a single point in the long run.