I cannot see why we cannot do both? You could have the Core protocol serving as the settlement layer and a side chain doing the Payment network.
We already have off-chain service providers doing a good job at handling the payment side.