But before xapo is charging high fees even there's no congestion or any problem regarding the transactions.
Online wallet services will always face a certain level of resistance when they force through changes. If they keep the lower fees, transactions will get confirmed slowly, resulting in people complaining. If they increase their fees to offer people faster confirmations, people complain that the fees are too high. In easy terms, regardless of what they do, it never gets appreciated by their users. Instead of complaining, people should install a mobile wallet client that only charges the required network fees, and from there save themselves some satoshis if that's so important for people.