I think if you can manage your time well, why not do both. You can have passive income in your work while having active income in bitcoin as well. It is better to diversify your attention also to avoid being stressed out focusing on just one side. Just enjoy what you do and make the best out of it.
Good idea to just manage both because your job will become the back up for getting money if something went wrong in cryptocurrencies for example is the scenario right now. All of the altcoins goes down and that is because of the banning of ICO in China and if you don't have a job then you are in a deep lose in bitcoin.