If you are not happy in your daily work, you can try to change it, but I think you should assess your own risk before giving up your job at full time. A stable job may be very important for your family.