My dear, having time for your family is one essential thing. I usually advice people to ensure you build a stable income generating platform before leaving the current jobs. So you can have something to hold onto when freelance jobs aren't forth coming.