Leaving one's family to become a monastic is not unheard of. I met a monk who retired from his job and, with his wife's blessing, left her his pension and home to live the monastic life. As long as the family is cared for and the spouse agrees, it is not a problem.
It should not be used as a means of escaping debts or responsibilities.
I read some ambiguity into the reference to the family being 'cared for and the spouse agrees.' If that were not your intent, I do apologize as I suspect we really do not disagree. Sorry for any confusion.