ANSWER:
What you have done is absolutely prohibited in islam and its not a valid marriage, rather you’re living in zina with him and all your children are born out of wedlock.
You must immediately leave him at once and if this so called marriage was registered on paper, you must dissolve it and get away from him immediately, besides repenting sincerely to Allah for this grave sin. He is not your husband and he is a total stranger like any random man walking down the streets.