If he does not pray his 5 daily prayers at all, then he is not a Muslim and you must leave him.
If he is slacking in his prayers and does not pray them on time, you must talk with him about this in a soft and respectful way. Getting angry with him, will only push him away. Try to have elders from his family talk to him.