ANSWER:
What you are doing is absolutely not permissible and missing fard salah deliberately is a major sin!
Let him cry all he wants, put toys in front of him to keep him busy. If you give in to his tantrums like this he will never learn to accept no for an answer.
And besides, do you not go to answer the call of nature for fear of his crying? Set your priorities right and make your life revolve around this obligatory act.