He fought them because they rejected Zakat all together and said that we only pay it to the Prophet salla Allahu alaihi wa sallam and that they were not going to pay it to anyone afterwards. This was a form of apostasy as they rejected one of the pillars of Islam.
This is different from not giving it because of greed or negligence.