Calling someone as such is like calling someone a kafir.
This can’t be to individuals. It can only be carried out by the rulers.