Try your level best to be patient and tolerant! Allah told us in the Quran that whenever we face hostility with kindness, our enemies will turn into friends and allies!
By overlooking their aggression and what is meant to hurt you, you are making them ashamed of themselves and they will eventually stop.
Deal with them with great deal of diplomacy and respect and anticipate the reward from Allah and you will see miracles happening in sha Allah.