You can wear such colors but I would recommend to wear black as it is the custom of the country and you would look like them.

Is it better to wear black abaaya and scarf during umrah or can a woman wear brown or gray ( dull colors) what is better?