It is permissible to wear them without any belief in them!

To believe that these gem stones have properties and can help you or harm you in anyway, it is Shirk, minor or major!

I advice you to read the below link: http://islamqa.info/en/6759

Is wearing Gem stones allowed in Islam?