If your Wali (father) is unfit to be your wali, you should take your case to the Islamic court and complain to them and they will appoint the next one in line to be your wali such as your paternal grandfather or your  paternal uncle or your bother.

Can I marry a brother without my Wali, out of fear, my father will do Sihr on me. This father has never known me since I was a toddler, severely!!! neglected me and did a lot of sihr on the rest of my family especially my mother to kill her, together with his wife, and makes no effort to know me (he has my number). I’m 22