If your father is okay with the marriage, this is the most important, because he is your wali and you can go ahead with the marriage. If you don’t have a father, your brother becomes your guardian and his opinion and consent is what counts. If you truly want to marry this man, try to
convince your mother in a respectful manner so that everyone is happy.