It is permissible for women to stay fit, but you should not push it and lift heavy weights like men. If there is an all female gym and there are not even male workers, and no music, and you are properly covered, this seems okay.
But it is better for you to do this within the comfort of your home.