Once he is not been abusive. If he is it may time to have a serious chat with him. It is not good staying in a relationship with a person who even attempts to raise a hand towards a woman. There can also be mental abuse. This is something nobody should have to put up with. Ask yourself exactly how you feel about him and the relationship. If it is worth it all. If you are not happy in the relationship it may be time to simply move on.