What a pity that you feel that way
We think this phrase is not appropriate. It makes the other person think that you do not want to be involved in the problem. Such words make you sound someone who is not able or willing to help out. Be sincere and tell your partner that what you did or said was for some certain reason and the way he feels now is his reaction to your action.