Doesn't matter.
I know I'm guilty of being cold-hearted and I'll fully admit to that. But anytime I've ever been that way I've always made a point to apologize. Unless the apology wasn't necessary because someone did something that hurt me.
If you have a problem and want to call me out on it, I'm all ears.