Sorry needn’t be the hardest word. When you make mistakes, apologize.
If you don’t say I’m sorry, you will be sorry! Make up for your mistakes by an honest apology and you will find whatever guilt or anguish you have been feeling will go away. It works in just about any situation. The smaller the transgression, that harder it may be, but just do it!