What is the solution to being raped?

I'm married and have 3 kids. My husband's behaviour was very bad with me always. Because of his lack of attention and irritating nature, I started talking with my colleague. I was talking to him only and didn't want to start any relationship with him. I was a girl with a very strong character. One day I went to his home and he started touching me, and he removed my clothes. I did not agree and was telling him no, but he did everything and I couldn't stop him. I was very upset as I don't want to do this kind of act. Still I'm talking to him but not in any sexual relationship between us now. Please tell me the solution. I cant sleep in nights and this sin is making me upset. I don't want to do this but he raped me. God knows what was his intentions, but I don't want to keep such relationships. I was also helping him by lending money; just that his talk would give me some courage. Please suggest what to do, it seems now that his intentions in the first place were to rape me.