Pain in mind while keeping it on breath

My question is subtle. When we meditate we move our body because of some physical pain . My question is why its so painful to keep my mind on breath . Its not physical pain then what type of pain we face when we try to keep our mind on beath away from distraction.