Is Hajj a pagan worship?

The ritual of pilgrimage (Hajj) was a pre-Islamic practice, which we do not find in Christianity or Judaism. Islam adopted it in almost the same form as it was done before. Can someone explain to me that it is not a pagan worship? This would tell me that while pagans were doing everything wrong, this was the only thing they were doing right! but to the wrong person. How can they do such a complicated ritual right. Why Jews and Christian have no such practice, where does it come from? My main question is in what way Hajj is not a pagan worship. Explain please. > Surely the Safa and the Marwa are among the signs appointed by Allah; > so whoever makes a pilgrimage to the House or pays a visit (to it), > there is no blame on him if he goes round them both; and whoever does > good spontaneously, then surely Allah is Grateful, Knowing. Quran 2:158