What is the basis for the belief that the wise men did not arrive in Bethlehem until several months after the birth of Jesus?

Many depictions of the nativity have both the shepherds and the wise men at the stable on the night of Jesus' birth. However, it is commonly held that the wise men did not arrive until several months after the birth of Jesus. What specifically is the basis for this belief?