Does the Buddha address varied predispositions toward suffering among different individuals?

Does the Buddha acknowledge that some people, without the Dharma, suffer more than other people, without the Dharma? I remember a monk talking about how it's a fact that some people are more skilled, better looking, more innately peaceful than others, and that especially those lacking in material attributes should seek to transcend their suffering. I wonder if there's a basis for this opinion in the suttas.