If Buddhism is about moderation, then why is it that you can attain nirvana only after renouncing worldly possessions?

This is really confusing to me. Buddha himself was an ascetic, and his teachings seem to imply that the path to nirvana is attained through renouncing one's worldly possessions. Isn't this in direct contradiction to the Middle Way?