What buddhism says about physical reality?

I had a discussion with one of my friend, who said, there's no such thing as physical reality, as per Lord Buddha. He quoted "The universe only exists inside this small body". As per my understanding, this is about how we understand the universe is different. But his idea is that there's no physical reality, all we are experiencing is a delusion. Any idea about this ?