Does it matter where or which location you pray, or not?

According to Surah Az-Zalzalah (99:4–5), the earth will report its news on the Day of Judgment. Some scholars say this includes testifying about where people prayed. Why is the location of prayer important, and what is the wisdom behind the earth testifying about it? I have heard that once you pray sunnah, you need to change your location. I want to know why and what is the point of where you pray. Your limbs can testify that you pray, so why earth?