Why did the Buddha remain silent on questions such as the existence of an absolute creator God or an eternal soul destined for a transcendent realm?

In several discourses, the Buddha is noted for his silence or deliberate non-engagement with certain metaphysical questions—such as whether the universe is created or governed by an absolute deity, or whether an eternal soul exists that can attain liberation by entering an everlasting transcendent spiritual realm such as Brahma-loka or Vishnu-loka. What was the rationale behind this silence? Was his silence due to the fact he actually did not know if they existed? Did he deliberately withhold such teachings, regarding his audience as unprepared to accept these doctrines as truths? Or did he see these views as fundamentally mistaken from the ground up and therefore not worth discussing? Which of these explanations aligns best with canonical teachings and the broader Buddhist philosophical tradition?