When and why did the color orange (and yellow and 'red') become associated with Buddhism?

Buddhist religious figures often wear orange robes. And I think that orange is, also, associated with Buddhist religious buildings -- and other religious "stuff" (although this may be simply a coincidence that I have given meaning it does not have) -- things like fabric, prayer flags, and religious art in temples, and painting of religious structures and artistic adornments in religious structures. When did the color orange become associated with Buddhism? Does this have any specific significance or meaning, and if so what is that meaning or significance? Also, sometimes a yellow or red color is used instead in the a similar context. The yellow color often looks like just a use/weather faded orange, or a trick of photography and lighting, or a different shade of orange, that may not be meaningful. But the red color (as depicted below), however, seems to be an intentional choice. Do either of these colors (yellow or red) these have different meanings than orange? And, when did these colors gain significance? Is it simply derived from robes -- https://buddhism.stackexchange.com/q/1642/254 -- or is there more to it than that? From here (Pixabay License - Free for commercial use - No attribution required). From here (Pixabay License - Free for commercial use - No attribution required). From here (Pixabay License - Free for commercial use - No attribution required). *Footnote Re Color Terminology* While this question, as edited, is not predominantly about robes as that has already been answered, the photographs above are primarily included to illustrate the colors that I am talking about as I am art terminology illiterate. I have used the primary color names orange, yellow and red because I have a thin vocabulary of colors and no art background (I haven't taken an art class since I was 13 years old, and I'm now more than three decades older than that). If that is not the proper name of the relevant colors feel free to correct me.