Earliest record of opposition towards Mawlid

As far as I've researched, the earliest record of yearly Mawlid of Nabi SAW (between 12-17 Rabi Ul Awwal) is during the 1100s initiated by the fatimids . What I want to know is when they started doing the mawlid of Nabi SAW, is there any scholar who opposed this ? To summarize, my question is, what is the earliest known opposition of the Mawlid of Nabi SAW? 1. Katz, Marion Holmes (2007). The Birth of The Prophet Muhammad: Devotional Piety in Sunni Islam