This is pretty typical.
I think it is highly probable that when the Temple Mount was under Ottoman, British and Jordanian rule, the number of worshipers never or very rarely exceeded that number, even during major Muslim holidays.
When Israel recaptured Jerusalem in 1967, there were only 54,000 Muslims in the city - including the areas of Jerusalem that Israel expanded. In 1944, only 30,000 Muslims lived there - men, women and children.
While it is possible that on holidays there were tens of thousands who came from surrounding areas to visit, I still doubt that it reached 35,000. Accounts from newspapers in the first half of the 20th century would describe the crowds as being in the thousands, not tens or hundreds of thousands, for Muslim holidays, as in this April 1, 1934 NYT article.