Is that relevant for the amount of houses they can build?
I feel like if you were truly motivated they could have had over New York's population by now if they were to build homes and skyscrapers. It doesn't take 100 or 200 years to build a skyscraper, they could simultaneously start like 20 of them every year.