Why are there no aerial photographs from the founding period of many cities?

Whenever I look at the chronicles of a city, I'm always struck by the lack of aerial photographs from the time of its founding, or at least before 1900? Why is that, when much earlier there were hot air balloons, or at least church towers or distillery chimneys, from which one could have painted an…