Unlike in all the other games of the series, the Town Center in Age of Empires cannot defend itself.
Players cannot build more Town Centers unless their civilization has advanced to the Bronze Age and has a Granary, Market, and Government Center present as well. However, a new Town Center may be built in any Age without any of the requisite buildings, if the player has no Town Center to begin with or had lost their original one.
Greeks: Town Centers work 10% faster starting in the Tool Age.
All villages and towns had an administrative center that was the site of governmental power and leadership. In the earliest villages this might have been the leader's home. Later it might have been the king's palace. The center was often the place where important supplies, especially food surpluses, were stored. Vessels for storing grain and oil were found in the ruins of the Palace at Knossos of Crete. Some of the earliest accounting records yet found were clay tablets left in long- forgotten storerooms in ancient Sumeria and in Hittite cities. The destruction of the town center usually meant the destruction of the town's governmental infrastructure.
—Age of Empires manual
Town Center (in the Stone Age) as shown in the Definitive Edition
Town Center in the Tool Age
Farms and a Town Center (in the Tool Age), as featured in the Definitive Edition