The fortress of Capalbio, Rocca Aldobrandesca, was first mentioned in historical records in 805, when Charlemagne donated it to the Abbey of the Three Fountains in Rome. It was ceded to the powerful Aldobrandeschi family in the 11th century, who enlarged the castle and built the city walls, lost it to the Orsini in the 14th century, won it back, and then were conqured by the Republic of Siena in the 15th, who held it until the second half of the 16th century, when Siena fell to the Medici family of the Duchy of Tuscany.

Palazzo Collacchioni was built leaning against the tower complex in the 19th century by Senator Giovanni Battista Collacchioni who was from Sansepolcro, near Arezzo. The palace is built on three levels in an eclectic neo-Renaissance style, was recently renovated, and is open to the public for a nominal fee, including the fortress itself and the climb to the top of the tower for an incredible view. The “Sala Puccini” room on the first floor features the Conrad Graf piano always played by Giacomo Puccini during his frequent stays in a nearby tower, the Torre della Tagliata.