The Huis ter Kleef castle was probably built in the late 13th century. In 1403 it was given to Margaret of Cleves (c.1375-1411), and has since retained that name. During the Siege of Haarlem in 1572 it was the headquarters of the Spanish army, under the leadership of the duke of Alva. It was blown up in 1573 and badly damaged, the rubble was used for city expansion. The house nearby with a tower called the 'Kaatsbaan' was long considered the only building left standing, though recent archeological research suggests that the foundations have older stones than the rest and perhaps it was itself rebuilt after the explosion.
The property changed hands several times until it was purchased by the city of Haarlem in 1713. Stones from the central castle ruin can still be seen in surrounding buildings. The Kaatsbaan was used as a residence for former owners and is now also in use by the city gardens.
References:The Château du Lude is one of the many great châteaux of the Loire Valley in France. Le Lude is the most northerly château of the Loire Valley and one of the last important historic castles in France, still inhabited by the same family for the last 260 years. The château is testimony to four centuries of French architecture, as a stronghold transformed into an elegant house during the Renaissance and the 18th century. The monument is located in the valley of Le Loir. Its gardens have evolved throughout the centuries.