Bardowie was the property of the Clan Galbraith from 1214, and passed by marriage to John Hamilton of Cadzow in the later 14th century. The tower was built in 1566, with additions made from the late 17th or early 18th century. The later part of the castle is dated 1713. In the mid 18th century the castle passed by marriage to Thomas Buchanan of Spittal-Leny, whose descendants owned the castle until the early 20th century. Thomas' son Dr. Francis Buchanan-Hamilton claimed the chiefship of Clan Buchanan. The castle was sold several times in the 20th century, including in 1912 and 1951.
In 2002, the property was owned by motivational speaker Jack Black, the founder of MindStore, who listed it for sale when he was unable to get a permit to operate his wife's software business from the property. The interior had been extensively modernized.
References:Celje Castle was once the largest fortification on Slovenian territory. The first fortified building on the site (a Romanesque palace) was built in the first half of the 13th century by the Counts of Heunburg from Carinthia on the stony outcrop on the western side of the ridge where the castle stands. It had five sides, or four plus the southern side, which was a natural defence. The first written records of the castle date back to between 1125 and 1137; it was probably built by Count Gunter. In the western section of the castle, there was a building with several floors. Remains of the walls of this palatium have survived. In the eastern section, there was an enclosed courtyard with large water reservoirs. The eastern wall, which protects the castle from its most exposed side, was around three metres thicker than the rest of the curtain wall. The wall was topped with a parapet and protected walkway.