Tradition has it that this was built when the statue of the Madonna was discovered in the sea after the infields had tried unsuccessfully to carry it off during the Turkish raids of the mid-sixteenth century. The church was built prior to 1418, as evidenced by a written on the fresco above the altar. The church is documented especially from 1583 onwards, when there was an order of brothers here. Records of the apostolic visit of 1612 refer to the church as 'recently built', with a confessional and a burial ground for sailors. It has two doors and a bell tower above. It has been established that the sacristy and an oil panting date from 1742, and records state that the church was built with contributions from seafarers.By 1875, in addition to the bell tower with its two bells, the organ, the pulpit and the clock, there was a marble sanctuary with a brass gate and altar rails, as well as a framed statue. In 1905, a wooden statue and a third door had been added. A few years later, in 1913, this church and others were closed, when they were occupies by soldiers sheltering from torrential rain.
Celje Castle was once the largest fortification on Slovenian territory. The first fortified building on the site (a Romanesque palace) was built in the first half of the 13th century by the Counts of Heunburg from Carinthia on the stony outcrop on the western side of the ridge where the castle stands. It had five sides, or four plus the southern side, which was a natural defence. The first written records of the castle date back to between 1125 and 1137; it was probably built by Count Gunter. In the western section of the castle, there was a building with several floors. Remains of the walls of this palatium have survived. In the eastern section, there was an enclosed courtyard with large water reservoirs. The eastern wall, which protects the castle from its most exposed side, was around three metres thicker than the rest of the curtain wall. The wall was topped with a parapet and protected walkway.