The church of the former Franciscan monastery was built probably between 1515 and 1520. It is located in the UNESCO World Heritage Site of Old Rauma. The church stands by the small stream of Raumanjoki (Rauma river).
The exact age of the Church of the Holy Cross is unknown, but it was built to serve as the monastery church of the Rauma Franciscan Friary. The monastery had been established in the early 15th century and a wooden church was built on this location around the year 1420.
The Church of the Holy Cross served the monastery until 1538, when it was abandoned for a hundred years as the Franciscan friary was disbanded in the Swedish Reformation. The church was re-established as a Lutheran church in 1640, when the nearby Church of the Holy Trinity was destroyed by fire.
The choir of the two-aisle grey granite church features medieval murals and frescoes. The white steeple of the church was built in 1816 and has served as a landmark for seafarers.
Celje Castle was once the largest fortification on Slovenian territory. The first fortified building on the site (a Romanesque palace) was built in the first half of the 13th century by the Counts of Heunburg from Carinthia on the stony outcrop on the western side of the ridge where the castle stands. It had five sides, or four plus the southern side, which was a natural defence. The first written records of the castle date back to between 1125 and 1137; it was probably built by Count Gunter. In the western section of the castle, there was a building with several floors. Remains of the walls of this palatium have survived. In the eastern section, there was an enclosed courtyard with large water reservoirs. The eastern wall, which protects the castle from its most exposed side, was around three metres thicker than the rest of the curtain wall. The wall was topped with a parapet and protected walkway.