Viļaka Castle was built by Archbishopric of Riga in 1342 as a wooden castle. At first it was closed monastery. It was rebuilt as a stone castle between 1509-1516. During Livonian war time in 1582 it was destroyed and finally demolished in 1702. The outer walls are 1.6m thick, remaining fragments of the walls are up to 2 meters high.
References:The first written record of church in Danmark locality date back to the year 1291. Close to the church are several stones with a Christian text and cross inscribed. The oldest parts of the present red-brick church are from the 1300s. In the late 1400s the church was enlarged to the appearance it has today. The church has been modified both internally and externally several times, among other things after the fires in 1699 and 1889. There are lot of well-preserved mural paintings in the walls.