Castello di Venere ('Venus Castle'), dating from the Norman period, was built on top of the ancient Temple of Venus, where Venus Ericina was worshipped. According to legend, the temple was founded by Aeneas. It was well known throughout the Mediterranean area in the ancient age, and an important cult was celebrated in it.
Herceg Novi was founded (on a former small fishing village, existing since Roman Empire times) as a fortress in 1382 by first Bosnian King Stjepan Tvrtko I and was called Sveti Stefan or Castelnuovo. The Turks conquered Herceg Novi in 1482, and ruled for 200 years, until 1687. However, there was a short pause between 1538 and 1539 when it was held by the Spaniards before they were defeated in the Siege of Castelnuovo. Turkey ruled again until 1687, from then until 1797, the town was ruled by the Venetian Republic.
The Herceg Novi old town is amazing. It is on a fairly steep hill that leads all the way down to the sea. Wandering through the small stairways to the various plazas and fortresses is a many hour adventure.