The ruins of St. Mary's Abbey (a 12th century Augustinian monastery) can be seen from the castle.