Oxford Castle: it was built in 1071 and was fought over many times before being a prison