Noltland Castle was erected in the second half of the 16th Century.