A first documentary mention of the Knights van der Arffe, the namesake of the castle, occurred in 1366. Albrecht von Baexen acquired the estate in 1572 through marriage to Catharina von der Arff. However, in the Cologne War from 1583 to 1586, the previous building was destroyed.