Holgate House dan Perpustakaan Victor Watts, Grey College