Joseph was baptised at the Unitarian Chapel on Friar Gate, Derby on 19 September 1765, and subsequently educated at Derby School.
Joseph dibaptis di Kapel Unitarian di Friar Gate, Derby tanggal 19 September 1765, dan kemudian belajar di Sekolah Derby.