When the 12th century castle was built, the church was contained within it and several Norman tombstone from the graveyard have been found. Some are in Trowbridge Museum while one is in the porch of the present church.