Original: If only one parity bit indicates an error, the parity bit itself is in error.
Simplified: A parity bit tells whether a group of bits is even or odd. In a Hamming code, each bit of data is covered by several parity bits.