A hard fork is a change to the underlying Ethereum protocol, creating new rules to improve the protocol that are not backwards compatible. All Ethereum clients need to upgrade; otherwise, they will be stuck on an incompatible chain following the old rules.