Language annotation involves making notes on a specific language to collect data about it. These notes assign values or tokens to words in sentences, enabling the collection of a broader language corpus for analysis and translation.