byte pair encoding (English, noun)
expansion: byte pair encoding (countable and uncountable, plural byte pair encodings)
Senses:
topics: computing
engineering
mathematics
natural-sciences
physical-sciences
sciences
glosses: A lossless data compression algorithm that iteratively replaces the most frequent pair of adjacent bytes in a sequence with a new byte not already present in the data.
tags: countable
uncountable
qualifier: natural language processing
glosses: A subword tokenization method that iteratively merges the most frequent pairs of adjacent characters in a corpus to form longer and more meaningful tokens, typically until a predefined vocabulary size is reached.
tags: countable
uncountable
Forms:
form: byte pair encodings
tags: plural
form: byte-pair encoding
tags: alternative