BERT stands for Bidirectional Encoder Representations from Transformers. It is a transformer-based model architecture that leverages bidirectional context in order to better understand the meaning of individual words in a sentence.