A training dataset is any collection of data used to train a machine learning algorithm. The program learns by taking in new information and comparing it with data it already knows in order to determine the similarity between the two. With time, the algorithm learns to accept a wide variety of inputs with a very high degree of accuracy.