We have talked about the complexity of models and networks without mentioning the execution speed of algorithms. Indeed, PyTorch is designed to minimize this time and to make the best use of the hardware specificities. PyTorch represents data as multidimensional arrays, similar to NumPy arrays, called "tensors". The tensors store the inputs of the neural network, the parameters of the hidden layers and the outputs.