A tensor is a multi-dimensional array of numerical values. Tensors are a fundamental concept in many areas, including linear algebra, calculus, and machine learning frameworks like PyTorch and TensorFlow. Tensors can have any number of dimensions, which determines their rank.