Before revision:  We characterize the dynamics that gradient descent induces on the factorization, and establish a bias towards low tensor rank , in compliance with empirical evidence.
After revision:  We circumvent the notorious difficulty of tensor problems by adopting a dynamical systems perspective, and characterizing the evolution induced by gradient descent. The characterization suggests a form of greedy low tensor rank , in compliance with empirical evidence.