Before revision:  To understand the inferior performance of deep learning, we investigate the generalization problem in forecasting.
After revision:  To understand the inferior performance of deep learning, we investigate the generalization problem in dynamical system learning due to distribution shift. We identify two scenarios where distribution shift can occur: changes in data domain and changes in parameter domain (system dynamics).