Standard RNNs struggle to capture long-term dependencies due to the vanishing gradient problem. However, variants like long short-term memory (LSTM) and gated recurrent unit (GRU) have been developed to address this issue and can effectively handle long-term dependencies.