Assert that the frame end doesn't move backwards