A method performed by one or more computers, the method comprising: obtaining features of an input image, the input image comprising a plurality of pixels; for each of one or more time steps starting from an initial time step and continuing until a final time step: generating a network input from the features of the input image and a current segmentation output as of the time step, wherein the current segmentation output defines a current segmentation of the input image that assigns each of the plurality of pixels to a respective segmentation category from a predetermined set of segmentation categories, processing the network input using a convolutional recurrent neural network to generate an intermediate segmentation output for the time step, and generating an updated segmentation output for the time step from the intermediate segmentation output for the time step and the current segmentation output as of the time step, wherein, for each time step after the initial time step, the current segmentation output as of the time step is the updated segmentation output from the preceding time step; and generating a final segmentation of the input image from the updated segmentation output for the final time step. obtaining features of an input image, the input image comprising a plurality of pixels; for each of one or more time steps starting from an initial time step and continuing until a final time step: generating a network input from the features of the input image and a current segmentation output as of the time step, wherein the current segmentation output defines a current segmentation of the input image that assigns each of the plurality of pixels to a respective segmentation category from a predetermined set of segmentation categories, processing the network input using a convolutional recurrent neural network to generate an intermediate segmentation output for the time step, and generating an updated segmentation output for the time step from the intermediate segmentation output for the time step and the current segmentation output as of the time step, wherein, for each time step after the initial time step, the current segmentation output as of the time step is the updated segmentation output from the preceding time step; and generating a network input from the features of the input image and a current segmentation output as of the time step, wherein the current segmentation output defines a current segmentation of the input image that assigns each of the plurality of pixels to a respective segmentation category from a predetermined set of segmentation categories, processing the network input using a convolutional recurrent neural network to generate an intermediate segmentation output for the time step, and generating an updated segmentation output for the time step from the intermediate segmentation output for the time step and the current segmentation output as of the time step, wherein, for each time step after the initial time step, the current segmentation output as of the time step is the updated segmentation output from the preceding time step; and generating a final segmentation of the input image from the updated segmentation output for the final time step. <EOS>