problem we have a big big image with dots on it and then we want to incorporate the sequence of dots to make our estimation so you can do this in a variety of ways of course the way we did it was for each of these dots we want to incorporate in our for making our prediction we cropped out a small rectangle of the image around it so we end up with a sequence of image tiles each of these image tiles representing the path in total then goes into a convolutional neural network a so-called CNN which is a type of neural network