A progressive JPEG is an image created using compression algorithms that load the image in successive waves until the entire image is downloaded. This makes the image appear to load faster, as it loads the whole image in progressive waves. A standard JPEG loads the image from the top to bottom line by line.
You can read more about Progressive JPEGs here.