The Deepmind paper trained for \"a total of 50 million frames (that is, around 38 days of game experience in total)\". However this script will give good results at around 10 million frames which are processed in less than 24 hours on a modern machine.