increased the wait between navigating and checking to 1 second (as around 1 out of 30 requests were still coming back with ready, when the page had not started loading). With the wait being 1 second it's all good.