lots of changes
recovered from another error in timed out connects; change in how to pick urls in queue