integrate title and url, deal with missing entries and successes, improve sorting