updated offline crawler