Fall back to generic crawler for news24