New API and crawler combined