implemented crawler API