Functional crawler with database update