updated views and added crawl function to populate the database