Removed folder_contents from list of suffixes to skip.
Performance optimization: keep track of the http requests we've made so that we don't have to repeat them.