support for archive and chache checking, and associated tests and changes to API responses