Crawler changes and fixes to client site and api schema