read add an api for the ratelimit and implement the update up to transforming the flat list of files in a tree with status (new/modified/deleted) and count the (not deleleted) files in each directory for housekeeping in the cache