Avoid thread exhaustion with large numbers of cookbooks

Each cookbook gets a future - and in Ridley that means a new thread. This
change limits the number of concurrent metadata calls to 500 to avoid
exhausting all the threads on the system.