directory_lists now gradually realloc enough memory for their requests up to a maximum limit of 12MB