Limited mapAlreadyAskedFor

Based on #2409 (though I dont think it needs it).
Just puts a limit on how large mapAlreadyAskedFor can grow.