Respect the lack of memory limit as well in memory pressure