only manually remove request if the memory size change across container request
Merge pull request #1021 from Microsoft-CISL/yingdac-more-memory-container-fix

only manually remove request if memory size change across container requests