Stop prematurely removing sandbox and app layers