Add spec for behavior of app that has exceeded quota

[#47038011]