Remove sparsity tolerance check when considering squashing layers

BUG=
R=abarth@chromium.org

Review URL: https://codereview.chromium.org/709623002