logserver: Delete only the files from the loglevel we care about

BUG=skia:

Review URL: https://codereview.chromium.org/740483002