Remove (mostly unused) logger

We don't really use the `goog.debug.Logger` infrastructure. This PR removes it completely.