Don't attempt to set the flag/fave state on comments that aren't on page

See: https://github.com/GigaOM/gigaom/issues/5262