Make sure we remove observer when the reader is dealloc'd