Don't leak writer and index goroutines on close