[#87981] Restore "remove from journal" feature

A similar feature existed until b6f4bf8f0532454e425f8e72d5c3dd18e9577431

Closes #229