Delete old actions with limits

Part of https://github.com/cargomedia/CM/issues/1444