Option to select duration to allow/deny once

Closes #1873