[REVIEW] Fix allow all button

Fixes #513

@baszoetekouw @relaxnow please review