Don't restrict if restriction element has no rect

Closes #144