Actually check permissions