Secure admin with token

What do you think of securing the admin with the same auth token used for adding users? We probably don't want to allow any logged in users access to /admin, and I don't think it's worth the effort/hassle to add admin roles or check for certain users.