Don't check for omnipresent access(3) call

Also remove the fallback code that uses the stat cache to determine
access rights.