Only check for user ownership