We like parenthesis in similar conditions, in case somebody looking at it isn't quite sure about operators' precence.
Furthermore, this would probably look even cleaner:

    return empty($referer['host']) OR (strpos(config_item('base_url'), $referer['host']) === FALSE);