Only add authority if not empty