Some terms are meant to be derogatory, others expanatory and still, some words are used in a context that does not mean what the dictionary defines it as. Words mean what history has make it to be understood as over the years. Those words were a way to convey their experiences, good or bad, to others. True, over time such words began to be used in a negative connotation, but by those who were ignorant of the culture they referred to and were also unwilling to educate themselves of it. Or I could say the same thing and imply that it is just weird and strange.
Terms come with stereotypes and it is important to be watchful of the context that it is used in.
I think that one can be too critical of the usage of a term. You could go on for days questioning the controversial interpretations of words. To help understand the meaning of a term, just look at the context that it is used in and who used it. I feel that Orientalism is partially responsible for the misleading stereotypical terms associated with the Orient, but it is also our fault too. It is explainable that society misunderstands other cultures and labels them with stereotypical terms.