UnicodeDecodeError: 'charmap' codec can't decode byte 0x9d in position 2810: character maps to <undefined>
Labels: name: auto:bug

### System Info

I have a CSV file with profile information, names, birthdate, gender, favoritemovies, etc, etc.

I need to create a chatbot with this and I am trying to use the CSVLoader like this:
```
    loader = CSVLoader(file_path="profiles.csv", source_column="IdentityId")
    doc = loader.load()
    text_splitter = CharacterTextSplitter(chunk_size=5000, chunk_overlap=0)
    #docs = text_splitter.split_documents(documents)
    embed = OpenAIEmbeddings(deployment=OPENAI_EMBEDDING_DEPLOYMENT_NAME, model=OPENAI_EMBEDDING_MODEL_NAME, chunk_size=1)
   
    docsearch = Pinecone.from_documents(doc, embed, index_name="cubigo")

    llm = AzureChatOpenAI(
        openai_api_base=OPENAI_DEPLOYMENT_ENDPOINT,
        openai_api_version=OPENAI_API_VERSION ,
        deployment_name=OPENAI_DEPLOYMENT_NAME,
        openai_api_key=OPENAI_API_KEY,
        openai_api_type = OPENAI_API_TYPE ,
        model_name=OPENAI_MODEL_NAME,
        temperature=0)    
    user_input = get_text()   
    docs = docsearch.similarity_search(user_input)
    st.write(docs)
```

However I get this error:

The file looks like this:
```

IdentityId,FirstName,LastName,Gender,Birthdate,Birthplace,Hometown,content
1A9DCDD4-DD7E-4235-BA0C-00CB0EC7FF4F,FirstName0002783,LastName0002783,Unknown,Not specified,Not Specified,Not Specified,"First Name: FirstName0002783. Last Name: LastName0002783. Role Name: Resident IL. Gender: Unknown. Phone number: Not specified. Cell Phone number: Not specified. Address2: 213. Birth Date: Not specified. Owned Technologies: Not specified. More About Me: Not Specified. Birth place: Not Specified. Home town:Not Specified. Education: Not Specified. College Name: Not Specified. Past Occupations: Not Specified. Past Interests:Not specified. Veteran: Not Specified. Name of spouse: Not specified, Religious Preferences: Not specified. Spoken Languages: Not specified. Active Live Description: Not specified. Retired Live Description: Not specified. Accomplishments: Not specified. Marital Status: Not specified. Anniversary Date: Not specified. Your typical day: Not specified. Talents and Hobbies:  Not specified. Interest categories: Not specified. Other Interest Categories: Not specified. Favorite Actor: Not specified. Favorite Actress: Not specified. Favorite Animal: Not specified. Favorite Author: Not specified. Favorite Band Musical Artist: Not specified. Favorite Book: Not specified. Favorite Climate: Not specified. Favorite Color: Not specified. Favorite Dance: Not specified. Favorite Dessert: Not specified. Favorite Drink: Not specified. Favorite Food: Not specified. Favorite Fruit: Not specified. Favorite Future Travel Destination: Not specified. Favorite Movie: Not specified. Favorite Past Travel Destination: Not specified. Favorite Game: Not specified. Favorite Season Of The Year: Not specified. Favorite Song: Not specified. Favorite Sport: Not specified. Favorite Sports Team: Not specified. Favorite Tv Show: Not specified. Favorite Vegetable: Not specified. FavoritePastTravelDestination: Not specified"
D50E05C9-16EB-4554-808C-01EEDE433076,FirstName0003583,LastName0003583,Unknown,Not specified,Not Specified,Not Specified,"First Name: FirstName0003583. Last Name: LastName0003583. Role Name: Resident AL. Gender: Unknown. Phone number: Not specified. Cell Phone number: Not specified. Address2: Not specified. Birth Date: Not specified. Owned Technologies: Not specified. More About Me: Not Specified. Birth place: Not Specified. Home town:Not Specified. Education: Not Specified. College Name: Not Specified. Past Occupations: Not Specified. Past Interests:Not specified. Veteran: Not Specified. Name of spouse: Not specified, Religious Preferences: Not specified. Spoken Languages: Not specified. Active Live Description: Not specified. Retired Live Description: Not specified. Accomplishments: Not specified. Marital Status: Not specified. Anniversary Date: Not specified. Your typical day: Not specified. Talents and Hobbies:  Not specified. Interest categories: Not specified. Other Interest Categories: Not specified. Favorite Actor: Not specified. Favorite Actress: Not specified. Favorite Animal: Not specified. Favorite Author: Not specified. Favorite Band Musical Artist: Not specified. Favorite Book: Not specified. Favorite Climate: Not specified. Favorite Color: Not specified. Favorite Dance: Not specified. Favorite Dessert: Not specified. Favorite Drink: Not specified. Favorite Food: Not specified. Favorite Fruit: Not specified. Favorite Future Travel Destination: Not specified. Favorite Movie: Not specified. Favorite Past Travel Destination: Not specified. Favorite Game: Not specified. Favorite Season Of The Year: Not specified. Favorite Song: Not specified. Favorite Sport: Not specified. Favorite Sports Team: Not specified. Favorite Tv Show: Not specified. Favorite Vegetable: Not specified. FavoritePastTravelDestination: Not specified"

```

### Who can help?

_No response_

### Information

- [ ] The official example notebooks/scripts
- [ ] My own modified scripts

### Related Components

- [ ] LLMs/Chat Models
- [ ] Embedding Models
- [ ] Prompts / Prompt Templates / Prompt Selectors
- [ ] Output Parsers
- [X] Document Loaders
- [ ] Vector Stores / Retrievers
- [ ] Memory
- [ ] Agents / Agent Executors
- [ ] Tools / Toolkits
- [ ] Chains
- [ ] Callbacks/Tracing
- [ ] Async

### Reproduction

USe this code:

```
    loader = CSVLoader(file_path="profiles.csv", source_column="IdentityId")
    doc = loader.load()
    text_splitter = CharacterTextSplitter(chunk_size=5000, chunk_overlap=0)
    #docs = text_splitter.split_documents(documents)
    embed = OpenAIEmbeddings(deployment=OPENAI_EMBEDDING_DEPLOYMENT_NAME, model=OPENAI_EMBEDDING_MODEL_NAME, chunk_size=1)
   
    docsearch = Pinecone.from_documents(doc, embed, index_name="x")

    llm = AzureChatOpenAI(
        openai_api_base=OPENAI_DEPLOYMENT_ENDPOINT,
        openai_api_version=OPENAI_API_VERSION ,
        deployment_name=OPENAI_DEPLOYMENT_NAME,
        openai_api_key=OPENAI_API_KEY,
        openai_api_type = OPENAI_API_TYPE ,
        model_name=OPENAI_MODEL_NAME,
        temperature=0)    
    user_input = get_text()   
    docs = docsearch.similarity_search(user_input)
    st.write(docs)
```

error is here:

**File "C:\Users\xx\anaconda3\envs\xx\Lib\encodings\cp1252.py", line 23, in decode
    return codecs.charmap_decode(input,self.errors,decoding_table)[0]
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^**

`Exception: UnicodeDecodeError: 'charmap' codec can't decode byte 0x9d in position 2810: character maps to <undefined>`

### Expected behavior

load the csv without any issue?