INTERMITTENT ERROR: AzureCogsImageAnalysisTool._run() got an unexpected keyword argument 'url'
Labels: name: area: agent, name: auto:bug

### System Info

Python 3.11.0
LangChain==0.0.295
Azure-ai-vision==0.15.1b1
Streamlit

### Who can help?

@agola11 @hwchase17 

### Information

- [X] The official example notebooks/scripts
- [ ] My own modified scripts

### Related Components

- [ ] LLMs/Chat Models
- [ ] Embedding Models
- [ ] Prompts / Prompt Templates / Prompt Selectors
- [ ] Output Parsers
- [ ] Document Loaders
- [ ] Vector Stores / Retrievers
- [ ] Memory
- [X] Agents / Agent Executors
- [X] Tools / Toolkits
- [X] Chains
- [ ] Callbacks/Tracing
- [ ] Async

### Reproduction

Important to note that the below error is INTERMITTEND using the exact same input every single time. Sometimes it works for an hour without error, then it will throw the below error a few times and return to normal. Other times it throws this error like 20 times before it will return to normal and start working again. It is like it gets confused about what inputs the agent expect at random.

Also note that this is a simplified version. The reason I use create_conversational_retrieval_agent is because I pass multiple tools like O365, SQLDatabase ect. But I can still produce the error without them. 

**Error:**

TypeError: AzureCogsImageAnalysisTool._run() got an unexpected keyword argument 'url'
Traceback:

File "C:\_Dev\AZURE-AGENT-TEST\venv\Lib\site-packages\streamlit\runtime\scriptrunner\script_runner.py", line 552, in _run_script
    exec(code, module.__dict__)
File "C:\_Dev\AZURE-AGENT-TEST\home.py", line 409, in <module>
    main()
File "C:\_Dev\AZURE-AGENT-TEST\home.py", line 256, in main
    handle_userinput(user_question, image_url)
File "C:\_Dev\AZURE-AGENT-TEST\home.py", line 151, in handle_userinput
    response = st.session_state.conversation({'input': user_question + " " + '"' + file_url + '"' })
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\_Dev\AZURE-AGENT-TEST\venv\Lib\site-packages\langchain\chains\base.py", line 292, in __call__
    raise e
File "C:\_Dev\AZURE-AGENT-TEST\venv\Lib\site-packages\langchain\chains\base.py", line 286, in __call__
    self._call(inputs, run_manager=run_manager)
File "C:\_Dev\AZURE-AGENT-TEST\venv\Lib\site-packages\langchain\agents\agent.py", line 1122, in _call
    next_step_output = self._take_next_step(
                       ^^^^^^^^^^^^^^^^^^^^^
File "C:\_Dev\AZURE-AGENT-TEST\venv\Lib\site-packages\langchain\agents\agent.py", line 977, in _take_next_step
    observation = tool.run(
                  ^^^^^^^^^
File "C:\_Dev\AZURE-AGENT-TEST\venv\Lib\site-packages\langchain\tools\base.py", line 356, in run
    raise e
File "C:\_Dev\AZURE-AGENT-TEST\venv\Lib\site-packages\langchain\tools\base.py", line 328, in run
    self._run(*tool_args, run_manager=run_manager, **tool_kwargs)

**Initialize the agent:**    

    toolkit = AzureCognitiveServicesToolkit()
    tools = toolkit.get_tools()

    llm = ChatOpenAI(temperature=0.7)
    
    st.session_state.conversation = create_conversational_retrieval_agent(llm,
                                                                          tools, 
                                                                          verbose=False, 
                                                                          max_iterations=3,
                                                                          early_stopping_method='generate',
                                                                          AgentType=AgentType.CHAT_ZERO_SHOT_REACT_DESCRIPTION)

**Then handle the user input:**
    user_question = "What can I make with these ingredients?"
    file_url = "https://images.openai.com/blob/9ad5a2ab-041f-475f-ad6a-b51899c50182/ingredients.png"

    response = st.session_state.conversation({'input': user_question + " " + '"' + file_url + '"' })
    st.write(response)

### Expected behavior

I expect it to not throw this error intermittently.