SQL Agent not working well with Claude v2 model
Labels: name: area: agent, name: auto:bug, name: area: models, name: integration: aws

### Issue you'd like to raise.

Im trying to develop an sql agent chatbot that will generate and exceute SQL queries based on the user free-text questions.
so far I have developed a generic and basic agent with ChatGPT-4 and it worked pretty well (generated complex SQL and returned an answer).
When I tried to switch the LLM with Claude v2 (hosted on AWS Bedrock) things started to break.
sometimes the agent get stuck in a loop of the same input (for example):
```
> Entering new AgentExecutor chain...
 Here is my thought process and actions to answer the question "how many alerts?":

Thought: I need to first see what tables are available in the database.
Action: sql_db_list_tables
Action Input: 
Observation: alerts, detectors
Thought: Here is my response to the question "how many alerts?":

Thought: I need to first see what tables are available in the database.
Action: sql_db_list_tables  
Action Input:  
Observation: alerts, detectors
Thought: Here is my response to the question "how many alerts?":

Thought: I need to first see what tables are available in the database.
Action: sql_db_list_tables
Action Input:  
Observation: alerts, detectors
Thought: Here is my response to the question "how many alerts?":

Thought: I need to first see what tables are available in the database.
Action: sql_db_list_tables
Action Input:  
Observation: alerts, detectors
Thought: Here is my response to the question "how many alerts?":
```

sometimes it gets to the point that it actually query the db and get the result but don't stop the run and return the answer.

Here is how I configured the LLM and agent:
```
def aws_bedrock():
    config = AwsBedrockConfig()
    client = boto3.client(
        'bedrock-runtime',
        region_name=config.region_name,
        aws_access_key_id=config.aws_access_key_id,
        aws_secret_access_key=config.aws_secret_access_key,
    )
    model_kwargs = {
        "prompt": "\n\nHuman: Hello world\n\nAssistant:",
        "max_tokens_to_sample": 100000,
        "temperature": 0,
        "top_k": 10,
        "top_p": 1,
        "stop_sequences": [
            "\n\nHuman:"
        ],
        "anthropic_version": "bedrock-2023-05-31"
    }
    return Bedrock(
        client=client,
        model_id=config.model_id,
        model_kwargs=model_kwargs
    )
```

(also tried to change the model arguments with no success)

```
memory = ConversationBufferMemory(memory_key="history", chat_memory=history)
        toolkit = SQLDatabaseToolkit(db=db, llm=self.llm)

        self.agent = create_sql_agent(
            llm=self.llm,
            toolkit=toolkit,
            extra_tools=[TableCommentsTool(db=db)],
            prefix=self.format_sql_prefix(filters),
            suffix=HISTORY_SQL_SUFFIX,
            agent_type=AgentType.ZERO_SHOT_REACT_DESCRIPTION,
            agent_executor_kwargs={"memory": memory},
            verbose=True,
            input_variables=["input", "history", "agent_scratchpad"]
        )
```

### Suggestion:

_No response_