Hello guys, we are using langchain with mixtral 8x7b instruct 0.1, unquantized with 4 x A6000 cards, and sometimes we get a barrage of carriage returns. Not sure if it's memory related. In the console there is no OOM errors. Any suggestions?
· Sign up or log in to comment
