:recycle: [Refactor] Move STOP_SEQUENCES_MAP and TOKEN_LIMIT_MAP to constants bf8c5bd Hansimov commited on Mar 1
:gem: [Feature] Add use_cache parameter, and set default temperature to 0.5 e2b245b Hansimov commited on Jan 28
:gem: [Feature] MessageStreamer: Support stop sequence and auto removal 4ba2ca6 Hansimov commited on Dec 28, 2023
:gem: [Feature] Support call hf api with api_key via HTTP Bearer 2da6968 Hansimov commited on Dec 28, 2023
:pencil: [Doc] Readme for features, and comments for references e820e51 Hansimov commited on Dec 20, 2023
:zap: [Enhance] OSLogger: Re-wrap for better syntax check, and move stream log to debug 047008b Hansimov commited on Dec 20, 2023
:gem: [Feature] New ArgParser: Specify server ip, port and running mode e28221f Hansimov commited on Dec 19, 2023
:gem: [Feature] New MessageStreamer: Enable requests inference api with requests 9f341cc Hansimov commited on Dec 19, 2023