Qwen3 / llm_server.py

Commit History

Smaller context
5787990

Tim Luka Horstmann commited on

Increase context window
8622ab5

Tim Luka Horstmann commited on

Import json and print
0a03f8b

Tim Luka Horstmann commited on

Add streaming
44afc53

Tim Luka Horstmann commited on

Smaller model and paremeters changed
46825d7

Tim Luka Horstmann commited on

Tried to copy other approach
7e32345

Tim Luka Horstmann commited on

Swap to pre-model packing
470d3ad

Tim Luka Horstmann commited on

Improved parameters for generation
41c6a1d

Tim Luka Horstmann commited on

Similar setup to other model
b173427

Tim Luka Horstmann commited on

Test first deployment
9f40e8d

Tim Luka Horstmann commited on