Spaces:

davidtran999
/

hue-portal-backend

Paused

App Files Files Community

hue-portal-backend / RAM_OPTIMIZATION_TRIGGER.md

davidtran999's picture

Trigger rebuild: RAM optimization changes (batch_size=128, n_batch=2048, n_ctx=16384)

1aa0af9 verified 6 days ago

|

history blame contribute delete

350 Bytes

RAM Optimization Trigger

This file triggers a rebuild to apply RAM optimization changes

Timestamp: 2025-12-04 12:17:31

Changes applied:

- Embedding batch_size: 32 → 128

- LLM n_batch: 512 → 2048

- LLM n_ctx: 8192 → 16384

- Documents retrieved: 8 → 15

- Documents in context: 2 → 4

- Snippet length: 300 → 500 chars