Zareian b3f624a512 gunicorn: warm the assistant's Qdrant/OpenAI clients when a worker starts ...

The first assistant round after a restart waited ~6 s before reaching the model on the
live server (later rounds ~1 s); locally a cold 10-ask burst took 7.5 s vs 6.1 s with
this hook (simulated model, 5.2 s). Workers are recycled by max_requests, so the delay
recurred. A failed warm-up is logged and does not stop the worker.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

2026-10-04 14:41:48 +03:30

4.3 KiB

Raw Blame History

View Raw