Handler for `POST /api/v1/llm/loaded-models/unload`.
POST/api/v1/llm/loaded-models/unload
Stops the model and frees its memory. Refused with 409 while it is answering a request, so an unload never cuts an answer short.
Request
Responses
- 200
- 400
- 404
- 409
- 503
Model unloaded
Empty model path
Model not loaded
Model in use, a response is in progress
No local engine on this host