unload idel model

[nefingar]

I might have missed something but is it possible to unload a model if it wasn't used for X minutes? Ollama has something like that, freeing up vram for other things (image generation etc.) if the llm isn't in use currently.

[nefingar]

I forgot to add, my question is about the llama-server that you can spin up to create an openapi compatible endpoint.