You can always hand firefox's built in ai an openai api compatible endpoint and just use that for page summarization.

> https://github.com/darshi1337/apogee/blob/main/MODELS.md#loc...

> Unlike Ollama, [llama.cpp] serves one model at a time: the GGUF you launched it with.

FWIW: llama-server's supported multiple models for a while now:

https://github.com/ggml-org/llama.cpp/tree/master/tools/serv...

[dead]

[dead]