One model, several behaviours: LoRA adapters switched at run time

A mixture-of-experts model answers in this tab, with its experts read from disk as each token needs them. A LoRA adapter (a few to a few hundred MB, trained by someone for one job) sits on the GPU beside the model and is switched on or off between replies: no reload, no second download of the model.

Chromium with WebGPU and about 6 GB of free GPU memory. Nothing leaves this tab except the downloads from Hugging Face. The adapters are other people's work, linked to their own pages.

Pick a model. The first load downloads it once into this browser's storage.

Adapters for this model

Load the model above first; then each adapter downloads once and stays on the GPU until you change model. Adapters must be llama.cpp LoRA GGUFs (F16, F32 or BF16) for this exact model. Adapters on the routed experts are refused.