Run it in the Llama app: https://llama.app
Or from the terminal:
llama serve -hf ggml-org/vllm-d3-mini-GGUF
This is a decision model, to be used via /v1/systemone API. See https://github.com/ggml-org/llama.cpp/pull/30383
Important
This model is automatically converted using https://github.com/ggml-org/convert
Content type
Unrecognized
Digest
sha256:7670b0638…
Size
5.4 GB
Last updated
about 1 hour ago
docker pull ai/d3