kdeps-recipes-llamafile
v1.0.0Self-contained .llamafile binary serving OpenAI-compatible /v1
set recipes / shelf model
LLM context: none - kdeps uses it without sending it to the model
Where it runs
Part of the recipes set, used in the kdeps CLI. How to build and run an LLM server as a Docker appliance: engine, base image, install steps, ports and health check.
- kdeps llm build or kdeps llm run
- the recipe is rendered into an imagerecipes/llamafile
- the LLM server starts
- workflows call it
Loaded by: kdeps llm list, kdeps llm, kdeps llm build, kdeps llm export iso, kdeps llm export k8s, kdeps llm run, kdeps llm show, kdeps llm wizard
In the code: kdeps llm listcatalog.LoadDefaultcatalog.Load
Install
A kdeps asset: installed with the first-run profile that includes its set, or the first time a command needs it, and updated without a new release.
Pin a version with kdeps install recipes/llamafile@<version>.
Contents
Self-contained .llamafile binary serving OpenAI-compatible /v1
- id
- llamafile
- name
- Llamafile
api:
port: 8000
base_path: /v1
chat_path: /v1/chat/completions
health:
method: GET
path: /v1/models
auth:
mode: none
env: LLM_API_KEY
engine:
kind: llamafile
base_image: ubuntu:24.04
packages: []
install: |
true
command:
- /models/model.llamafile
- --server
- --host
- 0.0.0.0
- --port
- "8000"
env: {}
internal_port: 8000
openai_bridge: false
resources:
gpu: optional
memory_hint: 8Gi
capabilities:
- chat
id: llamafile
name: Llamafile
description: Self-contained .llamafile binary serving OpenAI-compatible /v1
version: 1.0.0
api:
port: 8000
base_path: /v1
chat_path: /v1/chat/completions
health:
method: GET
path: /v1/models
auth:
mode: none
env: LLM_API_KEY
engine:
kind: llamafile
base_image: "ubuntu:24.04"
packages: []
install: |
true
command: ["/models/model.llamafile", "--server", "--host", "0.0.0.0", "--port", "8000"]
env: {}
internal_port: 8000
openai_bridge: false
models:
strategy: copy
default: ""
resources:
gpu: optional
memory_hint: "8Gi"
capabilities:
- chat
Versions
| Version | Published | Status |
|---|---|---|
| 1.0.0 | 10/11/2026 | active |
Details
- Author
- kdeps
- License
- Apache-2.0
- Latest Version
- 1.0.0
- Published
- 10/11/2026