Alphakdeps.io is experimental and evolving — the registry and packages may change or reset.
kdeps.ioregistry
LLM recipekdeps asset

kdeps-recipes-vllm

v1.0.0

High-throughput OpenAI-compatible server (vLLM) for GPU inference

set recipes / shelf model

LLM context: none - kdeps uses it without sending it to the model

Where it runs

Part of the recipes set, used in the kdeps CLI. How to build and run an LLM server as a Docker appliance: engine, base image, install steps, ports and health check.

  1. kdeps llm build or kdeps llm run
  2. the recipe is rendered into an imagerecipes/vllm
  3. the LLM server starts
  4. workflows call it

Loaded by: kdeps llm list, kdeps llm, kdeps llm build, kdeps llm export iso, kdeps llm export k8s, kdeps llm run, kdeps llm show, kdeps llm wizard

In the code: kdeps llm listcatalog.LoadDefaultcatalog.Load

Install

A kdeps asset: installed with the first-run profile that includes its set, or the first time a command needs it, and updated without a new release.

kdeps install recipes/vllm

Pin a version with kdeps install recipes/vllm@<version>.

Contents

High-throughput OpenAI-compatible server (vLLM) for GPU inference

id
vllm
name
vLLM
api:
  port: 8000
  base_path: /v1
  chat_path: /v1/chat/completions
  health:
    method: GET
    path: /v1/models
  auth:
    mode: none
    env: LLM_API_KEY
engine:
  kind: vllm
  base_image: vllm/vllm-openai:latest
  packages: []
  install: |
    true
  command:
    - sh
    - -c
    - exec python3 -m vllm.entrypoints.openai.api_server --host 0.0.0.0 --port
      8000 --model "${LLM_MODEL}"
  env: {}
  internal_port: 8000
  openai_bridge: false
resources:
  gpu: required
  memory_hint: 16Gi
capabilities:
  - chat
  - tools

Versions

VersionPublishedStatus
1.0.010/11/2026active

Details

Author
kdeps
License
Apache-2.0
Latest Version
1.0.0
Published
10/11/2026

Tags

kdepsrecipe