kdeps-recipes-sglang
v1.0.0SGLang OpenAI-compatible serving runtime (GPU)
set recipes / shelf model
LLM context: none - kdeps uses it without sending it to the model
Where it runs
Part of the recipes set, used in the kdeps CLI. How to build and run an LLM server as a Docker appliance: engine, base image, install steps, ports and health check.
- kdeps llm build or kdeps llm run
- the recipe is rendered into an imagerecipes/sglang
- the LLM server starts
- workflows call it
Loaded by: kdeps llm list, kdeps llm, kdeps llm build, kdeps llm export iso, kdeps llm export k8s, kdeps llm run, kdeps llm show, kdeps llm wizard
In the code: kdeps llm listcatalog.LoadDefaultcatalog.Load
Install
A kdeps asset: installed with the first-run profile that includes its set, or the first time a command needs it, and updated without a new release.
Pin a version with kdeps install recipes/sglang@<version>.
Contents
SGLang OpenAI-compatible serving runtime (GPU)
- id
- sglang
- name
- SGLang
api:
port: 8000
base_path: /v1
chat_path: /v1/chat/completions
health:
method: GET
path: /v1/models
auth:
mode: none
env: LLM_API_KEY
engine:
kind: sglang
base_image: lmsysorg/sglang:latest
packages: []
install: |
true
command:
- sh
- -c
- exec python3 -m sglang.launch_server --host 0.0.0.0 --port 8000
--model-path "${LLM_MODEL}"
env: {}
internal_port: 8000
openai_bridge: false
resources:
gpu: required
memory_hint: 16Gi
capabilities:
- chat
- tools
id: sglang
name: SGLang
description: SGLang OpenAI-compatible serving runtime (GPU)
version: 1.0.0
api:
port: 8000
base_path: /v1
chat_path: /v1/chat/completions
health:
method: GET
path: /v1/models
auth:
mode: none
env: LLM_API_KEY
engine:
kind: sglang
base_image: "lmsysorg/sglang:latest"
packages: []
install: |
true
command:
- sh
- -c
- exec python3 -m sglang.launch_server --host 0.0.0.0 --port 8000 --model-path "${LLM_MODEL}"
env: {}
internal_port: 8000
openai_bridge: false
models:
strategy: pull
default: ""
resources:
gpu: required
memory_hint: "16Gi"
capabilities:
- chat
- tools
Versions
| Version | Published | Status |
|---|---|---|
| 1.0.0 | 10/11/2026 | active |
Details
- Author
- kdeps
- License
- Apache-2.0
- Latest Version
- 1.0.0
- Published
- 10/11/2026