vllm-vulkan

An out-of-tree vLLM hardware plugin that enables cross-platform GPU inference via Vulkan.

Platform	Architecture	Vulkan provider
macOS	aarch64	KosmicKrisp (Vulkan → Metal translation)
Linux	x86_64	Native Vulkan driver
Linux	aarch64	Native Vulkan driver

Installation

curl -fsSL https://raw.githubusercontent.com/ericcurtin/vllm-vulkan/main/install.sh | bash

Name		Name	Last commit message	Last commit date
Latest commit History 62 Commits
.gemini		.gemini
.github/workflows		.github/workflows
scripts		scripts
shaders		shaders
src		src
tests		tests
vllm_vulkan		vllm_vulkan
.gitignore		.gitignore
.gitmodules		.gitmodules
Cargo.toml		Cargo.toml
Dockerfile		Dockerfile
LICENSE		LICENSE
README.md		README.md
build.rs		build.rs
install.sh		install.sh
pyproject.toml		pyproject.toml
uv.lock		uv.lock