Skip to content
This repository was archived by the owner on Apr 30, 2026. It is now read-only.

Properly support batched/non-batched with vllm/llama.cpp #77

Closed
njhill wants to merge 10 commits into
instructlab:mainfrom
njhill:remove_iterblock
Closed

Properly support batched/non-batched with vllm/llama.cpp #77
njhill wants to merge 10 commits into
instructlab:mainfrom
njhill:remove_iterblock

Commits

Commits on Jul 3, 2024