Skip to content

Commit a45b532

Browse files
committed
Add workflow step to run Granite-3.2-2b-instruct-Q8.gguf during CI
1 parent 2571614 commit a45b532

1 file changed

Lines changed: 7 additions & 0 deletions

File tree

.github/workflows/build-and-run.yml

Lines changed: 7 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -170,3 +170,10 @@ jobs:
170170
./llama-tornado --gpu --${{ matrix.backend.name }} \
171171
--model $MODELS_DIR/Mistral-7B-Instruct-v0.3.Q8_0.gguf \
172172
--prompt "Say hello"
173+
- name: Q8 - Run Granite-3.2-2b-instruct-Q8.gguf
174+
run: |
175+
cd ${{ github.workspace }}
176+
export PATH="$TORNADO_SDK/bin:$JAVA_HOME/bin:$PATH"
177+
./llama-tornado --gpu --${{ matrix.backend.name }} \
178+
--model /$MODELS_DIR/granite-3.2-2b-instruct-Q8_0.gguf \
179+
--prompt "Say hello"

0 commit comments

Comments
 (0)