We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
1 parent 2571614 commit a45b532Copy full SHA for a45b532
1 file changed
.github/workflows/build-and-run.yml
@@ -170,3 +170,10 @@ jobs:
170
./llama-tornado --gpu --${{ matrix.backend.name }} \
171
--model $MODELS_DIR/Mistral-7B-Instruct-v0.3.Q8_0.gguf \
172
--prompt "Say hello"
173
+ - name: Q8 - Run Granite-3.2-2b-instruct-Q8.gguf
174
+ run: |
175
+ cd ${{ github.workspace }}
176
+ export PATH="$TORNADO_SDK/bin:$JAVA_HOME/bin:$PATH"
177
+ ./llama-tornado --gpu --${{ matrix.backend.name }} \
178
+ --model /$MODELS_DIR/granite-3.2-2b-instruct-Q8_0.gguf \
179
+ --prompt "Say hello"
0 commit comments