Skip to content

Commit 2571614

Browse files
committed
Add build step for running Granite 3.2 model in CI pipelineAdd workflow step to run Granite-3.2-2b-instruct-f16.gguf during CI
1 parent c1459d9 commit 2571614

1 file changed

Lines changed: 7 additions & 0 deletions

File tree

.github/workflows/build-and-run.yml

Lines changed: 7 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -128,6 +128,13 @@ jobs:
128128
./llama-tornado --gpu --${{ matrix.backend.name }} \
129129
--model /$MODELS_DIR/Phi-3-mini-4k-instruct-fp16.gguf \
130130
--prompt "Say hello"
131+
- name: FP16 - Run Granite-3.2-2b-instruct-f16.gguf
132+
run: |
133+
cd ${{ github.workspace }}
134+
export PATH="$TORNADO_SDK/bin:$JAVA_HOME/bin:$PATH"
135+
./llama-tornado --gpu --${{ matrix.backend.name }} \
136+
--model /$MODELS_DIR/granite-3.2-2b-instruct-f16.gguf \
137+
--prompt "Say hello"
131138
- name: Q8 - Run Llama-3.2-1B-Instruct-Q8_0.gguf
132139
run: |
133140
cd ${{ github.workspace }}

0 commit comments

Comments
 (0)