|
| 1 | +# Results |
| 2 | + |
| 3 | +## ModuleLLM (AX630C) |
| 4 | + |
| 5 | +### LLM |
| 6 | +| model | ttft (ms) | avg-token/s | model version | llm version | |
| 7 | +|---------------------------------|------------|-------------|---------------|-------------| |
| 8 | +| qwen2.5-0.5B-prefill-20e | 359.8 | 10.32 | v0.2 | v1.8 | |
| 9 | +| qwen2.5-0.5B-p256-ax630c | 1126.19 | 10.30 | v0.4 | v1.8 | |
| 10 | +| qwen2.5-0.5B-Int4-ax630c | 442.95 | 12.52 | v0.4 | v1.8 | |
| 11 | +| qwen2.5-coder-0.5B-ax630c | 361.81 | 10.28 | v0.2 | v1.8 | |
| 12 | +| qwen2.5-1.5B-ax630c | 1029.41 | 3.59 | v0.3 | v1.8 | |
| 13 | +| qwen2.5-1.5B-p256-ax630c | 3056.54 | 3.57 | v0.4 | v1.8 | |
| 14 | +| qwen2.5-1.5B-Int4-ax630c | 1219.54 | 4.63 | v0.4 | v1.8 | |
| 15 | +| deepseek-r1-1.5B-ax630c | 1075.04 | 3.57 | v0.3 | v1.8 | |
| 16 | +| deepseek-r1-1.5B-p256-ax630c | 3056.86 | 3.57 | v0.4 | v1.8 | |
| 17 | +| llama3.2-1B-prefill-ax630c | 891.00 | 4.48 | v0.2 | v1.8 | |
| 18 | +| llama3.2-1B-p256-ax630c | 2601.11 | 4.49 | v0.4 | v1.8 | |
| 19 | +| openbuddy-llama3.2-1B-ax630c | 891.02 | 4.52 | v0.2 | v1.8 | |
| 20 | + |
| 21 | +### VLM |
| 22 | +| model | ttft (ms) | avg-token/s | image encode (ms) | model version | vlm version | |
| 23 | +|---------------------------------|------------|-------------|-------------------|---------------|-------------| |
| 24 | +| internvl2.5-1B-364-ax630c | 1117.27 | 10.56 | 1164.61 | v0.4 | v1.7 | |
| 25 | +| smolvlm-256M-ax630c | 185.75 | 30.16 | 799.11 | v0.4 | v1.7 | |
| 26 | +| smolvlm-500M-ax630c | 365.69 | 13.14 | 838.30 | v0.4 | v1.7 | |
| 27 | + |
| 28 | +### STT |
| 29 | +| model | encode (ms) | avg-decode (ms) | model version | whisper version | |
| 30 | +|--------------------|-------------|-----------------|---------------|-----------------| |
| 31 | +| whisper-tiny | 248.0 | 32.54 | v0.4 | v1.7 | |
| 32 | +| whisper-base | 660.31 | 51.11 | v0.4 | v1.7 | |
| 33 | +| whisper-small | 1606.08 | 148.92 | v0.4 | v1.7 | |
0 commit comments