LLM Leaderboard
Performance rankings for LLMs running on NVIDIA DGX Spark
Performance rankings for LLMs running on NVIDIA DGX Spark
Showing 10 results
| Rank | Model | Runtime | Cluster | Tokens/Sec | Type |
|---|---|---|---|---|---|
1 | vllm | Single | 5080.50 | Prefill | |
2 | vllm | 2 nodes | 4405.30 | Prefill | |
3 | vllm | 2 nodes | 2983.14 | Prefill | |
4 | vllm | Single | 2384.02 | Prefill | |
5 | vllm | Single | 2311.92 | Prefill | |
6 | vllm | Single | 1166.08 | Prefill | |
7 | vllm | 2 nodes | 1109.44 | Prefill | |
8 | vllm | 2 nodes | 1089.12 | Prefill | |
9 | vllm | 2 nodes | 1086.47 | Prefill | |
10 | vllm | 2 nodes | 869.95 | Prefill |