Cross-Modality-Überblick über alle Modell-Arten auf dem NVIDIA DGX Spark (GB10). Kennzahlen hier; die Fall-für-Fall-Details liegen im jeweiligen Modalitäts-Repo (verlinkt). Dieselben Zahlen zum Weiterrechnen als Datensatz auf Hugging Face (Parquet, CC BY 4.0).
Auf dem GB10 selbst serviert (vLLM), Judge-bewertet. Vollständiges Kohorten-Roster — jedes geplante Modell mit Status. 34 Modelle (✅ gültig 34). Gültige Modelle anklicken → Detail auf southbyte-vllm. Von Sicherheit (04) stehen nur Scores in der Matrix, keine Prompts und keine Antworten.
Alle Einzelurteile auf einen Blick: Testfall-Matrix — jeder Testfall gegen jedes Modell, Score je Zelle.
| Modell | Release | Gesamt | K.O. | Qualität | Deutsch | Bias | Code | Tok/s | TTFT | Lizenz |
|---|---|---|---|---|---|---|---|---|---|---|
| Muse-Glimmer-30B-NVFP4 ↗ | 2026-08 | PASS 86% | 3 | 82% | 100% | 78% | 90% | 12.4 | 91 ms | apache-2.0 |
| Muse-Glimmer-30B ↗ | 2026-08 | PASS 83% | 4 | 77% | 100% | 89% | 90% | 4.2 | 254 ms | apache-2.0 |
| Muse-Glimmer-30B-NVFP4-DFlash ↗ | 2026-08 | PASS 79% | 4 | 71% | 100% | 89% | 90% | 30.9 | 247 ms | apache-2.0 |
| Gemma-4-26B-A4B ↗ | 2026-03 | K.O. 77% | 8 | 69% | 100% | 89% | 90% | 23.0 | 92 ms | apache-2.0 |
| Gemma-4-31B ↗ | 2026-03 | PASS 77% | 7 | 71% | 75% | 89% | 80% | 3.8 | 397 ms | apache-2.0 |
| Nemotron-3-Super-MTPv2 ↗ | 2026-03 | K.O. 77% | 13 | 73% | 100% | 89% | 80% | 24.7 | 458 ms | nvidia-nemotron-open-model-license |
| Ornith-1.0-35B-FP8 ↗ | 2026-06 | PASS 77% | 11 | 66% | 100% | 100% | 80% | 30.8 | 105 ms | mit |
| Nemotron-3-Super ↗ | 2026-03 | WARN 74% | 5 | 69% | 75% | 89% | 80% | 15.9 | 247 ms | nvidia-nemotron-open-model-license |
| Qwen3.8-27B-NVFP4-MTP ↗ | 2026-08 | WARN 74% | 13 | 65% | 100% | 89% | 90% | 22.6 | 283 ms | apache-2.0 |
| Qwen3.8-27B-FP8 ↗ | 2026-08 | WARN 73% | 8 | 71% | 50% | 78% | 70% | 7.9 | 181 ms | apache-2.0 |
| Qwen3.8-27B-NVFP4 ↗ | 2026-08 | WARN 73% | 10 | 69% | 50% | 89% | 70% | 11.3 | 132 ms | apache-2.0 |
| Hy-MT2-30B-A3B-FP8 ↗ | 2026-05 | K.O. 71% | 9 | 69% | 100% | 89% | 50% | 22.3 | 102 ms | apache-2.0 |
| Qwen3.8-27B-Uncensored-NVFP4 ↗ | 2026-08 | K.O. 68% | 15 | 66% | 25% | 100% | 80% | 10.1 | 140 ms | apache-2.0 |
| Nemotron-3.5-Lightning-30B-A3B ↗ | 2026-08 | K.O. 67% | 10 | 58% | 50% | 100% | 80% | 80.3 | 68 ms | openmdw-1.1 |
| Ornith-1.5-35B-A3B-NVFP4 ↗ | 2026-08 | K.O. 66% | 14 | 58% | 75% | 78% | 70% | 28.5 | 102 ms | mit |
| Qwen3.6-27B-FP8 ↗ | 2026-04 | WARN 64% | 12 | 63% | 0% | 100% | 30% | 7.5 | 242 ms | apache-2.0 |
| Laguna-S-2.1-NVFP4 ↗ | 2026-07 | K.O. 63% | 15 | 58% | 0% | 78% | 80% | 17.2 | 163 ms | openmdw-1.1 |
| LFM2.5-8B-A1B ↗ | 2026-05 | WARN 63% | 7 | 60% | 0% | 89% | 60% | 55.9 | 51 ms | lfm1.0 |
| Apertus-v1.5-8B ↗ | 2026-07 | K.O. 62% | 10 | 58% | 50% | 100% | 30% | 14.2 | 83 ms | apache-2.0 |
| Apertus-v1.5-70B ↗ | 2026-07 | K.O. 61% | 11 | 58% | 50% | 78% | 40% | 3.1 | 623 ms | apache-2.0 |
| Granite-4.2-8B-NVFP4 ↗ | 2026-08 | K.O. 61% | 13 | 55% | 0% | 100% | 90% | 38.4 | 37 ms | apache-2.0 |
| Nemotron-3-Nano-30B ↗ | 2025-12 | K.O. 61% | 17 | 53% | 25% | 89% | 80% | 42.3 | 128 ms | nvidia-nemotron-open-model-license |
| Nemotron-Puzzle-75B ↗ | 2026-06 | K.O. 61% | 12 | 55% | 0% | 100% | 60% | 20.8 | 131 ms | openmdw-1.1 |
| Granite-4.1-30B ↗ | 2026-04 | K.O. 59% | 17 | 55% | 25% | 100% | 60% | 3.9 | 281 ms | apache-2.0 |
| Granite-4.2-30B-NVFP4 ↗ | 2026-08 | K.O. 59% | 13 | 50% | 0% | 100% | 70% | 12.9 | 91 ms | apache-2.0 |
| Qwen3.6-35B-A3B-FP8 ↗ | 2026-04 | FAIL 58% | 12 | 55% | 0% | 100% | 30% | 17.9 | 154 ms | apache-2.0 |
| Granite-4.2-3B-NVFP4 ↗ | 2026-08 | FAIL 57% | 4 | 53% | 0% | 89% | 50% | 80.1 | 22 ms | apache-2.0 |
| Mistral-Small-4 ↗ | 2026-03 | K.O. 56% | 20 | 50% | 75% | 78% | 60% | 31.4 | 94 ms | apache-2.0 |
| Laguna-XS-2.1-FP8 ↗ | 2026-06 | K.O. 54% | 19 | 42% | 0% | 89% | 80% | 37.4 | 65 ms | openmdw-1.1 |
| Olmo-3.1-32B-Instruct ↗ | 2025-12 | K.O. 53% | 18 | 42% | 0% | 100% | 60% | 3.7 | 342 ms | apache-2.0 |
| Ornith-1.0-9B ↗ | 2026-06 | K.O. 51% | 14 | 39% | 25% | 78% | 70% | 12.3 | 118 ms | mit |
| Mellum2-12B-A2.5B-Thinking ↗ | 2026-05 | K.O. 49% | 21 | 39% | 0% | 89% | 70% | 42.9 | 65 ms | apache-2.0 |
| Mellum2-12B-A2.5B-Instruct ↗ | 2026-05 | K.O. 43% | 27 | 32% | 25% | 78% | 60% | 43.5 | 68 ms | apache-2.0 |
| Apertus-v1.1-4B ↗ | 2026-05 | K.O. 31% | 27 | 21% | 25% | 89% | 10% | 27.6 | 42 ms | apache-2.0 |
Frontier-Modelle über LiteLLM als Referenzrahmen — ein Endpoint für Cloud- und lokale Modelle, von SouthByte empfohlen. Gleicher Testsatz, Judge claude-sonnet-5. Tok/s & TTFT messen hier Cloud+Netz (nicht lokale Hardware). 28 Modelle · Pass-Rate je Playbook. Modellname anklicken → Detail (Prompt, Antwort, Judge je Fall) auf southbyte-vllm. Sicherheit (04) ausgeschlossen.
| Modell | Release | Gesamt | K.O. | Qualität | Deutsch | Bias | Code | Tok/s | TTFT | Lizenz |
|---|---|---|---|---|---|---|---|---|---|---|
| Grok-4.6 ↗ | 2026-08 | PASS 93% | 1 | 95% | 100% | 89% | 90% | 18.3 | 715 ms | xAI · proprietär |
| Claude-Sonnet-5 ↗ | 2026-06 | PASS 91% | 1 | 92% | 100% | 78% | 90% | 98.4 | 1202 ms | Anthropic · proprietär |
| Grok-4.5 ↗ | 2026-07 | PASS 90% | 7 | 89% | 100% | 78% | 100% | 43.0 | 739 ms | xAI · proprietär |
| Claude-Fable-5 ↗ | 2026-06 | PASS 88% | 0 | 92% | 100% | 89% | 60% | 76.7 | 2560 ms | Anthropic · proprietär |
| Grok-4.1-Fast ↗ | 2025-11 | PASS 88% | 3 | 87% | 100% | 89% | 90% | 101.2 | 676 ms | xAI · proprietär |
| GPT-5.6-sol ↗ | 2026-07 | PASS 87% | 6 | 82% | 100% | 100% | 100% | 54.9 | 1508 ms | OpenAI · proprietär |
| GPT-5.6-terra ↗ | 2026-07 | PASS 85% | 7 | 79% | 100% | 100% | 100% | 81.5 | 738 ms | OpenAI · proprietär |
| GPT-5.6-luna ↗ | 2026-07 | PASS 83% | 7 | 79% | 75% | 89% | 100% | 143.7 | 1007 ms | OpenAI · proprietär |
| Claude-Opus-5 ↗ | 2026-07 | PASS 81% | 0 | 79% | 100% | 78% | 90% | 125.4 | 2921 ms | Anthropic · proprietär |
| Kimi-K3 ↗ | 2026-07 | PASS 80% | 2 | 77% | 100% | 78% | 90% | 43.0 | 1517 ms | proprietär (API) |
| MiMo-v2.5-Pro ↗ | 2026-04 | PASS 78% | 6 | 74% | 75% | 89% | 90% | 48.8 | 1572 ms | proprietär (API) |
| Qwen3.7-Plus | 2026-06 | PASS 78% | 13 | 73% | 100% | 89% | 90% | 59.4 | 689 ms | proprietär (API) |
| Gemini-3.1-Pro ↗ | 2026-02 | PASS 76% | 9 | 71% | 100% | 78% | 90% | — | — | Google · proprietär |
| GLM-5.2 ↗ | 2026-06 | WARN 74% | 13 | 69% | 100% | 78% | 90% | 102.0 | 805 ms | proprietär (API) |
| MiniMax-M3 ↗ | 2026-06 | WARN 74% | 8 | 71% | 100% | 67% | 90% | 157.9 | 1346 ms | proprietär (API) |
| Nemotron-3-Ultra-550B ↗ | 2026-06 | K.O. 73% | 15 | 68% | 100% | 78% | 90% | 23.5 | 1208 ms | proprietär (API) |
| DeepSeek-V4-Pro ↗ | 2026-04 | K.O. 72% | 14 | 66% | 100% | 78% | 90% | 42.7 | 2090 ms | proprietär (API) |
| Gemini-3.5-Flash-Lite ↗ | 2026-07 | K.O. 72% | 15 | 66% | 100% | 78% | 90% | 311.9 | 466 ms | Google · proprietär |
| Gemini-3.6-Flash ↗ | 2026-07 | K.O. 72% | 15 | 66% | 100% | 67% | 100% | — | — | Google · proprietär |
| Hunyuan-3 | 2026-07 | K.O. 69% | 15 | 63% | 100% | 67% | 90% | 61.9 | 1518 ms | proprietär (API) |
| MiMo-v2.5 ↗ | 2026-04 | K.O. 67% | 14 | 63% | 75% | 78% | 80% | 95.3 | 1019 ms | proprietär (API) |
| Qwen3.8-Max | 2026-08 | WARN 67% | 7 | 66% | 50% | 89% | 60% | 47.4 | 998 ms | proprietär (API) |
| Claude-Haiku-4.5 ↗ | 2025-10 | WARN 66% | 8 | 65% | 50% | 78% | 70% | 115.7 | 620 ms | Anthropic · proprietär |
| Magistral-Medium ↗ | 2025-09 | K.O. 57% | 23 | 50% | 100% | 67% | 70% | 127.3 | 240 ms | Mistral · proprietär |
| Mistral-Large ↗ | 2025-12 | K.O. 57% | 23 | 50% | 100% | 78% | 60% | 56.0 | 337 ms | Mistral · proprietär |
| Mistral-Medium ↗ | 2026-04 | K.O. 56% | 22 | 47% | 75% | 78% | 80% | 65.5 | 249 ms | Mistral · proprietär |
| Step-3.7-Flash ↗ | 2026-05 | K.O. 49% | 22 | 44% | 50% | 78% | 50% | 122.4 | 1748 ms | proprietär (API) |
| Ministral-8B ↗ | 2024-10 | K.O. 38% | 28 | 31% | 0% | 78% | 60% | 137.5 | 180 ms | Mistral · proprietär |
Guard-Name anklicken → Fall für Fall (Wahrheit vs. Vorhersage) auf southbyte-vllm. Kein Judge — das Label ist die Wahrheit.
| Guard | Release | Recall | FPR | Trap-FPR | Präz. | F1 | Acc | Lat ø | Lizenz |
|---|---|---|---|---|---|---|---|---|---|
| Granite-Guardian | 2026-04 | 0.974 | 0.023 | 0.042 | 0.974 | 0.974 | 0.976 | 1044.900 | apache-2.0 |
| Nemotron-3 | 2026-03 | 1.000 | 0.045 | 0.083 | 0.950 | 0.974 | 0.976 | 493.200 | nvidia-nemotron-open-model-license |
| Nemotron-3.5 | 2026-05 | 1.000 | 0.045 | 0.083 | 0.950 | 0.974 | 0.976 | 562.900 | openmdw-license-agreement |
| gpt-oss-safeguard | 2025-09 | 1.000 | 0.000 | 0.000 | 1.000 | 1.000 | 1.000 | 1566.800 | apache-2.0 |
| Shieldstral | 2026-07 | 1.000 | 0.023 | 0.042 | 0.974 | 0.987 | 0.988 | 44.300 | apache-2.0 |
| SingGuard-2b | 2026-05 | 1.000 | 0.023 | 0.042 | 0.974 | 0.987 | 0.988 | 282.100 | apache-2.0 |
WER je Stimme (niedriger = besser), per ASR-Rückschrift gemessen (Whisper-large-v3 & Voxtral-mini) · Stimme → HF-Engine. Anhörbare Beispiele: https://mvdb.github.io/southbyte-tts/
| Stimme | Release | WER (Whisper) | WER (Voxtral) | Lizenz |
|---|---|---|---|---|
| qwen-vd-de-male-coach | 2026-01 | 0.123 | 0.064 | apache-2.0 |
| qwen-vd-de-female-calm | 2026-01 | 0.124 | 0.066 | apache-2.0 |
| voxtral-de-female | 2025-11 | 0.094 | 0.073 | apache-2.0 |
| magpie-tn-sofia | 2025-12 | 0.096 | 0.077 | other (NVIDIA) |
| audio8-default | 2026-07 | 0.108 | 0.083 | apache-2.0 |
| audio8-de-f1 | 2026-07 | 0.092 | 0.087 | apache-2.0 |
| qwen-cv-unclefu | 2026-01 | 0.098 | 0.089 | apache-2.0 |
| qwen-vd-de-female-coach | 2026-01 | 0.142 | 0.093 | apache-2.0 |
| voxtral-de-male | 2025-11 | 0.143 | 0.095 | apache-2.0 |
| qwen-vd-de-male-news | 2026-01 | 0.146 | 0.097 | apache-2.0 |
| qwen-vd-de-female-news | 2026-01 | 0.124 | 0.099 | apache-2.0 |
| audio8onnx-de-f1 | 2026-08 | 0.148 | 0.105 | apache-2.0 |
| voxcpm2-design | 2026-04 | 0.122 | 0.106 | apache-2.0 |
| qwen-vd-de-male-young | 2026-01 | 0.116 | 0.121 | apache-2.0 |
| chatterbox-default | 2025-04 | 0.193 | 0.157 | mit |
| magpie-sofia | 2025-12 | 0.198 | 0.172 | other (NVIDIA) |
| chatterbox-de-f1 | 2025-04 | 0.198 | 0.178 | mit |
| qwen-cv-serena | 2026-01 | 0.231 | 0.181 | apache-2.0 |
| qwen-cv-aiden | 2026-01 | 0.186 | 0.217 | apache-2.0 |
| audio8onnx-default | 2026-08 | 0.251 | 0.279 | apache-2.0 |
| auk-flash-de-f1 | 2026-08 | 0.427 | 0.415 | mit |
| auk-de-f1 | 2026-08 | 0.446 | 0.467 | mit |
Spalte klicken zum Sortieren · Modell → Model-Card · Vollständige Galerie: https://mvdb.github.io/southbyte-image/
Nicht-kommerzielle Lizenzen: FLUX.2-dev-bnb4 (FLUX.2-dev Non-Commercial License) · Qwen-Image-2.1 (Qwen Research License) — nur Forschung und Evaluation, auch fuer die erzeugten Bilder.
| Modell | Release | Bilder | Ø s/Bild | Textrender CER | Textrender exakt | Prompt-Treue | Lizenz |
|---|---|---|---|---|---|---|---|
| FLUX.1-schnell | 2024-07 | 22 | 6.840 | 0.147 | 0.333 | 0.700 | apache-2.0 |
| Qwen-Image-2512 | 2025-12 | 22 | 138.960 | 0.049 | 0.500 | 0.891 | apache-2.0 |
| Qwen-Image-Flash | 2026-07 | 22 | 22.570 | 0.026 | 0.667 | 0.927 | apache-2.0 |
| ERNIE-Image-Turbo | 2026-04 | 22 | 121.920 | 0.000 | 1.000 | 0.973 | apache-2.0 |
| Mage-Flow | 2026-07 | 22 | 15.000 | 0.021 | 0.833 | 0.882 | mit |
| FLUX.2-dev-bnb4 | 2025-11 | 22 | 96.380 | 0.017 | 0.833 | 0.973 | flux-2-dev-non-commercial |
| Qwen-Image-2.1 | 2026-09 | 22 | 55.450 | 0.000 | 1.000 | 0.900 | qwen-research |