Files
homelab/scripts
claude-botandClaude Opus 5 043d1af4d4
ci/woodpecker/pr/ci-scripts-test Pipeline was successful
ci/woodpecker/pr/pr-review Pipeline was successful
feat(paperless-eval): four more MoE candidates, and Gemma was wrongly excluded
Five dense models have failed and the one MoE works, so the list was searched
again for that shape specifically — 20-60B total, under ~6B active:

  glm47-flash          GLM-4.7-Flash, 30B/3B, 17.8 GB
  gemma4-26b-a4b       gemma-4-26B-A4B-it, 26B/4B, 16.9 GB
  qwen35-35b-a3b       Qwen3.5-35B-A3B, 35B/3B, 21.5 GB
  nemotron35-30b-a3b   Nemotron-3.5-Lightning-30B-A3B, 30B/3B, 25.5 GB

Correcting an exclusion of mine: Gemma is not out. Gemma 3 has no tool support
at any size — verified, "tool" appears zero times in its template — but Gemma 4
26B-A4B does, and claims 140+ languages pretrained. Writing off a family by its
previous generation was sloppy.

Two carry a Vulkan risk that has to be checked in the server log rather than
assumed: Nemotron-3.5 interleaves real Mamba2 layers and Qwen3.5 uses DeltaNet
linear attention, and llama.cpp's Vulkan SSM shaders are less exercised on Iris
Xe than on Arc. Issue #19957 reported exactly this for Qwen3.5-35B-A3B, and it
turned out to be a stale build fixed well before b10731 — but a silent CPU
fallback would read as a slow model, not as an error, so confirm the layers are
offloaded.

Rejections with reasons are in the file: ERNIE-4.5-21B-A3B has tool calling
only in its Thinking variant, Ling-3.0-flash is 124B total, Granite-4.0-H-Small
is 9B active, gpt-oss-20b is a reasoning-effort model in Harmony format.

Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-09-04 08:30:45 +02:00
..