Unpin matter-server, otbr, music-assistant from k8s-edge (shrink edge to USB-only) #82

Merged
k.renner merged 1 commits from worktree-edge-unpin-nonusb into master 2026-06-27 16:44:29 +00:00
Owner

First step toward a tiny dedicated k8s-edge (N100). Unpins matter-server, otbr, music-assistant (drops zone=edge nodeSelector + workload-class=pinned toleration). All three only need v30iot L2, which is eth1 on every node (verified live: k8s-1 .158 / k8s-2 .193 / k8s-3 .231 / edge .137). matter/otbr macvlan already master:eth1 -> no NAD change; music-assistant hostNetwork gets v30iot on any node, no hardcoded 10.2.30.137 refs. Edge taint keeps them off the box once toleration is gone. USB-bound home-assistant + zwave-js stay. Separate finding: shelly-manager NAD master:eth2 is the Ceph net not v30iot (likely broken mDNS) - flagged, not touched.

First step toward a tiny dedicated k8s-edge (N100). Unpins matter-server, otbr, music-assistant (drops zone=edge nodeSelector + workload-class=pinned toleration). All three only need v30iot L2, which is eth1 on every node (verified live: k8s-1 .158 / k8s-2 .193 / k8s-3 .231 / edge .137). matter/otbr macvlan already master:eth1 -> no NAD change; music-assistant hostNetwork gets v30iot on any node, no hardcoded 10.2.30.137 refs. Edge taint keeps them off the box once toleration is gone. USB-bound home-assistant + zwave-js stay. Separate finding: shelly-manager NAD master:eth2 is the Ceph net not v30iot (likely broken mDNS) - flagged, not touched.
k.renner added 1 commit 2026-06-27 16:43:42 +00:00
These three only need v30iot L2 presence, which exists on every node
(eth1 is the v30iot interface on k8s-1/2/3 and k8s-edge alike), not the
edge node's USB devices. Removing their topology.kubernetes.io/zone=edge
nodeSelector and workload-class=pinned toleration lets the edge
NoSchedule taint keep them off the (soon-to-be dedicated, tiny N100) edge
box, reserving it for the only genuinely USB-bound workloads:
home-assistant (FTDI power meter) and zwave-js (ZWA-2 radio).

- matter-server / otbr: macvlan NAD already uses master: eth1, which
  resolves to v30iot on all nodes (verified live on k8s-1/2/3) — no NAD
  change needed.
- music-assistant: hostNetwork gets v30iot L2 on any node; it is the
  heaviest of the three (2Gi limit), so this is the main capacity win.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
k.renner merged commit b8b83baadb into master 2026-06-27 16:44:29 +00:00
Sign in to join this conversation.