konairius/Wiki
10
0
Fork 0
Code Issues Pull Requests 2 Packages Projects Releases Wiki Activity

feat: house encyclopedia (Wikipedia-style articles at /house) #17

Merged
k.renner merged 27 commits from feat/house-encyclopedia into main 2026-10-25 14:48:36 +00:00
Conversation 0 Commits 27 Files Changed 73
+9585 -74
claude-bot commented 2026-10-25 14:14:27 +00:00
Member
Copy Link
Copy Source

Implements docs/superpowers/specs/2026-10-24-house-encyclopedia-design.md following docs/superpowers/plans/2026-10-24-house-encyclopedia.md. This branch contains the docs commits of #16, so #16 can be closed once this merges.

What it does

  • Generation, nightly at 06:00 Europe/Berlin, after a sync. The AI first plans the article set, giving notable subjects their own article and folding the rest into a parent article's section. It then writes each article in German.
    • Leak protection: a deterministic scanner checks for this house's IPs, IP prefixes, FQDNs, renner.uno names, MACs, HA entity IDs and paths. An LLM leak check follows. Every image is private. Titles and slugs are checked too.
    • Translation: English is translated unit by unit, with public and private units sent in separate requests. The English text is then scanned and leak-checked again.
    • Saving: all changes go to konairius/notes in one commit under articles/<lang>/.
    • Cost control: attempt memory in articles/_state.json means a failure is never paid for twice on the same input. A run stops cleanly on a spend limit or overload and keeps what it already wrote. The run can never stop the host.
  • Pages at /house (static SSR, [AllowAnonymous], Wikipedia-like layout): a properties panel that doesn't overlap diagrams, a linked table of contents, Mermaid (vendored, securityLevel: 'strict') and a de/en switch.
    • For anonymous readers, private sections are removed server-side. A Markdig AST guard locks the whole body on anything unexpected.
    • Links to articles a reader can't see are dropped along with their text.
    • Link URLs are allowlisted (http, https, mailto, #, /house/…).
    • An anonymous request for a private article gets the same 404 as a missing one.
    • Pages send noindex and no-store. Everything outside /house stays behind login.
  • Off by default: Wiki:Encyclopedia:Enabled=false. The homelab PR turns it on in planning-only mode (MaxArticles=0).

Review

  • Each of the 11 tasks was built by a fresh subagent and reviewed by a fresh reviewer. Ten tasks needed fix rounds. Task 2 (redaction) needed three, and Task 10 (rendering) two.
  • A final whole-branch review on Fable led to one more fix wave, which a scoped re-review then approved.
  • Tests: dotnet test Wiki.slnx -c Release passes 542 tests (Core 174, Contracts 83, Application 144, Host 141).

Behaviour changes outside the feature

  • Frontmatter.Unquote now unescapes \" and \\ inside double-quoted values, for all notes. This is correct YAML. DepositFactUseCase now escapes \ as well.
  • MessagesTransport throws ModelUnavailableException (mapped to 502) for 429/529 after retries, overload and rate-limit stream errors, and spend-limit 400s. Other errors throw HttpRequestException with its StatusCode set. A stalled SSE stream fails after 90 s. The Facts page handles the new exception.
  • MapStaticAssets().AllowAnonymous(): static assets are readable without login. Nothing sensitive is in wwwroot.

Known, deferred

  • Images: distilled notes rarely carry attachments, so the first articles will mostly have no photos. Photos are private anyway.
  • A rare layout (a fenced code block on a list-item line, followed by an infobox with a private row) locks the article for anonymous readers. This affects availability only; nothing leaks.
  • The leak scanner errs toward private, for example on version strings that also appear as IPs in the sources.
  • An anonymous error page renders in the MainLayout shell. Cosmetic only; no data is shown.

🤖 Generated with Claude Code

Implements `docs/superpowers/specs/2026-10-24-house-encyclopedia-design.md` following `docs/superpowers/plans/2026-10-24-house-encyclopedia.md`. This branch contains the docs commits of #16, so #16 can be closed once this merges. ## What it does - **Generation, nightly at 06:00 Europe/Berlin, after a sync.** The AI first plans the article set, giving notable subjects their own article and folding the rest into a parent article's section. It then writes each article in German. - Leak protection: a deterministic scanner checks for this house's IPs, IP prefixes, FQDNs, `renner.uno` names, MACs, HA entity IDs and paths. An LLM leak check follows. Every image is private. Titles and slugs are checked too. - Translation: English is translated unit by unit, with public and private units sent in separate requests. The English text is then scanned and leak-checked again. - Saving: all changes go to `konairius/notes` in one commit under `articles/<lang>/`. - Cost control: attempt memory in `articles/_state.json` means a failure is never paid for twice on the same input. A run stops cleanly on a spend limit or overload and keeps what it already wrote. The run can never stop the host. - **Pages at `/house`** (static SSR, `[AllowAnonymous]`, Wikipedia-like layout): a properties panel that doesn't overlap diagrams, a linked table of contents, Mermaid (vendored, `securityLevel: 'strict'`) and a de/en switch. - For anonymous readers, private sections are removed server-side. A Markdig AST guard locks the whole body on anything unexpected. - Links to articles a reader can't see are dropped along with their text. - Link URLs are allowlisted (http, https, mailto, #, /house/…). - An anonymous request for a private article gets the same 404 as a missing one. - Pages send `noindex` and `no-store`. Everything outside `/house` stays behind login. - **Off by default:** `Wiki:Encyclopedia:Enabled=false`. The homelab PR turns it on in planning-only mode (`MaxArticles=0`). ## Review - Each of the 11 tasks was built by a fresh subagent and reviewed by a fresh reviewer. Ten tasks needed fix rounds. Task 2 (redaction) needed three, and Task 10 (rendering) two. - A final whole-branch review on Fable led to one more fix wave, which a scoped re-review then approved. - Tests: `dotnet test Wiki.slnx -c Release` passes 542 tests (Core 174, Contracts 83, Application 144, Host 141). ## Behaviour changes outside the feature - `Frontmatter.Unquote` now unescapes `\"` and `\\` inside double-quoted values, for all notes. This is correct YAML. `DepositFactUseCase` now escapes `\` as well. - `MessagesTransport` throws `ModelUnavailableException` (mapped to 502) for 429/529 after retries, overload and rate-limit stream errors, and spend-limit 400s. Other errors throw `HttpRequestException` with its `StatusCode` set. A stalled SSE stream fails after 90 s. The Facts page handles the new exception. - `MapStaticAssets().AllowAnonymous()`: static assets are readable without login. Nothing sensitive is in `wwwroot`. ## Known, deferred - Images: distilled notes rarely carry `attachments`, so the first articles will mostly have no photos. Photos are private anyway. - A rare layout (a fenced code block on a list-item line, followed by an infobox with a private row) locks the article for anonymous readers. This affects availability only; nothing leaks. - The leak scanner errs toward private, for example on version strings that also appear as IPs in the sources. - An anonymous error page renders in the MainLayout shell. Cosmetic only; no data is shown. 🤖 Generated with [Claude Code](https://claude.com/claude-code)
claude-bot added 33 commits 2026-10-25 14:14:27 +00:00
docs: house encyclopedia design
ci/woodpecker/push/test Pipeline was successful
Details
ci/woodpecker/pr/test Pipeline was successful
Details
e560fd13a7 
Wikipedia-style, bilingual (de/en) articles generated from the wiki,
with public/private split via Authentik group, LAN/NetBird only.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
docs: encyclopedia on one host, gated by the app's own OIDC
ci/woodpecker/pr/test Pipeline was successful
Details
ci/woodpecker/push/test Pipeline was successful
Details
e240bea5b1 
wiki.renner.uno has been plain Traefik with in-app OIDC since homelab
2026-10-19; the gate-based two-hostname split no longer applies.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
docs: house encyclopedia implementation plan
ci/woodpecker/push/test Pipeline was successful
Details
ci/woodpecker/pr/test Pipeline was successful
Details
1d5df07ad0 
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
docs(encyclopedia): no netbird public label; generic examples stay public
ci/woodpecker/push/test Pipeline was successful
Details
ci/woodpecker/pr/test Pipeline was successful
Details
a42c978a99 
The wiki Ingress carries neither dns.renner.uno/public nor
netbird.renner.uno/public; either publishes the host via
netbird-service-sync.

The deterministic leak filter only counts this house's identifiers:
values found in the article's source notes, names under renner.uno, and
credentials. Reserved example values (RFC 5737, RFC 3849, RFC 2606)
never count. Writer and leak-check prompts keep generic examples public.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
docs(encyclopedia): drop credential handling
ci/woodpecker/pr/test Pipeline was successful
Details
ci/woodpecker/push/test Pipeline was successful
Details
206c4629aa 
Credentials in the wiki are an upstream failure, not a case the
encyclopedia handles: no credential scanner rule, no writer instruction.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
docs(encyclopedia): nightly run, fold in concept review
ci/woodpecker/push/test Pipeline was successful
Details
ci/woodpecker/pr/test Pipeline was successful
Details
e93da3990c 
Nightly schedule (RunAt 06:00, after the 04:30 distill) instead of a
run after every sync. Reconciler never stops the host; catalog
freshness gate; failure memory in articles/_state.json; a missing or
shrunken plan never deletes; translation unit by unit with structure
reassembled by the service; links and listings to private articles
dropped for anonymous readers; media paths validated; in-page 404;
PilotSlugs; Cache-Control no-store; mermaid strict.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
feat(core): Article document kind under articles/<lang>/ c2cffcb291 
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
feat(core): article body format and private-block redaction 23db9e9240 
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
fix(core): fail closed where the body scanner and CommonMark disagree b8e48b7d16 
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
fix(core): container lines in any fence and stray closers redact the rest 8c25e93cfb 
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
fix(core): only ASCII space and tab count as structural whitespace 013e6cd1e2 
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
feat(core): deterministic leak scanner for public article text ab41ef8088 
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
fix(core): leak scanner covers renner.uno forms, normalized addresses, more paths and entity domains 2a80cb20af 
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
feat(store): multi-file commit, text and binary read by path d6953db0e9 
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
fix(store): map missing binary to FileNotFound, harden text read and fakes 572d38ef31 
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
feat(anthropic): long-form text model port with typed unavailability 1ac1495a4d 
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
feat(encyclopedia): article-set planning and attempt memory 13de42b838 
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
fix(encyclopedia): compact plan JSON, sanitized note lines, robust state read 469cbf6bd2 
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
feat(encyclopedia): write, leak-check and translate pipeline 9d95ae17b0 
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
fix(encyclopedia): renumbered leak check, escaped notes, images private, fenced replies 8532e0e0c5 
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
feat(encyclopedia): incremental reconciler with single-commit writes ff0c07ec76 
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
fix(encyclopedia): symmetric frontmatter quoting, trimmed plan titles, commit before unexpected writer failure dad8c4bb63 
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
feat(host): run the encyclopedia nightly after a sync a99b8c9f06 
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
fix(host): make encyclopedia schedule tests deterministic and harden the loop 5b625a241f 
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
feat(host): article markdown rendering with redaction, infobox, TOC, mermaid 87f88a0fb6 
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
fix(host): allowlist article link targets, resolve wiki links before parsing, lock on leftovers 4d94c9ef9a 
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
fix(host): mark wiki links outside Markdig's own code spans, reject link-like targets cf75cef563 
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
feat(host): house encyclopedia pages with anonymous public view 82d70e4c60 
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
fix(core): detect IPv4 network prefixes written as .x, .*, .0/NN or a trailing dot 8314424f8b 
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
fix(host): show a model-unavailable error on the facts page instead of dropping the circuit 4e6fa1c4cc 
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
fix(anthropic): fail a stalled response stream after an idle timeout 6a9d8204a0 
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
fix(host): answer an anonymous request for a private article with the missing-article 404 3f5c41a075 
The 404 offers anonymous readers the login back to the requested path.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
fix(encyclopedia): leak-check slugs and titles, keep planned titles stable
ci/woodpecker/push/test Pipeline was successful
Details
ci/woodpecker/pr/test Pipeline was successful
Details
ca12438ebb 
A scanner hit in the slug or titles, or the German leak check flagging them, makes the article private in both languages. The plan prompt forbids concrete identifiers in titles and slugs and keeps existing titles; prompt version 5.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
k.renner merged commit da0f813fed into main 2026-10-25 14:48:36 +00:00
k.renner deleted branch feat/house-encyclopedia 2026-10-25 14:48:36 +00:00
Sign in to join this conversation.
Reviewers
No Reviewers
Labels
Clear labels
apollo
Hermes expert: Immich, Audiobookshelf, Libation, Navidrome, Music Assistant
 atlas
Hermes expert: Talos, Flux, network, Authentik, Matrix, monitoring
 clio
Hermes expert: Paperless, wiki, ical-proxy, TRMNL, websites
 daedalus
Hermes expert: Gitea, Woodpecker, Renovate, review-bot, Hermes
 hestia
Hermes expert: Home Assistant, IoT, MQTT, ESPHome, voice
No labels
Milestone
No items
No Milestone
Projects
Clear projects
No projects
Assignees
Clear assignees
alert-monitor-bot claude-bot (Claude Bot) hermes-bot issue-fix-bot k.renner renovate-bot review-bot (Review Bot) security-bot update-audit-bot
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: konairius/Wiki#17