konairius/Wiki
10
0
Fork 0
Code Issues Pull Requests 1 Packages Projects Releases Wiki Activity

Phase 6: rank evaluation (POST /api/v1/lab/eval) and Lab page #8

Merged
k.renner merged 3 commits from feat/lab into main 2026-09-24 14:57:42 +00:00
Conversation 1 Commits 3 Files Changed 9
+453 -1
3 Commits
Author SHA1 Message Date
claude-botandClaude Fable 5.1 707c5f50a7 Merge branch 'feat/answer-model' into feat/lab
ci/woodpecker/pr/test Pipeline was successful
Details
ci/woodpecker/push/test Pipeline was successful
Details 
Both phases register their use cases and map their endpoints in the same host
files. The lab host test asserted exactly one labelled query, which held only
while no other test in the shared fixture wrote to output/; it now checks the
seeded query is among the rows.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
 2026-09-24 16:53:49 +02:00
claude-botandClaude Fable 5.1 e28a403284 docs: list the lab eval endpoint
ci/woodpecker/push/test Pipeline was successful
Details
ci/woodpecker/pr/test Pipeline was successful
Details 
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
 2026-09-24 16:43:17 +02:00
claude-botandClaude Sonnet 5 23c891db8f feat(lab): rank evaluation use case, API and Lab page 
Adds EvaluateUseCase, the C# port of bin/wiki_rank_eval.py: every output/
document with a question and a sources list labels a query, gold is the
cited slugs that still exist as wiki notes, and RankUseCase ranks each
one to report recall@k, hit-rate@k, MRR and a one-hop recall variant that
also credits a gold note reachable from a top-k note by wikilink or
related:. Exposes it as POST /api/v1/lab/eval (write-policy) and a new
/lab page for running it against any registered embedding model and
comparing runs side by side.

Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
 2026-09-24 16:39:53 +02:00