Eval Case

One repeatable test of an agent, lifted from a /wrong-answer report: the prompt that produced a bad answer, the node the answer had to read, the value it must not invent and the value it should state. Run N times against the agent; scored on the answer's own ThreadMessage record — did it look, did it invent, did it get it right. Stored under Feedback/_Evals/{agentId}/{case}, written as System. Compiled live from Source/.

Configuration: config => config.WithContentType<EvalCaseContent>().LiftOnActivation().StampConfirmationOnActivation().AddDefaultLayoutAreas().AddLayout(layout => layout.AddEvalCaseLayoutAreas().WithView("Tests", EvalCaseTestsArea.Tests).WithDefaultArea("Eval"))
Include global types: yes
Cell surface: no
Owns partition: no
Keeps history: yes
Sources: namespace:Source scope:subtree, shared=@Feedback/Feedback/Source/FeedbackContent, shared=@Feedback/Feedback/Source/WrongAnswerReport
Stamped fields: confirmedBy
Compilation status: 3
Last compile started at: 2026-10-29T17:42:22.6440258+00:00
Last compile succeeded at: 2026-10-30T07:11:09.4188127+00:00
Last compiled version: 326
Last compilation activity path: Feedback/EvalCase/_Activity/compile-20261029174222650fb9156520125429fbece9793ab3df502
Latest release path: Feedback/EvalCase/Release/20261029174348-T8PySUp5
Requested release at: 2026-10-29T16:30:23.3398651+00:00
Requested release force: no
Last release request handled at: 2026-10-29T16:30:23.3398651+00:00
Latest assembly collection: local
Latest assembly path: Feedback_EvalCase/v326-c003e001-ebd985ed3248.dll
Latest assembly mvid: c765e8bf47f94e42bfe1c8ea3fea71c4
Compiled sources › Feedback/ eval case/ source/ eval runner: 639274389430619550
Compiled sources › Feedback/ eval case/ source/ eval scoring: 639262027449048090
Compiled sources › Feedback/ eval case/ test/ eval case tests: 639265699592928510
Compiled sources › Feedback/ eval case/ source/ eval case content: 639274389430593620
Compiled sources › Feedback/ eval case/ source/ eval case lifting: 639265699592829440
Compiled sources › Feedback/ eval case/ test/ eval case tests area: 639265699592292680
Compiled sources › Feedback/ feedback/ source/ feedback content: 639288882139663800
Compiled sources › Feedback/ feedback/ source/ wrong answer report: 639265699592112710
Compiled sources › Feedback/ eval case/ source/ eval case layout areas: 639275209966795590
Compiled sources › Feedback/ eval case/ source/ eval case confirmation: 639275209966799160
Current source versions › Feedback/ eval case/ source/ eval runner: 639274389430619550
Current source versions › Feedback/ eval case/ source/ eval scoring: 639262027449048090
Current source versions › Feedback/ eval case/ test/ eval case tests: 639265699592928510
Current source versions › Feedback/ eval case/ source/ eval case content: 639274389430593620
Current source versions › Feedback/ eval case/ source/ eval case lifting: 639265699592829440
Current source versions › Feedback/ eval case/ test/ eval case tests area: 639265699592292680
Current source versions › Feedback/ feedback/ source/ feedback content: 639288882139663800
Current source versions › Feedback/ feedback/ source/ wrong answer report: 639265699592112710
Current source versions › Feedback/ eval case/ source/ eval case layout areas: 639275209966795590
Current source versions › Feedback/ eval case/ source/ eval case confirmation: 639275209966799160
Adopted source fingerprint: ed54340b6a557e41
Adopted source paths: Feedback/EvalCase/Source/EvalCaseConfirmation, Feedback/EvalCase/Source/EvalCaseContent, Feedback/EvalCase/Source/EvalCaseLayoutAreas, Feedback/EvalCase/Source/EvalCaseLifting, Feedback/EvalCase/Source/EvalRunner, Feedback/EvalCase/Source/EvalScoring, Feedback/EvalCase/Test/EvalCaseTests, Feedback/EvalCase/Test/EvalCaseTestsArea, Feedback/Feedback/Source/FeedbackContent, Feedback/Feedback/Source/WrongAnswerReport
Current source fingerprint: ed54340b6a557e41
Build provenance: 1
Adopted module version: 1.10.8
Current module version: 1.11
Built module version: 1.10.8
Built module version mvid: c765e8bf47f94e42bfe1c8ea3fea71c4
Compiled framework version: c003e001
Compiled platform version: 3.1.12090
Compiled modules hash: 613fd1ed5e94a8d3a6438e11d0241156b4c03b0c523fa4ac4ce3687ae68634ca
Compiled dependencies › !input: i158a3ecdc1eb338e4f36723daebda6a3
Compiled dependencies › !toolchain: compat:c003e001
Compiled dependencies › Mesh weaver. aI: min:3.1.0.0
Compiled dependencies › Mesh weaver. data: compat:c003e001
Compiled dependencies › Mesh weaver. graph: compat:c003e001
Compiled dependencies › Mesh weaver. layout: compat:c003e001
Compiled dependencies › Mesh weaver. mesh. contract: compat:c003e001
Compiled dependencies › Mesh weaver. messaging. contract: compat:c003e001
Compiled dependencies › Mesh weaver. messaging. hub: compat:c003e001
Compiled dependencies › Mesh weaver. utils: compat:c003e001