-
Notifications
You must be signed in to change notification settings - Fork 0
Expand file tree
/
Copy pathscoring-sequence.puml
More file actions
51 lines (42 loc) · 1.86 KB
/
Copy pathscoring-sequence.puml
File metadata and controls
51 lines (42 loc) · 1.86 KB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
@startuml
skinparam shadowing false
title Governed automated-scoring sequence
actor Caller
participant "AssessmentSpec /\nRubricSpecification" as Spec
participant "ScoringRequest Factory" as Request
participant "ScoringEngine\n(Human / AI / External)" as Engine
participant "Observation Boundary" as Obs
participant "Facets Design Builder" as Facets
participant "Rust Calibration Core" as Rust
participant "Validation / Fairness" as Validate
participant "Report / Adjudication" as Report
Caller -> Spec : select exact approved versions/fingerprints
Caller -> Request : create request(response revision, task revision, engine policy)
Request -> Spec : replay contract provenance
Spec --> Request : verified
Request --> Caller : content-addressed ScoringRequest
Caller -> Engine : execute exact request
Engine --> Caller : untrusted/raw engine result
Caller -> Obs : construct governed ScoreObservation
Obs -> Request : replay request + criterion + evidence + engine identity
Request --> Obs : verified
Obs --> Caller : scored | abstained | failed | excluded
Caller -> Facets : assemble governed observations
Facets -> Obs : replay child provenance
Facets -> Facets : validate respondent-task and task-rater design
Facets --> Caller : criterion-specific design(s)
Caller -> Rust : fit exact design
Rust --> Caller : estimates + convergence + trace evidence
Caller -> Validate : validate fit/agreement/DIF/range/drift evidence
Validate --> Caller : validation evidence + review triggers
Caller -> Report : build source-text-minimized audit report
Report --> Caller : exact-value JSON/HTML + human review route
note over Obs,Facets
Terminal states remain distinct.
Abstention/failure is never coerced into a low score.
end note
note over Engine,Obs
Engine output is not trusted merely because it is valid JSON.
Provider/rater identity and exact task/response revision remain separate.
end note
@enduml