Commit df0000d
authored
feat: aggressive MarkLLM detection decisions (#23)
* feat(harness): decision engine for MarkLLM text detection
5-state verdicts (DETECTED/NOT_DETECTED/INCONCLUSIVE/UNSUPPORTED/ERROR)
so a negative under unknown provenance is never reported as clean.
- watermark writes <input>.wm.json sidecar (key_id, config hash, scheme,
implementation_commit); detect verifies it before allowing NOT_DETECTED
- --key-id operator assertion, --min-tokens, --abstention-band flags
- abstention band + min calibrated length qualify negatives only; a
positive detector observation is always reported DETECTED
- detector_verdict keeps the raw MarkLLM observation in the payload
* test(harness): lock aggressive positive verdicts
* feat(service): surface unresolved detector evidence
* docs(service): explain aggregate detection status
* no-mistakes(review): fix untrusted provenance, token gate, and detector-failure reporting
* no-mistakes(document): reformat over-long line in markllm detect test
* no-mistakes(document): align Gemini detector docs with disabled implementation
* no-mistakes(lint): remove stray blank line failing ruff format
* docs(readme): unify badge row into quiet slate/amber system
- reserve amber accent for pypi version + release only
- demote metadata badges to muted slate (30363d) values
- restyle CI as shields workflow badge with live status color
- replace social stars and classic blue license badges
- match dark label chips (0f1110) across all eight badges
* fix: address PR review findings
- README: unsupported schemes document UNSUPPORTED verdict, not INCONCLUSIVE
- detect/watermark CLI: catch OSError from config hashing, exit 3 instead of traceback
- gemini detector: oversize skip reports configured=true per contract docstring
- tests: environment-independent implementation_commit assertion
- tests: rename detect_json to detect_literal (Python dict literal, not JSON)
- tests: regression coverage for unreadable-config paths
* docs: narrow ERROR verdict wording to unscoreable detector results1 parent c88d914 commit df0000d
11 files changed
Lines changed: 1087 additions & 37 deletions
File tree
- skills/remove-ai-marks
- references
- scripts
- tests
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
70 | 70 | | |
71 | 71 | | |
72 | 72 | | |
73 | | - | |
74 | | - | |
75 | | - | |
76 | | - | |
| 73 | + | |
| 74 | + | |
| 75 | + | |
| 76 | + | |
| 77 | + | |
| 78 | + | |
77 | 79 | | |
78 | 80 | | |
79 | 81 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
2 | 2 | | |
3 | 3 | | |
4 | 4 | | |
5 | | - | |
6 | | - | |
7 | | - | |
8 | 5 | | |
9 | | - | |
10 | | - | |
11 | | - | |
| 6 | + | |
| 7 | + | |
| 8 | + | |
| 9 | + | |
| 10 | + | |
| 11 | + | |
12 | 12 | | |
13 | 13 | | |
14 | 14 | | |
| |||
296 | 296 | | |
297 | 297 | | |
298 | 298 | | |
299 | | - | |
| 299 | + | |
| 300 | + | |
300 | 301 | | |
301 | 302 | | |
302 | 303 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
27 | 27 | | |
28 | 28 | | |
29 | 29 | | |
30 | | - | |
31 | | - | |
| 30 | + | |
| 31 | + | |
32 | 32 | | |
33 | 33 | | |
34 | 34 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
52 | 52 | | |
53 | 53 | | |
54 | 54 | | |
55 | | - | |
| 55 | + | |
56 | 56 | | |
57 | 57 | | |
58 | 58 | | |
| |||
61 | 61 | | |
62 | 62 | | |
63 | 63 | | |
| 64 | + | |
| 65 | + | |
| 66 | + | |
| 67 | + | |
| 68 | + | |
| 69 | + | |
| 70 | + | |
| 71 | + | |
| 72 | + | |
64 | 73 | | |
65 | 74 | | |
66 | 75 | | |
| |||
92 | 101 | | |
93 | 102 | | |
94 | 103 | | |
95 | | - | |
96 | | - | |
| 104 | + | |
| 105 | + | |
97 | 106 | | |
98 | 107 | | |
99 | 108 | | |
100 | | - | |
101 | | - | |
102 | | - | |
103 | | - | |
| 109 | + | |
| 110 | + | |
| 111 | + | |
| 112 | + | |
| 113 | + | |
| 114 | + | |
| 115 | + | |
104 | 116 | | |
105 | 117 | | |
106 | 118 | | |
| |||
0 commit comments