Skip to content

LINK-AUDIT.md

Latest commit

 

History

History
386 lines (359 loc) · 23.9 KB

LINK-AUDIT.md

File metadata and controls

386 lines (359 loc) · 23.9 KB
Raw

Link Audit

Generated by tools/check_links.py. Re-run it to reproduce this file.

Summary

Field Value
Audit date 2026-08-23
Failure policy strict
Distinct link destinations 265
Reported from a recorded exemption, listed below 3
Reported from the status observed today 262
Resolved (200 or 206) 262
Did not resolve 0
Unresolved and not a known bot wall 0
PR-blocking unresolved (non-retryable 4xx or non-network error) 0
PR-warning unresolved (transient or other status) 0
arXiv titles compared with citation_title 129
arXiv titles agreeing 129
arXiv titles agreeing loosely (listed below) 0
arXiv title disagreements 0
arXiv identifiers compared with citation_arxiv_id 132
arXiv identifiers agreeing 132
arXiv identifiers with no meta tag 0
arXiv identifier disagreements 0
arXiv pages where a check could not run (unverified) 0
Repository chrome skipped, listed below 4

What This Checks, and What It Does Not

Checked: that every destination responds; that each arXiv page reports the identifier in its own URL; and that each arXiv entry's title in this list agrees with the citation_title the arXiv page reports. The third check is the one that can catch an entry pointing at a real but different paper.

Not checked: whether a summary sentence fairly describes the linked work, whether a venue field is correct, or whether a non-arXiv destination contains the claimed content. This repository's own badges and the GitHub pages behind them are also not checked, and each one is named under Repository Chrome Not Audited rather than counted as passing.

Reported rather than observed: a destination that refuses automated clients is fetched on every run, but its row reports the exemption recorded for it instead of the status it returned today, because that status depends on the address the audit runs from. This is what makes the file reproducible, so a difference between two runs means the list changed rather than that the caller moved. An excused destination that answers something its exemption does not record is reported on what it actually returned, and fails.

Titles count as agreeing only when they are identical after case folding and punctuation removal, so a near-identical title is never silently accepted. A remaining difference of 0.80 similarity or better is listed under Titles Agreeing Loosely for a human to confirm. A difference confined to a number, a roman numeral, or a word such as Part is treated as a disagreement at any similarity score, because that is the shape of a link to the wrong paper in a series.

The strict failure policy rejects every unexpected unresolved destination. The pull-request policy rejects non-retryable 4xx responses and non-network exceptions, but treats exhausted timeouts, connection errors, 408, 425, 429, 5xx, and other HTTP statuses as warnings.

Title Disagreements

None. Every arXiv entry with a title label agrees with the title its page reports.

Titles Agreeing Loosely

None.

Identifier Disagreements

None. Every arXiv page reports the identifier in its own URL.

Destinations That Did Not Return 200

None.

Destinations Reported From a Recorded Exemption

These destinations refuse automated clients, and each carries a recorded reason in KNOWN_BOT_WALLS in tools/check_links.py that was confirmed by hand in a browser. They are fetched on every run, but the table below reports the recorded exemption rather than the status observed today, because the observed status depends on where the audit runs: the same wall answers a workstation and a datacenter address differently. Reporting the observation made this file unreproducible, so the weekly job saw the committed report disagree with its own on every run and raised an alarm that never meant anything. The exemption still covers only the status it records. An excused destination that answers anything else appears in the section above and fails the audit.

Recorded status URL Recorded reason
202/403 https://eur-lex.europa.eu/eli/reg/2026/1744/oj EUR-Lex answers some non-browser clients with an empty 202 from its JavaScript gateway; the cited act (Digital Omnibus on AI, in force 27 July 2026) was confirmed against the European Commission announcement and independent legal summaries. EUR-Lex also refuses datacenter clients outright. Recorded 2026-08-24 after a GitHub runner answered 403 where only the 202 above was on file, which failed a contributor's pull request over a page that is fine: the same URL served 200 and 13,692 bytes of the act from a workstation on three consecutive requests the same day. Two statuses are recorded for this one destination because the wall's answer depends on who is asking, which is the property this report is built to stay stable against.
403 https://scholar.google.com/citations?user=zoGDYsoAAAAJ&hl=en Google Scholar serves 403 to datacenter clients, so this destination resolves from a workstation and fails from a GitHub-hosted runner; the profile was verified by hand in a browser.
403 https://www.iso.org/standard/42001 ISO returns 403 to non-browser clients; verified by hand in a browser.

Repository Chrome Not Audited

These destinations are this repository's own badges and the GitHub pages behind them, rather than resources this list cites. They are skipped for two reasons. GitHub rate- limits its own dynamic pages for shared CI addresses, and one such limit should not fail an audit of everyone else's links. A badge that points at this audit would also be able to decide the audit's result, which is a loop worth refusing. Every other github.com destination is audited, including this owner's other repositories.

URL
https://github.com/yzhao062/awesome-auditable-ai/actions/workflows/verify.yml
https://github.com/yzhao062/awesome-auditable-ai/actions/workflows/verify.yml/badge.svg
https://github.com/yzhao062/awesome-auditable-ai/commits/main
https://github.com/yzhao062/awesome-auditable-ai/graphs/contributors

Status Code Distribution

Status Count
200 262
exempt 3

Every Destination

# Status Identifier Title URL
1 200 n/a n/a https://a2a-protocol.org/v1.0.1/specification/
2 200 n/a n/a https://aclanthology.org/2024.eacl-demo.16/
3 200 n/a n/a https://aclanthology.org/2025.eval4nlp-1.12/
4 200 n/a n/a https://ap2-protocol.org/
5 200 n/a n/a https://artificialintelligenceact.eu/article/12/
6 200 match match https://arxiv.org/abs/1803.09010
7 200 match match https://arxiv.org/abs/1804.05741
8 200 match match https://arxiv.org/abs/1810.03993
9 200 match match https://arxiv.org/abs/2001.00973
10 200 match match https://arxiv.org/abs/2307.13854
11 200 match match https://arxiv.org/abs/2308.03688
12 200 match match https://arxiv.org/abs/2308.11432
13 200 match match https://arxiv.org/abs/2309.07864
14 200 match match https://arxiv.org/abs/2309.15817
15 200 match match https://arxiv.org/abs/2310.06770
16 200 match no title label https://arxiv.org/abs/2310.10501
17 200 match match https://arxiv.org/abs/2311.12983
18 200 match match https://arxiv.org/abs/2312.06674
19 200 match match https://arxiv.org/abs/2312.06942
20 200 match match https://arxiv.org/abs/2401.10019
21 200 match match https://arxiv.org/abs/2401.13138
22 200 match match https://arxiv.org/abs/2401.13178
23 200 match match https://arxiv.org/abs/2401.14446
24 200 match match https://arxiv.org/abs/2402.01680
25 200 match match https://arxiv.org/abs/2402.03578
26 200 match match https://arxiv.org/abs/2403.02691
27 200 match match https://arxiv.org/abs/2404.07972
28 200 match match https://arxiv.org/abs/2405.15793
29 200 match match https://arxiv.org/abs/2406.09187
30 200 match match https://arxiv.org/abs/2406.12045
31 200 match match https://arxiv.org/abs/2406.13352
32 200 match match https://arxiv.org/abs/2407.01502
33 200 match match https://arxiv.org/abs/2407.18901
34 200 match match https://arxiv.org/abs/2408.14972
35 200 match match https://arxiv.org/abs/2410.02644
36 200 match match https://arxiv.org/abs/2411.05285
37 200 match no title label https://arxiv.org/abs/2501.09674
38 200 match match https://arxiv.org/abs/2502.11127
39 200 match match https://arxiv.org/abs/2502.11448
40 200 match match https://arxiv.org/abs/2503.03704
41 200 match match https://arxiv.org/abs/2503.09648
42 200 match match https://arxiv.org/abs/2503.13657
43 200 match match https://arxiv.org/abs/2503.16416
44 200 match match https://arxiv.org/abs/2503.18666
45 200 match match https://arxiv.org/abs/2503.18813
46 200 match match https://arxiv.org/abs/2504.08942
47 200 match match https://arxiv.org/abs/2505.00212
48 200 match no title label https://arxiv.org/abs/2505.03574
49 200 match match https://arxiv.org/abs/2505.08638
50 200 match match https://arxiv.org/abs/2505.19234
51 200 match match https://arxiv.org/abs/2505.24201
52 200 match match https://arxiv.org/abs/2506.00641
53 200 match match https://arxiv.org/abs/2506.07982
54 200 match match https://arxiv.org/abs/2506.08837
55 200 match match https://arxiv.org/abs/2506.14866
56 200 match match https://arxiv.org/abs/2507.05257
57 200 match match https://arxiv.org/abs/2508.00500
58 200 match match https://arxiv.org/abs/2508.01249
59 200 match match https://arxiv.org/abs/2508.19461
60 200 match match https://arxiv.org/abs/2509.03312
61 200 match match https://arxiv.org/abs/2509.07764
62 200 match match https://arxiv.org/abs/2509.14295
63 200 match match https://arxiv.org/abs/2509.23735
64 200 match match https://arxiv.org/abs/2509.25238
65 200 match match https://arxiv.org/abs/2509.25370
66 200 match match https://arxiv.org/abs/2510.04886
67 200 match match https://arxiv.org/abs/2510.09462
68 200 match match https://arxiv.org/abs/2510.11203
69 200 match match https://arxiv.org/abs/2510.17149
70 200 match match https://arxiv.org/abs/2512.08290
71 200 match match https://arxiv.org/abs/2512.23738
72 200 match match https://arxiv.org/abs/2601.00516
73 200 match match https://arxiv.org/abs/2601.06112
74 200 match match https://arxiv.org/abs/2601.11868
75 200 match match https://arxiv.org/abs/2601.20727
76 200 match match https://arxiv.org/abs/2602.02475
77 200 match match https://arxiv.org/abs/2602.11348
78 200 match match https://arxiv.org/abs/2602.11619
79 200 match match https://arxiv.org/abs/2602.14849
80 200 match match https://arxiv.org/abs/2602.16666
81 200 match match https://arxiv.org/abs/2603.06847
82 200 match match https://arxiv.org/abs/2603.10749
83 200 match match https://arxiv.org/abs/2603.20625
84 200 match match https://arxiv.org/abs/2603.22489
85 200 match match https://arxiv.org/abs/2603.22853
86 200 match match https://arxiv.org/abs/2603.22868
87 200 match match https://arxiv.org/abs/2603.22928
88 200 match match https://arxiv.org/abs/2603.25001
89 200 match match https://arxiv.org/abs/2603.29231
90 200 match match https://arxiv.org/abs/2604.05485
91 200 match match https://arxiv.org/abs/2604.08523
92 200 match match https://arxiv.org/abs/2604.09408
93 200 match match https://arxiv.org/abs/2604.13954
94 200 match match https://arxiv.org/abs/2604.17658
95 200 match match https://arxiv.org/abs/2604.22708
96 200 match match https://arxiv.org/abs/2604.23280
97 200 match match https://arxiv.org/abs/2604.24477
98 200 match match https://arxiv.org/abs/2605.06455
99 200 match match https://arxiv.org/abs/2605.06788
100 200 match match https://arxiv.org/abs/2605.06812
101 200 match match https://arxiv.org/abs/2605.10912
102 200 match match https://arxiv.org/abs/2605.12366
103 200 match match https://arxiv.org/abs/2605.12673
104 200 match match https://arxiv.org/abs/2605.14421
105 200 match match https://arxiv.org/abs/2605.16626
106 200 match match https://arxiv.org/abs/2605.17169
107 200 match match https://arxiv.org/abs/2605.21384
108 200 match match https://arxiv.org/abs/2605.21997
109 200 match match https://arxiv.org/abs/2605.22333
110 200 match match https://arxiv.org/abs/2605.26563
111 200 match match https://arxiv.org/abs/2605.29801
112 200 match match https://arxiv.org/abs/2606.00765
113 200 match match https://arxiv.org/abs/2606.02060
114 200 match match https://arxiv.org/abs/2606.03467
115 200 match match https://arxiv.org/abs/2606.04769
116 200 match match https://arxiv.org/abs/2606.04990
117 200 match match https://arxiv.org/abs/2606.13385
118 200 match match https://arxiv.org/abs/2606.22741
119 200 match match https://arxiv.org/abs/2606.24626
120 200 match match https://arxiv.org/abs/2606.25189
121 200 match match https://arxiv.org/abs/2607.02357
122 200 match match https://arxiv.org/abs/2607.08400
123 200 match match https://arxiv.org/abs/2607.09510
124 200 match match https://arxiv.org/abs/2607.09996
125 200 match match https://arxiv.org/abs/2607.10059
126 200 match match https://arxiv.org/abs/2607.11086
127 200 match match https://arxiv.org/abs/2607.12747
128 200 match no title label https://arxiv.org/abs/2607.18754
129 200 match match https://arxiv.org/abs/2607.20121
130 200 match match https://arxiv.org/abs/2607.27080
131 200 match match https://arxiv.org/abs/2608.02643
132 200 match match https://arxiv.org/abs/2608.05204
133 200 match match https://arxiv.org/abs/2608.05212
134 200 match match https://arxiv.org/abs/2608.06477
135 200 match match https://arxiv.org/abs/2608.06701
136 200 match no title label https://arxiv.org/abs/2608.07346
137 200 match match https://arxiv.org/abs/2608.07899
138 200 n/a n/a https://atlas.mitre.org/
139 200 n/a n/a https://auditable-agents.github.io/
140 200 n/a n/a https://awesome.re
141 200 n/a n/a https://awesome.re/badge-flat2.svg
142 200 n/a n/a https://claw-bench.com/
143 200 n/a n/a https://cloudsecurityalliance.org/blog/2025/02/06/agentic-ai-threat-modeling-framework-maestro
144 200 n/a n/a https://contrib.rocks/image?repo=yzhao062/awesome-auditable-ai
145 200 n/a n/a https://creativecommons.org/publicdomain/zero/1.0/
146 200 n/a n/a https://cwe.mitre.org/data/definitions/1427.html
147 exempt n/a n/a https://eur-lex.europa.eu/eli/reg/2026/1744/oj
148 200 n/a n/a https://genai.owasp.org/llm-top-10/
149 200 n/a n/a https://genai.owasp.org/resource/owasp-top-10-for-agentic-applications-for-2026/
150 200 n/a n/a https://genai.owasp.org/resource/securing-agentic-applications-guide-1-0/
151 200 n/a n/a https://github.com/33k0/PALADIN-Framework
152 200 n/a n/a https://github.com/AgentDebugX/AgentDebugX
153 200 n/a n/a https://github.com/AgentOps-AI/agentops
154 200 n/a n/a https://github.com/Arize-ai/openinference
155 200 n/a n/a https://github.com/Arize-ai/phoenix
156 200 n/a n/a https://github.com/Asaf-Yehudai/LLM-Agent-Evaluation-Survey
157 200 n/a n/a https://github.com/FU-max-boop/agentrunproof
158 200 n/a n/a https://github.com/Giskard-AI/giskard-oss
159 200 n/a n/a https://github.com/HeadyZhang/agent-audit
160 200 n/a n/a https://github.com/Helicone/helicone
161 200 n/a n/a https://github.com/JialongZhou666/GUARDIAN
162 200 n/a n/a https://github.com/Justin0504/Aegis
163 200 n/a n/a https://github.com/LogAnalysisTech/TrajAudit
164 200 n/a n/a https://github.com/McGill-NLP/agent-reward-bench
165 200 n/a n/a https://github.com/Minqi824/ADBench
166 200 n/a n/a https://github.com/NVIDIA-NeMo/Guardrails
167 200 n/a n/a https://github.com/NVIDIA/garak
168 200 n/a n/a https://github.com/Paitesanshi/LLM-Agent-Survey
169 200 n/a n/a https://github.com/SWE-agent/SWE-agent
170 200 n/a n/a https://github.com/SWE-bench/SWE-bench
171 200 n/a n/a https://github.com/SaFo-Lab/AGrail4Agent
172 200 n/a n/a https://github.com/StakeBench/SBC
173 200 n/a n/a https://github.com/THUDM/AgentBench
174 200 n/a n/a https://github.com/TIGER-AI-Lab/ClawBench
175 200 n/a n/a https://github.com/TraceElephant/TraceElephant
176 200 n/a n/a https://github.com/TransluceAI/docent
177 200 n/a n/a https://github.com/UKGovernmentBEIS/inspect_ai
178 200 n/a n/a https://github.com/USC-FORTIS
179 200 n/a n/a https://github.com/WaseemGhanem98/AgentCheck
180 200 n/a n/a https://github.com/WooooDyy/LLM-Agent-Paper-List
181 200 n/a n/a https://github.com/ag2ai/Agents_Failure_Attribution
182 200 n/a n/a https://github.com/agentkitai/agentlens
183 200 n/a n/a https://github.com/agentrust-io/trace-spec
184 200 n/a n/a https://github.com/benchjack/benchjack
185 200 n/a n/a https://github.com/benediktstroebl/agent-evals
186 200 n/a n/a https://github.com/bingreeky/AgenTracer
187 200 n/a n/a https://github.com/bkuan001/halo-record
188 200 n/a n/a https://github.com/breckbaldwin/llm-stability
189 200 n/a n/a https://github.com/ceodaradigu/proofline-agent
190 200 n/a n/a https://github.com/chanchimin/AgentMonitor
191 200 n/a n/a https://github.com/comet-ml/opik
192 200 n/a n/a https://github.com/confident-ai/deepeval
193 200 n/a n/a https://github.com/contentauth/c2pa-rs
194 200 n/a n/a https://github.com/datamllab/A2E
195 200 n/a n/a https://github.com/e2b-dev/E2B
196 200 n/a n/a https://github.com/ethz-spylab/agentdojo
197 200 n/a n/a https://github.com/evidentlyai/evidently
198 200 n/a n/a https://github.com/google-research/camel-prompt-injection
199 200 n/a n/a https://github.com/guardagent/code
200 200 n/a n/a https://github.com/guardrails-ai/guardrails
201 200 n/a n/a https://github.com/haoyuwang99/ProbGuard
202 200 n/a n/a https://github.com/harbor-framework/terminal-bench
203 200 n/a n/a https://github.com/in-toto/attestation
204 200 n/a n/a https://github.com/kfq20/AEGIS
205 200 n/a n/a https://github.com/langfuse/langfuse
206 200 n/a n/a https://github.com/lindixu6-hash/awesome-agentic-engineering
207 200 n/a n/a https://github.com/lmnr-ai/lmnr
208 200 n/a n/a https://github.com/m4p1e/agent-sentinel
209 200 n/a n/a https://github.com/makerchecker/MakerChecker
210 200 n/a n/a https://github.com/meta-llama/PurpleLlama
211 200 n/a n/a https://github.com/microsoft/AgentRx
212 200 n/a n/a https://github.com/microsoft/agent-governance-toolkit
213 200 n/a n/a https://github.com/mingyin1/Agents_Failure_Attribution
214 200 n/a n/a https://github.com/mitre-atlas/atlas-data/releases/tag/v2026.07
215 200 n/a n/a https://github.com/modelcontextprotocol/modelcontextprotocol
216 200 n/a n/a https://github.com/multi-agent-systems-failure-taxonomy/MAST
217 200 n/a n/a https://github.com/nyit-vancouver/mcp-security
218 200 n/a n/a https://github.com/open-telemetry/semantic-conventions-genai
219 200 n/a n/a https://github.com/rgreenblatt/control-evaluations
220 200 n/a n/a https://github.com/secure-systems-lab/dsse
221 200 n/a n/a https://github.com/sierra-research/tau-bench
222 200 n/a n/a https://github.com/sigstore/rekor
223 200 n/a n/a https://github.com/snyk/agent-scan
224 200 n/a n/a https://github.com/splx-ai/agentic-radar
225 200 n/a n/a https://github.com/superradcompany/microsandbox
226 200 n/a n/a https://github.com/taichengguo/LLM_MultiAgents_Survey_Papers
227 200 n/a n/a https://github.com/traceloop/openllmetry
228 200 n/a n/a https://github.com/truera/trulens
229 200 n/a n/a https://github.com/uiuc-kang-lab/InjecAgent
230 200 n/a n/a https://github.com/ulab-uiuc/AgentDebug
231 200 n/a n/a https://github.com/ulab-uiuc/AgentProtocols
232 200 n/a n/a https://github.com/vibrantlabsai/ragas
233 200 n/a n/a https://github.com/victorojewale/audit-trail-PoC
234 200 n/a n/a https://github.com/web-arena-x/webarena
235 200 n/a n/a https://github.com/whowhenpro/whowhen_pro
236 200 n/a n/a https://github.com/wslong20/G-safeguard
237 200 n/a n/a https://github.com/xiaoqi-7/Agent-Tracing-Survey
238 200 n/a n/a https://github.com/xlang-ai/OSWorld
239 200 n/a n/a https://github.com/yoheinakajima/activegraph
240 200 n/a n/a https://github.com/yzhao062
241 200 n/a n/a https://github.com/yzhao062/auditable
242 200 n/a n/a https://github.com/yzhao062/catchbench
243 200 n/a n/a https://github.com/yzhao062/grade
244 200 n/a n/a https://github.com/yzhao062/pyod
245 200 n/a n/a https://huggingface.co/datasets/E-k-O/PaladinData
246 200 n/a n/a https://huggingface.co/datasets/Fancylalala/AEGIS
247 200 n/a n/a https://huggingface.co/datasets/PatronusAI/TRAIL
248 200 n/a n/a https://huggingface.co/datasets/gaia-benchmark/GAIA
249 200 n/a n/a https://huggingface.co/meta-llama/LlamaGuard-7b
250 200 n/a n/a https://img.shields.io/badge/PRs-welcome-blue.svg
251 200 n/a n/a https://img.shields.io/badge/license-CC0--1.0-blue.svg
252 200 n/a n/a https://img.shields.io/github/last-commit/yzhao062/awesome-auditable-ai
253 200 n/a n/a https://in-toto.io/
254 200 n/a n/a https://modelcontextprotocol.io/specification/latest
255 200 n/a n/a https://nvlpubs.nist.gov/nistpubs/ai/NIST.AI.600-1.pdf
256 200 n/a n/a https://nvlpubs.nist.gov/nistpubs/ai/nist.ai.100-1.pdf
257 200 n/a n/a https://proceedings.mlr.press/v267/south25a.html
258 exempt n/a n/a https://scholar.google.com/citations?user=zoGDYsoAAAAJ&hl=en
259 200 n/a n/a https://slsa.dev/spec/v1.0/
260 200 n/a n/a https://spec.c2pa.org/specifications/specifications/2.2/specs/_attachments/C2PA_Specification.pdf
261 200 n/a n/a https://whowhenpro.github.io/
262 exempt n/a n/a https://www.iso.org/standard/42001
263 200 n/a n/a https://www.langchain.com/langsmith-platform
264 200 n/a n/a https://www.rfc-editor.org/rfc/rfc6962
265 200 n/a n/a https://www.rfc-editor.org/rfc/rfc9162