Skip to content

Weekly link audit needs attention #9

Description

@github-actions

The strict audit passed, but the regenerated report changed substantively.

Current README inventory

entries (occurrences)      186
  across sections          9
    Surveys and Foundations                          8
    Failure Attribution and Diagnosis                25
    Reliability and Robustness                       11
    Runtime Monitoring and Guardrails                28
    Audit Trails and Decision Records                18
    Security Auditing and Scanners                   23
    Datasets and Benchmarks                          29
    Tools and Platforms                              20
    Standards and Governance                         24
table rows                 134
  venue named              69
  labelled Preprint        65
arXiv links (occurrences)  132
arXiv papers (unique)      131
  repeated arXiv URL       1 ['2601.06112']
cross-listed papers        5
    aegis automated error generation and attribution for multi agent
    bench a benchmark for tool agent user interaction in real world 
    reliabilitybench evaluating llm agent reliability under producti
    trail trace reasoning and agentic issue localization
    which agent causes task failures and when on automated failure a
GitHub repositories        85
Standards section labels   {'Standard': 16, 'Framework': 1, 'Tool': 1}

Audit diagnostics

Summary

Field Value
Audit date 2026-08-16
Failure policy strict
Distinct link destinations 258
Resolved (200 or 206) 256
Did not resolve 2
Unresolved and not a known bot wall 0
PR-blocking unresolved (non-retryable 4xx or non-network error) 0
PR-warning unresolved (transient or other status) 0
arXiv titles compared with citation_title 129
arXiv titles agreeing 129
arXiv titles agreeing loosely (listed below) 0
arXiv title disagreements 0
arXiv identifiers compared with citation_arxiv_id 131
arXiv identifiers agreeing 131
arXiv identifiers with no meta tag 0
arXiv identifier disagreements 0
arXiv pages where a check could not run (unverified) 0
Repository chrome skipped, listed below 3

Title Disagreements

None. Every arXiv entry with a title label agrees with the title its page reports.

Identifier Disagreements

None. Every arXiv page reports the identifier in its own URL.

Destinations That Did Not Return 200

A non-200 result is not automatically a dead link: some publishers refuse automated
requests. Destinations listed in KNOWN_BOT_WALLS in tools/check_links.py carry a
recorded reason and were confirmed by hand. The strict policy fails every other row;
the pull-request policy applies the narrower rule described above.

Status URL Note
403 https://scholar.google.com/citations?user=zoGDYsoAAAAJ&hl=en Google Scholar serves 403 to datacenter clients, so this destination resolves from a workstation and fails from a GitHub-hosted runner; the profile was verified by hand in a browser.
403 https://www.iso.org/standard/42001 ISO returns 403 to non-browser clients; verified by hand in a browser.

Audit command output

... earlier command output omitted.
match https://arxiv.org/abs/2608.02643
[132/258] 200 match https://arxiv.org/abs/2608.05204
[133/258] 200 match https://arxiv.org/abs/2608.05212
[134/258] 200 match https://arxiv.org/abs/2608.06477
[135/258] 200 match https://arxiv.org/abs/2608.06701
[136/258] 200 match https://arxiv.org/abs/2608.07899
[137/258] 200 n/a https://atlas.mitre.org/
[138/258] 200 n/a https://auditable-agents.github.io/
[139/258] 200 n/a https://awesome.re
[140/258] 200 n/a https://awesome.re/badge-flat2.svg
[141/258] 200 n/a https://claw-bench.com/
[142/258] 200 n/a https://cloudsecurityalliance.org/blog/2025/02/06/agentic-ai-threat-modeling-framework-maestro
[143/258] 200 n/a https://creativecommons.org/publicdomain/zero/1.0/
[144/258] 200 n/a https://cwe.mitre.org/data/definitions/1427.html
[145/258] 200 n/a https://eur-lex.europa.eu/eli/reg/2026/1744/oj
[146/258] 200 n/a https://genai.owasp.org/llm-top-10/
[147/258] 200 n/a https://genai.owasp.org/resource/owasp-top-10-for-agentic-applications-for-2026/
[148/258] 200 n/a https://genai.owasp.org/resource/securing-agentic-applications-guide-1-0/
[149/258] 200 n/a https://github.com/33k0/PALADIN-Framework
[150/258] 200 n/a https://github.com/AgentDebugX/AgentDebugX
[151/258] 200 n/a https://github.com/AgentOps-AI/agentops
[152/258] 200 n/a https://github.com/Arize-ai/openinference
[153/258] 200 n/a https://github.com/Arize-ai/phoenix
[154/258] 200 n/a https://github.com/Asaf-Yehudai/LLM-Agent-Evaluation-Survey
[155/258] 200 n/a https://github.com/FU-max-boop/agentrunproof
[156/258] 200 n/a https://github.com/Giskard-AI/giskard-oss
[157/258] 200 n/a https://github.com/HeadyZhang/agent-audit
[158/258] 200 n/a https://github.com/Helicone/helicone
[159/258] 200 n/a https://github.com/JialongZhou666/GUARDIAN
[160/258] 200 n/a https://github.com/Justin0504/Aegis
[161/258] 200 n/a https://github.com/LogAnalysisTech/TrajAudit
[162/258] 200 n/a https://github.com/McGill-NLP/agent-reward-bench
[163/258] 200 n/a https://github.com/Minqi824/ADBench
[164/258] 200 n/a https://github.com/NVIDIA-NeMo/Guardrails
[165/258] 200 n/a https://github.com/NVIDIA/garak
[166/258] 200 n/a https://github.com/Paitesanshi/LLM-Agent-Survey
[167/258] 200 n/a https://github.com/SWE-agent/SWE-agent
[168/258] 200 n/a https://github.com/SWE-bench/SWE-bench
[169/258] 200 n/a https://github.com/SaFo-Lab/AGrail4Agent
[170/258] 200 n/a https://github.com/StakeBench/SBC
[171/258] 200 n/a https://github.com/THUDM/AgentBench
[172/258] 200 n/a https://github.com/TIGER-AI-Lab/ClawBench
[173/258] 200 n/a https://github.com/TraceElephant/TraceElephant
[174/258] 200 n/a https://github.com/TransluceAI/docent
[175/258] 200 n/a https://github.com/UKGovernmentBEIS/inspect_ai
[176/258] 200 n/a https://github.com/USC-FORTIS
[177/258] 200 n/a https://github.com/WooooDyy/LLM-Agent-Paper-List
[178/258] 200 n/a https://github.com/ag2ai/Agents_Failure_Attribution
[179/258] 200 n/a https://github.com/agentkitai/agentlens
[180/258] 200 n/a https://github.com/agentrust-io/trace-spec
[181/258] 200 n/a https://github.com/benchjack/benchjack
[182/258] 200 n/a https://github.com/benediktstroebl/agent-evals
[183/258] 200 n/a https://github.com/bingreeky/AgenTracer
[184/258] 200 n/a https://github.com/bkuan001/halo-record
[185/258] 200 n/a https://github.com/breckbaldwin/llm-stability
[186/258] 200 n/a https://github.com/chanchimin/AgentMonitor
[187/258] 200 n/a https://github.com/comet-ml/opik
[188/258] 200 n/a https://github.com/confident-ai/deepeval
[189/258] 200 n/a https://github.com/contentauth/c2pa-rs
[190/258] 200 n/a https://github.com/e2b-dev/E2B
[191/258] 200 n/a https://github.com/ethz-spylab/agentdojo
[192/258] 200 n/a https://github.com/evidentlyai/evidently
[193/258] 200 n/a https://github.com/google-research/camel-prompt-injection
[194/258] 200 n/a https://github.com/guardagent/code
[195/258] 200 n/a https://github.com/guardrails-ai/guardrails
[196/258] 200 n/a https://github.com/haoyuwang99/ProbGuard
[197/258] 200 n/a https://github.com/harbor-framework/terminal-bench
[198/258] 200 n/a https://github.com/in-toto/attestation
[199/258] 200 n/a https://github.com/kfq20/AEGIS
[200/258] 200 n/a https://github.com/langfuse/langfuse
[201/258] 200 n/a https://github.com/lmnr-ai/lmnr
[202/258] 200 n/a https://github.com/m4p1e/agent-sentinel
[203/258] 200 n/a https://github.com/makerchecker/MakerChecker
[204/258] 200 n/a https://github.com/meta-llama/PurpleLlama
[205/258] 200 n/a https://github.com/microsoft/AgentRx
[206/258] 200 n/a https://github.com/microsoft/agent-governance-toolkit
[207/258] 200 n/a https://github.com/mingyin1/Agents_Failure_Attribution
[208/258] 200 n/a https://github.com/mitre-atlas/atlas-data/releases/tag/v2026.07
[209/258] 200 n/a https://github.com/modelcontextprotocol/modelcontextprotocol
[210/258] 200 n/a https://github.com/multi-agent-systems-failure-taxonomy/MAST
[211/258] 200 n/a https://github.com/nyit-vancouver/mcp-security
[212/258] 200 n/a https://github.com/open-telemetry/semantic-conventions-genai
[213/258] 200 n/a https://github.com/rgreenblatt/control-evaluations
[214/258] 200 n/a https://github.com/secure-systems-lab/dsse
[215/258] 200 n/a https://github.com/sierra-research/tau-bench
[216/258] 200 n/a https://github.com/sigstore/rekor
[217/258] 200 n/a https://github.com/snyk/agent-scan
[218/258] 200 n/a https://github.com/splx-ai/agentic-radar
[219/258] 200 n/a https://github.com/superradcompany/microsandbox
[220/258] 200 n/a https://github.com/taichengguo/LLM_MultiAgents_Survey_Papers
[221/258] 200 n/a https://github.com/traceloop/openllmetry
[222/258] 200 n/a https://github.com/truera/trulens
[223/258] 200 n/a https://github.com/uiuc-kang-lab/InjecAgent
[224/258] 200 n/a https://github.com/ulab-uiuc/AgentDebug
[225/258] 200 n/a https://github.com/ulab-uiuc/AgentProtocols
[226/258] 200 n/a https://github.com/vibrantlabsai/ragas
[227/258] 200 n/a https://github.com/victorojewale/audit-trail-PoC
[228/258] 200 n/a https://github.com/web-arena-x/webarena
[229/258] 200 n/a https://github.com/whowhenpro/whowhen_pro
[230/258] 200 n/a https://github.com/wslong20/G-safeguard
[231/258] 200 n/a https://github.com/xiaoqi-7/Agent-Tracing-Survey
[232/258] 200 n/a https://github.com/xlang-ai/OSWorld
[233/258] 200 n/a https://github.com/yoheinakajima/activegraph
[234/258] 200 n/a https://github.com/yzhao062
[235/258] 200 n/a https://github.com/yzhao062/auditable
[236/258] 200 n/a https://github.com/yzhao062/grade
[237/258] 200 n/a https://github.com/yzhao062/pyod
[238/258] 200 n/a https://huggingface.co/datasets/E-k-O/PaladinData
[239/258] 200 n/a https://huggingface.co/datasets/Fancylalala/AEGIS
[240/258] 200 n/a https://huggingface.co/datasets/PatronusAI/TRAIL
[241/258] 200 n/a https://huggingface.co/datasets/gaia-benchmark/GAIA
[242/258] 200 n/a https://huggingface.co/meta-llama/LlamaGuard-7b
[243/258] 200 n/a https://img.shields.io/badge/PRs-welcome-blue.svg
[244/258] 200 n/a https://img.shields.io/badge/license-CC0--1.0-blue.svg
[245/258] 200 n/a https://img.shields.io/github/last-commit/yzhao062/awesome-auditable-ai
[246/258] 200 n/a https://in-toto.io/
[247/258] 200 n/a https://modelcontextprotocol.io/specification/latest
[248/258] 200 n/a https://nvlpubs.nist.gov/nistpubs/ai/NIST.AI.600-1.pdf
[249/258] 200 n/a https://nvlpubs.nist.gov/nistpubs/ai/nist.ai.100-1.pdf
[250/258] 200 n/a https://proceedings.mlr.press/v267/south25a.html
[251/258] 403 n/a https://scholar.google.com/citations?user=zoGDYsoAAAAJ&hl=en
[252/258] 200 n/a https://slsa.dev/spec/v1.0/
[253/258] 200 n/a https://spec.c2pa.org/specifications/specifications/2.2/specs/_attachments/C2PA_Specification.pdf
[254/258] 200 n/a https://whowhenpro.github.io/
[255/258] 403 n/a https://www.iso.org/standard/42001
[256/258] 200 n/a https://www.langchain.com/langsmith-platform
[257/258] 200 n/a https://www.rfc-editor.org/rfc/rfc6962
[258/258] 200 n/a https://www.rfc-editor.org/rfc/rfc9162
wrote LINK-AUDIT.md: 258 destinations, 256 resolved, 129 title checks, 0 unverified, 0 failures, 0 warnings

Substantive report diff

diff --git a/LINK-AUDIT.md b/LINK-AUDIT.md
index 6824365..041d7bc 100644
--- a/LINK-AUDIT.md
+++ b/LINK-AUDIT.md
@@ -10,6 +10,6 @@ Generated by `tools/check_links.py`. Re-run it to reproduce this file.
 | Failure policy | `strict` |
 | Distinct link destinations | 258 |
-| Resolved (200 or 206) | 258 |
-| Did not resolve | 0 |
+| Resolved (200 or 206) | 256 |
+| Did not resolve | 2 |
 | Unresolved and not a known bot wall | 0 |
 | PR-blocking unresolved (non-retryable 4xx or non-network error) | 0 |
@@ -63,5 +63,13 @@ None. Every arXiv page reports the identifier in its own URL.
 ## Destinations That Did Not Return 200
 
-None.
+A non-200 result is not automatically a dead link: some publishers refuse automated
+requests. Destinations listed in `KNOWN_BOT_WALLS` in `tools/check_links.py` carry a
+recorded reason and were confirmed by hand. The strict policy fails every other row;
+the pull-request policy applies the narrower rule described above.
+
+| Status | URL | Note |
+|---|---|---|
+| 403 | https://scholar.google.com/citations?user=zoGDYsoAAAAJ&hl=en | Google Scholar serves 403 to datacenter clients, so this destination resolves from a workstation and fails from a GitHub-hosted runner; the profile was verified by hand in a browser. |
+| 403 | https://www.iso.org/standard/42001 | ISO returns 403 to non-browser clients; verified by hand in a browser. |
 
 ## Repository Chrome Not Audited
@@ -84,5 +92,6 @@ github.com destination is audited, including this owner's other repositories.
 | Status | Count |
 |---|---:|
-| 200 | 258 |
+| 200 | 256 |
+| 403 | 2 |
 
 ## Every Destination
@@ -340,9 +349,9 @@ github.com destination is audited, including this owner's other repositories.
 | 249 | 200 | n/a | n/a | https://nvlpubs.nist.gov/nistpubs/ai/nist.ai.100-1.pdf |
 | 250 | 200 | n/a | n/a | https://proceedings.mlr.press/v267/south25a.html |
-| 251 | 200 | n/a | n/a | https://scholar.google.com/citations?user=zoGDYsoAAAAJ&hl=en |
+| 251 | 403 | n/a | n/a | https://scholar.google.com/citations?user=zoGDYsoAAAAJ&hl=en |
 | 252 | 200 | n/a | n/a | https://slsa.dev/spec/v1.0/ |
 | 253 | 200 | n/a | n/a | https://spec.c2pa.org/specifications/specifications/2.2/specs/_attachments/C2PA_Specification.pdf |
 | 254 | 200 | n/a | n/a | https://whowhenpro.github.io/ |
-| 255 | 200 | n/a | n/a | https://www.iso.org/standard/42001 |
+| 255 | 403 | n/a | n/a | https://www.iso.org/standard/42001 |
 | 256 | 200 | n/a | n/a | https://www.langchain.com/langsmith-platform |
 | 257 | 200 | n/a | n/a | https://www.rfc-editor.org/rfc/rfc6962 |
Complete regenerated report, subject to the size note below

Link Audit

Generated by tools/check_links.py. Re-run it to reproduce this file.

Summary

Field Value
Audit date 2026-08-16
Failure policy strict
Distinct link destinations 258
Resolved (200 or 206) 256
Did not resolve 2
Unresolved and not a known bot wall 0
PR-blocking unresolved (non-retryable 4xx or non-network error) 0
PR-warning unresolved (transient or other status) 0
arXiv titles compared with citation_title 129
arXiv titles agreeing 129
arXiv titles agreeing loosely (listed below) 0
arXiv title disagreements 0
arXiv identifiers compared with citation_arxiv_id 131
arXiv identifiers agreeing 131
arXiv identifiers with no meta tag 0
arXiv identifier disagreements 0
arXiv pages where a check could not run (unverified) 0
Repository chrome skipped, listed below 3

What This Checks, and What It Does Not

Checked: that every destination responds; that each arXiv page reports the identifier in
its own URL; and that each arXiv entry's title in this list agrees with the
citation_title the arXiv page reports. The third check is the one that can catch an
entry pointing at a real but different paper.

Not checked: whether a summary sentence fairly describes the linked work, whether a venue
field is correct, or whether a non-arXiv destination contains the claimed content. This
repository's own badges and the GitHub pages behind them are also not checked, and each
one is named under Repository Chrome Not Audited rather than counted as passing.

Titles count as agreeing only when they are identical after case folding and punctuation
removal, so a near-identical title is never silently accepted. A remaining difference of
0.80 similarity or better is listed under Titles Agreeing Loosely for a human to confirm.
A difference confined to a number, a roman numeral, or a word such as Part is treated as a
disagreement at any similarity score, because that is the shape of a link to the wrong
paper in a series.

The strict failure policy rejects every unexpected unresolved destination. The pull-request
policy rejects non-retryable 4xx responses and non-network exceptions, but treats exhausted
timeouts, connection errors, 408, 425, 429, 5xx, and other HTTP statuses as warnings.

Title Disagreements

None. Every arXiv entry with a title label agrees with the title its page reports.

Titles Agreeing Loosely

None.

Identifier Disagreements

None. Every arXiv page reports the identifier in its own URL.

Destinations That Did Not Return 200

A non-200 result is not automatically a dead link: some publishers refuse automated
requests. Destinations listed in KNOWN_BOT_WALLS in tools/check_links.py carry a
recorded reason and were confirmed by hand. The strict policy fails every other row;
the pull-request policy applies the narrower rule described above.

Status URL Note
403 https://scholar.google.com/citations?user=zoGDYsoAAAAJ&hl=en Google Scholar serves 403 to datacenter clients, so this destination resolves from a workstation and fails from a GitHub-hosted runner; the profile was verified by hand in a browser.
403 https://www.iso.org/standard/42001 ISO returns 403 to non-browser clients; verified by hand in a browser.

Repository Chrome Not Audited

These destinations are this repository's own badges and the GitHub pages behind them,
rather than resources this list cites. They are skipped for two reasons. GitHub rate-
limits its own dynamic pages for shared CI addresses, and one such limit should not
fail an audit of everyone else's links. A badge that points at this audit would also
be able to decide the audit's result, which is a loop worth refusing. Every other
github.com destination is audited, including this owner's other repositories.

URL
https://github.com/yzhao062/awesome-auditable-ai/actions/workflows/verify.yml
https://github.com/yzhao062/awesome-auditable-ai/actions/workflows/verify.yml/badge.svg
https://github.com/yzhao062/awesome-auditable-ai/commits/main

Status Code Distribution

Status Count
200 256
403 2

Every Destination

# Status Identifier Title URL
1 200 n/a n/a https://a2a-protocol.org/v1.0.1/specification/
2 200 n/a n/a https://aclanthology.org/2024.eacl-demo.16/
3 200 n/a n/a https://aclanthology.org/2025.eval4nlp-1.12/
4 200 n/a n/a https://ap2-protocol.org/
5 200 n/a n/a https://artificialintelligenceact.eu/article/12/
6 200 match match https://arxiv.org/abs/1803.09010
7 200 match match https://arxiv.org/abs/1804.05741
8 200 match match https://arxiv.org/abs/1810.03993
9 200 match match https://arxiv.org/abs/2001.00973
10 200 match match https://arxiv.org/abs/2307.13854
11 200 match match https://arxiv.org/abs/2308.03688
12 200 match match https://arxiv.org/abs/2308.11432
13 200 match match https://arxiv.org/abs/2309.07864
14 200 match match https://arxiv.org/abs/2309.15817
15 200 match match https://arxiv.org/abs/2310.06770
16 200 match no title label https://arxiv.org/abs/2310.10501
17 200 match match https://arxiv.org/abs/2311.12983
18 200 match match https://arxiv.org/abs/2312.06674
19 200 match match https://arxiv.org/abs/2312.06942
20 200 match match https://arxiv.org/abs/2401.10019
21 200 match match https://arxiv.org/abs/2401.13138
22 200 match match https://arxiv.org/abs/2401.13178
23 200 match match https://arxiv.org/abs/2401.14446
24 200 match match https://arxiv.org/abs/2402.01680
25 200 match match https://arxiv.org/abs/2402.03578
26 200 match match https://arxiv.org/abs/2403.02691
27 200 match match https://arxiv.org/abs/2404.07972
28 200 match match https://arxiv.org/abs/2405.15793
29 200 match match https://arxiv.org/abs/2406.09187
30 200 match match https://arxiv.org/abs/2406.12045
31 200 match match https://arxiv.org/abs/2406.13352
32 200 match match https://arxiv.org/abs/2407.01502
33 200 match match https://arxiv.org/abs/2407.18901
34 200 match match https://arxiv.org/abs/2408.14972
35 200 match match https://arxiv.org/abs/2410.02644
36 200 match match https://arxiv.org/abs/2411.05285
37 200 match no title label https://arxiv.org/abs/2501.09674
38 200 match match https://arxiv.org/abs/2502.11127
39 200 match match https://arxiv.org/abs/2502.11448
40 200 match match https://arxiv.org/abs/2503.03704
41 200 match match https://arxiv.org/abs/2503.09648
42 200 match match https://arxiv.org/abs/2503.13657
43 200 match match https://arxiv.org/abs/2503.16416
44 200 match match https://arxiv.org/abs/2503.18666
45 200 match match https://arxiv.org/abs/2503.18813
46 200 match match https://arxiv.org/abs/2504.08942
47 200 match match https://arxiv.org/abs/2505.00212
48 200 match no title label https://arxiv.org/abs/2505.03574
49 200 match match https://arxiv.org/abs/2505.08638
50 200 match match https://arxiv.org/abs/2505.19234
51 200 match match https://arxiv.org/abs/2505.24201
52 200 match match https://arxiv.org/abs/2506.00641
53 200 match match https://arxiv.org/abs/2506.07982
54 200 match match https://arxiv.org/abs/2506.08837
55 200 match match https://arxiv.org/abs/2506.14866
56 200 match match https://arxiv.org/abs/2507.05257
57 200 match match https://arxiv.org/abs/2508.00500
58 200 match match https://arxiv.org/abs/2508.01249
59 200 match match https://arxiv.org/abs/2508.19461
60 200 match match https://arxiv.org/abs/2509.03312
61 200 match match https://arxiv.org/abs/2509.07764
62 200 match match https://arxiv.org/abs/2509.14295
63 200 match match https://arxiv.org/abs/2509.23735
64 200 match match https://arxiv.org/abs/2509.25238
65 200 match match https://arxiv.org/abs/2509.25370
66 200 match match https://arxiv.org/abs/2510.04886
67 200 match match https://arxiv.org/abs/2510.09462
68 200 match match https://arxiv.org/abs/2510.11203
69 200 match match https://arxiv.org/abs/2510.17149
70 200 match match https://arxiv.org/abs/2512.08290
71 200 match match https://arxiv.org/abs/2512.23738
72 200 match match https://arxiv.org/abs/2601.00516
73 200 match match https://arxiv.org/abs/2601.06112
74 200 match match https://arxiv.org/abs/2601.11868
75 200 match match https://arxiv.org/abs/2601.20727
76 200 match match https://arxiv.org/abs/2602.02475
77 200 match match https://arxiv.org/abs/2602.11348
78 200 match match https://arxiv.org/abs/2602.11619
79 200 match match https://arxiv.org/abs/2602.14849
80 200 match match https://arxiv.org/abs/2602.16666
81 200 match match https://arxiv.org/abs/2603.06847
82 200 match match https://arxiv.org/abs/2603.10749
83 200 match match https://arxiv.org/abs/2603.20625
84 200 match match https://arxiv.org/abs/2603.22489
85 200 match match https://arxiv.org/abs/2603.22853
86 200 match match https://arxiv.org/abs/2603.22868
87 200 match match https://arxiv.org/abs/2603.22928
88 200 match match https://arxiv.org/abs/2603.25001
89 200 match match https://arxiv.org/abs/2603.29231
90 200 match match https://arxiv.org/abs/2604.05485
91 200 match match https://arxiv.org/abs/2604.08523
92 200 match match https://arxiv.org/abs/2604.09408
93 200 match match https://arxiv.org/abs/2604.13954
94 200 match match https://arxiv.org/abs/2604.17658
95 200 match match https://arxiv.org/abs/2604.22708
96 200 match match https://arxiv.org/abs/2604.23280
97 200 match match https://arxiv.org/abs/2604.24477
98 200 match match https://arxiv.org/abs/2605.06455
99 200 match match https://arxiv.org/abs/2605.06788
100 200 match match https://arxiv.org/abs/2605.06812
101 200 match match https://arxiv.org/abs/2605.10912
102 200 match match https://arxiv.org/abs/2605.12366
103 200 match match https://arxiv.org/abs/2605.12673
104 200 match match https://arxiv.org/abs/2605.14421
105 200 match match https://arxiv.org/abs/2605.16626
106 200 match match https://arxiv.org/abs/2605.17169
107 200 match match https://arxiv.org/abs/2605.21384
108 200 match match https://arxiv.org/abs/2605.21997
109 200 match match https://arxiv.org/abs/2605.22333
110 200 match match https://arxiv.org/abs/2605.26563
111 200 match match https://arxiv.org/abs/2605.29801
112 200 match match https://arxiv.org/abs/2606.00765
113 200 match match https://arxiv.org/abs/2606.02060
114 200 match match https://arxiv.org/abs/2606.03467
115 200 match match https://arxiv.org/abs/2606.04769
116 200 match match https://arxiv.org/abs/2606.04990
117 200 match match https://arxiv.org/abs/2606.13385
118 200 match match https://arxiv.org/abs/2606.22741
119 200 match match https://arxiv.org/abs/2606.24626
120 200 match match https://arxiv.org/abs/2606.25189
121 200 match match https://arxiv.org/abs/2607.02357
122 200 match match https://arxiv.org/abs/2607.08400
123 200 match match https://arxiv.org/abs/2607.09510
124 200 match match https://arxiv.org/abs/2607.09996
125 200 match match https://arxiv.org/abs/2607.10059
126 200 match match https://arxiv.org/abs/2607.11086
127 200 match match https://arxiv.org/abs/2607.12747
128 200 match no title label https://arxiv.org/abs/2607.18754
129 200 match match https://arxiv.org/abs/2607.20121
130 200 match match https://arxiv.org/abs/2607.27080
131 200 match match https://arxiv.org/abs/2608.02643
132 200 match match https://arxiv.org/abs/2608.05204
133 200 match match https://arxiv.org/abs/2608.05212
134 200 match match https://arxiv.org/abs/2608.06477
135 200 match match https://arxiv.org/abs/2608.06701
136 200 match match https://arxiv.org/abs/2608.07899
137 200 n/a n/a https://atlas.mitre.org/
138 200 n/a n/a https://auditable-agents.github.io/
139 200 n/a n/a https://awesome.re
140 200 n/a n/a https://awesome.re/badge-flat2.svg
141 200 n/a n/a https://claw-bench.com/
142 200 n/a n/a https://cloudsecurityalliance.org/blog/2025/02/06/agentic-ai-threat-modeling-framework-maestro
143 200 n/a n/a https://creativecommons.org/publicdomain/zero/1.0/
144 200 n/a n/a https://cwe.mitre.org/data/definitions/1427.html
145 200 n/a n/a https://eur-lex.europa.eu/eli/reg/2026/1744/oj
146 200 n/a n/a https://genai.owasp.org/llm-top-10/
147 200 n/a n/a https://genai.owasp.org/resource/owasp-top-10-for-agentic-applications-for-2026/
148 200 n/a n/a https://genai.owasp.org/resource/securing-agentic-applications-guide-1-0/
149 200 n/a n/a https://github.com/33k0/PALADIN-Framework
150 200 n/a n/a https://github.com/AgentDebugX/AgentDebugX
151 200 n/a n/a https://github.com/AgentOps-AI/agentops
152 200 n/a n/a https://github.com/Arize-ai/openinference
153 200 n/a n/a https://github.com/Arize-ai/phoenix
154 200 n/a n/a https://github.com/Asaf-Yehudai/LLM-Agent-Evaluation-Survey
155 200 n/a n/a https://github.com/FU-max-boop/agentrunproof
156 200 n/a n/a https://github.com/Giskard-AI/giskard-oss
157 200 n/a n/a https://github.com/HeadyZhang/agent-audit
158 200 n/a n/a https://github.com/Helicone/helicone
159 200 n/a n/a https://github.com/JialongZhou666/GUARDIAN
160 200 n/a n/a https://github.com/Justin0504/Aegis
161 200 n/a n/a https://github.com/LogAnalysisTech/TrajAudit
162 200 n/a n/a https://github.com/McGill-NLP/agent-reward-bench
163 200 n/a n/a https://github.com/Minqi824/ADBench
164 200 n/a n/a https://github.com/NVIDIA-NeMo/Guardrails
165 200 n/a n/a https://github.com/NVIDIA/garak
166 200 n/a n/a https://github.com/Paitesanshi/LLM-Agent-Survey
167 200 n/a n/a https://github.com/SWE-agent/SWE-agent
168 200 n/a n/a https://github.com/SWE-bench/SWE-bench
169 200 n/a n/a https://github.com/SaFo-Lab/AGrail4Agent
170 200 n/a n/a https://github.com/StakeBench/SBC
171 200 n/a n/a https://github.com/THUDM/AgentBench
172 200 n/a n/a https://github.com/TIGER-AI-Lab/ClawBench
173 200 n/a n/a https://github.com/TraceElephant/TraceElephant
174 200 n/a n/a https://github.com/TransluceAI/docent
175 200 n/a n/a https://github.com/UKGovernmentBEIS/inspect_ai
176 200 n/a n/a https://github.com/USC-FORTIS
177 200 n/a n/a https://github.com/WooooDyy/LLM-Agent-Paper-List
178 200 n/a n/a https://github.com/ag2ai/Agents_Failure_Attribution
179 200 n/a n/a https://github.com/agentkitai/agentlens
180 200 n/a n/a https://github.com/agentrust-io/trace-spec
181 200 n/a n/a https://github.com/benchjack/benchjack
182 200 n/a n/a https://github.com/benediktstroebl/agent-evals
183 200 n/a n/a https://github.com/bingreeky/AgenTracer
184 200 n/a n/a https://github.com/bkuan001/halo-record
185 200 n/a n/a https://github.com/breckbaldwin/llm-stability
186 200 n/a n/a https://github.com/chanchimin/AgentMonitor
187 200 n/a n/a https://github.com/comet-ml/opik
188 200 n/a n/a https://github.com/confident-ai/deepeval
189 200 n/a n/a https://github.com/contentauth/c2pa-rs
190 200 n/a n/a https://github.com/e2b-dev/E2B
191 200 n/a n/a https://github.com/ethz-spylab/agentdojo
192 200 n/a n/a https://github.com/evidentlyai/evidently
193 200 n/a n/a https://github.com/google-research/camel-prompt-injection
194 200 n/a n/a https://github.com/guardagent/code
195 200 n/a n/a https://github.com/guardrails-ai/guardrails
196 200 n/a n/a https://github.com/haoyuwang99/ProbGuard
197 200 n/a n/a https://github.com/harbor-framework/terminal-bench
198 200 n/a n/a https://github.com/in-toto/attestation
199 200 n/a n/a https://github.com/kfq20/AEGIS
200 200 n/a n/a https://github.com/langfuse/langfuse
201 200 n/a n/a https://github.com/lmnr-ai/lmnr
202 200 n/a n/a https://github.com/m4p1e/agent-sentinel
203 200 n/a n/a https://github.com/makerchecker/MakerChecker
204 200 n/a n/a https://github.com/meta-llama/PurpleLlama
205 200 n/a n/a https://github.com/microsoft/AgentRx
206 200 n/a n/a https://github.com/microsoft/agent-governance-toolkit
207 200 n/a n/a https://github.com/mingyin1/Agents_Failure_Attribution
208 200 n/a n/a https://github.com/mitre-atlas/atlas-data/releases/tag/v2026.07
209 200 n/a n/a https://github.com/modelcontextprotocol/modelcontextprotocol
210 200 n/a n/a https://github.com/multi-agent-systems-failure-taxonomy/MAST
211 200 n/a n/a https://github.com/nyit-vancouver/mcp-security
212 200 n/a n/a https://github.com/open-telemetry/semantic-conventions-genai
213 200 n/a n/a https://github.com/rgreenblatt/control-evaluations
214 200 n/a n/a https://github.com/secure-systems-lab/dsse
215 200 n/a n/a https://github.com/sierra-research/tau-bench
216 200 n/a n/a https://github.com/sigstore/rekor
217 200 n/a n/a https://github.com/snyk/agent-scan
218 200 n/a n/a https://github.com/splx-ai/agentic-radar
219 200 n/a n/a https://github.com/superradcompany/microsandbox
220 200 n/a n/a https://github.com/taichengguo/LLM_MultiAgents_Survey_Papers
221 200 n/a n/a https://github.com/traceloop/openllmetry
222 200 n/a n/a https://github.com/truera/trulens
223 200 n/a n/a https://github.com/uiuc-kang-lab/InjecAgent
224 200 n/a n/a https://github.com/ulab-uiuc/AgentDebug
225 200 n/a n/a https://github.com/ulab-uiuc/AgentProtocols
226 200 n/a n/a https://github.com/vibrantlabsai/ragas
227 200 n/a n/a https://github.com/victorojewale/audit-trail-PoC
228 200 n/a n/a https://github.com/web-arena-x/webarena
229 200 n/a n/a https://github.com/whowhenpro/whowhen_pro
230 200 n/a n/a https://github.com/wslong20/G-safeguard
231 200 n/a n/a https://github.com/xiaoqi-7/Agent-Tracing-Survey
232 200 n/a n/a https://github.com/xlang-ai/OSWorld
233 200 n/a n/a https://github.com/yoheinakajima/activegraph
234 200 n/a n/a https://github.com/yzhao062
235 200 n/a n/a https://github.com/yzhao062/auditable
236 200 n/a n/a https://github.com/yzhao062/grade
237 200 n/a n/a https://github.com/yzhao062/pyod
238 200 n/a n/a https://huggingface.co/datasets/E-k-O/PaladinData
239 200 n/a n/a https://huggingface.co/datasets/Fancylalala/AEGIS
240 200 n/a n/a https://huggingface.co/datasets/PatronusAI/TRAIL
241 200 n/a n/a https://huggingface.co/datasets/gaia-benchmark/GAIA
242 200 n/a n/a https://huggingface.co/meta-llama/LlamaGuard-7b
243 200 n/a n/a https://img.shields.io/badge/PRs-welcome-blue.svg
244 200 n/a n/a https://img.shields.io/badge/license-CC0--1.0-blue.svg
245 200 n/a n/a https://img.shields.io/github/last-commit/yzhao062/awesome-auditable-ai
246 200 n/a n/a https://in-toto.io/
247 200 n/a n/a https://modelcontextprotocol.io/specification/latest
248 200 n/a n/a https://nvlpubs.nist.gov/nistpubs/ai/NIST.AI.600-1.pdf
249 200 n/a n/a https://nvlpubs.nist.gov/nistpubs/ai/nist.ai.100-1.pdf
250 200 n/a n/a https://proceedings.mlr.press/v267/south25a.html
251 403 n/a n/a https://scholar.google.com/citations?user=zoGDYsoAAAAJ&hl=en
252 200 n/a n/a https://slsa.dev/spec/v1.0/
253 200 n/a n/a https://spec.c2pa.org/specifications/specifications/2.2/specs/_attachments/C2PA_Specification.pdf
254 200 n/a n/a https://whowhenpro.github.io/
255 403 n/a n/a https://www.iso.org/standard/42001
256 200 n/a n/a https://www.langchain.com/langsmith-platform
257 200 n/a n/a https://www.rfc-editor.org/rfc/rfc6962
258 200 n/a n/a https://www.rfc-editor.org/rfc/rfc9162

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions