Last updated: 2026-04-22
This document keeps two truths separate:
- the stable release baseline (
v2.4.0) - the current
mainbranch snapshot, which already contains newer AI + Obsidian improvements
The checks used to cut v2.4.0 remain the minimum baseline for future stable tags.
bash scripts/bootstrap.sh --install-python
bash scripts/bootstrap.sh
.venv/bin/python -m py_compile scripts/process_share_links.py scripts/run_regression.py
.venv/bin/python -m unittest discover -s tests -vLatest stable-baseline outcome on 2026-04-19:
bootstrap.sh --install-python: passedbootstrap.sh: passedpy_compile: passedunittest: passed (33tests at the time)
Public-link regression entrypoint:
.venv/bin/python scripts/run_regression.py --preset extended --analysis-mode heuristicextended covers:
- GitHub
- Zhihu
- CSDN
- Toutiao
- Bilibili
Stable-baseline outcome on 2026-04-19: passed (5/5 success)
| Platform | Result | Extraction path |
|---|---|---|
| GitHub | success | github api + readme |
| Zhihu | success | scrapling fetch [.Post-RichText] |
| CSDN | success | scrapling fetch [#article_content] |
| Toutiao | success | scrapling stealthy-fetch [.article-content] |
| Bilibili | success | yt-dlp download + whisper-cli |
These checks describe the repository as it exists on main, not the last stable tag.
.venv/bin/python -m py_compile scripts/process_share_links.py scripts/douyin_auth.py scripts/run_regression.py
.venv/bin/python -m unittest discover -s tests -vOutcome:
py_compile: passedunittest: passed (67tests)
These are not abstract claims; they correspond to real notes / reports already generated in a working vault.
| Source type | Result | Extraction path |
|---|---|---|
| GitHub repo | success | deepwiki overview |
| Douyin short video | success | playwright douyin download + whisper-cli |
Representative notes already written by the current pipeline:
NousResearch/hermes-agentOpenCode 保姆级配置与实战指南
In addition to the public preset above, the project has manually verified representative public share links during the hardening cycles around 2026-03-26, 2026-04-19, and 2026-04-22.
| Platform | Result | Typical extraction path |
|---|---|---|
| GitHub | success | deepwiki overview or github api + readme |
| Zhihu | success | article extraction |
| CSDN | success | article extraction |
| Toutiao | success | scrapling stealthy-fetch [.article-content] |
| Bilibili | success | yt-dlp download + whisper-cli |
| success | scrapling stealthy-fetch [#js_content] |
|
| Xiaohongshu | success | yt-dlp download + whisper-cli |
| X/Twitter | success | yt-dlp download + whisper-cli |
| partial | yt-dlp metadata only on very short clips |
|
| Douyin | success | playwright douyin download + whisper-cli |
Notes:
partialis an honest outcome, not a hidden failure.- social-platform success rates can change over time because anti-bot behavior changes
- browser cookies, saved auth, and referer support exist for users who need stronger access stability
- Feishu / Feishu Wiki upload is intentionally outside the current release scope
Recommended split:
- public CI:
- runtime bootstrap
- compile checks
- unit tests
- lightweight public-link regression
- mocked Douyin auth gating and fallback logic
- self-hosted runner / desktop smoke test:
- real Douyin QR login
- saved-cookie reuse
- Playwright media fallback on a real share link
Important note:
- public CI should not attempt real Douyin QR login
- real QR login only makes sense in a self-hosted runner, VNC session, or remote desktop where a human can actually scan the code
- if you intentionally use such an environment, open the gate explicitly with
CONTENT_PROCESSOR_ALLOW_NON_TTY_DOUYIN_LOGIN=1
Before publishing a new stable tag:
- the stable-baseline installation checks should pass on a clean runtime
- unit tests should remain green
- at least one GitHub link, one article page, one dynamic page, and one media link should succeed
- mixed-outcome platforms such as Weibo should be documented honestly instead of being hidden