Skip to content

Commit ae91bee

Browse files
Asaif AliAsaif Ali
authored andcommitted
Redesigning the UI
1 parent 8c25e37 commit ae91bee

3 files changed

Lines changed: 261 additions & 94 deletions

File tree

PERFORMANCE.md

Lines changed: 13 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,13 @@
1+
# WebQA Crawl Performance
2+
3+
WebQA now uses concurrent Playwright pages, one-pass DOM extraction, resource blocking for unused image/media/font bytes, and no duplicate page navigation.
4+
5+
## Defaults
6+
7+
- `CRAWLER_CONCURRENCY=6` concurrent page crawls
8+
- `CRAWLER_NAV_TIMEOUT_MS=30000` navigation timeout
9+
- `CRAWLER_SETTLE_MS=100` post-navigation settle window
10+
11+
For constrained environments, use 2-4 workers. With more CPU/RAM, 6-8 is a reasonable starting point.
12+
13+
The crawler keeps CSS, JavaScript, XHR/fetch, and document responses enabled because QA analysis depends on DOM and runtime signals. Images, media, and fonts are skipped because their bytes are not inspected during the crawl phase.

0 commit comments

Comments
 (0)