All pull requests

Pull requests

• chore(deps): update dependency puppeteer to v25.14.0

  t-tooling
  #4278·renovate[bot] opened Oct 16, 2026Bot·1 task·

  ·
  1

• chore: Remove the -Secs suffix from lock methods on RequestQueueBackend interface

  adhoct-toolingtested
  #4276·janbuchar opened Oct 15, 2026Contributor·

  ·
  2

  

• docs: Add an Adaptive Crawling guide

  t-tooling
  #4273·janbuchar opened Oct 15, 2026Contributor·3/3·

  ·
  1

  

• fix(basic): allow sendRequest to send a request body

  t-tooling
  #4268·jayhemnani9910 opened Oct 15, 2026Contributor·

  ·
  1

• fix(basic): forward proxyUrl from sendRequest to the HTTP client

  t-tooling
  #4267·jayhemnani9910 opened Oct 15, 2026Contributor·

  ·
  1

• chore(deps): update dependency oxfmt to ^0.73.0

  t-tooling
  #4265·renovate[bot] opened Oct 14, 2026Bot·1 task·

  ·

• fix(playwright-crawler): scope noRetry to the HTTP-only attempt in AdaptivePlaywrightCrawler

  t-tooling
  #4264·heyuhe2003 opened Oct 14, 2026·2 tasks done·

  ·
  1

  2

• fix(playwright): clear HTTP noRetry before adaptive browser fallback

  t-tooling
  #4263·jipeng6036-del opened Oct 13, 2026·

  ·
  1

  1

• fix(basic-crawler): fetch robots.txt with the crawler's httpClient and proxy (#4244)

  t-tooling
  #4258·heyuhe2003 opened Oct 13, 2026·3 tasks done·

  ·
  1

• test: assert rejected nested sitemaps are never fetched

  t-tooling
  #4254·safal207 opened Oct 11, 2026·

  ·

• fix(playwright): align adaptive deferred cleanup with BasicCrawler

  t-tooling
  #4253·Dekaz4 opened Oct 11, 2026·

  ·
  1

• fix(utils): keep urls from the other sitemaps when one sitemap is malformed

  t-tooling
  #4249·jayhemnani9910 opened Oct 10, 2026Contributor·

  ·
  1

• chore(deps): update opentelemetry-js monorepo to ^0.223.0

  t-tooling
  #4227·renovate[bot] opened Oct 7, 2026Bot·1 task·

  ·

• feat(cli): add an AI prompt for migrating to v4

  featuret-tooling
  #4226·vladfrangu opened Oct 7, 2026Member·

  ·
  4

  38

  

• fix: let the adaptive crawler's navigation window be set and extended

  #4219·cruspy2004 opened Oct 6, 2026Contributor·

  ·
  1

  2

• fix: fetch robots.txt through the crawler's HTTP client like a browser

  #4218·cruspy2004 opened Oct 6, 2026Contributor·

  ·
  2

  2

• fix: keep the impit client from timing out before the crawler's deadline

  #4215·cruspy2004 opened Oct 6, 2026Contributor·

  ·
  1

  2

• fix(core): respect process cgroup memory limits

  #4208·vvinayakkk opened Oct 5, 2026·

  ·
  1

  1

• chore(deps): update dependency header-generator>ow to v3

  #4206·renovate[bot] opened Oct 5, 2026Bot·1 task·

  ·
  1

• fix: detect the AWS WAF challenge and CAPTCHA with retryOnBlocked

  #4184·mikhail-koviazin opened Oct 3, 2026Contributor·

  ·
  1

• feat(playwright-crawler): add BrowserFetchHttpClient

  #4177·noahg9 opened Sep 30, 2026Contributor·

  ·
  1

  9

• fix(basic): stop SitemapRequestLoader from looping on cyclic sitemap indexes

  #4172·breken-ai opened Sep 30, 2026Contributor·

  ·
  2

• docs(blog): add post on using Lightpanda as a remote browser

  #4156·candidosales opened Sep 23, 2026·

  ·
  2

• docs(blog): add post on using Obscura as a remote browser

  t-tooling
  #4105·barjin opened Sep 3, 2026Member·

  ·

  · 148th sprint - Tooling team
  

• fix(core): log background request-batch failures instead of swallowing them

  #4103·florinBC89 opened Sep 3, 2026·

  ·