Skip to content

Commit 241bacf

Browse files
feat(api): api update
1 parent f5cd0d0 commit 241bacf

3 files changed

Lines changed: 7 additions & 16 deletions

File tree

‎.stats.yml‎

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,4 @@
11
configured_endpoints: 21
2-
openapi_spec_url: https://storage.googleapis.com/stainless-sdk-openapi-specs/context-dev%2Fcontext.dev-6358650aa8bbd5ba9a423f2c146607c43c09ce92e455e7905a94ce64c032551b.yml
3-
openapi_spec_hash: a6734ff6462155d6d2f0be39185dcfdc
2+
openapi_spec_url: https://storage.googleapis.com/stainless-sdk-openapi-specs/context-dev%2Fcontext.dev-710f2543cb3ae7b29cf20a527e5fcca5f3aa518c7435ecb2b84fb9f8fe61506c.yml
3+
openapi_spec_hash: 219f0884a214dba75a2e971dc5962804
44
config_hash: 682b89b02a20f5d1c13e2c91ecbcf5ce

‎src/context/dev/resources/web.py‎

Lines changed: 4 additions & 10 deletions
Original file line numberDiff line numberDiff line change
@@ -372,13 +372,10 @@ def web_scrape_sitemap(
372372
timeout: float | httpx.Timeout | None | NotGiven = not_given,
373373
) -> WebWebScrapeSitemapResponse:
374374
"""
375-
Crawls the sitemap of the given domain and returns all discovered page URLs.
376-
Supports sitemap index files (recursive), parallel fetching with concurrency
377-
control, deduplication, and filters out non-page resources (images, PDFs, etc.).
375+
Crawl an entire website's sitemap and return all discovered page URLs
378376
379377
Args:
380-
domain: Domain name to crawl sitemaps for (e.g., 'example.com'). The domain will be
381-
automatically normalized and validated.
378+
domain: Domain to build a sitemap for
382379
383380
max_links: Maximum number of links to return from the sitemap crawl. Defaults to 10,000.
384381
Minimum is 1, maximum is 100,000.
@@ -747,13 +744,10 @@ async def web_scrape_sitemap(
747744
timeout: float | httpx.Timeout | None | NotGiven = not_given,
748745
) -> WebWebScrapeSitemapResponse:
749746
"""
750-
Crawls the sitemap of the given domain and returns all discovered page URLs.
751-
Supports sitemap index files (recursive), parallel fetching with concurrency
752-
control, deduplication, and filters out non-page resources (images, PDFs, etc.).
747+
Crawl an entire website's sitemap and return all discovered page URLs
753748
754749
Args:
755-
domain: Domain name to crawl sitemaps for (e.g., 'example.com'). The domain will be
756-
automatically normalized and validated.
750+
domain: Domain to build a sitemap for
757751
758752
max_links: Maximum number of links to return from the sitemap crawl. Defaults to 10,000.
759753
Minimum is 1, maximum is 100,000.

‎src/context/dev/types/web_web_scrape_sitemap_params.py‎

Lines changed: 1 addition & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -11,10 +11,7 @@
1111

1212
class WebWebScrapeSitemapParams(TypedDict, total=False):
1313
domain: Required[str]
14-
"""Domain name to crawl sitemaps for (e.g., 'example.com').
15-
16-
The domain will be automatically normalized and validated.
17-
"""
14+
"""Domain to build a sitemap for"""
1815

1916
max_links: Annotated[int, PropertyInfo(alias="maxLinks")]
2017
"""Maximum number of links to return from the sitemap crawl.

0 commit comments

Comments
 (0)