Skip to content

Commit d030032

Browse files
author
stlc-bot
committed
feat(scrape): return Yelp reviewer id and profile url in yelp-reviews (#2402)
Stainless-Generated-From: 11bfd243093dd9e110797f1dc7ef06f896f26d56
1 parent 4efa2b1 commit d030032

2 files changed

Lines changed: 36 additions & 33 deletions

File tree

‎src/context/dev/types/batch_submit_params.py‎

Lines changed: 24 additions & 22 deletions
Original file line numberDiff line numberDiff line change
@@ -1021,17 +1021,18 @@ class InputScrapeDataBatchUnifiedScrapeDataParseParamsPrebuiltParser(TypedDict,
10211021
filters are rejected, while tracking params are ignored. It returns up to 20
10221022
latest public reviews in data.reviews with business details and
10231023
pagination.next_offset. Each review has rating, full text, updated_at, and
1024-
author; owner replies and photos are not included. emails accepts any page and
1025-
returns its email addresses as data.emails ([{ email }]), read from mailto
1026-
links, Cloudflare-protected addresses, and visible text. phone-numbers accepts
1027-
any page and returns its valid phone numbers in E.164 as data.phone_numbers ([{
1028-
phone }]), read from tel links and visible text; numbers without a country code
1029-
are read for the country of the site TLD, defaulting to US. links accepts any
1030-
page and returns its unique http(s) links as data.links ([{ url, text }]), with
1031-
absolute URLs; text falls back to aria-label or image alt and is null when a
1032-
link has none. The emails parser reads the rendered page and respects content
1033-
filters; the other prebuilt parsers read their data independently of DOM
1034-
filters.
1024+
author (id is the Yelp user id from the reviewer profile URL, url links to that
1025+
profile, plus name, location, and review_count); owner replies and photos are
1026+
not included. emails accepts any page and returns its email addresses as
1027+
data.emails ([{ email }]), read from mailto links, Cloudflare-protected
1028+
addresses, and visible text. phone-numbers accepts any page and returns its
1029+
valid phone numbers in E.164 as data.phone_numbers ([{ phone }]), read from tel
1030+
links and visible text; numbers without a country code are read for the country
1031+
of the site TLD, defaulting to US. links accepts any page and returns its unique
1032+
http(s) links as data.links ([{ url, text }]), with absolute URLs; text falls
1033+
back to aria-label or image alt and is null when a link has none. The emails
1034+
parser reads the rendered page and respects content filters; the other prebuilt
1035+
parsers read their data independently of DOM filters.
10351036
"""
10361037

10371038
type: Required[Literal["prebuilt"]]
@@ -2726,17 +2727,18 @@ class InputCrawlDataBatchUnifiedCrawlDataParseParamsPrebuiltParser(TypedDict, to
27262727
filters are rejected, while tracking params are ignored. It returns up to 20
27272728
latest public reviews in data.reviews with business details and
27282729
pagination.next_offset. Each review has rating, full text, updated_at, and
2729-
author; owner replies and photos are not included. emails accepts any page and
2730-
returns its email addresses as data.emails ([{ email }]), read from mailto
2731-
links, Cloudflare-protected addresses, and visible text. phone-numbers accepts
2732-
any page and returns its valid phone numbers in E.164 as data.phone_numbers ([{
2733-
phone }]), read from tel links and visible text; numbers without a country code
2734-
are read for the country of the site TLD, defaulting to US. links accepts any
2735-
page and returns its unique http(s) links as data.links ([{ url, text }]), with
2736-
absolute URLs; text falls back to aria-label or image alt and is null when a
2737-
link has none. The emails parser reads the rendered page and respects content
2738-
filters; the other prebuilt parsers read their data independently of DOM
2739-
filters.
2730+
author (id is the Yelp user id from the reviewer profile URL, url links to that
2731+
profile, plus name, location, and review_count); owner replies and photos are
2732+
not included. emails accepts any page and returns its email addresses as
2733+
data.emails ([{ email }]), read from mailto links, Cloudflare-protected
2734+
addresses, and visible text. phone-numbers accepts any page and returns its
2735+
valid phone numbers in E.164 as data.phone_numbers ([{ phone }]), read from tel
2736+
links and visible text; numbers without a country code are read for the country
2737+
of the site TLD, defaulting to US. links accepts any page and returns its unique
2738+
http(s) links as data.links ([{ url, text }]), with absolute URLs; text falls
2739+
back to aria-label or image alt and is null when a link has none. The emails
2740+
parser reads the rendered page and respects content filters; the other prebuilt
2741+
parsers read their data independently of DOM filters.
27402742
"""
27412743

27422744
type: Required[Literal["prebuilt"]]

‎src/context/dev/types/web_scrape_params.py‎

Lines changed: 12 additions & 11 deletions
Original file line numberDiff line numberDiff line change
@@ -358,17 +358,18 @@ class ParseParamsPrebuiltParser(TypedDict, total=False):
358358
filters are rejected, while tracking params are ignored. It returns up to 20
359359
latest public reviews in data.reviews with business details and
360360
pagination.next_offset. Each review has rating, full text, updated_at, and
361-
author; owner replies and photos are not included. emails accepts any page and
362-
returns its email addresses as data.emails ([{ email }]), read from mailto
363-
links, Cloudflare-protected addresses, and visible text. phone-numbers accepts
364-
any page and returns its valid phone numbers in E.164 as data.phone_numbers ([{
365-
phone }]), read from tel links and visible text; numbers without a country code
366-
are read for the country of the site TLD, defaulting to US. links accepts any
367-
page and returns its unique http(s) links as data.links ([{ url, text }]), with
368-
absolute URLs; text falls back to aria-label or image alt and is null when a
369-
link has none. The emails parser reads the rendered page and respects content
370-
filters; the other prebuilt parsers read their data independently of DOM
371-
filters.
361+
author (id is the Yelp user id from the reviewer profile URL, url links to that
362+
profile, plus name, location, and review_count); owner replies and photos are
363+
not included. emails accepts any page and returns its email addresses as
364+
data.emails ([{ email }]), read from mailto links, Cloudflare-protected
365+
addresses, and visible text. phone-numbers accepts any page and returns its
366+
valid phone numbers in E.164 as data.phone_numbers ([{ phone }]), read from tel
367+
links and visible text; numbers without a country code are read for the country
368+
of the site TLD, defaulting to US. links accepts any page and returns its unique
369+
http(s) links as data.links ([{ url, text }]), with absolute URLs; text falls
370+
back to aria-label or image alt and is null when a link has none. The emails
371+
parser reads the rendered page and respects content filters; the other prebuilt
372+
parsers read their data independently of DOM filters.
372373
"""
373374

374375
type: Required[Literal["prebuilt"]]

0 commit comments

Comments
 (0)