Skip to content

Commit 4596198

Browse files
author
stlc-bot
committed
feat(scrape): return Yelp reviewer id and profile url in yelp-reviews (#2402)
Stainless-Generated-From: 8949ce69d736a9f4a3dd03972458a4363cdc8164
1 parent 95a3632 commit 4596198

4 files changed

Lines changed: 180 additions & 165 deletions

File tree

‎lib/context_dev/models/batch_submit_params.rb‎

Lines changed: 48 additions & 44 deletions
Original file line numberDiff line numberDiff line change
@@ -1724,17 +1724,18 @@ class PrebuiltParser < ContextDev::Internal::Type::BaseModel
17241724
# filters are rejected, while tracking params are ignored. It returns up to 20
17251725
# latest public reviews in data.reviews with business details and
17261726
# pagination.next_offset. Each review has rating, full text, updated_at, and
1727-
# author; owner replies and photos are not included. emails accepts any page and
1728-
# returns its email addresses as data.emails ([{ email }]), read from mailto
1729-
# links, Cloudflare-protected addresses, and visible text. phone-numbers accepts
1730-
# any page and returns its valid phone numbers in E.164 as data.phone_numbers ([{
1731-
# phone }]), read from tel links and visible text; numbers without a country code
1732-
# are read for the country of the site TLD, defaulting to US. links accepts any
1733-
# page and returns its unique http(s) links as data.links ([{ url, text }]), with
1734-
# absolute URLs; text falls back to aria-label or image alt and is null when a
1735-
# link has none. The emails parser reads the rendered page and respects content
1736-
# filters; the other prebuilt parsers read their data independently of DOM
1737-
# filters.
1727+
# author (id is the Yelp user id from the reviewer profile URL, url links to that
1728+
# profile, plus name, location, and review_count); owner replies and photos are
1729+
# not included. emails accepts any page and returns its email addresses as
1730+
# data.emails ([{ email }]), read from mailto links, Cloudflare-protected
1731+
# addresses, and visible text. phone-numbers accepts any page and returns its
1732+
# valid phone numbers in E.164 as data.phone_numbers ([{ phone }]), read from tel
1733+
# links and visible text; numbers without a country code are read for the country
1734+
# of the site TLD, defaulting to US. links accepts any page and returns its unique
1735+
# http(s) links as data.links ([{ url, text }]), with absolute URLs; text falls
1736+
# back to aria-label or image alt and is null when a link has none. The emails
1737+
# parser reads the rendered page and respects content filters; the other prebuilt
1738+
# parsers read their data independently of DOM filters.
17381739
#
17391740
# @return [Symbol, ContextDev::Models::BatchSubmitParams::Input::Scrape::Data::BatchUnifiedScrapeData::ParseParams::PrebuiltParser::Parser]
17401741
required :parser,
@@ -1892,17 +1893,18 @@ class PrebuiltParser < ContextDev::Internal::Type::BaseModel
18921893
# filters are rejected, while tracking params are ignored. It returns up to 20
18931894
# latest public reviews in data.reviews with business details and
18941895
# pagination.next_offset. Each review has rating, full text, updated_at, and
1895-
# author; owner replies and photos are not included. emails accepts any page and
1896-
# returns its email addresses as data.emails ([{ email }]), read from mailto
1897-
# links, Cloudflare-protected addresses, and visible text. phone-numbers accepts
1898-
# any page and returns its valid phone numbers in E.164 as data.phone_numbers ([{
1899-
# phone }]), read from tel links and visible text; numbers without a country code
1900-
# are read for the country of the site TLD, defaulting to US. links accepts any
1901-
# page and returns its unique http(s) links as data.links ([{ url, text }]), with
1902-
# absolute URLs; text falls back to aria-label or image alt and is null when a
1903-
# link has none. The emails parser reads the rendered page and respects content
1904-
# filters; the other prebuilt parsers read their data independently of DOM
1905-
# filters.
1896+
# author (id is the Yelp user id from the reviewer profile URL, url links to that
1897+
# profile, plus name, location, and review_count); owner replies and photos are
1898+
# not included. emails accepts any page and returns its email addresses as
1899+
# data.emails ([{ email }]), read from mailto links, Cloudflare-protected
1900+
# addresses, and visible text. phone-numbers accepts any page and returns its
1901+
# valid phone numbers in E.164 as data.phone_numbers ([{ phone }]), read from tel
1902+
# links and visible text; numbers without a country code are read for the country
1903+
# of the site TLD, defaulting to US. links accepts any page and returns its unique
1904+
# http(s) links as data.links ([{ url, text }]), with absolute URLs; text falls
1905+
# back to aria-label or image alt and is null when a link has none. The emails
1906+
# parser reads the rendered page and respects content filters; the other prebuilt
1907+
# parsers read their data independently of DOM filters.
19061908
#
19071909
# @see ContextDev::Models::BatchSubmitParams::Input::Scrape::Data::BatchUnifiedScrapeData::ParseParams::PrebuiltParser#parser
19081910
module Parser
@@ -5148,17 +5150,18 @@ class PrebuiltParser < ContextDev::Internal::Type::BaseModel
51485150
# filters are rejected, while tracking params are ignored. It returns up to 20
51495151
# latest public reviews in data.reviews with business details and
51505152
# pagination.next_offset. Each review has rating, full text, updated_at, and
5151-
# author; owner replies and photos are not included. emails accepts any page and
5152-
# returns its email addresses as data.emails ([{ email }]), read from mailto
5153-
# links, Cloudflare-protected addresses, and visible text. phone-numbers accepts
5154-
# any page and returns its valid phone numbers in E.164 as data.phone_numbers ([{
5155-
# phone }]), read from tel links and visible text; numbers without a country code
5156-
# are read for the country of the site TLD, defaulting to US. links accepts any
5157-
# page and returns its unique http(s) links as data.links ([{ url, text }]), with
5158-
# absolute URLs; text falls back to aria-label or image alt and is null when a
5159-
# link has none. The emails parser reads the rendered page and respects content
5160-
# filters; the other prebuilt parsers read their data independently of DOM
5161-
# filters.
5153+
# author (id is the Yelp user id from the reviewer profile URL, url links to that
5154+
# profile, plus name, location, and review_count); owner replies and photos are
5155+
# not included. emails accepts any page and returns its email addresses as
5156+
# data.emails ([{ email }]), read from mailto links, Cloudflare-protected
5157+
# addresses, and visible text. phone-numbers accepts any page and returns its
5158+
# valid phone numbers in E.164 as data.phone_numbers ([{ phone }]), read from tel
5159+
# links and visible text; numbers without a country code are read for the country
5160+
# of the site TLD, defaulting to US. links accepts any page and returns its unique
5161+
# http(s) links as data.links ([{ url, text }]), with absolute URLs; text falls
5162+
# back to aria-label or image alt and is null when a link has none. The emails
5163+
# parser reads the rendered page and respects content filters; the other prebuilt
5164+
# parsers read their data independently of DOM filters.
51625165
#
51635166
# @return [Symbol, ContextDev::Models::BatchSubmitParams::Input::Crawl::Data::BatchUnifiedCrawlData::ParseParams::PrebuiltParser::Parser]
51645167
required :parser,
@@ -5316,17 +5319,18 @@ class PrebuiltParser < ContextDev::Internal::Type::BaseModel
53165319
# filters are rejected, while tracking params are ignored. It returns up to 20
53175320
# latest public reviews in data.reviews with business details and
53185321
# pagination.next_offset. Each review has rating, full text, updated_at, and
5319-
# author; owner replies and photos are not included. emails accepts any page and
5320-
# returns its email addresses as data.emails ([{ email }]), read from mailto
5321-
# links, Cloudflare-protected addresses, and visible text. phone-numbers accepts
5322-
# any page and returns its valid phone numbers in E.164 as data.phone_numbers ([{
5323-
# phone }]), read from tel links and visible text; numbers without a country code
5324-
# are read for the country of the site TLD, defaulting to US. links accepts any
5325-
# page and returns its unique http(s) links as data.links ([{ url, text }]), with
5326-
# absolute URLs; text falls back to aria-label or image alt and is null when a
5327-
# link has none. The emails parser reads the rendered page and respects content
5328-
# filters; the other prebuilt parsers read their data independently of DOM
5329-
# filters.
5322+
# author (id is the Yelp user id from the reviewer profile URL, url links to that
5323+
# profile, plus name, location, and review_count); owner replies and photos are
5324+
# not included. emails accepts any page and returns its email addresses as
5325+
# data.emails ([{ email }]), read from mailto links, Cloudflare-protected
5326+
# addresses, and visible text. phone-numbers accepts any page and returns its
5327+
# valid phone numbers in E.164 as data.phone_numbers ([{ phone }]), read from tel
5328+
# links and visible text; numbers without a country code are read for the country
5329+
# of the site TLD, defaulting to US. links accepts any page and returns its unique
5330+
# http(s) links as data.links ([{ url, text }]), with absolute URLs; text falls
5331+
# back to aria-label or image alt and is null when a link has none. The emails
5332+
# parser reads the rendered page and respects content filters; the other prebuilt
5333+
# parsers read their data independently of DOM filters.
53305334
#
53315335
# @see ContextDev::Models::BatchSubmitParams::Input::Crawl::Data::BatchUnifiedCrawlData::ParseParams::PrebuiltParser#parser
53325336
module Parser

‎lib/context_dev/models/web_scrape_params.rb‎

Lines changed: 24 additions & 22 deletions
Original file line numberDiff line numberDiff line change
@@ -633,17 +633,18 @@ class PrebuiltParser < ContextDev::Internal::Type::BaseModel
633633
# filters are rejected, while tracking params are ignored. It returns up to 20
634634
# latest public reviews in data.reviews with business details and
635635
# pagination.next_offset. Each review has rating, full text, updated_at, and
636-
# author; owner replies and photos are not included. emails accepts any page and
637-
# returns its email addresses as data.emails ([{ email }]), read from mailto
638-
# links, Cloudflare-protected addresses, and visible text. phone-numbers accepts
639-
# any page and returns its valid phone numbers in E.164 as data.phone_numbers ([{
640-
# phone }]), read from tel links and visible text; numbers without a country code
641-
# are read for the country of the site TLD, defaulting to US. links accepts any
642-
# page and returns its unique http(s) links as data.links ([{ url, text }]), with
643-
# absolute URLs; text falls back to aria-label or image alt and is null when a
644-
# link has none. The emails parser reads the rendered page and respects content
645-
# filters; the other prebuilt parsers read their data independently of DOM
646-
# filters.
636+
# author (id is the Yelp user id from the reviewer profile URL, url links to that
637+
# profile, plus name, location, and review_count); owner replies and photos are
638+
# not included. emails accepts any page and returns its email addresses as
639+
# data.emails ([{ email }]), read from mailto links, Cloudflare-protected
640+
# addresses, and visible text. phone-numbers accepts any page and returns its
641+
# valid phone numbers in E.164 as data.phone_numbers ([{ phone }]), read from tel
642+
# links and visible text; numbers without a country code are read for the country
643+
# of the site TLD, defaulting to US. links accepts any page and returns its unique
644+
# http(s) links as data.links ([{ url, text }]), with absolute URLs; text falls
645+
# back to aria-label or image alt and is null when a link has none. The emails
646+
# parser reads the rendered page and respects content filters; the other prebuilt
647+
# parsers read their data independently of DOM filters.
647648
#
648649
# @return [Symbol, ContextDev::Models::WebScrapeParams::ParseParams::PrebuiltParser::Parser]
649650
required :parser, enum: -> { ContextDev::WebScrapeParams::ParseParams::PrebuiltParser::Parser }
@@ -799,17 +800,18 @@ class PrebuiltParser < ContextDev::Internal::Type::BaseModel
799800
# filters are rejected, while tracking params are ignored. It returns up to 20
800801
# latest public reviews in data.reviews with business details and
801802
# pagination.next_offset. Each review has rating, full text, updated_at, and
802-
# author; owner replies and photos are not included. emails accepts any page and
803-
# returns its email addresses as data.emails ([{ email }]), read from mailto
804-
# links, Cloudflare-protected addresses, and visible text. phone-numbers accepts
805-
# any page and returns its valid phone numbers in E.164 as data.phone_numbers ([{
806-
# phone }]), read from tel links and visible text; numbers without a country code
807-
# are read for the country of the site TLD, defaulting to US. links accepts any
808-
# page and returns its unique http(s) links as data.links ([{ url, text }]), with
809-
# absolute URLs; text falls back to aria-label or image alt and is null when a
810-
# link has none. The emails parser reads the rendered page and respects content
811-
# filters; the other prebuilt parsers read their data independently of DOM
812-
# filters.
803+
# author (id is the Yelp user id from the reviewer profile URL, url links to that
804+
# profile, plus name, location, and review_count); owner replies and photos are
805+
# not included. emails accepts any page and returns its email addresses as
806+
# data.emails ([{ email }]), read from mailto links, Cloudflare-protected
807+
# addresses, and visible text. phone-numbers accepts any page and returns its
808+
# valid phone numbers in E.164 as data.phone_numbers ([{ phone }]), read from tel
809+
# links and visible text; numbers without a country code are read for the country
810+
# of the site TLD, defaulting to US. links accepts any page and returns its unique
811+
# http(s) links as data.links ([{ url, text }]), with absolute URLs; text falls
812+
# back to aria-label or image alt and is null when a link has none. The emails
813+
# parser reads the rendered page and respects content filters; the other prebuilt
814+
# parsers read their data independently of DOM filters.
813815
#
814816
# @see ContextDev::Models::WebScrapeParams::ParseParams::PrebuiltParser#parser
815817
module Parser

0 commit comments

Comments
 (0)