Skip to content

Add crawlerdata/crawlerdata_google_search 0.0.1 - #3375

Open
adibenmati wants to merge 1 commit into
langgenius:mainfrom
CrawlerData:add-crawlerdata-google-search
Open

adibenmati wants to merge 1 commit into
langgenius:mainfrom
CrawlerData:add-crawlerdata-google-search

Conversation

@adibenmati

Copy link
Copy Markdown

Plugin Submission

Plugin information

Submission type

  • New plugin
  • Version update

What changed

New tool plugin with two tools backed by the CrawlerData API (https://crawlerdata.com): Google Search (organic results, Google's AI Overview text with its cited sources when present, related questions) and Google News. Authentication is a single API key credential (api_key, secret-input). Each call is one HTTPS request to https://api.crawlerdata.com/v1/jobs.

Risk level

  • Low risk
  • Medium risk

Required checks

  • I have read and followed the Marketplace submission requirements.
  • I have read and comply with the Plugin Developer Agreement.
  • I tested this plugin on Dify Community Edition and Dify Cloud, or documented any limitation below. Limitation: not yet run inside Dify. The tool and provider code was tested against the live CrawlerData API (search, news, valid/invalid/missing key, credential validation) using a stand-in for the SDK base classes, and the package was built and validated with the official dify-plugin CLI (0.6.11). I will test on Dify Cloud/CE and report here if reviewers find anything.
  • The package contains only files needed at runtime.
  • The package does not contain secrets, local credentials, .env files, .git directories, virtual environments, caches, logs, or IDE files.
  • The package does not contain executables or bundled binaries, or I explained why they are required below.
  • The plugin README includes setup steps, usage instructions, required APIs or credentials, connection requirements, and the source repository link.
  • The plugin includes PRIVACY.md or a hosted privacy policy, and manifest.yaml references it.
  • All user-facing text is primarily in English, with any localized README files following the i18n guidance.

Security and privacy notes

None of the sensitive capabilities listed. The plugin makes requests only to the fixed endpoint https://api.crawlerdata.com/v1/jobs with a 120 s timeout, sends the query, country code and the user's API key, and does not log or store anything. Errors never include the key.

Local validation

dify-plugin plugin package ./crawlerdata-google-search -o crawlerdata_google_search.difypkg
INFO plugin packaged successfully

Tool/provider code run against the live API: search returns text + JSON (AI Overview, organic results, related questions), news returns text + JSON, a bad key returns "The CrawlerData API key was rejected.", a missing key returns "A CrawlerData API key is required.", and _validate_credentials rejects a bad key and accepts a good one.

Reviewer notes

Free credits for reviewers: a verified work email on https://app.crawlerdata.com gets 50 free credits; if a test key would help, tell us here or at contact@crawlerdata.com and we will provide one.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@github-actions github-actions Bot added the risk: medium Medium-risk Marketplace submission label Oct 17, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

risk: medium Medium-risk Marketplace submission

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant