Align SDK with current API documentation

Add the latest documented endpoints, remove obsolete YouTube APIs, and update supported Python tooling and documentation so the SDK matches the current public API surface.

Author: sahilsunny

.github/workflows/main.yaml

@@ -17,7 +17,7 @@ jobs:
     runs-on: ubuntu-latest
     strategy:
       matrix:
-        python-version: ['3.10', '3.11']
+        python-version: ['3.10', '3.11', '3.12', '3.13', '3.14']
     steps:
     - uses: actions/checkout@v3
     - name: Set up Python

CHANGELOG.md

@@ -1,26 +1,28 @@
 # Changelog
 
-## [2.1.0](https://github.com/ScrapingBee/scrapingbee-python/compare/v2.0.2...v2.1.0) (2024-12-18)
+## [2.1.0](https://github.com/ScrapingBee/scrapingbee-python/compare/v2.0.2...v2.1.0) (2026-07-20)
 
 ### Features
 
 - Added `html_api()` method for HTML API with unified GET/POST support
 - Added `google_search()` method for Google Search API
+- Added `fast_search()` method for Fast Search API
 - Added `amazon_search()` method for Amazon Search API
 - Added `amazon_product()` method for Amazon Product API
+- Added `amazon_pricing()` method for Amazon Pricing API
 - Added `walmart_search()` method for Walmart Search API
 - Added `walmart_product()` method for Walmart Product API
 - Added `youtube_search()` method for YouTube Search API
 - Added `youtube_metadata()` method for YouTube Metadata API
-- Added `youtube_transcript()` method for YouTube Transcript API
-- Added `youtube_trainability()` method for YouTube Trainability API
+- Added `youtube_subtitles()` method for YouTube Subtitles API
 - Added `chatgpt()` method for ChatGPT API
+- Added `gemini()` method for Gemini API
 - Added `usage()` method for Usage API
 - Refactored internal `request()` method to be API-agnostic
 
 ### Deprecated
 
-- `get()` and `post()` methods are deprecated in favor of `html_api()` method
+- `get()` and `post()` are deprecated in favor of `html_api()` and will be removed in version 3.0.0.
 
 ## [2.0.2](https://github.com/ScrapingBee/scrapingbee-python/compare/v2.0.1...v2.0.2) (2025-10-02)
 
@@ -47,4 +49,4 @@
 
 ### Breaking change
 
-- No need to url encode params anymore.
+- No need to url encode params anymore.

README.md

@@ -24,10 +24,12 @@ Signup to ScrapingBee to [get your API key](https://app.scrapingbee.com/account/
 
 - [HTML API](#html-api)
 - [Google Search API](#google-search-api)
+- [Fast Search API](#fast-search-api)
 - [Amazon API](#amazon-api)
 - [Walmart API](#walmart-api)
 - [YouTube API](#youtube-api)
 - [ChatGPT API](#chatgpt-api)
+- [Gemini API](#gemini-api)
 - [Usage API](#usage-api)
 
 ---
@@ -86,9 +88,28 @@ print(response.json())
 
 ---
 
+## Fast Search API
+
+Lightweight Google search results in under a second.
+
+```python
+response = client.fast_search(
+    search='pizza in new york',
+    params={
+        'country_code': 'us',
+        'language': 'en',
+        'page': 1
+    }
+)
+
+print(response.json())
+```
+
+---
+
 ## Amazon API
 
-Scrape Amazon search results and product details.
+Scrape Amazon search results, product details, and pricing.
 
 ### Amazon Search
 
@@ -118,6 +139,20 @@ response = client.amazon_product(
 print(response.json())
 ```
 
+### Amazon Pricing
+
+```python
+response = client.amazon_pricing(
+    asin='B0DPDRNSXV',
+    params={
+        'domain': 'com',
+        'light_request': True
+    }
+)
+
+print(response.json())
+```
+
 ---
 
 ## Walmart API
@@ -155,7 +190,7 @@ print(response.json())
 
 ## YouTube API
 
-Scrape YouTube search results, video metadata, and transcripts.
+Scrape YouTube search results, video metadata, and subtitles.
 
 ### YouTube Search
 
@@ -178,23 +213,19 @@ response = client.youtube_metadata(video_id='dQw4w9WgXcQ')
 print(response.json())
 ```
 
-### YouTube Transcript
+### YouTube Subtitles
 
 ```python
-response = client.youtube_transcript(
+response = client.youtube_subtitles(
     video_id='dQw4w9WgXcQ',
-    params={'language': 'en'}
+    params={
+        'language': 'en',
+        'subtitle_origin': 'uploader_provided'
+    }
 )
 print(response.json())
 ```
 
-### YouTube Trainability
-
-```python
-response = client.youtube_trainability(video_id='dQw4w9WgXcQ')
-print(response.json())
-```
-
 ---
 
 ## ChatGPT API
@@ -215,6 +246,24 @@ print(response.json())
 
 ---
 
+## Gemini API
+
+Send prompts to Gemini and receive AI-generated responses.
+
+```python
+response = client.gemini(
+    prompt='Best programming languages for data science',
+    params={
+        'country_code': 'us',
+        'add_html': False
+    }
+)
+
+print(response.json())
+```
+
+---
+
 ## Usage API
 
 Check your API credit usage.

manual-test.py

@@ -312,6 +312,33 @@ def test_google_search():
         raise
 
 
+# ============================================
+# Fast Search API
+# ============================================
+
+def test_fast_search():
+    print("=== Testing Fast Search API ===")
+    try:
+        response = client.fast_search(
+            search="scrapingbee",
+            params={"country_code": "us", "language": "en"}
+        )
+
+        assert_test(response.status_code == 200, f"Expected status 200, got {response.status_code}")
+
+        data = response.json()
+        assert_test(data.get("organic"), "Missing organic in response")
+        assert_test(isinstance(data.get("organic"), list), "organic is not a list")
+        assert_test(len(data.get("organic", [])) > 0, "No organic results found")
+
+        print(f"Status: {response.status_code}")
+        print(f"Results found: {len(data.get('organic', []))}")
+        print("✅ Fast Search test passed!\n")
+    except Exception as e:
+        print(f"❌ Fast Search test failed: {e}\n")
+        raise
+
+
 # ============================================
 # Amazon API
 # ============================================
@@ -360,6 +387,28 @@ def test_amazon_product():
         raise
 
 
+def test_amazon_pricing():
+    print("=== Testing Amazon Pricing API ===")
+    try:
+        response = client.amazon_pricing(
+            asin="B0DPDRNSXV",
+            params={"domain": "com"}
+        )
+
+        assert_test(response.status_code == 200, f"Expected status 200, got {response.status_code}")
+
+        data = response.json()
+        assert_test(data.get("pricing") is not None or data.get("asin"), "Missing pricing data in response")
+
+        print(f"Status: {response.status_code}")
+        print(f"ASIN: {data.get('asin')}")
+        print(f"Offers: {len(data.get('pricing', []))}")
+        print("✅ Amazon Pricing test passed!\n")
+    except Exception as e:
+        print(f"❌ Amazon Pricing test failed: {e}\n")
+        raise
+
+
 # ============================================
 # Walmart API
 # ============================================
@@ -453,56 +502,63 @@ def test_youtube_metadata():
         raise
 
 
-def test_youtube_transcript():
-    print("=== Testing YouTube Transcript API ===")
+def test_youtube_subtitles():
+    print("=== Testing YouTube Subtitles API ===")
     try:
-        response = client.youtube_transcript(
-            video_id="sfyL4BswUeE",
+        response = client.youtube_subtitles(
+            video_id="dQw4w9WgXcQ",
             params={"language": "en"}
         )
 
         assert_test(response.status_code == 200, f"Expected status 200, got {response.status_code}")
 
         data = response.json()
-        assert_test(data.get("text") or data.get("transcript"), "Missing transcript in response")
+        assert_test(data.get("subtitles"), "Missing subtitles in response")
 
-        transcript_preview = (data.get("text") or str(data.get("transcript", "")))[:100]
         print(f"Status: {response.status_code}")
-        print(f"Transcript preview: {transcript_preview}")
-        print("✅ YouTube Transcript test passed!\n")
+        print(f"Subtitle origins: {list(data.get('subtitles', {}).keys())}")
+        print("✅ YouTube Subtitles test passed!\n")
     except Exception as e:
-        print(f"❌ YouTube Transcript test failed: {e}\n")
+        print(f"❌ YouTube Subtitles test failed: {e}\n")
         raise
 
 
-def test_youtube_trainability():
-    print("=== Testing YouTube Trainability API ===")
+# ============================================
+# ChatGPT API
+# ============================================
+
+def test_chatgpt():
+    print("=== Testing ChatGPT API ===")
     try:
-        response = client.youtube_trainability(video_id="dQw4w9WgXcQ")
+        response = client.chatgpt(
+            prompt="What is web scraping? Answer in one sentence.",
+            params={"search": True}
+        )
 
         assert_test(response.status_code == 200, f"Expected status 200, got {response.status_code}")
 
         data = response.json()
-        assert_test(data.get("permitted") is not None, "Missing permitted field in response")
+        assert_test(data.get("results_text") or data.get("results_markdown"), "Missing response text")
 
+        response_text = (data.get("results_text") or data.get("results_markdown", ""))[:100]
         print(f"Status: {response.status_code}")
-        print(f"Permitted: {data.get('permitted')}")
-        print("✅ YouTube Trainability test passed!\n")
+        print(f"Response: {response_text}")
+        print("✅ ChatGPT test passed!\n")
     except Exception as e:
-        print(f"❌ YouTube Trainability test failed: {e}\n")
+        print(f"❌ ChatGPT test failed: {e}\n")
         raise
 
 
 # ============================================
-# ChatGPT API
+# Gemini API
 # ============================================
 
-def test_chatgpt():
-    print("=== Testing ChatGPT API ===")
+def test_gemini():
+    print("=== Testing Gemini API ===")
     try:
-        response = client.chatgpt(
+        response = client.gemini(
             prompt="What is web scraping? Answer in one sentence.",
-            params={"search": True}
+            params={"country_code": "us"}
         )
 
         assert_test(response.status_code == 200, f"Expected status 200, got {response.status_code}")
@@ -513,9 +569,9 @@ def test_chatgpt():
         response_text = (data.get("results_text") or data.get("results_markdown", ""))[:100]
         print(f"Status: {response.status_code}")
         print(f"Response: {response_text}")
-        print("✅ ChatGPT test passed!\n")
+        print("✅ Gemini test passed!\n")
     except Exception as e:
-        print(f"❌ ChatGPT test failed: {e}\n")
+        print(f"❌ Gemini test failed: {e}\n")
         raise
 
 
@@ -570,15 +626,17 @@ def run_tests():
 
         # Other APIs
         test_google_search,
+        test_fast_search,
         test_amazon_search,
         test_amazon_product,
+        test_amazon_pricing,
         test_walmart_search,
         test_walmart_product,
         test_youtube_search,
         test_youtube_metadata,
-        test_youtube_transcript,
-        test_youtube_trainability,
+        test_youtube_subtitles,
         test_chatgpt,
+        test_gemini,
         test_usage,
     ]