Repository navigation
Create Python scraper for automatic book metadata collection #541
Description
Description
Overview
Develop a Python-based scraper/API integration that automatically collects metadata for books displayed on the platform.
Features
Fetch book title
Author name
Cover image URL
Genre
Summary/description
Ratings (optional)
Suggested Tech Stack
Python
BeautifulSoup / Requests
Selenium (if needed)
OpenLibrary API or Google Books API
Expected Outcome
The scraper should generate structured JSON/CSV data that can later be integrated into the frontend recommendation system.
Possible Enhancements
Cache scraped results
Duplicate detection
Auto-update metadata periodically
Activity
manthanukhalkar029 commentedon May 15, 2026
Hi, I would like to work on this issue.
My approach will be to build a Python-based metadata fetcher using the Google Books API/OpenLibrary API to automatically collect book details such as title, author, genre, summary, cover image URL, and ratings.
I also plan to structure the output in JSON/CSV format for easy frontend integration. Additionally, I can work on enhancements like duplicate detection, caching previously fetched results, and support for periodic metadata updates.
I’ll first implement a clean API integration module and then extend it with data validation and optimization features if needed.
RamaMavuduru commentedon May 15, 2026
Hi, I would like to work on this issue. I plan to implement a Python script using OpenLibrary API to fetch metadata and store it in structured JSON/CSV with duplicate detection and caching.
Komal-11k commentedon May 15, 2026
Hi, I am a GSSoC 2026 contributor and would like to work on this issue.
I've reviewed the issue-
Here's what i will do:
Approach:
fallback to OpenLibrary API for missing data
description, cover image URL, published date, ratings
missing fields and rate limits
READMEon how to run the scraperand configure the API key via
.envPlease assign this to me!
MONIKA0711-gh commentedon May 16, 2026
Hi @devanshi14malhotra ,
I'm a GSSoC'26 Contributor. i have worked and had experience on Python, data preprocessing and Machine Learning. I would like to work on this issue. Please assign this issue to me.
MaheshReddy-ML commentedon May 16, 2026
Hi @devanshi14malhotra 👋
I’m interested in working on this issue: Create Python scraper for automatic book metadata collection #541 under GSSoC’26.
I have experience with Python, backend workflows, and data preprocessing. I’d like to build a robust and modular scraper for collecting structured book metadata efficiently.
I’ll ensure clean, well-documented code with proper error handling and scalability considerations.
Kindly assign this issue to me. Looking forward to contributing 🚀
jhamuskan1909 commentedon May 16, 2026
Hi @devanshi14malhotra!
I'd love to work on issue #541. I'm a Python developer contributing to GSSoC '26 on the AI/Agents track.
My approach:
Bonus enhancements I plan to add:
I understand the expected output is structured JSON/CSV data that can plug into the recommendation system directly.
Could you please assign this issue to me? I'll submit a PR within 3-4 days.
manthanukhalkar029 commentedon May 16, 2026
@devanshi14malhotra I have given PR for the same , you may accept the PR after checking it
Eishita0506 commentedon May 16, 2026
Hi @devanshi14malhotra I am interested in working on this issue. Please assign it to me