Archives of all links found in IndieWeb Search crawls.
The data folder contains a weekly archive of all links found in IndieWeb Search crawls. This archive is generated and committed to
this repository automatically.
The structure of each CSV is:
source, target, domain_name
Note: Each CSV file is over 100 megabytes.
The pagerank.py file calculates a PageRank ranking for every URL in a specified CSV.
To calculate PageRank for each item in a given CSV, run this command:
python3 pagerank.py
This project and its data is licensed under an MIT license.
- capjamesg