Skip to content

Latest commit

 

History

History
21 lines (15 loc) · 817 Bytes

File metadata and controls

21 lines (15 loc) · 817 Bytes

Ethical crawling

Backlink Intelligence is designed for controlled SEO analysis, not high-volume indiscriminate crawling.

Built-in boundaries

  • HTTP/HTTPS only
  • identifiable user agent
  • timeouts
  • response-size limits
  • redirect limits
  • private-network blocking
  • HTML-only processing
  • repeated-URL caching inside bulk commands
  • configurable delay between bulk rows

User responsibility

Users should respect website terms, applicable laws, access controls, and reasonable request rates. Do not use the tool to bypass authentication, anti-bot controls, or technical restrictions.

For bulk prospect work, keep lists targeted and avoid repeatedly requesting the same website at aggressive rates. A hosted version should add centralized rate limiting, caching, concurrency control, and abuse prevention.