Skip to content

Commit 9fc5328

Browse files
committed
chore(docs): add robots.txt with sitemap and llms references
- Allow all crawlers and declare the sitemap URL - Reference llms.txt and llms-full.txt for LLM-friendly docs
1 parent 6606d84 commit 9fc5328

1 file changed

Lines changed: 8 additions & 0 deletions

File tree

‎docs/public/robots.txt‎

Lines changed: 8 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,8 @@
1+
User-agent: *
2+
Allow: /
3+
4+
Sitemap: https://docs-deserve.neabyte.com/sitemap.xml
5+
6+
# LLM-friendly documentation
7+
# https://docs-deserve.neabyte.com/llms.txt
8+
# https://docs-deserve.neabyte.com/llms-full.txt

0 commit comments

Comments
 (0)