Docs: Add robots.txt, llms.txt and update documentation urls

[solid-illiaaihistov]

Summary by CodeRabbit

• Documentation
  • Updated package and website links to use https://lints.solid.software.
  • Added a plain-text overview of the lint package, including setup guidance, available rules, and related packages.
  • Enabled search engine crawling and added the site sitemap location.

[coderabbitai]

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info

⚙️ Run configuration

Configuration used: defaults

Review profile: CHILL

Plan: Advanced

Run ID: ccb38cfe-b7f7-41bb-85f0-95ef33dbef52

📥 Commits

Reviewing files that changed from the base of the PR and between 8ace26b and 447f679.

📒 Files selected for processing (4)

• doc/docusaurus/package.json
• doc/docusaurus/static/llms.txt
• doc/docusaurus/static/robots.txt
• pubspec.yaml

Included review availability: Your plan provides up to 1 included review per hour; 0 remain after this review.

---

📝 Walkthrough

Walkthrough

The documentation site now uses https://lints.solid.software. The update adds crawler directives, a sitemap reference, and an LLM-readable package overview. The package metadata points to the new documentation URL.

Changes

Documentation site metadata

Layer / File(s)	Summary
Site discovery metadata doc/docusaurus/package.json, doc/docusaurus/static/robots.txt, doc/docusaurus/static/llms.txt	The site homepage uses the new domain. robots.txt permits crawling and declares the sitemap. llms.txt documents package setup, rulesets, custom rules, and companion packages.
Package documentation URL pubspec.yaml	The package documentation URL now points to the new documentation site.

Estimated code review effort: 1 (Trivial) | ~5 minutes

Merge Risk: 🔵 Low · up to 447f6

The documentation metadata update is otherwise low risk, but the new setup example may prevent users from resolving dependencies when copied. Correct the constraint or accept the follow-up before merging.

🚥 Pre-merge checks | ✅ 5

✅ Passed checks (5 passed)

Check name	Status	Explanation
Description Check	✅ Passed	Check skipped - CodeRabbit’s high-level summary is enabled.
Title check	✅ Passed	The title accurately summarizes the main changes: adding robots.txt and llms.txt, and updating documentation URLs. It is concise and specific.
Docstring Coverage	✅ Passed	No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check. Docstring coverage is scoped to functions touched by this diff. Analyzed 0 functions across 0…
Linked Issues check	✅ Passed	Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check	✅ Passed	Check skipped because no linked issues were found for this pull request.

✨ Finishing Touches

🧪 Generate unit tests (beta)

• Create PR with unit tests

---

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

• X
• Mastodon
• Reddit
• LinkedIn

_{Comment @coderabbitai help to get the list of available commands.}