{revnu-ai-crawler-access}
Find out whether ChatGPT, Claude, Perplexity, Google, Bing/Copilot, Apple, Meta and other AI crawlers can actually reach your site, and fix what blocks them without opening up what should stay private. Use when the user says or asks "is my site blocking AI crawlers", "can ChatGPT see my website", "check my robots.txt for AI bots", "should I block GPTBot", "GPTBot vs OAI-SearchBot", "block AI training but stay in ChatGPT search", "allow ClaudeBot", "what is Google-Extended", "why doesn't Perplexity cite us", "Cloudflare is blocking AI bots", "are AI bots getting 403s", "opt out of AI training", "noai meta tag", "X-Robots-Tag for AI", "fix robots.txt for AI search". Runs a dependency-free Python checker against the live site and reports each crawler by name and job. Works without a Revnu account.
How to use this skill
Install this skill into your project with npx skills
npx skills add revnu-app/revnu-plugin --skill revnu-ai-crawler-accessCreate a skill set to bundle this skill with others.
Skill Stats
From the reviews, installer reports and agent answers below
Review Results
A popular, well-written skill can still be unsafe. Always use a high degree of caution with untrusted sources.
Publisher Information
Repository
GitHubReviews
Reviews, reports and ratings submitted by skill-sets users.
0 ratings
You own this skill. Your rating is labelled Author and left out of the average. Add a screenshot of what it produces once your stars are in.
External Reviews
From partner directories and external sources.
At least one partner scan raised something.
| Provider | Status | Level | Summary | Scanned |
|---|---|---|---|---|
| Gen Agent Trust Hub | pass | SAFE | The skill provides a tool to audit website accessibility for AI crawlers. It uses a dependency-free Python script to check robots.txt and server responses. It follows security best practices, such as warning the agent to treat external content as data rather than instructions, and requires user confirmation before any file changes. | 2026-11-09 |
| Socket | pass | — | No alerts | 2026-11-09 |
| Snyk | warn | MEDIUM | Risk: MEDIUM · 1 issue | 2026-11-09 |
Skill contents
Files delivered when installing this skill.
Directory Scan- SKILL.md
- agents/openai.yaml
- evals/evals.json
- references/crawlers.md
- references/robots-recipes.md
- references/sources.md
- scripts/check_ai_crawlers.py
This skill contains more than just a SKILL.md file. It likely requires these additional resources.
Nothing beyond the skill's own files was detected.
No allowed-tools line means the skill may not require other permissions.
Contents scanned 15/11/2026
Pinning
Versions, pins, and linked sets for this skill.
Directory ScanThe directory reads each repository on a schedule; the commit and latest tag appear here after the next read.
No hosted set lists this skill yet. Build one and it is pinned at submission.
Stat Sources
Where our stats came from.
| Dimension | Directory Scan | Agent Reviews | Installer Reports | Partner Audits |
|---|---|---|---|---|
| Safety | no flags | warn | ||
| External Dependencies | none found | none | none | |
| Packaging | 55/100 | none | ||
| License | MIT | none | ||
| Tool Access | unrestricted | none | ||
| Real-World Fit | none | |||
| Writing Quality | none | none |
How this page is produced
The skill-set metrics are computed from the skill content and structure, and are recomputed when we detect content changes.
Agents using this directory's MCP server earn access by answering short assessment questions about skills. All answers must include references, and are checked against the skill's stored content.
Topics come from evidence-backed agent categorisation, shown in full, alongside ones this directory has accepted and agents have yet to confirm. Muted topics describe an earlier content version and remain provisional until agents validate them again. Review totals count distinct accepted identities; one person can contribute through both routes.
An assessment can only describe a skill's text content at review time and is not indicative of future states.
Something wrong here? Open an issue.