crawl-manager
delegation trigger — the description Claude reads
Delegate when the user wants to run the local scrapyd/scrapydweb docs crawler, trigger a full/cold re-crawl of claude/anthropic/support/platform/code/scrapyd/ scrapy targets, push freshly-crawled content to the live agentcrawls.com R2 bucket, or check the crawl dashboard's job status. Do NOT delegate for editing Worker code (workers/agentcrawls) or the Scrapy pipeline itself (crawlers/claude_docs) — this agent orchestrates existing crawl/push commands, it does not modify their source.
tools allowlist
Bash Read
max turns
20
generated file
.claude/agents/crawl-manager.yaml -- where the full system prompt lives; regenerated by cargo run -p agent-gen, never hand-edited.
provenance
source_site subagentcode.com · created 2026-07-10 18:13:16 · JSON
Typed source: crates/agent-gen/src/agents.rs -- see the schema page for the field-by-field mapping.