Glossary
Crawler policy
A crawler policy is the set of robots.txt rules, and the public statement beside them, that say which automated agents may fetch a site.
A policy that blocks GPTBot, ClaudeBot, PerplexityBot, or Google-Extended is a decision not to be retrieved by those systems. That can be legitimate. It cannot be combined with a wish to be cited by the products those crawlers feed.
Allowing a crawler is not permission for the model to invent claims. It is permission to read the page. The page still has to be worth quoting.
Named North allows the major answer-engine crawlers. The machine-readable file is robots.txt. The explanation is For machines.