Crawler policy

RSS first, robots respected, removals handled.

VistoaBot collects public article context for scoring and source analysis while respecting outlet crawl controls and removal requests.

Policy

How the crawler behaves.

Source preference

RSS is preferred where available. Public pages are used only where needed for article analysis.

Respect controls

The crawler respects robots.txt, crawl-delay, outlet kill switches, and removal requests.

Body retention

Full article bodies are held only in memory long enough to score and are not stored long-term.
User-AgentVistoaBot/1.0 (+https://vistoa.com/bot)