MetaCapBot
MetaCapBot is an RSS feed and Open Graph image crawler used by MetaCap to fetch headlines and article previews for display on the site.
User Agent
MetaCapBot/1.0 (+https://metacap.si/about/bot/)
What It Does
- Fetches RSS feeds from news sources
- Retrieves Open Graph images for article previews
- Does not scrape or crawl full content
Opting Out
If you wish to opt out of MetaCapBot requests, add this to your robots.txt:
User-agent: MetaCapBot
Disallow: /