For site owners
BotsmanBot

BotsmanBot reads a web page when someone using Botsman asks about it — to analyse it, summarise it, or learn about their own company. It reads one page at a time, only on request, and doesn’t crawl.

1

How it identifies itself

Every request carries the user agent Mozilla/5.0 (compatible; BotsmanBot/1.0; +https://botsman.io/bot). For pages built with JavaScript it may load the page in a headless browser, with the same user agent. It never disguises itself and never tries to get past a bot check — a site that blocks it is told to the person as blocked.

2

Letting it in (Cloudflare)

If your site is behind Cloudflare and you want Botsman to read it — your own company site, for example — add a custom rule in Security → WAF → Custom rules: when User Agent contains BotsmanBot, choose Skip and tick the bot protections you use (Super Bot Fight Mode and managed challenges). On Cloudflare’s free plan, Bot Fight Mode can’t be skipped by a rule; switching it off is the only option there. A user agent can be copied by anyone, so allow it only where reading is harmless.

3

Keeping it out

Block the user agent BotsmanBot in your firewall or CDN and it won’t read your pages. People can still send a page they’re viewing from their own browser with the Send to Botsman button, the same as copying it by hand.

Questions? support@botsman.io