About CohelmBot
CohelmBot is the fetcher behind the Cohelm Business Health Check. It only visits a site when someone asks us to check that site. It is not a continuous crawler and it does not build an index.
How to identify it
Every request carries this User-Agent:
Mozilla/5.0 (compatible; CohelmBot/0.1; +https://cohelm.co/bot)What it does
- Fetches the homepage, robots.txt, the XML sitemap and a small sample of internal pages (typically 10–30 URLs in total).
- Makes at most three concurrent requests to any one host, and stops after roughly a minute.
- Sends HEAD requests first where a full body is not needed.
- Reads public DNS and registry data about the domain from third-party resolvers, not from your server.
- Runs only when a person submits the URL. Nothing is scheduled or repeated automatically.
What it never does
- Submit forms, create accounts, log in, or click buttons.
- Download media, execute purchases, or attempt to access non-public paths beyond a handful of well-known files (such as
.envand.git/HEAD) checked only to warn the site owner if they are exposed. - Store page content beyond the two hours a report link remains live.
Blocking it
Add this to your robots.txt and the crawl portion of the check will honour it:
User-agent: CohelmBot
Disallow: /If your firewall rate-limits or blocks us, the report marks those checks as “blocked” rather than failed, so you are not penalised.
Contact
Questions or concerns about the scanner: hello@cohelm.co.