UmbracoCommunityBot

UmbracoCommunityBot is an automated crawler operated by Umbraco. It collects public content from the Umbraco community, such as blog posts and RSS feeds, so it can be shown and linked from Umbraco community platforms.

How to recognise it

Requests from this crawler send this User-Agent:

Mozilla/5.0 (compatible; UmbracoCommunityBot/1.0)

Requests are signed using Web Bot Auth (HTTP message signatures). Our public key is published at https://community.umbraco.com/.well-known/http-message-signatures-directory.

What it fetches

  • RSS and Atom feeds that community members or site owners have asked us to include.

  • Article pages, to read the page text and find a cover image (for example the og:image tag).

  • Favicons, found by reading the site's HTML.

It only makes ordinary read-only GET requests. It does not log in, submit forms, run JavaScript or follow links to crawl a site beyond the feeds and articles above.

Why

To list community blog posts, link back to the original authors, and show a title, summary and image alongside each link. The crawler does not republish full articles. It does not collect content to train AI models.

How it behaves

  • It follows your robots.txt, including Disallow rules and Crawl-delay.

  • It identifies itself honestly and does not try to get around blocks or challenges.

  • It keeps its request rate low and does not retry aggressively after being blocked.

Opting out or reporting a problem

To stop the crawler fetching your site, add this to your robots.txt:

User-agent: UmbracoCommunityBot
Disallow: /

To ask us to remove content, report a problem or ask a question, use the DevRel contact form.

If the crawler is causing load on your site, please tell us through the form so we can look at it quickly.