Bot Info & Opt-Out

HeelerRescueBot is a polite web crawler operated by HeelerRescue.org. It collects information about adoptable Australian Cattle Dogs from a hand-curated list of rescue organization websites to help dogs find homes.

User-Agent

HeelerRescueBot/1.0 (+https://heelerrescue.org/bot; [email protected])

What the bot does

  • Reads robots.txt on every domain and respects all directives including Crawl-delay
  • Honors noindex and nofollow meta tags and X-Robots-Tag headers
  • Crawls only a hand-curated allowlist of rescue sites — not the open web
  • Extracts only: dog name, approximate location, one photo thumbnail, a short snippet, and the source URL
  • Links out to the original adoption page — we never republish full listings
  • Limits requests to approximately one request per several seconds per domain
  • Refreshes listings at most once or twice daily per site

What we collect and how we use it

We collect minimal listing data (name, location, one thumbnail URL, short snippet, source URL) to display adoptable dogs on HeelerRescue.org. All traffic is directed back to your adoption page. We do not republish your full listings, we do not host your images, and we do not compete with your adoption platform.

Opt out

To block HeelerRescueBot immediately, add the following to your robots.txt:

User-agent: HeelerRescueBot
Disallow: /

You can also submit the form below and we'll remove your site from our allowlist within 48 hours. Or email us directly at [email protected].

Submit Opt-Out Request