TellstackBot

TellstackBot is the crawler behind Tellstack, which tells people what technology a website is built with. If it visited you, this is what it did and how to stop it.

What it fetches

Your robots.txt first, then your homepage and at most two other pages linked from it. That is all, about once a month, or sooner when a Tellstack customer asks about your site. It reads response headers, cookie names, script and stylesheet addresses and meta tags, and it looks up your public DNS records. It doesn’t run JavaScript, submit forms, log in or follow links beyond those pages.

How it behaves

It identifies itself as TellstackBot/1.0 with a link to this page. It obeys robots.txt, including Crawl-delay, and waits at least 1.5 seconds between requests to one host. If your site answers with a bot check, a challenge page or a 429, it stops and leaves your site alone for 90 days. It never uses proxies or rotates addresses to get round a block.

Opting out

Add this to your robots.txt and we won’t fetch anything else from your site:

User-agent: TellstackBot
Disallow: /

To have your site removed from the index, email admin@onibaku.co.uk with the domain.