If you see one of the following user agents in your web server logs, it means Twingly has visited your website. You can read more about our services on Twingly.com.
Mozilla/5.0 (compatible; Twingly Recon; twingly.com)
Twingly Recon-<subsystem>/1.0 (+https://developer.twingly.com)
<subsystem> may vary depending upon which crawler that visited your website.
According to the Robots exclusion standard, you can inform Twingly’s crawler to not process your site by adding a
# This will restrict access to /private/ User-agent: Twingly Recon Disallow: /private/
You can ensure that your site is not indexed by Twingly by changing your feed in any of the following three ways:
<meta xmlns="http://www.w3.org/1999/xhtml" name="robots" content="noindex" />
We may still visit your feed from time to time, but nothing will be indexed as long as any of the directives are kept.