MICROFPGA.COM

GNU Terry Pratchett

GNU Terry Pratchett Usage Statistics · Download List of All Websites using GNU Terry Pratchett

A long-running tribute to late fantasy author Sir Terry Pratchett. X-Clacks-Overhead.

AmazonBot Disallow

AmazonBot Disallow Usage Statistics · Download List of All Websites using AmazonBot Disallow

AmazonBot is a crawler that web content publishers can refer to for information - website has disallow rules.

AI Bot

1and1

1and1 Usage Statistics · Download List of All Websites using 1and1

1&1 internet packaged hosting, mail and eCommerce solutions owned by United Internet and incorporating Schlund and Partners.

UK hosting

IONOS

IONOS Usage Statistics · Download List of All Websites using IONOS

IONOS is a hosting provider that offers cloud solutions, web hosting, and other services such as websites, domains, and servers.

US hosting

SSL by Default

SSL by Default Usage Statistics · Download List of All Websites using SSL by Default

The website redirects traffic to an HTTPS/SSL version by default.

LetsEncrypt

LetsEncrypt Usage Statistics · Download List of All Websites using LetsEncrypt

Let’s Encrypt is a free open Certificate Authority.

Root Authority

IONOS DNS

IONOS DNS Usage Statistics · Download List of All Websites using IONOS DNS

Domain NS hosted at IONOS

IONOS Mail

IONOS Mail Usage Statistics · Download List of All Websites using IONOS Mail

Email hosted at IONOS.

SPF

SPF Usage Statistics · Download List of All Websites using SPF

The Sender Policy Framework is an open standard specifying a technical method to prevent sender address forgery.

nginx

nginx Usage Statistics · Download List of All Websites using nginx

nginx [engine x] is a HTTP server and mail proxy server written by Igor Sysoev.

Ubuntu

Ubuntu Usage Statistics · Download List of All Websites using Ubuntu

Ubuntu is a free, Debian derived Linux-based operating system, available with both community and professional support.

IPv6

IPv6 Usage Statistics · Download List of All Websites using IPv6

The website has an IPv6 record.

Anthropic Claude Bot Disallow

Anthropic Claude Bot Disallow Usage Statistics · Download List of All Websites using Anthropic Claude Bot Disallow

Block Anthropic Claude bot.

AI Bot

AppleBot Disallow

AppleBot Disallow Usage Statistics · Download List of All Websites using AppleBot Disallow

The website has disallow rules for Applebot.

Apple AI Bot Disallow

Apple AI Bot Disallow Usage Statistics · Download List of All Websites using Apple AI Bot Disallow

Disallow rule for Apple AI Bot

AI Bot

ByteDance Bytespider Disallow

ByteDance Bytespider Disallow Usage Statistics · Download List of All Websites using ByteDance Bytespider Disallow

Doubao potentail AI bot disallow rule.

AI Bot

Common Crawl Bot Disallow

Common Crawl Bot Disallow Usage Statistics · Download List of All Websites using Common Crawl Bot Disallow

Block a site from being crawled by Common Crawl Crawler.

AI Bot

GPTBot Disallow

GPTBot Disallow Usage Statistics · Download List of All Websites using GPTBot Disallow

The website has disallow rules for OpenAI GPTBot.

AI Bot

Cohere AI Disallow

Cohere AI Disallow Usage Statistics · Download List of All Websites using Cohere AI Disallow

Disallow rules for Cohere AI bot.

AI Bot

Diffbot Disallow

Diffbot Disallow Usage Statistics · Download List of All Websites using Diffbot Disallow

Diffbot uses AI to extract data from websites - this website blocks it.

AI Bot

Facebook Bot Disallow

Facebook Bot Disallow Usage Statistics · Download List of All Websites using Facebook Bot Disallow

Blocks Facebook crawling.

AI Bot

Google Bard Disallow

Google Bard Disallow Usage Statistics · Download List of All Websites using Google Bard Disallow

The website blocks Bard AI and Vertex AI scraping requests.

AI Bot

Webz Omgili Disallow

Webz Omgili Disallow Usage Statistics · Download List of All Websites using Webz Omgili Disallow

Webz.io disallow block for big data indexing.

AI Bot

Perplexity

Perplexity Usage Statistics · Download List of All Websites using Perplexity

AI chatbot-powered research and conversational search engine disallow rules.

AI Bot

Semrush Bot Disallow

Semrush Bot Disallow Usage Statistics · Download List of All Websites using Semrush Bot Disallow

The website has disallow rules for Semrush Bot.

YOU Disallow

YOU Disallow Usage Statistics · Download List of All Websites using YOU Disallow

Leverage a personal AI search assistant & customized recommendations bot disallow rule.

AI Bot