BuiltWith Indexing Usage Policy

The BuiltWith system visits a website to determine the technology profile it is using by looking at the publicly visible code on a website.

Millions of people benefit from understanding how websites are built using BuiltWith's free technology profile lookup tool.

Technology profiles are generated from publicly accessible information on a website that can be determined by anyone regardless of using the BuiltWith tool.

Remove a Site from BuiltWith Public Profiles

You can remove a website you own from BuiltWith public technology profiles by visiting https://builtwith.com/removals

BuiltWith User-Agent

All our requests contain a User-Agent which will include -

BW/1.1; rb.gy/oupwis

Preventing BuiltWith from indexing your website

Add the following code to the root domain robots.txt i.e. example.com/robots.txt -


User-agent: BuiltWith

Disallow: /

To block all crawlers from visiting your site -


User-agent: *

Disallow: /

We check robots.txt when indexing sites and stop if we find this directive.

What we don't do -

Store or cache any portion of your website
Visit your website more than once per 24 hours
Copy or resell any portion of your website content
Attempt to login or access restricted areas of your website

BuiltWith adheres to the Amazon AUP available at https://aws.amazon.com/aup/, Google Cloud Platform Terms of Service https://cloud.google.com/terms and Microsoft Azure's Terms of Use https://www.microsoft.com/en-us/legal/terms-of-use.

Please contact us if you have any questions or comments.