BuiltWith Indexing Usage Policy

The BuiltWith system visits a website to determine the technology profile it is using by looking at the publicly visible code on a website.

Millions of people benefit from understanding how websites are built using BuiltWith's free technology profile lookup tool.

Technology profiles are generated from publicly accessible information on a website that can be determined by anyone regardless of using the BuiltWith tool.

Remove a Site from BuiltWith Public Profiles

You can remove a website you own from BuiltWith public technology profiles by visiting https://builtwith.com/removals

BuiltWith User-Agent

All our requests contain a User-Agent which will include -

BW/1.1; rb.gy/oupwis

Preventing BuiltWith from indexing your website

Add the following code to the root domain robots.txt i.e. example.com/robots.txt -

User-agent: BuiltWith
Disallow: /

To block all crawlers from visiting your site -

User-agent: *
Disallow: /

We check robots.txt when indexing sites and stop if we find this directive.

What we don't do -

  • Store or cache any portion of your website
  • Visit your website more than once per 24 hours
  • Copy or resell any portion of your website content
  • Attempt to login or access restricted areas of your website

BuiltWith adheres to the Amazon AUP available at https://aws.amazon.com/aup/, Google Cloud Platform Terms of Service https://cloud.google.com/terms and Microsoft Azure's Terms of Use https://www.microsoft.com/en-us/legal/terms-of-use.

Please contact us if you have any questions or comments.

BuiltWith® Pty Ltd - © 2024 - ACN 167 706 470 - 35th Floor, One International Towers, 100 Barangaroo Avenue, Sydney, NSW 2000, Australia