Log In · Signup for Free
EN  DE  FR  ES  IT  Русский  한국어  日本語  简体中文  عربي
🤖
Live and expired websites.BAR

Datasets .BAR All Robots.txt

Download a current list of Datasets .BAR All Robots.txt with website, company, location and technology detection fields.

One-time dataset price
$495.00

One-time delivery in Parquet or TSV format.

Buy Dataset

Compare Team Plan Ultra

Dataset facts
Domains
16,701
Detections
675,232
Generated
2026-07-26 UTC
Formats
Parquet, TSV
Scope
.BAR
What's included
  • ✓ Domain and technology detection history
  • ✓ Company and website location signals
  • ✓ Spend, revenue and employee estimates
  • ✓ Traffic and authority rankings
  • ✓ Available business contact and social fields
View fields and technical schema →
Find another dataset
Browse all datasets
Dataset sampleParquet sampleTSV sample

Preview representative rows before purchasing. Full downloads contain all available fields and records.

DomainTechnologyFirst detectedLast detectedCompanyLocationSpend
hay88.barCloudflare Hosting2024-05-142026-07-21$240
hay88.barAlibaba2024-08-232024-08-23$240
hay88.barTengine2025-05-072025-05-07$240
hay88.barCloudflare DNS2025-09-022026-07-21$240
jilimacao.barContent Delivery Network2024-05-142026-07-27$1,466
jilimacao.barLiveChat2024-05-142026-07-27$1,466
jilimacao.barViewport Meta2024-05-142026-07-27$1,466
jilimacao.barMobile Non Scaleable Content2024-05-142026-07-27$1,466
wigancentral.barTwitter Timeline2014-10-262021-04-20Wallgate, ENG, GB$1,071
wigancentral.barGoogle Font API2014-10-262023-12-22Wallgate, ENG, GB$1,071
wigancentral.barTwitter Platform2014-10-262021-04-20Wallgate, ENG, GB$1,071
wigancentral.barApache2014-10-262019-01-17Wallgate, ENG, GB$1,071
thewhiteswan.barSquarespace2024-07-102026-07-26$122
thewhiteswan.barFacebook2024-07-102026-07-26$122
thewhiteswan.barInstagram2024-07-102026-07-26$122
thewhiteswan.barX2024-07-102026-07-26$122
soak.barFacebook for Websites2019-07-022026-07-24SOAK Bar BeautyElwood, Victoria, AU$352
soak.barViewport Meta2019-07-022026-07-24SOAK Bar BeautyElwood, Victoria, AU$352
soak.barIPhone / Mobile Compatible2019-07-022026-07-24SOAK Bar BeautyElwood, Victoria, AU$352
soak.barSquarespace2019-07-022026-07-24SOAK Bar BeautyElwood, Victoria, AU$352
eighttothe.barSquarespace2024-08-202026-07-24Eight To The BarRichmond, IN, US$590
eighttothe.barLocalBusiness Schema2024-08-202026-02-24Eight To The BarRichmond, IN, US$590
eighttothe.barFacebook2024-08-202026-07-24Eight To The BarRichmond, IN, US$590
eighttothe.barInstagram2024-08-202026-07-24Eight To The BarRichmond, IN, US$590
theusual.barViewport Meta2019-08-252026-07-24The UsualFort Worth, TX, US$262
theusual.barIPhone / Mobile Compatible2019-08-252026-07-24The UsualFort Worth, TX, US$262
theusual.barContent Delivery Network2019-08-252026-07-24The UsualFort Worth, TX, US$262
theusual.barBootstrapCDN2019-08-252020-10-23The UsualFort Worth, TX, US$262
fredsplace.barSSL by Default2023-08-142026-07-26Mountain View, CA, US$800
fredsplace.barAggregateRating Schema2023-08-142026-07-26Mountain View, CA, US$800
fredsplace.barGeoCoordinates Schema2023-08-142026-07-26Mountain View, CA, US$800
fredsplace.barOpeningHoursSpecification Schema2023-08-142026-07-26Mountain View, CA, US$800
Related datasets
Live and Expired websites using Robots.txt128,929,443Live and Expired websites using Robots.txt in .COM TLD78,255,867Live websites using Robots.txt33,854,084Live websites using Robots.txt in .COM TLD21,637,530Live and Expired websites using Robots.txt in United States7,953,549Live and Expired websites using Robots.txt in .ORG TLD5,191,806Live and Expired websites using Robots.txt in .NET TLD5,187,818Live and Expired websites using Robots.txt in .RU TLD3,706,386