Log In · Signup for Free
EN  DE  FR  ES  IT  Русский  한국어  日本語  简体中文  عربي
🤖
Live and expired websites.COMPANY

Datasets .COMPANY All Robots.txt

Download a current list of Datasets .COMPANY All Robots.txt with website, company, location and technology detection fields.

One-time dataset price
$622.33

One-time delivery in Parquet or TSV format.

Buy Dataset

Compare Team Plan Ultra

Dataset facts
Domains
40,675
Detections
1,728,006
Generated
2026-07-26 UTC
Formats
Parquet, TSV
Scope
.COMPANY
What's included
  • ✓ Domain and technology detection history
  • ✓ Company and website location signals
  • ✓ Spend, revenue and employee estimates
  • ✓ Traffic and authority rankings
  • ✓ Available business contact and social fields
View fields and technical schema →
Find another dataset
Browse all datasets
Dataset sampleParquet sampleTSV sample

Preview representative rows before purchasing. Full downloads contain all available fields and records.

DomainTechnologyFirst detectedLast detectedCompanyLocationSpend
maxslots777.companyCloudflare Challenge2023-10-032026-07-20$1,725
maxslots777.companyCloudflare Automatic Challenge2023-10-032026-07-20$1,725
maxslots777.companyCloudflare Hosting2023-10-032026-07-20$1,725
maxslots777.companyIPv62023-10-032026-07-20$1,725
imex.companynginx2023-07-062026-07-21RU$1,799
imex.companyGlobalSign2023-07-062023-09-13RU$1,799
imex.companyCommon Name Invalid2023-07-062023-09-13RU$1,799
imex.companyTimeweb2023-07-062026-07-21RU$1,799
primedesignsbynancy.companyFacebook Domain Insights2017-07-292026-07-20Prime DesignsbyNancyTroy, MO, US$203
primedesignsbynancy.companyWix2017-07-292026-07-20Prime DesignsbyNancyTroy, MO, US$203
primedesignsbynancy.companyWix Premium2017-07-292021-04-11Prime DesignsbyNancyTroy, MO, US$203
primedesignsbynancy.companylodash2017-07-292026-07-20Prime DesignsbyNancyTroy, MO, US$203
atlasapparel.companyShopify Local Pickup2024-05-222025-03-27Atlas Apparel Company$937
atlasapparel.companyShopify POS2024-05-222025-03-27Atlas Apparel Company$937
atlasapparel.companyShipping to One Country Only2024-05-222025-03-27Atlas Apparel Company$937
atlasapparel.companyUS Shipping Only2024-05-222025-03-27Atlas Apparel Company$937
thatbranding.companyGoogle Analytics Classic2017-06-032017-11-19that branding companyhello@thatbranding.companyGrainger Town, ENG, GB$1,727
thatbranding.companyHostEurope DNS2017-06-032021-02-02that branding companyhello@thatbranding.companyGrainger Town, ENG, GB$1,727
thatbranding.companyRSS2017-06-032026-05-16that branding companyhello@thatbranding.companyGrainger Town, ENG, GB$1,727
thatbranding.companyLetsEncrypt2017-06-032026-07-20that branding companyhello@thatbranding.companyGrainger Town, ENG, GB$1,727
planetpets.companyShopify Ride Theme2025-03-182026-07-20$287
planetpets.companyShopify Pay2025-03-182026-07-20$287
planetpets.companyContent Delivery Network2025-03-182026-07-20$287
planetpets.companyShopify Dormant2025-03-182026-07-20$287
love-toi.companyShipping to One Country Only2024-11-102025-11-19Love-Toi CompanyAnderson, IN, US$287
love-toi.companyUS Shipping Only2024-11-102025-11-19Love-Toi CompanyAnderson, IN, US$287
love-toi.companyShopify Email Marketing2024-11-102025-11-19Love-Toi CompanyAnderson, IN, US$287
love-toi.companyShopify US Dollar2024-11-102026-01-26Love-Toi CompanyAnderson, IN, US$287
profix.companyViewport Meta2023-08-302026-07-20Profix Contampyکارێزە وشک, SU, IQ$270
profix.companyIPhone / Mobile Compatible2023-08-302026-07-20Profix Contampyکارێزە وشک, SU, IQ$270
profix.companyWordPress2023-08-302023-08-30Profix Contampyکارێزە وشک, SU, IQ$270
profix.companynginx2023-08-302023-08-30Profix Contampyکارێزە وشک, SU, IQ$270
Related datasets
Live and Expired websites using Robots.txt128,929,443Live and Expired websites using Robots.txt in .COM TLD78,255,867Live websites using Robots.txt33,854,084Live websites using Robots.txt in .COM TLD21,637,530Live and Expired websites using Robots.txt in United States7,953,549Live and Expired websites using Robots.txt in .ORG TLD5,191,806Live and Expired websites using Robots.txt in .NET TLD5,187,818Live and Expired websites using Robots.txt in .RU TLD3,706,386