Log In · Signup for Free
EN  DE  FR  ES  IT  Русский  한국어  日本語  简体中文  عربي
🤖
Live and expired websites.WS

Datasets .WS All Robots.txt

Download a current list of Datasets .WS All Robots.txt with website, company, location and technology detection fields.

One-time dataset price
$644.35

One-time delivery in Parquet or TSV format.

Buy Dataset

Compare Team Plan Ultra

Dataset facts
Domains
42,677
Detections
2,195,039
Generated
2026-07-18 UTC
Formats
Parquet, TSV
Scope
.WS
What's included
  • ✓ Domain and technology detection history
  • ✓ Company and website location signals
  • ✓ Spend, revenue and employee estimates
  • ✓ Traffic and authority rankings
  • ✓ Available business contact and social fields
View fields and technical schema →
Find another dataset
Browse all datasets
Dataset sampleParquet sampleTSV sample

Preview representative rows before purchasing. Full downloads contain all available fields and records.

DomainTechnologyFirst detectedLast detectedCompanyLocationSpend
paughcarlsonassociates.us1.advisor.wsDrupal2025-04-082026-07-19Cranbrook, British Columbia, CA$800
paughcarlsonassociates.us1.advisor.wsDrupal 102025-04-082026-07-19Cranbrook, British Columbia, CA$800
paughcarlsonassociates.us1.advisor.wsMobile Optimized2025-04-082026-07-19Cranbrook, British Columbia, CA$800
paughcarlsonassociates.us1.advisor.wsViewport Meta2025-04-082026-07-19Cranbrook, British Columbia, CA$800
jpbassoc.us1.advisor.wsreCAPTCHA2023-01-212024-03-12Tampa, FL, US$357
jpbassoc.us1.advisor.wsreCAPTCHA v22023-01-212024-03-12Tampa, FL, US$357
jpbassoc.us1.advisor.wsAmazon2025-04-092026-07-19Tampa, FL, US$357
jpbassoc.us1.advisor.wsAmazon Oregon Region2025-04-092026-07-19Tampa, FL, US$357
waseet.wsASP.NET2022-09-042026-07-19$160
waseet.wsIIS2022-09-042026-07-19$160
waseet.wsIIS 102022-09-042026-07-19$160
waseet.wsParallels Plesk Panel2022-09-042026-07-19$160
bradmcphee.us1.advisor.wsSSL by Default2021-07-312026-07-20Vancouver (Waterfront / Coal Harbour / Canada Place), BC, CA$8,597
bradmcphee.us1.advisor.wsAJAX Libraries API2021-07-312026-07-18Vancouver (Waterfront / Coal Harbour / Canada Place), BC, CA$8,597
bradmcphee.us1.advisor.wsAdobe Dynamic Tag Management2021-07-312026-07-18Vancouver (Waterfront / Coal Harbour / Canada Place), BC, CA$8,597
bradmcphee.us1.advisor.wsContent Delivery Network2021-07-312026-07-18Vancouver (Waterfront / Coal Harbour / Canada Place), BC, CA$8,597
wagners.wsOpenResty2019-01-122026-07-19$145
wagners.wsDefense Net2019-02-252020-02-25$145
wagners.wsSPF2019-02-252026-07-19$145
wagners.wsNetwork Solutions DNS2019-02-252026-07-19$145
blooms.wsWooCommerce Checkout2023-07-182024-05-18Blooms$427
blooms.wsSSL by Default2023-07-182026-07-19Blooms$427
blooms.wsSite Kit2023-07-182024-07-21Blooms$427
blooms.wsIsraeli New Shekel2023-07-182023-12-31Blooms$427
jamesbayard.us1.advisor.wsSSL by Default2022-09-042022-09-04Capital South Wealth Management LLCBaton Rouge, LA, US$240
jamesbayard.us1.advisor.wsFacebook2022-09-042026-07-25Capital South Wealth Management LLCBaton Rouge, LA, US$240
jamesbayard.us1.advisor.wsLinkedIn2022-09-042026-07-25Capital South Wealth Management LLCBaton Rouge, LA, US$240
jamesbayard.us1.advisor.wsTwitter2022-09-042026-07-25Capital South Wealth Management LLCBaton Rouge, LA, US$240
joedunat.us1.advisor.wsDrupal 102024-09-082026-07-25The Sturkie Wealth Management GroupLexington, South Carolina, US$1,555
joedunat.us1.advisor.wsFacebook2024-09-082026-07-25The Sturkie Wealth Management GroupLexington, South Carolina, US$1,555
joedunat.us1.advisor.wsFinancial Industry Regulatory Authority2024-09-082026-07-25The Sturkie Wealth Management GroupLexington, South Carolina, US$1,555
joedunat.us1.advisor.wsSIPC2024-09-082026-07-25The Sturkie Wealth Management GroupLexington, South Carolina, US$1,555
Related datasets
Live and Expired websites using Robots.txt127,636,552Live and Expired websites using Robots.txt in .COM TLD77,559,832Live websites using Robots.txt32,823,758Live websites using Robots.txt in .COM TLD21,028,271Live and Expired websites using Robots.txt in United States7,906,043Live and Expired websites using Robots.txt in .NET TLD5,151,971Live and Expired websites using Robots.txt in .ORG TLD5,149,472Live and Expired websites using Robots.txt in .RU TLD3,677,100