Log In · Signup for Free
EN  DE  FR  ES  IT  Русский  한국어  日本語  简体中文  عربي
🤖
Live websites.LINK

Datasets .LINK Live Robots.txt

Download a current list of Datasets .LINK Live Robots.txt with website, company, location and technology detection fields.

One-time dataset price
$547.22

One-time delivery in Parquet or TSV format.

Buy Dataset

Compare Team Plan Ultra

Dataset facts
Domains
33,847
Detections
1,216,906
Generated
2026-07-18 UTC
Formats
Parquet, TSV
Scope
.LINK
What's included
  • ✓ Domain and technology detection history
  • ✓ Company and website location signals
  • ✓ Spend, revenue and employee estimates
  • ✓ Traffic and authority rankings
  • ✓ Available business contact and social fields
View fields and technical schema →
Find another dataset
Browse all datasets
Dataset sampleParquet sampleTSV sample

Preview representative rows before purchasing. Full downloads contain all available fields and records.

DomainTechnologyFirst detectedLast detectedCompanyLocationSpend
33m2-sandbox.linkAmazon2025-09-302026-07-25$700
33m2-sandbox.linkAmazon Route 532025-09-302026-07-25$700
33m2-sandbox.linkSouth Korean Server Location2025-09-302026-07-25$700
33m2-sandbox.linkKorean2025-09-302026-07-18$700
radic.linkViewport Meta2019-12-022026-07-20$240
radic.linkIPhone / Mobile Compatible2019-12-022026-07-20$240
radic.linkRSS2019-12-022023-09-19$240
radic.linkWordPress2019-12-022026-07-20$240
happyfamilystore.linkGoogle Font API2024-08-202026-07-23$348
happyfamilystore.linkViewport Meta2024-08-202026-07-23$348
happyfamilystore.linkJavaScript Modules2024-08-202026-07-23$348
happyfamilystore.linkMobile Non Scaleable Content2024-08-202026-07-23$348
oklv.linkCrUX Dataset2025-10-092026-06-26$700
oklv.linkCrUX Top 5m2025-10-092026-06-26$700
oklv.linkSingaporean Server Location2025-10-292026-07-23$700
oklv.linkViewport Meta2025-10-292026-07-23$700
healthycare.linkViewport Meta2020-04-022026-07-23$860
healthycare.linkIPhone / Mobile Compatible2020-04-022026-07-23$860
healthycare.linkAmazon S32020-04-022026-07-23$860
healthycare.linkSSL by Default2020-04-022026-07-23$860
mykeeper.linkAmazon Frankfurt Region2020-12-152022-07-08$700
mykeeper.linkDomain Not Resolving2023-04-112023-04-11$700
mykeeper.linkAmazon Virginia Region2021-02-162022-07-08$700
mykeeper.linkDomain Not Resolving2023-04-112023-04-11$700
imenu.linkPopper.js2021-04-042026-06-23Your title$700
imenu.linkjQuery2021-04-042026-06-23Your title$700
imenu.linkViewport Meta2021-04-042026-07-20Your title$700
imenu.linkIPhone / Mobile Compatible2021-04-042026-07-20Your title$700
siakad.linkFacebook2023-07-162023-08-19SIAKAD LINK$557
siakad.linkTwitter2023-07-162023-08-19SIAKAD LINK$557
siakad.linkLinkedIn2023-07-162023-08-19SIAKAD LINK$557
siakad.linkInstagram2023-07-162023-08-19SIAKAD LINK$557
Related datasets
Live and Expired websites using Robots.txt127,636,552Live and Expired websites using Robots.txt in .COM TLD77,559,832Live websites using Robots.txt32,823,758Live websites using Robots.txt in .COM TLD21,028,271Live and Expired websites using Robots.txt in United States7,906,043Live and Expired websites using Robots.txt in .NET TLD5,151,971Live and Expired websites using Robots.txt in .ORG TLD5,149,472Live and Expired websites using Robots.txt in .RU TLD3,677,100