Log In · Signup for Free
EN  DE  FR  ES  IT  Русский  한국어  日本語  简体中文  عربي
🤖
Live and expired websites.GG

Datasets .GG All Robots.txt

Download a current list of Datasets .GG All Robots.txt with website, company, location and technology detection fields.

One-time dataset price
$495.00

One-time delivery in Parquet or TSV format.

Buy Dataset

Compare Team Plan Ultra

Dataset facts
Domains
17,110
Detections
1,143,567
Generated
2026-07-18 UTC
Formats
Parquet, TSV
Scope
.GG
What's included
  • ✓ Domain and technology detection history
  • ✓ Company and website location signals
  • ✓ Spend, revenue and employee estimates
  • ✓ Traffic and authority rankings
  • ✓ Available business contact and social fields
View fields and technical schema →
Find another dataset
Browse all datasets
Dataset sampleParquet sampleTSV sample

Preview representative rows before purchasing. Full downloads contain all available fields and records.

DomainTechnologyFirst detectedLast detectedCompanyLocationSpend
leyline.ggIPv62020-08-182020-08-18Leyline IncorporatedMünchen, BY, DE$290
leyline.ggDomain Not Resolving2024-05-312024-05-31Leyline IncorporatedMünchen, BY, DE$290
leyline.ggSSL by Default2020-09-172026-07-19Leyline IncorporatedMünchen, BY, DE$290
leyline.ggViewport Meta2020-09-172026-07-19Leyline IncorporatedMünchen, BY, DE$290
stellarwatch.ggGoogle Analytics 42022-11-022026-07-20$899
stellarwatch.ggTwitter2022-11-022026-07-20$899
stellarwatch.ggApple Mobile Web Clips Icon2022-11-022026-07-20$899
stellarwatch.ggGoogle Font API2022-11-022026-07-20$899
egf.ggSquarespace2020-05-072026-07-24Electronic Gaming Federation IncNew York City, New York, US$122
egf.ggContent Delivery Network2020-05-072026-07-24Electronic Gaming Federation IncNew York City, New York, US$122
egf.ggTypography2020-05-072026-07-24Electronic Gaming Federation IncNew York City, New York, US$122
egf.ggGoogle Font API2020-05-072026-07-21Electronic Gaming Federation IncNew York City, New York, US$122
topprivateservers.ggGoogle Universal Analytics2023-06-032026-06-22$482
topprivateservers.ggGoogle Analytics2023-06-032026-06-22$482
topprivateservers.ggContent Delivery Network2023-06-032026-06-22$482
topprivateservers.ggjsDelivr2023-06-032026-06-22$482
efire.ggCloudFront2020-04-102024-10-15efire.gg$190
efire.ggAdBlock Acceptable Ads2024-10-152024-10-15efire.gg$190
efire.ggDoubleClick.Net2024-10-152024-10-15efire.gg$190
efire.ggGoogle Adsense for Domains2024-10-152024-10-15efire.gg$190
screens.ggCloudflare Hosting2021-01-192026-01-08$700
screens.ggIPv62021-01-192026-01-08$700
screens.ggCloudflare DNS2021-01-192026-01-08$700
screens.ggSSL by Default2021-04-012026-07-19$700
ecstatic.ggSSL by Default2021-10-192026-07-19Ecstatic CoLynge, 84, DK$347
ecstatic.ggWordPress 5.82021-10-192022-02-07Ecstatic CoLynge, 84, DK$347
ecstatic.ggjQuery2021-10-192026-07-19Ecstatic CoLynge, 84, DK$347
ecstatic.ggWordpress Plugins2021-10-192026-07-19Ecstatic CoLynge, 84, DK$347
clutchup.ggExpress2025-04-082025-05-06$240
clutchup.ggViewport Meta2025-04-082026-05-16$240
clutchup.ggIPhone / Mobile Compatible2025-04-082026-05-16$240
clutchup.gghCaptcha2025-04-082026-04-14$240
Related datasets
Live and Expired websites using Robots.txt127,636,552Live and Expired websites using Robots.txt in .COM TLD77,559,832Live websites using Robots.txt32,823,758Live websites using Robots.txt in .COM TLD21,028,271Live and Expired websites using Robots.txt in United States7,906,043Live and Expired websites using Robots.txt in .NET TLD5,151,971Live and Expired websites using Robots.txt in .ORG TLD5,149,472Live and Expired websites using Robots.txt in .RU TLD3,677,100