Log In · Signup for Free
EN  DE  FR  ES  IT  Русский  한국어  日本語  简体中文  عربي
commoncrawl.org
Live and expired websitesGlobal

Datasets Global All Common Crawl

Download a current list of Datasets Global All Common Crawl with website, company, location and technology detection fields.

One-time dataset price
Contact us for licensing

Datasets over 100 million domains require a custom licence.

Contact Us

Compare Team Plan Ultra

Dataset facts
Domains
129,396,764
Detections
8,481,968,237
Generated
2026-07-26 UTC
Formats
Parquet, TSV
Scope
Global
What's included
  • ✓ Domain and technology detection history
  • ✓ Company and website location signals
  • ✓ Spend, revenue and employee estimates
  • ✓ Traffic and authority rankings
  • ✓ Available business contact and social fields
View fields and technical schema →
How this dataset differs from a BuiltWith plan

BuiltWith plans provide technology lists and historical access for the technologies you select.

Plans do not provide a bulk export of the additional technologies found on every site in that list.

This dataset includes those additional technologies, both live and historical, with FirstDetected and LastDetected dates attached to each technology.

Compare BuiltWith plans →
Find another dataset
Browse all datasets
Dataset sampleParquet sampleTSV sample

Preview representative rows before purchasing. Full downloads contain all available fields and records.

DomainTechnologyFirst detectedLast detectedCompanyLocationSpend
jvimmigrationservices.comShopify Pay2024-06-232024-06-27My Store$287
jvimmigrationservices.comCloudflare Hosting2024-07-152025-04-11My Store$287
jvimmigrationservices.comOrganization Schema2024-07-202025-08-21My Store$287
jvimmigrationservices.comShopify Dawn Theme2024-07-202026-07-19My Store$287
friendly.campReg.ru DNS2019-04-022019-12-23Пермь 68, 90, RU$2,149
friendly.campSPF2020-02-252026-07-23Пермь 68, 90, RU$2,149
friendly.campYandex DNS2020-03-032026-07-23Пермь 68, 90, RU$2,149
friendly.campUniSender2021-05-082026-07-23Пермь 68, 90, RU$2,149
papateco.comWooCommerce Checkout2022-01-082026-07-19Papateco-Circuit Protection ComponentsCN$557
papateco.comOrganization Schema2022-01-082026-07-19Papateco-Circuit Protection ComponentsCN$557
papateco.comPerson Schema2022-01-082026-07-19Papateco-Circuit Protection ComponentsCN$557
papateco.comSitelinks Search Box2022-01-082026-07-19Papateco-Circuit Protection ComponentsCN$557
hackettwrites.comSSL by Default2021-12-212026-07-19$847
hackettwrites.comFont Awesome2021-12-212022-07-03$847
hackettwrites.comjQuery Validate2021-12-212023-10-20$847
hackettwrites.comjQuery2021-12-212026-05-15$847
ssbnoain.comarsys.es2013-02-282018-07-12$349
ssbnoain.comArsys DNS2014-01-112018-07-12$349
ssbnoain.comMicrosoft Exchange Online2017-02-282026-07-19$349
ssbnoain.comSPF2017-10-052026-07-19$349
etmnnov.ruRambler2017-06-252021-09-18Нижний Новгород 3, 51, RU$980
etmnnov.ruYandex Maps2017-06-252021-09-02Нижний Новгород 3, 51, RU$980
etmnnov.ruMyLiveChat2017-10-042020-06-02Нижний Новгород 3, 51, RU$980
etmnnov.ruSendPulse2017-06-252026-07-23Нижний Новгород 3, 51, RU$980
filtr-online.ruRussian2018-02-022026-05-15RU$1,560
filtr-online.rujQuery2018-02-022026-05-15RU$1,560
filtr-online.rujQuery 1.7.22018-02-022019-01-20RU$1,560
filtr-online.rujQuery 1.10.22018-02-022026-05-15RU$1,560
astorsearch.comComodo PositiveSSL2013-11-122018-06-14Astor Professional SearchChicago, IL, US$1,080
astorsearch.comComodo PositiveSSL Wildcard2013-11-122018-06-14Astor Professional SearchChicago, IL, US$1,080
astorsearch.comComodo SSL2013-11-122019-04-11Astor Professional SearchChicago, IL, US$1,080
astorsearch.comNetwork Solutions DNS2013-06-222021-06-15Astor Professional SearchChicago, IL, US$1,080
Related datasets
Live websites using Common Crawl116,166,333Live and Expired websites using Google Font API156,415,399Live and Expired websites using CommonCrawl Top 100m98,367,346Live and Expired websites using Google Tag Manager88,493,799Live and Expired websites using Font Awesome86,920,490Live and Expired websites using Wordpress Plugins76,978,189Live and Expired websites using CommonCrawl Top 50m66,249,530Live and Expired websites using US Privacy User Signal Mechanism63,805,775