Compound Words on the Web

How to find closed compounds that dictionaries miss, and what 104,006 files of Common Crawl, FineWeb and FineWeb-Edu show. 14 November 2026, updated 16 November 2026.

A compound word can be written three ways: solid (lifecycle), open (life cycle) or hyphenated (life-cycle). Dictionaries usually record one or two of the forms. Writers use all three, and the web holds enough text to measure how often each form is used. The question behind this work is the one asked in The Legitimacy of AIRVENT: when is a solid form such as airvent a word in the language, even though no dictionary lists it?

The method

Finding compounds means finding pairs of words that are sometimes written as one. The method has three parts.

  1. Make the candidate list from both directions. Take every two-word headword in the dictionaries (life cycle, gold mine). Then split every solid word into two words that are each in a dictionary or word list, following Eric Chaikin's technique of splitting words. The solid words come from the dictionaries, the word lists, and words already seen on at least 3 web sites. The splitting finds compounds that no dictionary records in any form (back link, skill set, breath work). Each part must have at least 2 letters, except a single a (alot). The result is 1,554,646 candidate pairs.
  2. Count all three forms in the same text, under the same rules. Only English prose lines count: lines that end like sentences and contain enough common function words. A line repeated in one file is counted once. A pair counts as open when its two words stand next to each other with only white space between them, and as hyphenated when a hyphen joins them inside one token. Punctuation between them ("life, cycle") breaks the pair. Each form is counted in occurrences and in distinct web sites (domains). The site count is the better measure, because one site that repeats a phrase thousands of times counts once.
  3. Compare the forms. For each candidate, set the solid, open and hyphenated counts side by side. The form on the most sites is the one writers prefer. Then compare it with what the dictionaries list.

Raw counts need four filters before they can be read:

One part of the method does not work as it stands: splitting a solid word into three or more listed words. The word lists contain so many short, obscure words that nearly every long word splits. Datasets becomes "dat as ets" and shockwaves becomes "sho ckw aves". Splits of this kind produce 1.3 million false candidates. A split into many parts is worth keeping only when the web also writes those parts apart, as with state of the art and state-of-the-art. A second counting pass is now measuring the open and hyphenated forms of 12.1 million phrases of three to five words. Those phrases come from three sources:

The data so far

Text counted (English prose only): Common Crawl crawls of September and October 2026, FineWeb (Common Crawl 2013 to 2025, the files stored so far) and FineWeb-Edu
MeasureCommon CrawlFineWebFineWeb-EduTotal
Files100,0101,5862,410104,006
Web pages371,160,9571,487,969,1181,525,223,0563,384,353,131
Prose lines counted6,233,716,05012,895,491,32918,024,979,39637,154,186,775
Words238,639,287,679611,845,307,989944,198,402,7771,794,682,998,445
Occurrences of candidate pairs in the text70,104,417,580189,229,263,170288,598,545,827547,932,226,577
Distinct words and pairs on 3 or more sites35,869,645
Two-word compounds on 3 or more sites in some form725,612
The same, after the filters above171,812

The 171,812 filtered compounds divide as follows by the form writers prefer and the forms the dictionaries list. The dictionaries checked are Webster's Third, the Collegiate 10th and 11th, the OED, Webster's 1913, the Learner's and Medical dictionaries, two thesauruses and others. The word lists checked are ENABLE, Collins Scrabble Words 2024 and the NASPA Word List 2023.

Two-word compounds on 3 or more sites, by preferred form (most sites)
Dictionaries and lists giveSolid preferredOpen preferredHyphenated preferred
No form at all25,60216,7425,695
Open or hyphenated only54653,4954,167
Solid only37,11615,5797,205
Solid and another form2,4992,1501,016
All65,76387,96618,083

Two rows show where the dictionaries and the web disagree:

Counting every compound whose solid form appears on at least 3 sites but is in no dictionary or list, whatever form is preferred, there are 82,377. Of these, 59,050 are solid on at least 100 sites and 21,618 on at least 1,000. 32,029 of the 82,377 are written solid on most of their sites. Airvent is among the 82,377 but not among those: it is solid on 1,153 sites, open on 55,217 and hyphenated on 2,067.

Written solid on most sites, solid form in no dictionary or list (occurrences)
SolidSolidOpenHyphenatedSolid share of sitesListed form
dataset16,684,8537,892,496110,18758%none
plugins8,552,61161,3801,887,65869%none
runtime6,690,5391,329,690931,08659%none
sportsbook4,183,245189,4162,75085%none
backlinks3,702,412217,77137,13383%none
cardstock2,035,9391,080,80529,43659%none
keychain1,021,415283,09718,20273%open
rulebook838,372487,43220,78063%open
breathwork827,778204,96622,93467%none
goldmine787,3961,562,58026,35450%open, hyphenated
walkability703,6912,3166,35997%none
Listed solid, but written apart on most sites (occurrences)
SolidSolidOpenHyphenated
ecofriendly227,490934,54423,253,113
nonrefundable367,499211,4192,956,838
noninvasive2,270,078164,9396,979,861
nontoxic1,271,955282,3716,075,136
followups47,435231,4862,051,237
longtime10,461,04666,137,8436,360,237
All three forms in heavy use (occurrences)
CompoundSolidOpenHyphenated
long term1,014,66142,976,083168,967,196
well being27,546,8359,481,13581,243,407
health care155,483,37396,631,2195,320,506
non profit25,846,652611,98120,978,991
web site434,126,80738,173,7491,388,273

Still to come