Offline URL Database 1st January 2023 changelog: Difference between revisions
Jump to navigation
Jump to search
(Created page with "= Category change = * Added Parked domain category * Added Domain not available category * Added Private site available category * Added Earth science category * Added Fringe theory category * Added Conspiracy theory category * Added Alt right category * Added Alt left category = Database change = * Removed 1.6m invalid domains (they were classified under DNS not found category) * Improved detection of Captcha protected sites * Improved the ability to classify captcha...") |
No edit summary |
||
(One intermediate revision by the same user not shown) | |||
Line 15: | Line 15: | ||
* Improved detection of Captcha protected sites | * Improved detection of Captcha protected sites | ||
* Improved the ability to classify captcha protected sites | * Improved the ability to classify captcha protected sites | ||
* Improved detection for parked domains | |||
= Domain count and statistics = | = Domain count and statistics = | ||
{| class="wikitable" | |||
|- | |||
! ID | |||
! Name | |||
! Domain count | |||
|- | |||
| 1 | |||
| Abortion and pregnancy | |||
| 103,122 | |||
|- | |||
| 2 | |||
| Ads | |||
| 81,349 | |||
|- | |||
| 3 | |||
| Adult | |||
| 433,537 | |||
|- | |||
| 4 | |||
| Adult dating | |||
| 18,822 | |||
|- | |||
| 5 | |||
| Alcohol | |||
| 407,089 | |||
|- | |||
| 6 | |||
| Astrology | |||
| 63,652 | |||
|- | |||
| 7 | |||
| Blogs | |||
| 3,467,789 | |||
|- | |||
| 8 | |||
| Books or comics | |||
| 491,035 | |||
|- | |||
| 9 | |||
| Business and services | |||
| 6,355,917 | |||
|- | |||
| 10 | |||
| CDN | |||
| 1,048,973 | |||
|- | |||
| 11 | |||
| Chats | |||
| 98,172 | |||
|- | |||
| 12 | |||
| Classifieds | |||
| 111,450 | |||
|- | |||
| 13 | |||
| Clothing and fashion | |||
| 1,111,631 | |||
|- | |||
| 14 | |||
| Cooking and food | |||
| 1,799,018 | |||
|- | |||
| 15 | |||
| Dating | |||
| 89,236 | |||
|- | |||
| 16 | |||
| Drugs | |||
| 78,046 | |||
|- | |||
| 17 | |||
| Education | |||
| 1,247,376 | |||
|- | |||
| 18 | |||
| Empty site | |||
| 1,747,224 | |||
|- | |||
| 19 | |||
| Entertainment | |||
| 749,283 | |||
|- | |||
| 20 | |||
| Error site can't be accessed | |||
| 5,844,831 | |||
|- | |||
| 21 | |||
| DNS error site can't be resolved | |||
| 41,923,049 | |||
|- | |||
| 22 | |||
| File hosting | |||
| 78,577 | |||
|- | |||
| 23 | |||
| Finance (Banks_Real estate_Insurance) | |||
| 645,657 | |||
|- | |||
| 24 | |||
| Gambling | |||
| 394,582 | |||
|- | |||
| 25 | |||
| Computer games | |||
| 544,632 | |||
|- | |||
| 26 | |||
| General (safe) | |||
| 9,925 | |||
|- | |||
| 27 | |||
| Government | |||
| 133,134 | |||
|- | |||
| 28 | |||
| Hacking | |||
| 12,210 | |||
|- | |||
| 29 | |||
| Hate | |||
| 17,532 | |||
|- | |||
| 30 | |||
| Hobbies | |||
| 373,352 | |||
|- | |||
| 31 | |||
| Home improvement | |||
| 465,905 | |||
|- | |||
| 32 | |||
| Humor | |||
| 29,447 | |||
|- | |||
| 33 | |||
| Hunting and fishing | |||
| 109,552 | |||
|- | |||
| 34 | |||
| Image and video hosting | |||
| 112,941 | |||
|- | |||
| 35 | |||
| Jobs | |||
| 834,226 | |||
|- | |||
| 36 | |||
| Kids safe | |||
| 237 | |||
|- | |||
| 37 | |||
| Legal | |||
| 446,981 | |||
|- | |||
| 38 | |||
| Life style and beauty | |||
| 761,550 | |||
|- | |||
| 39 | |||
| Link farm (no real content) | |||
| 7,174,545 | |||
|- | |||
| 40 | |||
| Local information | |||
| 73,426 | |||
|- | |||
| 41 | |||
| Medical | |||
| 2,650,605 | |||
|- | |||
| 42 | |||
| Military | |||
| 31,264 | |||
|- | |||
| 43 | |||
| Mixed adult | |||
| 1,043,067 | |||
|- | |||
| 44 | |||
| Mobile | |||
| 282,692 | |||
|- | |||
| 45 | |||
| Models | |||
| 57,687 | |||
|- | |||
| 46 | |||
| Music | |||
| 1,118,131 | |||
|- | |||
| 47 | |||
| News | |||
| 1,498,895 | |||
|- | |||
| 49 | |||
| Not child safe | |||
| 22,942 | |||
|- | |||
| 50 | |||
| Online drugs | |||
| 41,389 | |||
|- | |||
| 51 | |||
| Online marketing | |||
| 581,405 | |||
|- | |||
| 52 | |||
| Online video or audio | |||
| 327,634 | |||
|- | |||
| 53 | |||
| Pets and animals | |||
| 424,470 | |||
|- | |||
| 54 | |||
| Phishing | |||
| 1,474 | |||
|- | |||
| 55 | |||
| Politics | |||
| 348,562 | |||
|- | |||
| 56 | |||
| Porn | |||
| 852,102 | |||
|- | |||
| 57 | |||
| Internet portals | |||
| 295,704 | |||
|- | |||
| 58 | |||
| Profanity | |||
| 32,824 | |||
|- | |||
| 59 | |||
| Proxy | |||
| 16,021 | |||
|- | |||
| 60 | |||
| Religion | |||
| 536,742 | |||
|- | |||
| 62 | |||
| Science | |||
| 344,082 | |||
|- | |||
| 63 | |||
| Search engines | |||
| 81,401 | |||
|- | |||
| 64 | |||
| Sects | |||
| 13,029 | |||
|- | |||
| 65 | |||
| Semi nude and pin up | |||
| 27,048 | |||
|- | |||
| 66 | |||
| Sex education | |||
| 67,498 | |||
|- | |||
| 67 | |||
| Shopping | |||
| 2,491,562 | |||
|- | |||
| 68 | |||
| Social networks | |||
| 631,912 | |||
|- | |||
| 69 | |||
| Spam or scam | |||
| 3,652 | |||
|- | |||
| 70 | |||
| Sports | |||
| 1,361,544 | |||
|- | |||
| 71 | |||
| Suicide | |||
| 293 | |||
|- | |||
| 72 | |||
| Technology and computers | |||
| 937,929 | |||
|- | |||
| 73 | |||
| Site under construction or not available | |||
| 5,231,976 | |||
|- | |||
| 74 | |||
| General - not porn | |||
| 9,445,557 | |||
|- | |||
| 75 | |||
| URL shortener | |||
| 7,157 | |||
|- | |||
| 76 | |||
| Vacation and travel | |||
| 1,800,131 | |||
|- | |||
| 77 | |||
| Vehicles | |||
| 1,277,162 | |||
|- | |||
| 78 | |||
| Violence | |||
| 32,506 | |||
|- | |||
| 79 | |||
| Virus or Spyware | |||
| 1,755 | |||
|- | |||
| 80 | |||
| Warez | |||
| 38,300 | |||
|- | |||
| 81 | |||
| Weapons | |||
| 150,389 | |||
|- | |||
| 82 | |||
| Web hosting | |||
| 867,988 | |||
|- | |||
| 83 | |||
| Web mail | |||
| 114,425 | |||
|- | |||
| 84 | |||
| Reference | |||
| 201,620 | |||
|- | |||
| 85 | |||
| Community and society | |||
| 235,593 | |||
|- | |||
| 86 | |||
| Software repository | |||
| 34,049 | |||
|- | |||
| 87 | |||
| Philosophy and psychology | |||
| 246,067 | |||
|- | |||
| 88 | |||
| History | |||
| 301,236 | |||
|- | |||
| 89 | |||
| Nonsense and time waste | |||
| 73,668 | |||
|- | |||
| 90 | |||
| Local IP | |||
| 70 | |||
|- | |||
| 91 | |||
| Swimsuits and underwear | |||
| 110,587 | |||
|- | |||
| 92 | |||
| Arts | |||
| 749,980 | |||
|- | |||
| 94 | |||
| Login page | |||
| 144,551 | |||
|- | |||
| 95 | |||
| Surveys and polls | |||
| 35,298 | |||
|- | |||
| 96 | |||
| Tobacco | |||
| 56,205 | |||
|- | |||
| 97 | |||
| ISP | |||
| 19,293 | |||
|- | |||
| 98 | |||
| Tracker | |||
| 1,144,480 | |||
|- | |||
| 99 | |||
| Bypass protection | |||
| 3,067 | |||
|- | |||
| 100 | |||
| Search block | |||
| 52 | |||
|- | |||
| 101 | |||
| Image search block | |||
| 171,739 | |||
|- | |||
| 102 | |||
| Desktop themes | |||
| 9,389 | |||
|- | |||
| 103 | |||
| Depress domain | |||
| 71,347 | |||
|- | |||
| 104 | |||
| Depress page | |||
| 1,839 | |||
|- | |||
| 105 | |||
| Parenting and family | |||
| 71,638 | |||
|- | |||
| 106 | |||
| School cheats | |||
| 4,588 | |||
|- | |||
| 107 | |||
| Celebrity gossip | |||
| 122,298 | |||
|- | |||
| 108 | |||
| How to | |||
| 100,124 | |||
|- | |||
| 109 | |||
| Illegal | |||
| 3,134 | |||
|- | |||
| 110 | |||
| Recreation | |||
| 211,185 | |||
|- | |||
| 111 | |||
| Bookmarks | |||
| 17,684 | |||
|- | |||
| 112 | |||
| Money spam | |||
| 5,633 | |||
|- | |||
| 113 | |||
| Directories | |||
| 4,843 | |||
|- | |||
| 114 | |||
| Site_Graphic design | |||
| 368,814 | |||
|- | |||
| 115 | |||
| Weather | |||
| 80,739 | |||
|- | |||
| 116 | |||
| Knowledge | |||
| 62,116 | |||
|- | |||
| 117 | |||
| Kids entertainment | |||
| 16,005 | |||
|- | |||
| 118 | |||
| Nature | |||
| 107,232 | |||
|- | |||
| 119 | |||
| Diet | |||
| 119,703 | |||
|- | |||
| 120 | |||
| Eating disorders | |||
| 5,342 | |||
|- | |||
| 121 | |||
| Self help | |||
| 94,318 | |||
|- | |||
| 122 | |||
| Relationships | |||
| 21,186 | |||
|- | |||
| 123 | |||
| Paranormal | |||
| 37,595 | |||
|- | |||
| 124 | |||
| Images CDN | |||
| 2,952 | |||
|- | |||
| 125 | |||
| Images CDN Unknown | |||
| 65,694 | |||
|- | |||
| 126 | |||
| LGBT | |||
| 16,219 | |||
|- | |||
| 127 | |||
| Marketing or ads | |||
| 33,601 | |||
|- | |||
| 128 | |||
| Magazines | |||
| 153,333 | |||
|- | |||
| 129 | |||
| Forums | |||
| 128,074 | |||
|- | |||
| 130 | |||
| User generated content | |||
| 41,146 | |||
|- | |||
| 131 | |||
| Tele Communications | |||
| 60,070 | |||
|- | |||
| 132 | |||
| Gender specific | |||
| 2,334 | |||
|- | |||
| 134 | |||
| Crime | |||
| 37,866 | |||
|- | |||
| 135 | |||
| Person | |||
| 59,620 | |||
|- | |||
| 136 | |||
| Grief | |||
| 2,431 | |||
|- | |||
| 137 | |||
| Retirement | |||
| 50,478 | |||
|- | |||
| 138 | |||
| Other drugs | |||
| 69,238 | |||
|- | |||
| 139 | |||
| Pharmacy | |||
| 42,976 | |||
|- | |||
| 140 | |||
| Songs download | |||
| 18,585 | |||
|- | |||
| 141 | |||
| Lookup | |||
| 45,445 | |||
|- | |||
| 142 | |||
| Movies download | |||
| 112,313 | |||
|- | |||
| 143 | |||
| Consumer reviews | |||
| 19,530 | |||
|- | |||
| 144 | |||
| API | |||
| 87,711 | |||
|- | |||
| 145 | |||
| Legal movies | |||
| 641 | |||
|- | |||
| 146 | |||
| Legal songs | |||
| 1,639 | |||
|- | |||
| 147 | |||
| Bitcoin | |||
| 75,757 | |||
|- | |||
| 148 | |||
| Victim help | |||
| 3,443 | |||
|- | |||
| 149 | |||
| Rewards | |||
| 9,676 | |||
|- | |||
| 150 | |||
| Photography | |||
| 380,737 | |||
|- | |||
| 151 | |||
| Toys | |||
| 124,686 | |||
|- | |||
| 152 | |||
| Restaurant | |||
| 375,699 | |||
|- | |||
| 153 | |||
| Fitness | |||
| 276,768 | |||
|- | |||
| 154 | |||
| Contact sport | |||
| 126,870 | |||
|- | |||
| 155 | |||
| Dancing | |||
| 50,443 | |||
|- | |||
| 156 | |||
| Software | |||
| 428,950 | |||
|- | |||
| 157 | |||
| Programming | |||
| 258,516 | |||
|- | |||
| 158 | |||
| Registry cleaner | |||
| 324 | |||
|- | |||
| 159 | |||
| Online security | |||
| 125,113 | |||
|- | |||
| 160 | |||
| Real estate | |||
| 763,346 | |||
|- | |||
| 161 | |||
| Loans | |||
| 130,508 | |||
|- | |||
| 162 | |||
| Forex | |||
| 26,322 | |||
|- | |||
| 163 | |||
| Banks | |||
| 250,261 | |||
|- | |||
| 164 | |||
| Insurance | |||
| 279,614 | |||
|- | |||
| 165 | |||
| SEO | |||
| 84,320 | |||
|- | |||
| 166 | |||
| PPC | |||
| 7,298 | |||
|- | |||
| 167 | |||
| Supplements | |||
| 47,769 | |||
|- | |||
| 168 | |||
| URL Classification | |||
| 455 | |||
|- | |||
| 170 | |||
| Tatoo | |||
| 30,615 | |||
|- | |||
| 172 | |||
| Tactical equipment | |||
| 5,977 | |||
|- | |||
| 173 | |||
| Alternative medicine | |||
| 230,771 | |||
|- | |||
| 174 | |||
| AI | |||
| 16,115 | |||
|- | |||
| 175 | |||
| Comics | |||
| 20,342 | |||
|- | |||
| 176 | |||
| Manga | |||
| 7,348 | |||
|- | |||
| 177 | |||
| Captcha | |||
| 487,782 | |||
|- | |||
| 178 | |||
| Racism education | |||
| 1,310 | |||
|- | |||
| 179 | |||
| Payment | |||
| 14,989 | |||
|- | |||
| 180 | |||
| Brokerage | |||
| 18,924 | |||
|- | |||
| 181 | |||
| SAAS | |||
| 13,334 | |||
|- | |||
| 182 | |||
| Anime | |||
| 14,552 | |||
|- | |||
| 183 | |||
| Cartoon | |||
| 5,936 | |||
|- | |||
| 184 | |||
| Grownups | |||
| 19 | |||
|- | |||
| 185 | |||
| Stream converter | |||
| 3,195 | |||
|- | |||
| 186 | |||
| File converter | |||
| 2,811 | |||
|- | |||
| 187 | |||
| TV Personality | |||
| 839 | |||
|- | |||
| 188 | |||
| Radio Personality | |||
| 634 | |||
|- | |||
| 189 | |||
| Youtube Personality | |||
| 7,985 | |||
|- | |||
| 190 | |||
| Prevent crime or violence | |||
| 3,519 | |||
|- | |||
| 191 | |||
| Collaboration software | |||
| 8,045 | |||
|- | |||
| 193 | |||
| Internet support | |||
| 2,956 | |||
|- | |||
| 194 | |||
| Computer support | |||
| 24,520 | |||
|- | |||
| 195 | |||
| Home appliance | |||
| 4,380 | |||
|- | |||
| 196 | |||
| Disposable mail | |||
| 414 | |||
|- | |||
| 197 | |||
| Parked domain | |||
| 315,396 | |||
|- | |||
| 198 | |||
| Domain not available | |||
| 83,876 | |||
|- | |||
| 199 | |||
| Private site | |||
| 135,361 | |||
|- | |||
| 200 | |||
| Earth science | |||
| 27,311 | |||
|- | |||
| 201 | |||
| Fringe theory | |||
| 45 | |||
|- | |||
| 202 | |||
| Conspiracy theory | |||
| 185 | |||
|- | |||
| 203 | |||
| Alt right | |||
| 106 | |||
|- | |||
| 204 | |||
| Alt left | |||
| 97 | |||
|} | |||
Total domains: 126,012,685 | |||
Total classified domains: 78,244,805 (Total domains excluding DNS resolve errors and other errors) | |||
Total unique domains: 115,219,367 | |||
Total unique classified domains: 67,451,725 (Total unique domains excluding DNS resolve errors and other errors) | |||
= TLD Distribution (all domains) = | |||
{| class="wikitable" | |||
|- | |||
! # | |||
! TLD | |||
! Domain count | |||
|- | |||
|1 | |||
|com | |||
|58,746,836 | |||
|- | |||
|2 | |||
|net | |||
|6,434,278 | |||
|- | |||
|3 | |||
|de | |||
|4,347,180 | |||
|- | |||
|4 | |||
|org | |||
|4,263,895 | |||
|- | |||
|5 | |||
|uk | |||
|3,503,529 | |||
|- | |||
|6 | |||
|ru | |||
|2,375,815 | |||
|- | |||
|7 | |||
|cn | |||
|1,899,847 | |||
|- | |||
|8 | |||
|info | |||
|1,729,539 | |||
|- | |||
|9 | |||
|nl | |||
|1,388,483 | |||
|- | |||
|10 | |||
|fr | |||
|1,196,513 | |||
|- | |||
|11 | |||
|pl | |||
|1,128,700 | |||
|- | |||
|12 | |||
|it | |||
|1,118,404 | |||
|- | |||
|13 | |||
|jp | |||
|1,104,209 | |||
|- | |||
|14 | |||
|br | |||
|1,037,378 | |||
|- | |||
|15 | |||
|tk | |||
|917,956 | |||
|- | |||
|16 | |||
|ca | |||
|716,416 | |||
|- | |||
|17 | |||
|tw | |||
|705,894 | |||
|- | |||
|18 | |||
|eu | |||
|641,022 | |||
|- | |||
|19 | |||
|top | |||
|605,562 | |||
|- | |||
|20 | |||
|co | |||
|604,706 | |||
|- | |||
|21 | |||
|in | |||
|594,994 | |||
|- | |||
|22 | |||
|ch | |||
|547,632 | |||
|- | |||
|23 | |||
|biz | |||
|547,415 | |||
|- | |||
|24 | |||
|us | |||
|530,790 | |||
|- | |||
|25 | |||
|es | |||
|488,538 | |||
|- | |||
|26 | |||
|cz | |||
|466,159 | |||
|- | |||
|27 | |||
|se | |||
|429,430 | |||
|- | |||
|28 | |||
|be | |||
|408,253 | |||
|- | |||
|29 | |||
|at | |||
|389,258 | |||
|- | |||
|30 | |||
|ga | |||
|361,392 | |||
|- | |||
|31 | |||
|cf | |||
|344,705 | |||
|- | |||
|32 | |||
|ir | |||
|340,061 | |||
|- | |||
|33 | |||
|dk | |||
|322,437 | |||
|- | |||
|34 | |||
|za | |||
|318,612 | |||
|- | |||
|35 | |||
|hu | |||
|302,208 | |||
|- | |||
|36 | |||
|club | |||
|291,850 | |||
|- | |||
|37 | |||
|ml | |||
|282,107 | |||
|- | |||
|38 | |||
|io | |||
|280,960 | |||
|- | |||
|39 | |||
|me | |||
|271,191 | |||
|- | |||
|40 | |||
|gq | |||
|270,862 | |||
|- | |||
|41 | |||
|nz | |||
|270,813 | |||
|- | |||
|42 | |||
|ua | |||
|269,832 | |||
|- | |||
|43 | |||
|ro | |||
|259,773 | |||
|- | |||
|44 | |||
|cc | |||
|255,628 | |||
|- | |||
|45 | |||
|tr | |||
|251,823 | |||
|- | |||
|46 | |||
|home | |||
|251,553 | |||
|- | |||
|47 | |||
|mx | |||
|221,564 | |||
|- | |||
|48 | |||
|ar | |||
|216,032 | |||
|- | |||
|49 | |||
|online | |||
|213,020 | |||
|- | |||
|50 | |||
|il | |||
|209,699 | |||
|- | |||
|51 | |||
|gr | |||
|205,441 | |||
|- | |||
|52 | |||
|icu | |||
|200,112 | |||
|- | |||
|53 | |||
|kr | |||
|197,749 | |||
|- | |||
|54 | |||
|xyz | |||
|195,489 | |||
|- | |||
|55 | |||
|no | |||
|184,838 | |||
|- | |||
|56 | |||
|live | |||
|180,119 | |||
|- | |||
|57 | |||
|loan | |||
|174,224 | |||
|- | |||
|58 | |||
|site | |||
|172,896 | |||
|- | |||
|59 | |||
|fi | |||
|169,519 | |||
|- | |||
|60 | |||
|pw | |||
|167,069 | |||
|- | |||
|61 | |||
|vn | |||
|161,463 | |||
|- | |||
|62 | |||
|tv | |||
|150,487 | |||
|- | |||
|63 | |||
|cl | |||
|147,461 | |||
|- | |||
|64 | |||
|sk | |||
|145,794 | |||
|- | |||
|65 | |||
|edu | |||
|140,498 | |||
|- | |||
|66 | |||
|id | |||
|129,276 | |||
|- | |||
|67 | |||
|pt | |||
|111,654 | |||
|- | |||
|68 | |||
|pro | |||
|109,381 | |||
|- | |||
|69 | |||
|ws | |||
|105,826 | |||
|- | |||
|70 | |||
|ie | |||
|102,981 | |||
|- | |||
|71 | |||
|su | |||
|98,101 | |||
|- | |||
|72 | |||
|vip | |||
|79,255 | |||
|- | |||
|73 | |||
|nu | |||
|79,003 | |||
|- | |||
|74 | |||
|shop | |||
|78,439 | |||
|- | |||
|75 | |||
|lt | |||
|76,968 | |||
|- | |||
|76 | |||
|space | |||
|73,487 | |||
|- | |||
|77 | |||
|kz | |||
|71,895 | |||
|- | |||
|78 | |||
|my | |||
|71,557 | |||
|- | |||
|79 | |||
|gdn | |||
|68,475 | |||
|- | |||
|80 | |||
|by | |||
|66,774 | |||
|- | |||
|81 | |||
|sg | |||
|63,217 | |||
|- | |||
|82 | |||
|win | |||
|62,439 | |||
|- | |||
|83 | |||
|asia | |||
|61,691 | |||
|- | |||
|84 | |||
|hk | |||
|61,515 | |||
|- | |||
|85 | |||
|bid | |||
|60,156 | |||
|- | |||
|86 | |||
|website | |||
|60,107 | |||
|- | |||
|87 | |||
|si | |||
|58,499 | |||
|- | |||
|88 | |||
|to | |||
|56,567 | |||
|- | |||
|89 | |||
|hr | |||
|54,871 | |||
|- | |||
|90 | |||
|ee | |||
|53,026 | |||
|- | |||
|91 | |||
|mobi | |||
|52,551 | |||
|- | |||
|92 | |||
|rs | |||
|52,385 | |||
|- | |||
|93 | |||
|tech | |||
|52,315 | |||
|- | |||
|94 | |||
|app | |||
|49,790 | |||
|- | |||
|95 | |||
|gov | |||
|47,819 | |||
|- | |||
|96 | |||
|lv | |||
|46,565 | |||
|- | |||
|97 | |||
|domain | |||
|46,245 | |||
|- | |||
|98 | |||
|work | |||
|45,362 | |||
|- | |||
|99 | |||
|fun | |||
|45,205 | |||
|- | |||
|100 | |||
|All other | |||
|5,597,896 | |||
|} | |||
= TLD Distribution (excluding DNS resolve errors and other errors) = | |||
{| class="wikitable" | |||
|- | |||
! # | |||
! TLD | |||
! Domain count | |||
|- | |||
|1 | |||
|com | |||
|37,300,408 | |||
|- | |||
|2 | |||
|net | |||
|3,766,009 | |||
|- | |||
|3 | |||
|de | |||
|2,987,387 | |||
|- | |||
|4 | |||
|org | |||
|2,530,378 | |||
|- | |||
|5 | |||
|uk | |||
|2,528,466 | |||
|- | |||
|6 | |||
|ru | |||
|1,320,466 | |||
|- | |||
|7 | |||
|nl | |||
|1,021,809 | |||
|- | |||
|8 | |||
|fr | |||
|788,261 | |||
|- | |||
|9 | |||
|it | |||
|781,646 | |||
|- | |||
|10 | |||
|jp | |||
|777,437 | |||
|- | |||
|11 | |||
|pl | |||
|719,634 | |||
|- | |||
|12 | |||
|br | |||
|624,499 | |||
|- | |||
|13 | |||
|ca | |||
|527,891 | |||
|- | |||
|14 | |||
|cn | |||
|507,153 | |||
|- | |||
|15 | |||
|info | |||
|440,798 | |||
|- | |||
|16 | |||
|ch | |||
|417,061 | |||
|- | |||
|17 | |||
|cz | |||
|370,561 | |||
|- | |||
|18 | |||
|eu | |||
|364,051 | |||
|- | |||
|19 | |||
|co | |||
|327,177 | |||
|- | |||
|20 | |||
|es | |||
|323,874 | |||
|- | |||
|21 | |||
|in | |||
|320,848 | |||
|- | |||
|22 | |||
|se | |||
|306,929 | |||
|- | |||
|23 | |||
|be | |||
|293,779 | |||
|- | |||
|24 | |||
|at | |||
|291,725 | |||
|- | |||
|25 | |||
|dk | |||
|232,536 | |||
|- | |||
|26 | |||
|hu | |||
|228,054 | |||
|- | |||
|27 | |||
|za | |||
|226,850 | |||
|- | |||
|28 | |||
|us | |||
|215,532 | |||
|- | |||
|29 | |||
|io | |||
|200,616 | |||
|- | |||
|30 | |||
|ga | |||
|190,811 | |||
|- | |||
|31 | |||
|cf | |||
|187,682 | |||
|- | |||
|32 | |||
|biz | |||
|186,318 | |||
|- | |||
|33 | |||
|nz | |||
|175,385 | |||
|- | |||
|34 | |||
|ua | |||
|173,415 | |||
|- | |||
|35 | |||
|ml | |||
|172,104 | |||
|- | |||
|36 | |||
|tr | |||
|166,641 | |||
|- | |||
|37 | |||
|ro | |||
|165,723 | |||
|- | |||
|38 | |||
|ir | |||
|161,217 | |||
|- | |||
|39 | |||
|gq | |||
|150,990 | |||
|- | |||
|40 | |||
|gr | |||
|147,176 | |||
|- | |||
|41 | |||
|no | |||
|143,592 | |||
|- | |||
|42 | |||
|il | |||
|141,349 | |||
|- | |||
|43 | |||
|me | |||
|136,554 | |||
|- | |||
|44 | |||
|mx | |||
|135,424 | |||
|- | |||
|45 | |||
|fi | |||
|135,069 | |||
|- | |||
|46 | |||
|kr | |||
|126,860 | |||
|- | |||
|47 | |||
|ar | |||
|124,527 | |||
|- | |||
|48 | |||
|sk | |||
|113,717 | |||
|- | |||
|49 | |||
|edu | |||
|109,395 | |||
|- | |||
|50 | |||
|tw | |||
|104,169 | |||
|- | |||
|51 | |||
|vn | |||
|103,675 | |||
|- | |||
|52 | |||
|cc | |||
|95,787 | |||
|- | |||
|53 | |||
|cl | |||
|91,639 | |||
|- | |||
|54 | |||
|pt | |||
|81,711 | |||
|- | |||
|55 | |||
|ie | |||
|77,138 | |||
|- | |||
|56 | |||
|tv | |||
|76,522 | |||
|- | |||
|57 | |||
|id | |||
|73,907 | |||
|- | |||
|58 | |||
|ws | |||
|63,332 | |||
|- | |||
|59 | |||
|online | |||
|62,485 | |||
|- | |||
|60 | |||
|lt | |||
|59,030 | |||
|- | |||
|61 | |||
|top | |||
|57,701 | |||
|- | |||
|62 | |||
|club | |||
|49,982 | |||
|- | |||
|63 | |||
|my | |||
|47,511 | |||
|- | |||
|64 | |||
|xyz | |||
|45,974 | |||
|- | |||
|65 | |||
|site | |||
|45,551 | |||
|- | |||
|66 | |||
|by | |||
|44,767 | |||
|- | |||
|67 | |||
|pro | |||
|43,313 | |||
|- | |||
|68 | |||
|ee | |||
|42,050 | |||
|- | |||
|69 | |||
|si | |||
|41,946 | |||
|- | |||
|70 | |||
|sg | |||
|40,926 | |||
|- | |||
|71 | |||
|hr | |||
|39,182 | |||
|- | |||
|72 | |||
|rs | |||
|38,169 | |||
|- | |||
|73 | |||
|hk | |||
|38,082 | |||
|- | |||
|74 | |||
|nu | |||
|36,689 | |||
|- | |||
|75 | |||
|tk | |||
|36,588 | |||
|- | |||
|76 | |||
|lv | |||
|33,330 | |||
|- | |||
|77 | |||
|ph | |||
|32,519 | |||
|- | |||
|78 | |||
|app | |||
|30,983 | |||
|- | |||
|79 | |||
|kz | |||
|30,503 | |||
|- | |||
|80 | |||
|shop | |||
|30,287 | |||
|- | |||
|81 | |||
|su | |||
|27,578 | |||
|- | |||
|82 | |||
|th | |||
|27,157 | |||
|- | |||
|83 | |||
|bg | |||
|26,841 | |||
|- | |||
|84 | |||
|gov | |||
|25,798 | |||
|- | |||
|85 | |||
|cat | |||
|24,337 | |||
|- | |||
|86 | |||
|live | |||
|23,455 | |||
|- | |||
|87 | |||
|ae | |||
|22,213 | |||
|- | |||
|88 | |||
|blog | |||
|21,982 | |||
|- | |||
|89 | |||
|pe | |||
|21,644 | |||
|- | |||
|90 | |||
|pk | |||
|21,533 | |||
|- | |||
|91 | |||
|mobi | |||
|18,619 | |||
|- | |||
|92 | |||
|is | |||
|17,580 | |||
|- | |||
|93 | |||
|store | |||
|16,876 | |||
|- | |||
|94 | |||
|space | |||
|16,839 | |||
|- | |||
|95 | |||
|lu | |||
|16,491 | |||
|- | |||
|96 | |||
|to | |||
|16,341 | |||
|- | |||
|97 | |||
|asia | |||
|15,845 | |||
|- | |||
|98 | |||
|link | |||
|15,134 | |||
|- | |||
|99 | |||
|tech | |||
|14,761 | |||
|- | |||
|100 | |||
|All other | |||
|1,579,464 | |||
|} |
Latest revision as of 01:47, 2 January 2023
Category change
- Added Parked domain category
- Added Domain not available category
- Added Private site available category
- Added Earth science category
- Added Fringe theory category
- Added Conspiracy theory category
- Added Alt right category
- Added Alt left category
Database change
- Removed 1.6m invalid domains (they were classified under DNS not found category)
- Improved detection of Captcha protected sites
- Improved the ability to classify captcha protected sites
- Improved detection for parked domains
Domain count and statistics
ID | Name | Domain count |
---|---|---|
1 | Abortion and pregnancy | 103,122 |
2 | Ads | 81,349 |
3 | Adult | 433,537 |
4 | Adult dating | 18,822 |
5 | Alcohol | 407,089 |
6 | Astrology | 63,652 |
7 | Blogs | 3,467,789 |
8 | Books or comics | 491,035 |
9 | Business and services | 6,355,917 |
10 | CDN | 1,048,973 |
11 | Chats | 98,172 |
12 | Classifieds | 111,450 |
13 | Clothing and fashion | 1,111,631 |
14 | Cooking and food | 1,799,018 |
15 | Dating | 89,236 |
16 | Drugs | 78,046 |
17 | Education | 1,247,376 |
18 | Empty site | 1,747,224 |
19 | Entertainment | 749,283 |
20 | Error site can't be accessed | 5,844,831 |
21 | DNS error site can't be resolved | 41,923,049 |
22 | File hosting | 78,577 |
23 | Finance (Banks_Real estate_Insurance) | 645,657 |
24 | Gambling | 394,582 |
25 | Computer games | 544,632 |
26 | General (safe) | 9,925 |
27 | Government | 133,134 |
28 | Hacking | 12,210 |
29 | Hate | 17,532 |
30 | Hobbies | 373,352 |
31 | Home improvement | 465,905 |
32 | Humor | 29,447 |
33 | Hunting and fishing | 109,552 |
34 | Image and video hosting | 112,941 |
35 | Jobs | 834,226 |
36 | Kids safe | 237 |
37 | Legal | 446,981 |
38 | Life style and beauty | 761,550 |
39 | Link farm (no real content) | 7,174,545 |
40 | Local information | 73,426 |
41 | Medical | 2,650,605 |
42 | Military | 31,264 |
43 | Mixed adult | 1,043,067 |
44 | Mobile | 282,692 |
45 | Models | 57,687 |
46 | Music | 1,118,131 |
47 | News | 1,498,895 |
49 | Not child safe | 22,942 |
50 | Online drugs | 41,389 |
51 | Online marketing | 581,405 |
52 | Online video or audio | 327,634 |
53 | Pets and animals | 424,470 |
54 | Phishing | 1,474 |
55 | Politics | 348,562 |
56 | Porn | 852,102 |
57 | Internet portals | 295,704 |
58 | Profanity | 32,824 |
59 | Proxy | 16,021 |
60 | Religion | 536,742 |
62 | Science | 344,082 |
63 | Search engines | 81,401 |
64 | Sects | 13,029 |
65 | Semi nude and pin up | 27,048 |
66 | Sex education | 67,498 |
67 | Shopping | 2,491,562 |
68 | Social networks | 631,912 |
69 | Spam or scam | 3,652 |
70 | Sports | 1,361,544 |
71 | Suicide | 293 |
72 | Technology and computers | 937,929 |
73 | Site under construction or not available | 5,231,976 |
74 | General - not porn | 9,445,557 |
75 | URL shortener | 7,157 |
76 | Vacation and travel | 1,800,131 |
77 | Vehicles | 1,277,162 |
78 | Violence | 32,506 |
79 | Virus or Spyware | 1,755 |
80 | Warez | 38,300 |
81 | Weapons | 150,389 |
82 | Web hosting | 867,988 |
83 | Web mail | 114,425 |
84 | Reference | 201,620 |
85 | Community and society | 235,593 |
86 | Software repository | 34,049 |
87 | Philosophy and psychology | 246,067 |
88 | History | 301,236 |
89 | Nonsense and time waste | 73,668 |
90 | Local IP | 70 |
91 | Swimsuits and underwear | 110,587 |
92 | Arts | 749,980 |
94 | Login page | 144,551 |
95 | Surveys and polls | 35,298 |
96 | Tobacco | 56,205 |
97 | ISP | 19,293 |
98 | Tracker | 1,144,480 |
99 | Bypass protection | 3,067 |
100 | Search block | 52 |
101 | Image search block | 171,739 |
102 | Desktop themes | 9,389 |
103 | Depress domain | 71,347 |
104 | Depress page | 1,839 |
105 | Parenting and family | 71,638 |
106 | School cheats | 4,588 |
107 | Celebrity gossip | 122,298 |
108 | How to | 100,124 |
109 | Illegal | 3,134 |
110 | Recreation | 211,185 |
111 | Bookmarks | 17,684 |
112 | Money spam | 5,633 |
113 | Directories | 4,843 |
114 | Site_Graphic design | 368,814 |
115 | Weather | 80,739 |
116 | Knowledge | 62,116 |
117 | Kids entertainment | 16,005 |
118 | Nature | 107,232 |
119 | Diet | 119,703 |
120 | Eating disorders | 5,342 |
121 | Self help | 94,318 |
122 | Relationships | 21,186 |
123 | Paranormal | 37,595 |
124 | Images CDN | 2,952 |
125 | Images CDN Unknown | 65,694 |
126 | LGBT | 16,219 |
127 | Marketing or ads | 33,601 |
128 | Magazines | 153,333 |
129 | Forums | 128,074 |
130 | User generated content | 41,146 |
131 | Tele Communications | 60,070 |
132 | Gender specific | 2,334 |
134 | Crime | 37,866 |
135 | Person | 59,620 |
136 | Grief | 2,431 |
137 | Retirement | 50,478 |
138 | Other drugs | 69,238 |
139 | Pharmacy | 42,976 |
140 | Songs download | 18,585 |
141 | Lookup | 45,445 |
142 | Movies download | 112,313 |
143 | Consumer reviews | 19,530 |
144 | API | 87,711 |
145 | Legal movies | 641 |
146 | Legal songs | 1,639 |
147 | Bitcoin | 75,757 |
148 | Victim help | 3,443 |
149 | Rewards | 9,676 |
150 | Photography | 380,737 |
151 | Toys | 124,686 |
152 | Restaurant | 375,699 |
153 | Fitness | 276,768 |
154 | Contact sport | 126,870 |
155 | Dancing | 50,443 |
156 | Software | 428,950 |
157 | Programming | 258,516 |
158 | Registry cleaner | 324 |
159 | Online security | 125,113 |
160 | Real estate | 763,346 |
161 | Loans | 130,508 |
162 | Forex | 26,322 |
163 | Banks | 250,261 |
164 | Insurance | 279,614 |
165 | SEO | 84,320 |
166 | PPC | 7,298 |
167 | Supplements | 47,769 |
168 | URL Classification | 455 |
170 | Tatoo | 30,615 |
172 | Tactical equipment | 5,977 |
173 | Alternative medicine | 230,771 |
174 | AI | 16,115 |
175 | Comics | 20,342 |
176 | Manga | 7,348 |
177 | Captcha | 487,782 |
178 | Racism education | 1,310 |
179 | Payment | 14,989 |
180 | Brokerage | 18,924 |
181 | SAAS | 13,334 |
182 | Anime | 14,552 |
183 | Cartoon | 5,936 |
184 | Grownups | 19 |
185 | Stream converter | 3,195 |
186 | File converter | 2,811 |
187 | TV Personality | 839 |
188 | Radio Personality | 634 |
189 | Youtube Personality | 7,985 |
190 | Prevent crime or violence | 3,519 |
191 | Collaboration software | 8,045 |
193 | Internet support | 2,956 |
194 | Computer support | 24,520 |
195 | Home appliance | 4,380 |
196 | Disposable mail | 414 |
197 | Parked domain | 315,396 |
198 | Domain not available | 83,876 |
199 | Private site | 135,361 |
200 | Earth science | 27,311 |
201 | Fringe theory | 45 |
202 | Conspiracy theory | 185 |
203 | Alt right | 106 |
204 | Alt left | 97 |
Total domains: 126,012,685
Total classified domains: 78,244,805 (Total domains excluding DNS resolve errors and other errors)
Total unique domains: 115,219,367
Total unique classified domains: 67,451,725 (Total unique domains excluding DNS resolve errors and other errors)
TLD Distribution (all domains)
# | TLD | Domain count |
---|---|---|
1 | com | 58,746,836 |
2 | net | 6,434,278 |
3 | de | 4,347,180 |
4 | org | 4,263,895 |
5 | uk | 3,503,529 |
6 | ru | 2,375,815 |
7 | cn | 1,899,847 |
8 | info | 1,729,539 |
9 | nl | 1,388,483 |
10 | fr | 1,196,513 |
11 | pl | 1,128,700 |
12 | it | 1,118,404 |
13 | jp | 1,104,209 |
14 | br | 1,037,378 |
15 | tk | 917,956 |
16 | ca | 716,416 |
17 | tw | 705,894 |
18 | eu | 641,022 |
19 | top | 605,562 |
20 | co | 604,706 |
21 | in | 594,994 |
22 | ch | 547,632 |
23 | biz | 547,415 |
24 | us | 530,790 |
25 | es | 488,538 |
26 | cz | 466,159 |
27 | se | 429,430 |
28 | be | 408,253 |
29 | at | 389,258 |
30 | ga | 361,392 |
31 | cf | 344,705 |
32 | ir | 340,061 |
33 | dk | 322,437 |
34 | za | 318,612 |
35 | hu | 302,208 |
36 | club | 291,850 |
37 | ml | 282,107 |
38 | io | 280,960 |
39 | me | 271,191 |
40 | gq | 270,862 |
41 | nz | 270,813 |
42 | ua | 269,832 |
43 | ro | 259,773 |
44 | cc | 255,628 |
45 | tr | 251,823 |
46 | home | 251,553 |
47 | mx | 221,564 |
48 | ar | 216,032 |
49 | online | 213,020 |
50 | il | 209,699 |
51 | gr | 205,441 |
52 | icu | 200,112 |
53 | kr | 197,749 |
54 | xyz | 195,489 |
55 | no | 184,838 |
56 | live | 180,119 |
57 | loan | 174,224 |
58 | site | 172,896 |
59 | fi | 169,519 |
60 | pw | 167,069 |
61 | vn | 161,463 |
62 | tv | 150,487 |
63 | cl | 147,461 |
64 | sk | 145,794 |
65 | edu | 140,498 |
66 | id | 129,276 |
67 | pt | 111,654 |
68 | pro | 109,381 |
69 | ws | 105,826 |
70 | ie | 102,981 |
71 | su | 98,101 |
72 | vip | 79,255 |
73 | nu | 79,003 |
74 | shop | 78,439 |
75 | lt | 76,968 |
76 | space | 73,487 |
77 | kz | 71,895 |
78 | my | 71,557 |
79 | gdn | 68,475 |
80 | by | 66,774 |
81 | sg | 63,217 |
82 | win | 62,439 |
83 | asia | 61,691 |
84 | hk | 61,515 |
85 | bid | 60,156 |
86 | website | 60,107 |
87 | si | 58,499 |
88 | to | 56,567 |
89 | hr | 54,871 |
90 | ee | 53,026 |
91 | mobi | 52,551 |
92 | rs | 52,385 |
93 | tech | 52,315 |
94 | app | 49,790 |
95 | gov | 47,819 |
96 | lv | 46,565 |
97 | domain | 46,245 |
98 | work | 45,362 |
99 | fun | 45,205 |
100 | All other | 5,597,896 |
TLD Distribution (excluding DNS resolve errors and other errors)
# | TLD | Domain count |
---|---|---|
1 | com | 37,300,408 |
2 | net | 3,766,009 |
3 | de | 2,987,387 |
4 | org | 2,530,378 |
5 | uk | 2,528,466 |
6 | ru | 1,320,466 |
7 | nl | 1,021,809 |
8 | fr | 788,261 |
9 | it | 781,646 |
10 | jp | 777,437 |
11 | pl | 719,634 |
12 | br | 624,499 |
13 | ca | 527,891 |
14 | cn | 507,153 |
15 | info | 440,798 |
16 | ch | 417,061 |
17 | cz | 370,561 |
18 | eu | 364,051 |
19 | co | 327,177 |
20 | es | 323,874 |
21 | in | 320,848 |
22 | se | 306,929 |
23 | be | 293,779 |
24 | at | 291,725 |
25 | dk | 232,536 |
26 | hu | 228,054 |
27 | za | 226,850 |
28 | us | 215,532 |
29 | io | 200,616 |
30 | ga | 190,811 |
31 | cf | 187,682 |
32 | biz | 186,318 |
33 | nz | 175,385 |
34 | ua | 173,415 |
35 | ml | 172,104 |
36 | tr | 166,641 |
37 | ro | 165,723 |
38 | ir | 161,217 |
39 | gq | 150,990 |
40 | gr | 147,176 |
41 | no | 143,592 |
42 | il | 141,349 |
43 | me | 136,554 |
44 | mx | 135,424 |
45 | fi | 135,069 |
46 | kr | 126,860 |
47 | ar | 124,527 |
48 | sk | 113,717 |
49 | edu | 109,395 |
50 | tw | 104,169 |
51 | vn | 103,675 |
52 | cc | 95,787 |
53 | cl | 91,639 |
54 | pt | 81,711 |
55 | ie | 77,138 |
56 | tv | 76,522 |
57 | id | 73,907 |
58 | ws | 63,332 |
59 | online | 62,485 |
60 | lt | 59,030 |
61 | top | 57,701 |
62 | club | 49,982 |
63 | my | 47,511 |
64 | xyz | 45,974 |
65 | site | 45,551 |
66 | by | 44,767 |
67 | pro | 43,313 |
68 | ee | 42,050 |
69 | si | 41,946 |
70 | sg | 40,926 |
71 | hr | 39,182 |
72 | rs | 38,169 |
73 | hk | 38,082 |
74 | nu | 36,689 |
75 | tk | 36,588 |
76 | lv | 33,330 |
77 | ph | 32,519 |
78 | app | 30,983 |
79 | kz | 30,503 |
80 | shop | 30,287 |
81 | su | 27,578 |
82 | th | 27,157 |
83 | bg | 26,841 |
84 | gov | 25,798 |
85 | cat | 24,337 |
86 | live | 23,455 |
87 | ae | 22,213 |
88 | blog | 21,982 |
89 | pe | 21,644 |
90 | pk | 21,533 |
91 | mobi | 18,619 |
92 | is | 17,580 |
93 | store | 16,876 |
94 | space | 16,839 |
95 | lu | 16,491 |
96 | to | 16,341 |
97 | asia | 15,845 |
98 | link | 15,134 |
99 | tech | 14,761 |
100 | All other | 1,579,464 |