Offline URL Database 1st January 2023 changelog
Jump to navigation
Jump to search
Category change
- Added Parked domain category
- Added Domain not available category
- Added Private site available category
- Added Earth science category
- Added Fringe theory category
- Added Conspiracy theory category
- Added Alt right category
- Added Alt left category
Database change
- Removed 1.6m invalid domains (they were classified under DNS not found category)
- Improved detection of Captcha protected sites
- Improved the ability to classify captcha protected sites
- Improved detection for parked domains
Domain count and statistics
| ID | Name | Domain count |
|---|---|---|
| 1 | Abortion and pregnancy | 103,122 |
| 2 | Ads | 81,349 |
| 3 | Adult | 433,537 |
| 4 | Adult dating | 18,822 |
| 5 | Alcohol | 407,089 |
| 6 | Astrology | 63,652 |
| 7 | Blogs | 3,467,789 |
| 8 | Books or comics | 491,035 |
| 9 | Business and services | 6,355,917 |
| 10 | CDN | 1,048,973 |
| 11 | Chats | 98,172 |
| 12 | Classifieds | 111,450 |
| 13 | Clothing and fashion | 1,111,631 |
| 14 | Cooking and food | 1,799,018 |
| 15 | Dating | 89,236 |
| 16 | Drugs | 78,046 |
| 17 | Education | 1,247,376 |
| 18 | Empty site | 1,747,224 |
| 19 | Entertainment | 749,283 |
| 20 | Error site can't be accessed | 5,844,831 |
| 21 | DNS error site can't be resolved | 41,923,049 |
| 22 | File hosting | 78,577 |
| 23 | Finance (Banks_Real estate_Insurance) | 645,657 |
| 24 | Gambling | 394,582 |
| 25 | Computer games | 544,632 |
| 26 | General (safe) | 9,925 |
| 27 | Government | 133,134 |
| 28 | Hacking | 12,210 |
| 29 | Hate | 17,532 |
| 30 | Hobbies | 373,352 |
| 31 | Home improvement | 465,905 |
| 32 | Humor | 29,447 |
| 33 | Hunting and fishing | 109,552 |
| 34 | Image and video hosting | 112,941 |
| 35 | Jobs | 834,226 |
| 36 | Kids safe | 237 |
| 37 | Legal | 446,981 |
| 38 | Life style and beauty | 761,550 |
| 39 | Link farm (no real content) | 7,174,545 |
| 40 | Local information | 73,426 |
| 41 | Medical | 2,650,605 |
| 42 | Military | 31,264 |
| 43 | Mixed adult | 1,043,067 |
| 44 | Mobile | 282,692 |
| 45 | Models | 57,687 |
| 46 | Music | 1,118,131 |
| 47 | News | 1,498,895 |
| 49 | Not child safe | 22,942 |
| 50 | Online drugs | 41,389 |
| 51 | Online marketing | 581,405 |
| 52 | Online video or audio | 327,634 |
| 53 | Pets and animals | 424,470 |
| 54 | Phishing | 1,474 |
| 55 | Politics | 348,562 |
| 56 | Porn | 852,102 |
| 57 | Internet portals | 295,704 |
| 58 | Profanity | 32,824 |
| 59 | Proxy | 16,021 |
| 60 | Religion | 536,742 |
| 62 | Science | 344,082 |
| 63 | Search engines | 81,401 |
| 64 | Sects | 13,029 |
| 65 | Semi nude and pin up | 27,048 |
| 66 | Sex education | 67,498 |
| 67 | Shopping | 2,491,562 |
| 68 | Social networks | 631,912 |
| 69 | Spam or scam | 3,652 |
| 70 | Sports | 1,361,544 |
| 71 | Suicide | 293 |
| 72 | Technology and computers | 937,929 |
| 73 | Site under construction or not available | 5,231,976 |
| 74 | General - not porn | 9,445,557 |
| 75 | URL shortener | 7,157 |
| 76 | Vacation and travel | 1,800,131 |
| 77 | Vehicles | 1,277,162 |
| 78 | Violence | 32,506 |
| 79 | Virus or Spyware | 1,755 |
| 80 | Warez | 38,300 |
| 81 | Weapons | 150,389 |
| 82 | Web hosting | 867,988 |
| 83 | Web mail | 114,425 |
| 84 | Reference | 201,620 |
| 85 | Community and society | 235,593 |
| 86 | Software repository | 34,049 |
| 87 | Philosophy and psychology | 246,067 |
| 88 | History | 301,236 |
| 89 | Nonsense and time waste | 73,668 |
| 90 | Local IP | 70 |
| 91 | Swimsuits and underwear | 110,587 |
| 92 | Arts | 749,980 |
| 94 | Login page | 144,551 |
| 95 | Surveys and polls | 35,298 |
| 96 | Tobacco | 56,205 |
| 97 | ISP | 19,293 |
| 98 | Tracker | 1,144,480 |
| 99 | Bypass protection | 3,067 |
| 100 | Search block | 52 |
| 101 | Image search block | 171,739 |
| 102 | Desktop themes | 9,389 |
| 103 | Depress domain | 71,347 |
| 104 | Depress page | 1,839 |
| 105 | Parenting and family | 71,638 |
| 106 | School cheats | 4,588 |
| 107 | Celebrity gossip | 122,298 |
| 108 | How to | 100,124 |
| 109 | Illegal | 3,134 |
| 110 | Recreation | 211,185 |
| 111 | Bookmarks | 17,684 |
| 112 | Money spam | 5,633 |
| 113 | Directories | 4,843 |
| 114 | Site_Graphic design | 368,814 |
| 115 | Weather | 80,739 |
| 116 | Knowledge | 62,116 |
| 117 | Kids entertainment | 16,005 |
| 118 | Nature | 107,232 |
| 119 | Diet | 119,703 |
| 120 | Eating disorders | 5,342 |
| 121 | Self help | 94,318 |
| 122 | Relationships | 21,186 |
| 123 | Paranormal | 37,595 |
| 124 | Images CDN | 2,952 |
| 125 | Images CDN Unknown | 65,694 |
| 126 | LGBT | 16,219 |
| 127 | Marketing or ads | 33,601 |
| 128 | Magazines | 153,333 |
| 129 | Forums | 128,074 |
| 130 | User generated content | 41,146 |
| 131 | Tele Communications | 60,070 |
| 132 | Gender specific | 2,334 |
| 134 | Crime | 37,866 |
| 135 | Person | 59,620 |
| 136 | Grief | 2,431 |
| 137 | Retirement | 50,478 |
| 138 | Other drugs | 69,238 |
| 139 | Pharmacy | 42,976 |
| 140 | Songs download | 18,585 |
| 141 | Lookup | 45,445 |
| 142 | Movies download | 112,313 |
| 143 | Consumer reviews | 19,530 |
| 144 | API | 87,711 |
| 145 | Legal movies | 641 |
| 146 | Legal songs | 1,639 |
| 147 | Bitcoin | 75,757 |
| 148 | Victim help | 3,443 |
| 149 | Rewards | 9,676 |
| 150 | Photography | 380,737 |
| 151 | Toys | 124,686 |
| 152 | Restaurant | 375,699 |
| 153 | Fitness | 276,768 |
| 154 | Contact sport | 126,870 |
| 155 | Dancing | 50,443 |
| 156 | Software | 428,950 |
| 157 | Programming | 258,516 |
| 158 | Registry cleaner | 324 |
| 159 | Online security | 125,113 |
| 160 | Real estate | 763,346 |
| 161 | Loans | 130,508 |
| 162 | Forex | 26,322 |
| 163 | Banks | 250,261 |
| 164 | Insurance | 279,614 |
| 165 | SEO | 84,320 |
| 166 | PPC | 7,298 |
| 167 | Supplements | 47,769 |
| 168 | URL Classification | 455 |
| 170 | Tatoo | 30,615 |
| 172 | Tactical equipment | 5,977 |
| 173 | Alternative medicine | 230,771 |
| 174 | AI | 16,115 |
| 175 | Comics | 20,342 |
| 176 | Manga | 7,348 |
| 177 | Captcha | 487,782 |
| 178 | Racism education | 1,310 |
| 179 | Payment | 14,989 |
| 180 | Brokerage | 18,924 |
| 181 | SAAS | 13,334 |
| 182 | Anime | 14,552 |
| 183 | Cartoon | 5,936 |
| 184 | Grownups | 19 |
| 185 | Stream converter | 3,195 |
| 186 | File converter | 2,811 |
| 187 | TV Personality | 839 |
| 188 | Radio Personality | 634 |
| 189 | Youtube Personality | 7,985 |
| 190 | Prevent crime or violence | 3,519 |
| 191 | Collaboration software | 8,045 |
| 193 | Internet support | 2,956 |
| 194 | Computer support | 24,520 |
| 195 | Home appliance | 4,380 |
| 196 | Disposable mail | 414 |
| 197 | Parked domain | 315,396 |
| 198 | Domain not available | 83,876 |
| 199 | Private site | 135,361 |
| 200 | Earth science | 27,311 |
| 201 | Fringe theory | 45 |
| 202 | Conspiracy theory | 185 |
| 203 | Alt right | 106 |
| 204 | Alt left | 97 |
Total domains: 126,012,685
Total classified domains: 78,244,805 (Total domains excluding DNS resolve errors and other errors)
Total unique domains: 115,219,367
Total unique classified domains: 67,451,725 (Total unique domains excluding DNS resolve errors and other errors)
TLD Distribution (all domains)
| # | TLD | Domain count |
|---|---|---|
| 1 | com | 58,746,836 |
| 2 | net | 6,434,278 |
| 3 | de | 4,347,180 |
| 4 | org | 4,263,895 |
| 5 | uk | 3,503,529 |
| 6 | ru | 2,375,815 |
| 7 | cn | 1,899,847 |
| 8 | info | 1,729,539 |
| 9 | nl | 1,388,483 |
| 10 | fr | 1,196,513 |
| 11 | pl | 1,128,700 |
| 12 | it | 1,118,404 |
| 13 | jp | 1,104,209 |
| 14 | br | 1,037,378 |
| 15 | tk | 917,956 |
| 16 | ca | 716,416 |
| 17 | tw | 705,894 |
| 18 | eu | 641,022 |
| 19 | top | 605,562 |
| 20 | co | 604,706 |
| 21 | in | 594,994 |
| 22 | ch | 547,632 |
| 23 | biz | 547,415 |
| 24 | us | 530,790 |
| 25 | es | 488,538 |
| 26 | cz | 466,159 |
| 27 | se | 429,430 |
| 28 | be | 408,253 |
| 29 | at | 389,258 |
| 30 | ga | 361,392 |
| 31 | cf | 344,705 |
| 32 | ir | 340,061 |
| 33 | dk | 322,437 |
| 34 | za | 318,612 |
| 35 | hu | 302,208 |
| 36 | club | 291,850 |
| 37 | ml | 282,107 |
| 38 | io | 280,960 |
| 39 | me | 271,191 |
| 40 | gq | 270,862 |
| 41 | nz | 270,813 |
| 42 | ua | 269,832 |
| 43 | ro | 259,773 |
| 44 | cc | 255,628 |
| 45 | tr | 251,823 |
| 46 | home | 251,553 |
| 47 | mx | 221,564 |
| 48 | ar | 216,032 |
| 49 | online | 213,020 |
| 50 | il | 209,699 |
| 51 | gr | 205,441 |
| 52 | icu | 200,112 |
| 53 | kr | 197,749 |
| 54 | xyz | 195,489 |
| 55 | no | 184,838 |
| 56 | live | 180,119 |
| 57 | loan | 174,224 |
| 58 | site | 172,896 |
| 59 | fi | 169,519 |
| 60 | pw | 167,069 |
| 61 | vn | 161,463 |
| 62 | tv | 150,487 |
| 63 | cl | 147,461 |
| 64 | sk | 145,794 |
| 65 | edu | 140,498 |
| 66 | id | 129,276 |
| 67 | pt | 111,654 |
| 68 | pro | 109,381 |
| 69 | ws | 105,826 |
| 70 | ie | 102,981 |
| 71 | su | 98,101 |
| 72 | vip | 79,255 |
| 73 | nu | 79,003 |
| 74 | shop | 78,439 |
| 75 | lt | 76,968 |
| 76 | space | 73,487 |
| 77 | kz | 71,895 |
| 78 | my | 71,557 |
| 79 | gdn | 68,475 |
| 80 | by | 66,774 |
| 81 | sg | 63,217 |
| 82 | win | 62,439 |
| 83 | asia | 61,691 |
| 84 | hk | 61,515 |
| 85 | bid | 60,156 |
| 86 | website | 60,107 |
| 87 | si | 58,499 |
| 88 | to | 56,567 |
| 89 | hr | 54,871 |
| 90 | ee | 53,026 |
| 91 | mobi | 52,551 |
| 92 | rs | 52,385 |
| 93 | tech | 52,315 |
| 94 | app | 49,790 |
| 95 | gov | 47,819 |
| 96 | lv | 46,565 |
| 97 | domain | 46,245 |
| 98 | work | 45,362 |
| 99 | fun | 45,205 |
| 100 | All other | 5,597,896 |
TLD Distribution (excluding DNS resolve errors and other errors)
| # | TLD | Domain count |
|---|---|---|
| 1 | com | 37,300,408 |
| 2 | net | 3,766,009 |
| 3 | de | 2,987,387 |
| 4 | org | 2,530,378 |
| 5 | uk | 2,528,466 |
| 6 | ru | 1,320,466 |
| 7 | nl | 1,021,809 |
| 8 | fr | 788,261 |
| 9 | it | 781,646 |
| 10 | jp | 777,437 |
| 11 | pl | 719,634 |
| 12 | br | 624,499 |
| 13 | ca | 527,891 |
| 14 | cn | 507,153 |
| 15 | info | 440,798 |
| 16 | ch | 417,061 |
| 17 | cz | 370,561 |
| 18 | eu | 364,051 |
| 19 | co | 327,177 |
| 20 | es | 323,874 |
| 21 | in | 320,848 |
| 22 | se | 306,929 |
| 23 | be | 293,779 |
| 24 | at | 291,725 |
| 25 | dk | 232,536 |
| 26 | hu | 228,054 |
| 27 | za | 226,850 |
| 28 | us | 215,532 |
| 29 | io | 200,616 |
| 30 | ga | 190,811 |
| 31 | cf | 187,682 |
| 32 | biz | 186,318 |
| 33 | nz | 175,385 |
| 34 | ua | 173,415 |
| 35 | ml | 172,104 |
| 36 | tr | 166,641 |
| 37 | ro | 165,723 |
| 38 | ir | 161,217 |
| 39 | gq | 150,990 |
| 40 | gr | 147,176 |
| 41 | no | 143,592 |
| 42 | il | 141,349 |
| 43 | me | 136,554 |
| 44 | mx | 135,424 |
| 45 | fi | 135,069 |
| 46 | kr | 126,860 |
| 47 | ar | 124,527 |
| 48 | sk | 113,717 |
| 49 | edu | 109,395 |
| 50 | tw | 104,169 |
| 51 | vn | 103,675 |
| 52 | cc | 95,787 |
| 53 | cl | 91,639 |
| 54 | pt | 81,711 |
| 55 | ie | 77,138 |
| 56 | tv | 76,522 |
| 57 | id | 73,907 |
| 58 | ws | 63,332 |
| 59 | online | 62,485 |
| 60 | lt | 59,030 |
| 61 | top | 57,701 |
| 62 | club | 49,982 |
| 63 | my | 47,511 |
| 64 | xyz | 45,974 |
| 65 | site | 45,551 |
| 66 | by | 44,767 |
| 67 | pro | 43,313 |
| 68 | ee | 42,050 |
| 69 | si | 41,946 |
| 70 | sg | 40,926 |
| 71 | hr | 39,182 |
| 72 | rs | 38,169 |
| 73 | hk | 38,082 |
| 74 | nu | 36,689 |
| 75 | tk | 36,588 |
| 76 | lv | 33,330 |
| 77 | ph | 32,519 |
| 78 | app | 30,983 |
| 79 | kz | 30,503 |
| 80 | shop | 30,287 |
| 81 | su | 27,578 |
| 82 | th | 27,157 |
| 83 | bg | 26,841 |
| 84 | gov | 25,798 |
| 85 | cat | 24,337 |
| 86 | live | 23,455 |
| 87 | ae | 22,213 |
| 88 | blog | 21,982 |
| 89 | pe | 21,644 |
| 90 | pk | 21,533 |
| 91 | mobi | 18,619 |
| 92 | is | 17,580 |
| 93 | store | 16,876 |
| 94 | space | 16,839 |
| 95 | lu | 16,491 |
| 96 | to | 16,341 |
| 97 | asia | 15,845 |
| 98 | link | 15,134 |
| 99 | tech | 14,761 |
| 100 | All other | 1,579,464 |