Offline URL Database 1st April 2023 changelog: Difference between revisions
Jump to navigation
Jump to search
(Created page with "= Domain count and statistics = {| class="wikitable" |- ! ID ! Name ! Domain count |- | 1 | Abortion and pregnancy | 108,713 |- | 2 | Ads | 80,389 |- | 3 | Adult | 411,739 |- | 4 | Adult dating | 19,028 |- | 5 | Alcohol | 381,504 |- | 6 | Astrology | 62,689 |- | 7 | Blogs | 3,532,163 |- | 8 | Books or comics | 461,527 |- | 9 | Business and services | 6,456,046 |- | 10 | CDN | 1,056,361 |- | 11 | Chats | 96,731 |- | 12 | Classifieds | 110,641 |- | 13 | Clothing and fashi...") |
No edit summary |
||
Line 1: | Line 1: | ||
= Database change = | |||
* Improved support for non English language. | |||
= Domain count and statistics = | = Domain count and statistics = | ||
Latest revision as of 21:53, 4 April 2023
Database change
- Improved support for non English language.
Domain count and statistics
ID | Name | Domain count |
---|---|---|
1 | Abortion and pregnancy | 108,713 |
2 | Ads | 80,389 |
3 | Adult | 411,739 |
4 | Adult dating | 19,028 |
5 | Alcohol | 381,504 |
6 | Astrology | 62,689 |
7 | Blogs | 3,532,163 |
8 | Books or comics | 461,527 |
9 | Business and services | 6,456,046 |
10 | CDN | 1,056,361 |
11 | Chats | 96,731 |
12 | Classifieds | 110,641 |
13 | Clothing and fashion | 1,077,824 |
14 | Cooking and food | 1,777,214 |
15 | Dating | 86,094 |
16 | Drugs | 85,213 |
17 | Education | 1,234,983 |
18 | Empty site | 1,010,807 |
19 | Entertainment | 723,648 |
20 | Error site can't be accessed | 10,230,890 |
21 | DNS error site can't be resolved | 40,089,643 |
22 | File hosting | 82,224 |
23 | Finance (Banks_Real estate_Insurance) | 645,149 |
24 | Gambling | 383,641 |
25 | Computer games | 523,581 |
26 | General (safe) | 10,148 |
27 | Government | 137,321 |
28 | Hacking | 12,447 |
29 | Hate | 20,487 |
30 | Hobbies | 344,753 |
31 | Home improvement | 489,524 |
32 | Humor | 28,528 |
33 | Hunting and fishing | 107,470 |
34 | Image and video hosting | 114,004 |
35 | Jobs | 703,917 |
36 | Kids safe | 243 |
37 | Legal | 452,642 |
38 | Life style and beauty | 749,728 |
39 | Link farm (no real content) | 5,678,184 |
40 | Local information | 75,899 |
41 | Medical | 2,582,925 |
42 | Military | 30,616 |
43 | Mixed adult | 1,043,503 |
44 | Mobile | 266,963 |
45 | Models | 54,936 |
46 | Music | 1,090,871 |
47 | News | 1,499,094 |
49 | Not child safe | 22,097 |
50 | Online drugs | 32,040 |
51 | Online marketing | 587,422 |
52 | Online video or audio | 321,222 |
53 | Pets and animals | 417,038 |
54 | Phishing | 1,316 |
55 | Politics | 311,415 |
56 | Porn | 818,129 |
57 | Internet portals | 345,979 |
58 | Profanity | 30,685 |
59 | Proxy | 16,023 |
60 | Religion | 529,322 |
62 | Science | 357,907 |
63 | Search engines | 82,543 |
64 | Sects | 12,455 |
65 | Semi nude and pin up | 25,313 |
66 | Sex education | 65,308 |
67 | Shopping | 2,492,160 |
68 | Social networks | 770,042 |
69 | Spam or scam | 3,697 |
70 | Sports | 1,333,415 |
71 | Suicide | 317 |
72 | Technology and computers | 919,947 |
73 | Site under construction or not available | 5,637,506 |
74 | General - not porn | 9,016,257 |
75 | URL shortener | 7,716 |
76 | Vacation and travel | 1,771,367 |
77 | Vehicles | 1,276,999 |
78 | Violence | 33,254 |
79 | Virus or Spyware | 1,751 |
80 | Warez | 33,082 |
81 | Weapons | 145,755 |
82 | Web hosting | 675,436 |
83 | Web mail | 109,905 |
84 | Reference | 187,294 |
85 | Community and society | 253,793 |
86 | Software repository | 34,114 |
87 | Philosophy and psychology | 255,259 |
88 | History | 299,950 |
89 | Nonsense and time waste | 71,515 |
90 | Local IP | 59 |
91 | Swimsuits and underwear | 98,691 |
92 | Arts | 734,581 |
94 | Login page | 133,231 |
95 | Surveys and polls | 29,516 |
96 | Tobacco | 57,390 |
97 | ISP | 18,811 |
98 | Tracker | 1,694,338 |
99 | Bypass protection | 3,590 |
100 | Search block | 38 |
101 | Image search block | 96,083 |
102 | Desktop themes | 9,088 |
103 | Depress domain | 71,891 |
104 | Depress page | 2,050 |
105 | Parenting and family | 68,872 |
106 | School cheats | 4,813 |
107 | Celebrity gossip | 109,228 |
108 | How to | 100,594 |
109 | Illegal | 3,087 |
110 | Recreation | 214,370 |
111 | Bookmarks | 22,387 |
112 | Money spam | 5,473 |
113 | Directories | 4,848 |
114 | Site_Graphic design | 355,459 |
115 | Weather | 77,318 |
116 | Knowledge | 62,533 |
117 | Kids entertainment | 15,671 |
118 | Nature | 124,615 |
119 | Diet | 116,941 |
120 | Eating disorders | 5,161 |
121 | Self help | 92,935 |
122 | Relationships | 21,201 |
123 | Paranormal | 35,304 |
124 | Images CDN | 2,964 |
125 | Images CDN Unknown | 67,309 |
126 | LGBT | 15,400 |
127 | Marketing or ads | 33,453 |
128 | Magazines | 150,047 |
129 | Forums | 135,603 |
130 | User generated content | 53,652 |
131 | Tele Communications | 66,580 |
132 | Gender specific | 2,367 |
134 | Crime | 42,116 |
135 | Person | 58,736 |
136 | Grief | 2,370 |
137 | Retirement | 49,980 |
138 | Other drugs | 66,244 |
139 | Pharmacy | 41,996 |
140 | Songs download | 15,704 |
141 | Lookup | 37,174 |
142 | Movies download | 115,092 |
143 | Consumer reviews | 19,312 |
144 | API | 92,619 |
145 | Legal movies | 655 |
146 | Legal songs | 1,580 |
147 | Bitcoin | 72,873 |
148 | Victim help | 4,314 |
149 | Rewards | 9,745 |
150 | Photography | 378,314 |
151 | Toys | 124,173 |
152 | Restaurant | 376,954 |
153 | Fitness | 276,034 |
154 | Contact sport | 124,951 |
155 | Dancing | 50,162 |
156 | Software | 459,311 |
157 | Programming | 266,750 |
158 | Registry cleaner | 316 |
159 | Online security | 123,445 |
160 | Real estate | 753,905 |
161 | Loans | 129,387 |
162 | Forex | 25,713 |
163 | Banks | 247,830 |
164 | Insurance | 271,343 |
165 | SEO | 84,933 |
166 | PPC | 6,946 |
167 | Supplements | 46,826 |
168 | URL Classification | 461 |
170 | Tatoo | 29,911 |
172 | Tactical equipment | 6,779 |
173 | Alternative medicine | 240,912 |
174 | AI | 19,254 |
175 | Comics | 19,561 |
176 | Manga | 7,874 |
177 | Captcha | 390,361 |
178 | Racism education | 1,326 |
179 | Payment | 15,732 |
180 | Brokerage | 19,011 |
181 | SAAS | 14,998 |
182 | Anime | 21,146 |
183 | Cartoon | 5,752 |
184 | Grownups | 19 |
185 | Stream converter | 3,276 |
186 | File converter | 2,916 |
187 | TV Personality | 836 |
188 | Radio Personality | 649 |
189 | Youtube Personality | 7,853 |
190 | Prevent crime or violence | 5,980 |
191 | Collaboration software | 104,789 |
193 | Internet support | 2,590 |
194 | Computer support | 24,002 |
195 | Home appliance | 4,377 |
196 | Disposable mail | 457 |
197 | Parked domain | 374,397 |
198 | Domain not available | 112,709 |
199 | Private site | 147,528 |
200 | Earth science | 33,231 |
201 | Fringe theory | 2,747 |
202 | Conspiracy theory | 3,936 |
203 | Alt right | 358 |
204 | Alt left | 525 |
Total domains: 126,450,988
Total classified domains: 76,130,455 (Total domains excluding DNS resolve errors and other errors)
Total unique domains: 115,785,238
Total unique classified domains: 65,465,017 (Total unique domains excluding DNS resolve errors and other errors)
TLD Distribution (all domains)
# | TLD | Domain count |
---|---|---|
1 | com | 58,864,807 |
2 | net | 6,442,351 |
3 | de | 4,350,439 |
4 | org | 4,270,093 |
5 | uk | 3,506,371 |
6 | ru | 2,380,631 |
7 | cn | 1,906,121 |
8 | info | 1,732,321 |
9 | nl | 1,390,995 |
10 | fr | 1,198,141 |
11 | pl | 1,130,625 |
12 | it | 1,123,080 |
13 | jp | 1,105,144 |
14 | br | 1,038,861 |
15 | tk | 918,381 |
16 | ca | 717,447 |
17 | tw | 706,235 |
18 | eu | 641,946 |
19 | top | 610,425 |
20 | co | 607,157 |
21 | in | 597,241 |
22 | ch | 549,095 |
23 | biz | 548,171 |
24 | us | 531,484 |
25 | es | 489,253 |
26 | cz | 466,526 |
27 | se | 430,449 |
28 | be | 409,446 |
29 | at | 390,120 |
30 | ga | 361,622 |
31 | cf | 344,989 |
32 | ir | 341,569 |
33 | dk | 323,806 |
34 | za | 319,018 |
35 | hu | 302,470 |
36 | au | 297,667 |
37 | club | 292,356 |
38 | io | 284,842 |
39 | ml | 282,404 |
40 | me | 272,849 |
41 | nz | 271,711 |
42 | gq | 271,054 |
43 | ua | 270,362 |
44 | ro | 260,144 |
45 | cc | 256,523 |
46 | tr | 252,875 |
47 | home | 251,563 |
48 | mx | 221,979 |
49 | ar | 216,275 |
50 | online | 214,117 |
51 | il | 209,886 |
52 | gr | 205,684 |
53 | icu | 200,248 |
54 | kr | 198,971 |
55 | xyz | 198,757 |
56 | no | 185,663 |
57 | live | 180,706 |
58 | loan | 174,222 |
59 | site | 173,897 |
60 | fi | 170,133 |
61 | pw | 167,414 |
62 | vn | 162,405 |
63 | tv | 150,911 |
64 | cl | 147,722 |
65 | sk | 146,002 |
66 | edu | 140,681 |
67 | id | 130,403 |
68 | pt | 111,966 |
69 | pro | 110,011 |
70 | ws | 105,988 |
71 | ie | 103,426 |
72 | su | 98,231 |
73 | shop | 80,063 |
74 | vip | 79,574 |
75 | nu | 79,124 |
76 | lt | 77,133 |
77 | space | 73,828 |
78 | kz | 72,072 |
79 | my | 71,782 |
80 | gdn | 68,472 |
81 | by | 66,917 |
82 | sg | 63,615 |
83 | win | 62,531 |
84 | asia | 61,795 |
85 | hk | 61,660 |
86 | website | 60,208 |
87 | bid | 60,172 |
88 | si | 58,580 |
89 | to | 56,802 |
90 | hr | 54,979 |
91 | ee | 53,111 |
92 | mobi | 52,669 |
93 | tech | 52,658 |
94 | rs | 52,528 |
95 | app | 51,548 |
96 | gov | 47,934 |
97 | lv | 46,632 |
98 | domain | 46,241 |
99 | fun | 45,592 |
100 | All other | 5,689,978 |
TLD Distribution (excluding DNS resolve errors and other errors)
# | TLD | Domain count |
---|---|---|
1 | com | 35,958,559 |
2 | net | 3,666,953 |
3 | de | 2,942,163 |
4 | org | 2,466,557 |
5 | uk | 2,464,029 |
6 | ru | 1,280,846 |
7 | nl | 1,002,932 |
8 | fr | 772,372 |
9 | it | 771,011 |
10 | jp | 768,833 |
11 | pl | 700,821 |
12 | br | 610,002 |
13 | ca | 518,140 |
14 | cn | 454,159 |
15 | info | 421,552 |
16 | ch | 410,944 |
17 | eu | 353,460 |
18 | cz | 327,187 |
19 | es | 308,806 |
20 | co | 308,802 |
21 | in | 307,333 |
22 | se | 299,603 |
23 | be | 287,813 |
24 | at | 287,255 |
25 | dk | 228,164 |
26 | hu | 218,359 |
27 | us | 214,790 |
28 | za | 212,362 |
29 | au | 201,208 |
30 | io | 198,317 |
31 | ga | 184,107 |
32 | cf | 182,074 |
33 | biz | 175,550 |
34 | nz | 166,332 |
35 | ml | 166,062 |
36 | tr | 165,891 |
37 | ua | 164,642 |
38 | ro | 161,571 |
39 | ir | 153,773 |
40 | gq | 147,692 |
41 | gr | 142,431 |
42 | no | 141,472 |
43 | il | 138,457 |
44 | me | 132,843 |
45 | fi | 131,750 |
46 | mx | 130,723 |
47 | kr | 124,861 |
48 | ar | 121,785 |
49 | edu | 108,911 |
50 | sk | 105,560 |
51 | tw | 103,354 |
52 | vn | 97,626 |
53 | cc | 92,469 |
54 | cl | 84,294 |
55 | pt | 80,233 |
56 | ie | 75,994 |
57 | tv | 74,767 |
58 | id | 72,523 |
59 | online | 61,594 |
60 | ws | 60,705 |
61 | lt | 58,122 |
62 | top | 53,127 |
63 | club | 50,200 |
64 | my | 46,579 |
65 | site | 45,398 |
66 | xyz | 45,176 |
67 | by | 43,686 |
68 | pro | 43,057 |
69 | si | 41,340 |
70 | ee | 41,286 |
71 | sg | 40,197 |
72 | hr | 38,712 |
73 | hk | 37,300 |
74 | rs | 36,829 |
75 | nu | 35,483 |
76 | tk | 32,812 |
77 | lv | 32,698 |
78 | app | 31,374 |
79 | shop | 30,417 |
80 | kz | 29,917 |
81 | ph | 29,642 |
82 | su | 26,898 |
83 | th | 26,797 |
84 | bg | 25,930 |
85 | gov | 25,591 |
86 | live | 23,117 |
87 | cat | 22,927 |
88 | ae | 21,871 |
89 | blog | 21,382 |
90 | pk | 21,005 |
91 | pe | 20,793 |
92 | mobi | 17,639 |
93 | is | 17,234 |
94 | xn--p1ai | 16,693 |
95 | store | 16,002 |
96 | lu | 15,808 |
97 | space | 15,711 |
98 | asia | 15,496 |
99 | link | 15,288 |
100 | All other | 1,542,099 |