Offline URL Database 1st April 2024 changelog

From URL Classification
Revision as of 23:59, 1 April 2024 by Barak (talk | contribs) (Created page with "= Database change = = Domain count and statistics = {| class="wikitable" |- ! ID ! Name ! Domain count |- | 1 | Abortion and pregnancy | 104,164 |- | 2 | Ads | 79,785 |- | 3 | Adult | 387,433 |- | 4 | Adult dating | 16,255 |- | 5 | Alcohol | 352,232 |- | 6 | Astrology | 60,639 |- | 7 | Blogs | 3,536,760 |- | 8 | Books or comics | 436,002 |- | 9 | Business and services | 6,302,436 |- | 10 | CDN | 1,068,122 |- | 11 | Chats | 89,606 |- | 12 | Classifieds | 93,976 |- | 13...")
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to navigation Jump to search

Database change

Domain count and statistics

ID Name Domain count
1 Abortion and pregnancy 104,164
2 Ads 79,785
3 Adult 387,433
4 Adult dating 16,255
5 Alcohol 352,232
6 Astrology 60,639
7 Blogs 3,536,760
8 Books or comics 436,002
9 Business and services 6,302,436
10 CDN 1,068,122
11 Chats 89,606
12 Classifieds 93,976
13 Clothing and fashion 992,734
14 Cooking and food 1,736,924
15 Dating 75,009
16 Drugs 79,709
17 Education 1,173,018
18 Empty site 2,463,385
19 Entertainment 692,179
20 Error site can't be accessed 11,601,153
21 DNS error site can't be resolved 46,047,581
22 File hosting 83,203
23 Finance (Banks_Real estate_Insurance) 626,674
24 Gambling 435,900
25 Computer games 515,158
26 General (safe) 9,315
27 Government 133,515
28 Hacking 13,839
29 Hate 18,854
30 Hobbies 334,824
31 Home improvement 611,793
32 Humor 27,326
33 Hunting and fishing 102,089
34 Image and video hosting 108,775
35 Jobs 651,803
36 Kids safe 239
37 Legal 422,327
38 Life style and beauty 710,607
39 Link farm (no real content) 3,845,988
40 Local information 74,145
41 Medical 2,488,937
42 Military 28,640
43 Mixed adult 1,049,883
44 Mobile 245,286
45 Models 50,898
46 Music 1,026,072
47 News 1,386,691
49 Not child safe 18,561
50 Online drugs 29,318
51 Online marketing 557,718
52 Online video or audio 306,017
53 Pets and animals 392,850
54 Phishing 747
55 Politics 302,485
56 Porn 757,678
57 Internet portals 319,863
58 Profanity 29,605
59 Proxy 16,621
60 Religion 514,122
62 Science 342,983
63 Search engines 73,526
64 Sects 11,829
65 Semi nude and pin up 23,287
66 Sex education 62,181
67 Shopping 2,308,572
68 Social networks 489,372
69 Spam or scam 3,075
70 Sports 1,215,686
71 Suicide 308
72 Technology and computers 870,177
73 Site under construction or not available 5,150,007
74 General - not porn 8,823,317
75 URL shortener 8,810
76 Vacation and travel 1,666,905
77 Vehicles 1,234,618
78 Violence 32,124
79 Virus or Spyware 1,757
80 Warez 31,341
81 Weapons 142,550
82 Web hosting 861,957
83 Web mail 114,663
84 Reference 194,054
85 Community and society 248,921
86 Software repository 35,458
87 Philosophy and psychology 257,997
88 History 293,734
89 Nonsense and time waste 72,957
90 Local IP 66
91 Swimsuits and underwear 89,315
92 Arts 702,867
94 Login page 159,037
95 Surveys and polls 32,746
96 Tobacco 53,921
97 ISP 17,131
98 Tracker 1,720,565
99 Bypass protection 3,612
100 Search block 45
101 Image search block 226,142
102 Desktop themes 9,011
103 Depress domain 68,350
104 Depress page 1,879
105 Parenting and family 64,932
106 School cheats 4,380
107 Celebrity gossip 83,169
108 How to 86,814
109 Illegal 2,873
110 Recreation 211,007
111 Bookmarks 1,705
112 Money spam 1,900
113 Directories 4,101
114 Site_Graphic design 346,711
115 Weather 72,515
116 Knowledge 67,865
117 Kids entertainment 15,780
118 Nature 129,030
119 Diet 105,653
120 Eating disorders 4,884
121 Self help 91,763
122 Relationships 19,852
123 Paranormal 34,584
124 Images CDN 3,190
125 Images CDN Unknown 71,064
126 LGBT 15,821
127 Marketing or ads 33,021
128 Magazines 140,494
129 Forums 127,303
130 User generated content 51,546
131 Tele Communications 67,026
132 Gender specific 2,192
134 Crime 38,585
135 Person 55,100
136 Grief 2,221
137 Retirement 47,298
138 Other drugs 62,504
139 Pharmacy 39,667
140 Songs download 14,115
141 Lookup 35,570
142 Movies download 109,573
143 Consumer reviews 18,434
144 API 100,180
145 Legal movies 781
146 Legal songs 1,511
147 Bitcoin 63,440
148 Victim help 4,223
149 Rewards 9,261
150 Photography 354,062
151 Toys 122,215
152 Restaurant 368,975
153 Fitness 257,747
154 Contact sport 119,150
155 Dancing 50,357
156 Software 448,364
157 Programming 269,694
158 Registry cleaner 296
159 Online security 121,729
160 Real estate 711,020
161 Loans 118,618
162 Forex 21,961
163 Banks 231,202
164 Insurance 238,207
165 SEO 76,098
166 PPC 6,089
167 Supplements 43,259
168 URL Classification 469
170 Tatoo 29,906
172 Tactical equipment 9,314
173 Alternative medicine 234,030
174 AI 23,772
175 Comics 18,886
176 Manga 7,622
177 Captcha 729,854
178 Racism education 1,257
179 Payment 15,305
180 Brokerage 17,572
181 SAAS 17,719
182 Anime 20,736
183 Cartoon 5,587
184 Grownups 18
185 Stream converter 3,285
186 File converter 2,941
187 TV Personality 780
188 Radio Personality 663
189 Youtube Personality 7,804
190 Prevent crime or violence 5,566
191 Collaboration software 108,311
193 Internet support 2,580
194 Computer support 22,467
195 Home appliance 4,215
196 Disposable mail 435
197 Parked domain 392,681
198 Domain not available 113,984
199 Private site 169,208
200 Earth science 32,254
201 Fringe theory 2,651
202 Conspiracy theory 3,749
203 Alt right 332
204 Alt left 466

Total domains: 131,323,421

Total classified domains: 73,674,687 (Total domains excluding DNS resolve errors and other errors)

Total unique domains: 121,057,344

Total unique classified domains: 63,408,814 (Total unique domains excluding DNS resolve errors and other errors)

TLD Distribution (all domains)

# TLD Domain count
1 com 62,724,480
2 net 6,529,564
3 de 4,428,345
4 org 4,324,409
5 uk 3,539,509
6 ru 2,433,921
7 cn 1,973,823
8 info 1,748,799
9 nl 1,397,008
10 fr 1,207,918
11 pl 1,141,960
12 it 1,133,139
13 jp 1,112,531
14 br 1,053,259
15 tk 920,836
16 ca 726,253
17 tw 706,962
18 eu 649,752
19 top 645,119
20 co 631,108
21 in 615,965
22 ch 554,419
23 biz 553,031
24 us 538,060
25 es 494,326
26 cz 468,624
27 se 432,686
28 be 414,686
29 at 395,968
30 ga 362,849
31 cf 346,375
32 ir 343,349
33 au 333,789
34 dk 325,756
35 za 324,264
36 hu 308,596
37 io 304,143
38 club 298,559
39 ml 283,849
40 me 281,993
41 ua 274,823
42 nz 274,349
43 gq 272,008
44 ro 264,728
45 cc 264,162
46 tr 255,682
47 home 251,540
48 online 232,197
49 mx 225,839
50 il 225,706
51 ar 218,125
52 xyz 212,360
53 gr 211,080
54 kr 203,019
55 icu 201,773
56 live 192,241
57 no 187,246
58 site 179,237
59 loan 174,267
60 fi 171,132
61 pw 169,659
62 vn 165,499
63 tv 154,053
64 cl 149,220
65 sk 146,993
66 edu 142,703
67 id 134,592
68 pro 115,202
69 pt 113,355
70 ws 109,732
71 ie 105,041
72 su 99,661
73 shop 92,327
74 vip 82,919
75 nu 79,438
76 space 79,241
77 lt 77,758
78 my 73,255
79 kz 73,094
80 gdn 68,480
81 by 67,740
82 asia 66,596
83 win 65,481
84 sg 64,856
85 website 62,893
86 hk 62,200
87 bid 60,471
88 si 59,247
89 buzz 58,717
90 to 58,486
91 app 58,131
92 hr 56,035
93 tech 55,466
94 ee 53,747
95 mobi 53,515
96 rs 53,282
97 fun 50,840
98 gov 50,102
99 store 49,516
100 All other 6,216,138

TLD Distribution (excluding DNS resolve errors and other errors)

# TLD Domain count
1 com 34,869,548
2 net 3,600,250
3 de 2,950,618
4 org 2,416,336
5 uk 2,400,477
6 ru 1,296,718
7 nl 976,679
8 jp 750,004
9 it 747,113
10 fr 745,122
11 pl 631,053
12 br 593,988
13 cn 555,935
14 ca 504,082
15 info 419,014
16 ch 401,810
17 eu 340,256
18 cz 302,300
19 in 301,926
20 co 290,442
21 se 288,404
22 at 283,245
23 es 283,101
24 be 278,548
25 au 228,852
26 dk 220,990
27 hu 212,023
28 za 208,872
29 io 205,596
30 us 197,694
31 biz 168,290
32 tr 165,743
33 nz 164,751
34 ua 164,721
35 ro 159,674
36 ir 145,696
37 gr 144,575
38 il 142,632
39 no 137,065
40 me 131,792
41 fi 128,454
42 kr 120,971
43 mx 120,947
44 ar 116,844
45 edu 108,671
46 sk 100,178
47 tw 99,369
48 vn 96,207
49 cc 93,416
50 cl 79,613
51 pt 78,211
52 ie 74,120
53 id 71,084
54 tv 69,660
55 online 69,033
56 ws 64,339
57 top 60,225
58 lt 56,575
59 club 50,943
60 xyz 50,158
61 site 48,701
62 pro 47,285
63 my 44,963
64 by 42,176
65 si 40,919
66 ee 40,701
67 sg 38,959
68 hr 38,695
69 hk 36,136
70 rs 35,726
71 app 35,342
72 ph 34,371
73 nu 33,794
74 shop 33,169
75 lv 32,000
76 kz 29,978
77 su 26,801
78 th 26,474
79 bg 26,213
80 gov 26,070
81 live 24,264
82 ae 21,646
83 blog 21,296
84 pk 20,472
85 pe 20,251
86 asia 19,516
87 xn--p1ai 19,421
88 cat 19,302
89 store 18,281
90 is 17,063
91 mobi 16,975
92 link 16,258
93 space 16,165
94 lu 15,490
95 cloud 15,452
96 tech 15,140
97 life 14,597
98 tk 14,452
99 to 14,354
100 All other 1,614,985