Offline URL Database 1st January 2024 changelog

From URL Classification
Revision as of 00:26, 2 January 2024 by Barak (talk | contribs) (Created page with "= Database change = = Domain count and statistics = {| class="wikitable" |- ! ID ! Name ! Domain count |- | 1 | Abortion and pregnancy | 104,921 |- | 2 | Ads | 82,476 |- | 3 | Adult | 395,392 |- | 4 | Adult dating | 17,364 |- | 5 | Alcohol | 356,094 |- | 6 | Astrology | 61,624 |- | 7 | Blogs | 3,551,659 |- | 8 | Books or comics | 437,294 |- | 9 | Business and services | 6,324,321 |- | 10 | CDN | 1,071,593 |- | 11 | Chats | 90,743 |- | 12 | Classifieds | 99,213 |- | 13...")
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to navigation Jump to search

Database change

Domain count and statistics

ID Name Domain count
1 Abortion and pregnancy 104,921
2 Ads 82,476
3 Adult 395,392
4 Adult dating 17,364
5 Alcohol 356,094
6 Astrology 61,624
7 Blogs 3,551,659
8 Books or comics 437,294
9 Business and services 6,324,321
10 CDN 1,071,593
11 Chats 90,743
12 Classifieds 99,213
13 Clothing and fashion 1,001,717
14 Cooking and food 1,749,445
15 Dating 77,704
16 Drugs 80,004
17 Education 1,190,516
18 Empty site 2,263,270
19 Entertainment 704,512
20 Error site can't be accessed 19,951,024
21 DNS error site can't be resolved 37,483,857
22 File hosting 82,110
23 Finance (Banks_Real estate_Insurance) 634,461
24 Gambling 394,950
25 Computer games 523,986
26 General (safe) 9,506
27 Government 134,293
28 Hacking 14,570
29 Hate 19,127
30 Hobbies 348,859
31 Home improvement 620,953
32 Humor 27,771
33 Hunting and fishing 103,089
34 Image and video hosting 114,656
35 Jobs 654,764
36 Kids safe 255
37 Legal 430,947
38 Life style and beauty 716,491
39 Link farm (no real content) 3,858,049
40 Local information 74,819
41 Medical 2,497,280
42 Military 29,117
43 Mixed adult 1,051,954
44 Mobile 249,887
45 Models 52,248
46 Music 1,042,032
47 News 1,403,519
49 Not child safe 19,477
50 Online drugs 28,777
51 Online marketing 563,964
52 Online video or audio 308,664
53 Pets and animals 397,364
54 Phishing 869
55 Politics 294,320
56 Porn 768,060
57 Internet portals 313,468
58 Profanity 29,812
59 Proxy 16,508
60 Religion 521,222
62 Science 347,747
63 Search engines 80,637
64 Sects 12,013
65 Semi nude and pin up 24,545
66 Sex education 62,889
67 Shopping 2,321,460
68 Social networks 457,036
69 Spam or scam 3,255
70 Sports 1,235,352
71 Suicide 291
72 Technology and computers 877,555
73 Site under construction or not available 4,592,537
74 General - not porn 9,265,881
75 URL shortener 8,533
76 Vacation and travel 1,682,038
77 Vehicles 1,254,254
78 Violence 32,860
79 Virus or Spyware 1,759
80 Warez 35,004
81 Weapons 143,564
82 Web hosting 874,494
83 Web mail 118,141
84 Reference 196,422
85 Community and society 250,774
86 Software repository 36,999
87 Philosophy and psychology 265,284
88 History 290,058
89 Nonsense and time waste 72,796
90 Local IP 68
91 Swimsuits and underwear 93,543
92 Arts 712,331
94 Login page 174,715
95 Surveys and polls 27,039
96 Tobacco 55,371
97 ISP 17,263
98 Tracker 1,702,281
99 Bypass protection 3,675
100 Search block 40
101 Image search block 233,579
102 Desktop themes 8,855
103 Depress domain 69,342
104 Depress page 1,858
105 Parenting and family 65,339
106 School cheats 4,693
107 Celebrity gossip 90,464
108 How to 88,833
109 Illegal 2,908
110 Recreation 207,941
111 Bookmarks 1,621
112 Money spam 5,285
113 Directories 4,539
114 Site_Graphic design 350,503
115 Weather 73,006
116 Knowledge 67,958
117 Kids entertainment 15,938
118 Nature 130,680
119 Diet 107,609
120 Eating disorders 4,933
121 Self help 92,300
122 Relationships 20,207
123 Paranormal 34,995
124 Images CDN 3,200
125 Images CDN Unknown 70,962
126 LGBT 16,301
127 Marketing or ads 32,971
128 Magazines 140,494
129 Forums 129,422
130 User generated content 44,531
131 Tele Communications 64,004
132 Gender specific 2,254
134 Crime 39,098
135 Person 55,861
136 Grief 2,243
137 Retirement 47,562
138 Other drugs 63,511
139 Pharmacy 40,339
140 Songs download 14,602
141 Lookup 37,040
142 Movies download 112,663
143 Consumer reviews 18,977
144 API 101,336
145 Legal movies 807
146 Legal songs 1,528
147 Bitcoin 65,921
148 Victim help 4,349
149 Rewards 9,245
150 Photography 364,759
151 Toys 122,485
152 Restaurant 371,990
153 Fitness 261,914
154 Contact sport 120,314
155 Dancing 51,063
156 Software 458,685
157 Programming 268,741
158 Registry cleaner 306
159 Online security 120,594
160 Real estate 722,422
161 Loans 118,930
162 Forex 22,110
163 Banks 232,719
164 Insurance 239,621
165 SEO 78,552
166 PPC 6,316
167 Supplements 44,238
168 URL Classification 471
170 Tatoo 30,436
172 Tactical equipment 9,642
173 Alternative medicine 236,459
174 AI 24,498
175 Comics 19,318
176 Manga 7,525
177 Captcha 694,656
178 Racism education 1,248
179 Payment 15,435
180 Brokerage 17,841
181 SAAS 18,323
182 Anime 20,520
183 Cartoon 5,771
184 Grownups 18
185 Stream converter 3,275
186 File converter 2,960
187 TV Personality 801
188 Radio Personality 672
189 Youtube Personality 7,946
190 Prevent crime or violence 5,819
191 Collaboration software 107,064
193 Internet support 2,632
194 Computer support 24,031
195 Home appliance 4,429
196 Disposable mail 436
197 Parked domain 374,290
198 Domain not available 77,026
199 Private site 132,178
200 Earth science 32,388
201 Fringe theory 2,724
202 Conspiracy theory 3,895
203 Alt right 346
204 Alt left 476


Total domains: 131,071,360

Total classified domains: 73,636,479 (Total domains excluding DNS resolve errors and other errors)

Total unique domains: 120,749,478

Total unique classified domains: 63,315,039 (Total unique domains excluding DNS resolve errors and other errors)

TLD Distribution (all domains)

# TLD Domain count
1 com 62,623,092
2 net 6,518,818
3 de 4,426,977
4 org 4,321,641
5 uk 3,538,113
6 ru 2,415,377
7 cn 1,931,542
8 info 1,745,547
9 nl 1,396,246
10 fr 1,207,314
11 pl 1,141,601
12 it 1,132,618
13 jp 1,108,960
14 br 1,049,750
15 tk 920,741
16 ca 725,765
17 tw 706,831
18 eu 649,082
19 co 629,107
20 top 623,917
21 in 613,418
22 ch 554,177
23 biz 551,622
24 us 537,403
25 es 494,010
26 cz 468,348
27 se 432,564
28 be 414,411
29 at 395,628
30 ga 362,876
31 cf 346,276
32 ir 342,873
33 au 332,400
34 dk 325,735
35 za 324,043
36 hu 308,485
37 io 302,398
38 club 295,287
39 ml 283,853
40 me 281,241
41 nz 274,328
42 ua 274,271
43 gq 271,934
44 ro 264,480
45 cc 262,685
46 tr 255,458
47 home 251,548
48 online 227,275
49 il 225,662
50 mx 225,441
51 ar 217,776
52 gr 210,964
53 kr 201,634
54 xyz 201,238
55 icu 201,055
56 live 190,856
57 no 187,226
58 site 174,982
59 loan 174,256
60 fi 171,070
61 pw 168,701
62 vn 165,145
63 tv 153,552
64 cl 148,907
65 sk 146,836
66 edu 142,663
67 id 133,701
68 pro 113,440
69 pt 113,183
70 ws 109,589
71 ie 105,006
72 su 99,273
73 shop 90,343
74 vip 81,871
75 nu 79,404
76 lt 77,695
77 space 77,266
78 my 73,170
79 kz 72,752
80 gdn 68,473
81 by 67,620
82 asia 66,467
83 sg 64,821
84 win 62,985
85 website 62,284
86 hk 62,156
87 bid 60,352
88 si 59,209
89 to 58,344
90 app 57,335
91 hr 55,999
92 tech 54,848
93 ee 53,684
94 mobi 53,342
95 rs 53,197
96 buzz 52,115
97 gov 50,043
98 store 48,635
99 fun 48,380
100 All other 6,192,299

TLD Distribution (excluding DNS resolve errors and other errors)

# TLD Domain count
1 com 34,891,118
2 net 3,598,741
3 de 2,961,506
4 org 2,420,361
5 uk 2,394,623
6 ru 1,281,786
7 nl 981,680
8 fr 748,979
9 it 747,319
10 jp 711,908
11 pl 661,106
12 br 586,635
13 cn 506,680
14 ca 506,652
15 info 416,142
16 ch 402,254
17 eu 344,246
18 cz 303,418
19 in 299,185
20 co 295,607
21 se 291,889
22 es 290,013
23 at 282,846
24 be 280,269
25 au 226,732
26 dk 222,544
27 hu 214,761
28 io 205,818
29 us 205,628
30 za 203,245
31 biz 167,416
32 tr 163,653
33 nz 162,989
34 ro 160,101
35 ua 159,350
36 il 143,597
37 gr 143,234
38 ir 143,014
39 no 137,597
40 me 134,662
41 fi 127,968
42 mx 121,828
43 kr 121,111
44 ar 116,636
45 edu 108,577
46 sk 100,645
47 tw 99,512
48 vn 96,802
49 cc 92,968
50 cl 79,606
51 pt 78,471
52 ie 73,033
53 tv 70,894
54 id 70,023
55 online 65,611
56 ws 63,766
57 lt 56,370
58 club 50,733
59 top 46,302
60 site 45,913
61 pro 45,578
62 my 45,201
63 xyz 43,131
64 by 42,172
65 si 41,160
66 ee 40,475
67 sg 39,177
68 hr 38,824
69 hk 36,137
70 rs 35,910
71 app 34,774
72 nu 34,216
73 ph 33,365
74 shop 33,046
75 lv 31,705
76 kz 29,575
77 tk 28,681
78 su 26,455
79 bg 26,278
80 th 26,136
81 gov 26,042
82 live 24,039
83 ae 21,651
84 blog 21,496
85 pk 20,027
86 cat 20,007
87 pe 19,642
88 asia 19,503
89 xn--p1ai 19,070
90 store 17,642
91 mobi 17,037
92 is 17,033
93 link 16,013
94 space 15,839
95 lu 15,605
96 cloud 14,922
97 tech 14,686
98 life 14,334
99 to 14,040
100 All other 1,568,334