Offline URL Database 1st April 2023 changelog: Difference between revisions

From URL Classification
Jump to navigation Jump to search
(Created page with "= Domain count and statistics = {| class="wikitable" |- ! ID ! Name ! Domain count |- | 1 | Abortion and pregnancy | 108,713 |- | 2 | Ads | 80,389 |- | 3 | Adult | 411,739 |- | 4 | Adult dating | 19,028 |- | 5 | Alcohol | 381,504 |- | 6 | Astrology | 62,689 |- | 7 | Blogs | 3,532,163 |- | 8 | Books or comics | 461,527 |- | 9 | Business and services | 6,456,046 |- | 10 | CDN | 1,056,361 |- | 11 | Chats | 96,731 |- | 12 | Classifieds | 110,641 |- | 13 | Clothing and fashi...")
 
No edit summary
 
Line 1: Line 1:
= Database change =
* Improved support for non English language.
= Domain count and statistics =
= Domain count and statistics =



Latest revision as of 21:53, 4 April 2023

Database change

  • Improved support for non English language.

Domain count and statistics

ID Name Domain count
1 Abortion and pregnancy 108,713
2 Ads 80,389
3 Adult 411,739
4 Adult dating 19,028
5 Alcohol 381,504
6 Astrology 62,689
7 Blogs 3,532,163
8 Books or comics 461,527
9 Business and services 6,456,046
10 CDN 1,056,361
11 Chats 96,731
12 Classifieds 110,641
13 Clothing and fashion 1,077,824
14 Cooking and food 1,777,214
15 Dating 86,094
16 Drugs 85,213
17 Education 1,234,983
18 Empty site 1,010,807
19 Entertainment 723,648
20 Error site can't be accessed 10,230,890
21 DNS error site can't be resolved 40,089,643
22 File hosting 82,224
23 Finance (Banks_Real estate_Insurance) 645,149
24 Gambling 383,641
25 Computer games 523,581
26 General (safe) 10,148
27 Government 137,321
28 Hacking 12,447
29 Hate 20,487
30 Hobbies 344,753
31 Home improvement 489,524
32 Humor 28,528
33 Hunting and fishing 107,470
34 Image and video hosting 114,004
35 Jobs 703,917
36 Kids safe 243
37 Legal 452,642
38 Life style and beauty 749,728
39 Link farm (no real content) 5,678,184
40 Local information 75,899
41 Medical 2,582,925
42 Military 30,616
43 Mixed adult 1,043,503
44 Mobile 266,963
45 Models 54,936
46 Music 1,090,871
47 News 1,499,094
49 Not child safe 22,097
50 Online drugs 32,040
51 Online marketing 587,422
52 Online video or audio 321,222
53 Pets and animals 417,038
54 Phishing 1,316
55 Politics 311,415
56 Porn 818,129
57 Internet portals 345,979
58 Profanity 30,685
59 Proxy 16,023
60 Religion 529,322
62 Science 357,907
63 Search engines 82,543
64 Sects 12,455
65 Semi nude and pin up 25,313
66 Sex education 65,308
67 Shopping 2,492,160
68 Social networks 770,042
69 Spam or scam 3,697
70 Sports 1,333,415
71 Suicide 317
72 Technology and computers 919,947
73 Site under construction or not available 5,637,506
74 General - not porn 9,016,257
75 URL shortener 7,716
76 Vacation and travel 1,771,367
77 Vehicles 1,276,999
78 Violence 33,254
79 Virus or Spyware 1,751
80 Warez 33,082
81 Weapons 145,755
82 Web hosting 675,436
83 Web mail 109,905
84 Reference 187,294
85 Community and society 253,793
86 Software repository 34,114
87 Philosophy and psychology 255,259
88 History 299,950
89 Nonsense and time waste 71,515
90 Local IP 59
91 Swimsuits and underwear 98,691
92 Arts 734,581
94 Login page 133,231
95 Surveys and polls 29,516
96 Tobacco 57,390
97 ISP 18,811
98 Tracker 1,694,338
99 Bypass protection 3,590
100 Search block 38
101 Image search block 96,083
102 Desktop themes 9,088
103 Depress domain 71,891
104 Depress page 2,050
105 Parenting and family 68,872
106 School cheats 4,813
107 Celebrity gossip 109,228
108 How to 100,594
109 Illegal 3,087
110 Recreation 214,370
111 Bookmarks 22,387
112 Money spam 5,473
113 Directories 4,848
114 Site_Graphic design 355,459
115 Weather 77,318
116 Knowledge 62,533
117 Kids entertainment 15,671
118 Nature 124,615
119 Diet 116,941
120 Eating disorders 5,161
121 Self help 92,935
122 Relationships 21,201
123 Paranormal 35,304
124 Images CDN 2,964
125 Images CDN Unknown 67,309
126 LGBT 15,400
127 Marketing or ads 33,453
128 Magazines 150,047
129 Forums 135,603
130 User generated content 53,652
131 Tele Communications 66,580
132 Gender specific 2,367
134 Crime 42,116
135 Person 58,736
136 Grief 2,370
137 Retirement 49,980
138 Other drugs 66,244
139 Pharmacy 41,996
140 Songs download 15,704
141 Lookup 37,174
142 Movies download 115,092
143 Consumer reviews 19,312
144 API 92,619
145 Legal movies 655
146 Legal songs 1,580
147 Bitcoin 72,873
148 Victim help 4,314
149 Rewards 9,745
150 Photography 378,314
151 Toys 124,173
152 Restaurant 376,954
153 Fitness 276,034
154 Contact sport 124,951
155 Dancing 50,162
156 Software 459,311
157 Programming 266,750
158 Registry cleaner 316
159 Online security 123,445
160 Real estate 753,905
161 Loans 129,387
162 Forex 25,713
163 Banks 247,830
164 Insurance 271,343
165 SEO 84,933
166 PPC 6,946
167 Supplements 46,826
168 URL Classification 461
170 Tatoo 29,911
172 Tactical equipment 6,779
173 Alternative medicine 240,912
174 AI 19,254
175 Comics 19,561
176 Manga 7,874
177 Captcha 390,361
178 Racism education 1,326
179 Payment 15,732
180 Brokerage 19,011
181 SAAS 14,998
182 Anime 21,146
183 Cartoon 5,752
184 Grownups 19
185 Stream converter 3,276
186 File converter 2,916
187 TV Personality 836
188 Radio Personality 649
189 Youtube Personality 7,853
190 Prevent crime or violence 5,980
191 Collaboration software 104,789
193 Internet support 2,590
194 Computer support 24,002
195 Home appliance 4,377
196 Disposable mail 457
197 Parked domain 374,397
198 Domain not available 112,709
199 Private site 147,528
200 Earth science 33,231
201 Fringe theory 2,747
202 Conspiracy theory 3,936
203 Alt right 358
204 Alt left 525

Total domains: 126,450,988

Total classified domains: 76,130,455 (Total domains excluding DNS resolve errors and other errors)

Total unique domains: 115,785,238

Total unique classified domains: 65,465,017 (Total unique domains excluding DNS resolve errors and other errors)

TLD Distribution (all domains)

# TLD Domain count
1 com 58,864,807
2 net 6,442,351
3 de 4,350,439
4 org 4,270,093
5 uk 3,506,371
6 ru 2,380,631
7 cn 1,906,121
8 info 1,732,321
9 nl 1,390,995
10 fr 1,198,141
11 pl 1,130,625
12 it 1,123,080
13 jp 1,105,144
14 br 1,038,861
15 tk 918,381
16 ca 717,447
17 tw 706,235
18 eu 641,946
19 top 610,425
20 co 607,157
21 in 597,241
22 ch 549,095
23 biz 548,171
24 us 531,484
25 es 489,253
26 cz 466,526
27 se 430,449
28 be 409,446
29 at 390,120
30 ga 361,622
31 cf 344,989
32 ir 341,569
33 dk 323,806
34 za 319,018
35 hu 302,470
36 au 297,667
37 club 292,356
38 io 284,842
39 ml 282,404
40 me 272,849
41 nz 271,711
42 gq 271,054
43 ua 270,362
44 ro 260,144
45 cc 256,523
46 tr 252,875
47 home 251,563
48 mx 221,979
49 ar 216,275
50 online 214,117
51 il 209,886
52 gr 205,684
53 icu 200,248
54 kr 198,971
55 xyz 198,757
56 no 185,663
57 live 180,706
58 loan 174,222
59 site 173,897
60 fi 170,133
61 pw 167,414
62 vn 162,405
63 tv 150,911
64 cl 147,722
65 sk 146,002
66 edu 140,681
67 id 130,403
68 pt 111,966
69 pro 110,011
70 ws 105,988
71 ie 103,426
72 su 98,231
73 shop 80,063
74 vip 79,574
75 nu 79,124
76 lt 77,133
77 space 73,828
78 kz 72,072
79 my 71,782
80 gdn 68,472
81 by 66,917
82 sg 63,615
83 win 62,531
84 asia 61,795
85 hk 61,660
86 website 60,208
87 bid 60,172
88 si 58,580
89 to 56,802
90 hr 54,979
91 ee 53,111
92 mobi 52,669
93 tech 52,658
94 rs 52,528
95 app 51,548
96 gov 47,934
97 lv 46,632
98 domain 46,241
99 fun 45,592
100 All other 5,689,978

TLD Distribution (excluding DNS resolve errors and other errors)

# TLD Domain count
1 com 35,958,559
2 net 3,666,953
3 de 2,942,163
4 org 2,466,557
5 uk 2,464,029
6 ru 1,280,846
7 nl 1,002,932
8 fr 772,372
9 it 771,011
10 jp 768,833
11 pl 700,821
12 br 610,002
13 ca 518,140
14 cn 454,159
15 info 421,552
16 ch 410,944
17 eu 353,460
18 cz 327,187
19 es 308,806
20 co 308,802
21 in 307,333
22 se 299,603
23 be 287,813
24 at 287,255
25 dk 228,164
26 hu 218,359
27 us 214,790
28 za 212,362
29 au 201,208
30 io 198,317
31 ga 184,107
32 cf 182,074
33 biz 175,550
34 nz 166,332
35 ml 166,062
36 tr 165,891
37 ua 164,642
38 ro 161,571
39 ir 153,773
40 gq 147,692
41 gr 142,431
42 no 141,472
43 il 138,457
44 me 132,843
45 fi 131,750
46 mx 130,723
47 kr 124,861
48 ar 121,785
49 edu 108,911
50 sk 105,560
51 tw 103,354
52 vn 97,626
53 cc 92,469
54 cl 84,294
55 pt 80,233
56 ie 75,994
57 tv 74,767
58 id 72,523
59 online 61,594
60 ws 60,705
61 lt 58,122
62 top 53,127
63 club 50,200
64 my 46,579
65 site 45,398
66 xyz 45,176
67 by 43,686
68 pro 43,057
69 si 41,340
70 ee 41,286
71 sg 40,197
72 hr 38,712
73 hk 37,300
74 rs 36,829
75 nu 35,483
76 tk 32,812
77 lv 32,698
78 app 31,374
79 shop 30,417
80 kz 29,917
81 ph 29,642
82 su 26,898
83 th 26,797
84 bg 25,930
85 gov 25,591
86 live 23,117
87 cat 22,927
88 ae 21,871
89 blog 21,382
90 pk 21,005
91 pe 20,793
92 mobi 17,639
93 is 17,234
94 xn--p1ai 16,693
95 store 16,002
96 lu 15,808
97 space 15,711
98 asia 15,496
99 link 15,288
100 All other 1,542,099