Offline FULL URL Database 31th October 2023 changelog

From URL Classification
Revision as of 00:43, 7 November 2023 by Barak (talk | contribs) (Created page with "= Domain count and statistics = {| class="wikitable" |- ! ID ! Name ! Domain count |- | 1 | Abortion and pregnancy | 236,462 |- | 2 | Ads | 276,997 |- | 3 | Adult | 1,679,027 |- | 4 | Adult dating | 46,294 |- | 5 | Alcohol | 714,526 |- | 6 | Astrology | 157,688 |- | 7 | Blogs | 19,243,369 |- | 8 | Books or comics | 1,255,064 |- | 9 | Business and services | 23,759,900 |- | 10 | CDN | 1,221,641 |- | 11 | Chats | 275,386 |- | 12 | Classifieds | 437,124 |- | 13 | Clothing...")
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to navigation Jump to search

Domain count and statistics

ID Name Domain count
1 Abortion and pregnancy 236,462
2 Ads 276,997
3 Adult 1,679,027
4 Adult dating 46,294
5 Alcohol 714,526
6 Astrology 157,688
7 Blogs 19,243,369
8 Books or comics 1,255,064
9 Business and services 23,759,900
10 CDN 1,221,641
11 Chats 275,386
12 Classifieds 437,124
13 Clothing and fashion 2,461,308
14 Cooking and food 4,535,800
15 Dating 253,748
16 Drugs 252,512
17 Education 3,619,424
18 Empty site 4,150,302
19 Entertainment 2,174,266
20 Error site can't be accessed 390,026,569
21 DNS error site can't be resolved 282,309,276
22 File hosting 387,467
23 Finance (Banks_Real estate_Insurance) 1,402,599
24 Gambling 1,145,867
25 Computer games 2,521,341
26 General (safe) 17,004
27 Government 457,991
28 Hacking 29,902
29 Hate 200,483
30 Hobbies 661,018
31 Home improvement 1,042,402
32 Humor 80,194
33 Hunting and fishing 182,613
34 Image and video hosting 836,782
35 Jobs 2,678,165
36 Kids safe 2,436
37 Legal 905,490
38 Life style and beauty 1,649,104
39 Link farm (no real content) 19,391,765
40 Local information 161,883
41 Medical 5,579,621
42 Military 63,272
43 Mixed adult 3,186,793
44 Mobile 721,729
45 Models 116,126
46 Music 2,351,469
47 News 4,660,766
49 Not child safe 51,408
50 Online drugs 74,043
51 Online marketing 1,488,593
52 Online video or audio 1,601,500
53 Pets and animals 808,790
54 Phishing 1,930
55 Politics 705,786
56 Porn 7,360,619
57 Internet portals 1,123,554
58 Profanity 237,933
59 Proxy 42,713
60 Religion 1,000,954
62 Science 1,396,434
63 Search engines 479,618
64 Sects 46,457
65 Semi nude and pin up 117,718
66 Sex education 150,774
67 Shopping 7,158,755
68 Social networks 2,855,626
69 Spam or scam 7,885
70 Sports 3,442,025
71 Suicide 657
72 Technology and computers 2,550,832
73 Site under construction or not available 43,427,430
74 General - not porn 32,017,479
75 URL shortener 21,179
76 Vacation and travel 3,694,718
77 Vehicles 2,753,605
78 Violence 78,463
79 Virus or Spyware 1,769
80 Warez 99,376
81 Weapons 274,820
82 Web hosting 5,153,216
83 Web mail 291,258
84 Reference 809,329
85 Community and society 542,372
86 Software repository 293,154
87 Philosophy and psychology 543,808
88 History 567,111
89 Nonsense and time waste 411,026
90 Local IP 102
91 Swimsuits and underwear 206,378
92 Arts 1,689,242
94 Login page 565,528
95 Surveys and polls 116,570
96 Tobacco 120,071
97 ISP 32,308
98 Tracker 4,205,060
99 Bypass protection 16,018
100 Search block 93
101 Image search block 1,825,115
102 Desktop themes 19,181
103 Depress domain 137,245
104 Depress page 4,448
105 Parenting and family 144,157
106 School cheats 25,305
107 Celebrity gossip 678,489
108 How to 293,004
109 Illegal 13,766
110 Recreation 395,877
111 Bookmarks 24,074
112 Money spam 19,224
113 Directories 19,885
114 Site_Graphic design 1,121,731
115 Weather 268,146
116 Knowledge 179,980
117 Kids entertainment 53,877
118 Nature 246,481
119 Diet 267,213
120 Eating disorders 13,353
121 Self help 194,306
122 Relationships 47,820
123 Paranormal 78,456
124 Images CDN 3,337
125 Images CDN Unknown 575,586
126 LGBT 40,345
127 Marketing or ads 49,465
128 Magazines 311,284
129 Forums 619,359
130 User generated content 2,651,894
131 Tele Communications 253,890
132 Gender specific 5,508
134 Crime 99,941
135 Person 141,282
136 Grief 4,984
137 Retirement 88,850
138 Other drugs 153,031
139 Pharmacy 94,206
140 Songs download 65,960
141 Lookup 253,246
142 Movies download 400,757
143 Consumer reviews 63,493
144 API 208,912
145 Legal movies 2,623
146 Legal songs 4,748
147 Bitcoin 165,032
148 Victim help 8,812
149 Rewards 18,440
150 Photography 751,233
151 Toys 308,988
152 Restaurant 726,987
153 Fitness 567,704
154 Contact sport 261,782
155 Dancing 93,969
156 Software 1,518,993
157 Programming 919,520
158 Registry cleaner 1,238
159 Online security 285,225
160 Real estate 1,686,298
161 Loans 307,307
162 Forex 74,221
163 Banks 513,049
164 Insurance 520,401
165 SEO 684,516
166 PPC 14,052
167 Supplements 97,903
168 URL Classification 1,315
170 Tatoo 77,887
172 Tactical equipment 17,650
173 Alternative medicine 494,559
174 AI 50,115
175 Comics 50,055
176 Manga 35,366
177 Captcha 2,554,667
178 Racism education 6,748
179 Payment 30,683
180 Brokerage 39,178
181 SAAS 121,223
182 Anime 56,826
183 Cartoon 12,364
184 Grownups 44
185 Stream converter 8,144
186 File converter 18,852
187 TV Personality 1,850
188 Radio Personality 1,284
189 Youtube Personality 25,276
190 Prevent crime or violence 13,055
191 Collaboration software 166,267
193 Internet support 12,946
194 Computer support 53,407
195 Home appliance 9,802
196 Disposable mail 1,253
197 Parked domain 1,091,197
198 Domain not available 1,724,949
199 Private site 454,237
200 Earth science 68,519
201 Fringe theory 7,093
202 Conspiracy theory 9,317
203 Alt right 992
204 Alt left 1,620

Total domains: 949,065,296

Total classified domains: 276,729,451 (Total domains excluding DNS resolve errors and other errors)

Total unique domains: 917,087,908

Total unique classified domains: 244,896,650 (Total unique domains excluding DNS resolve errors and other errors)

TLD Distribution (all domains)

# TLD Domain count
1 com 450,696,447
2 cn 220,755,988
3 net 26,390,129
4 tw 20,169,843
5 top 14,984,300
6 icu 14,746,056
7 org 13,048,561
8 ga 12,029,841
9 jp 9,281,729
10 de 9,169,284
11 ru 8,164,107
12 gq 7,080,625
13 it 6,044,176
14 uk 5,788,261
15 online 4,987,594
16 info 4,887,388
17 pw 3,887,156
18 vip 3,644,871
19 nl 3,513,999
20 fr 3,311,175
21 pl 3,129,169
22 biz 2,837,342
23 eu 2,615,235
24 cc 2,606,172
25 br 2,554,753
26 tk 1,716,111
27 club 1,695,031
28 au 1,594,715
29 cz 1,570,458
30 ca 1,424,474
31 co 1,410,538
32 io 1,405,548
33 ir 1,359,729
34 wang 1,319,941
35 es 1,296,360
36 in 1,275,244
37 ch 1,275,008
38 us 1,229,598
39 me 1,185,609
40 se 1,169,630
41 app 1,062,924
42 be 1,062,408
43 live 1,008,122
44 dk 996,896
45 kr 982,479
46 hu 936,764
47 work 928,671
48 at 885,969
49 asia 864,059
50 ua 799,234
51 ro 623,482
52 za 584,676
53 cf 569,440
54 ml 556,428
55 ar 543,737
56 edu 518,756
57 tr 490,790
58 mx 457,687
59 no 453,447
60 nz 438,046
61 vn 433,788
62 buzz 430,362
63 fi 421,580
64 id 421,324
65 gr 412,341
66 sk 409,742
67 shop 408,712
68 tv 393,066
69 mobi 371,217
70 space 368,947
71 il 354,566
72 cl 339,039
73 pt 319,288
74 website 304,314
75 tech 296,462
76 fun 288,727
77 pro 279,323
78 hk 267,409
79 win 262,282
80 ws 257,758
81 home 251,558
82 party 251,483
83 nu 222,466
84 su 218,399
85 blog 208,821
86 lt 208,746
87 xyz 200,578
88 ie 195,792
89 loan 194,824
90 my 176,945
91 by 175,165
92 site 174,337
93 kz 159,460
94 date 156,737
95 th 152,350
96 store 149,088
97 link 145,766
98 tl 144,208
99 life 143,902
100 All other 14,500,659


TLD Distribution (excluding DNS resolve errors and other errors)

# TLD Domain count
1 com 161,989,307
2 cn 12,117,863
3 net 9,529,553
4 de 5,572,350
5 org 5,085,473
6 uk 3,528,077
7 jp 3,388,028
8 ru 3,312,879
9 nl 2,192,094
10 fr 1,958,322
11 pl 1,759,096
12 it 1,586,541
13 br 1,295,702
14 tw 1,261,812
15 eu 1,161,808
16 io 1,148,099
17 biz 1,080,454
18 au 1,040,034
19 cz 1,024,870
20 info 965,513
21 ca 882,307
22 top 868,878
23 ch 794,625
24 club 748,749
25 se 709,195
26 es 670,461
27 online 640,878
28 hu 629,423
29 co 604,233
30 be 604,230
31 in 603,386
32 kr 589,873
33 at 579,753
34 dk 572,358
35 pw 554,244
36 me 516,965
37 ir 513,304
38 us 431,304
39 ua 382,756
40 edu 362,640
41 cc 345,415
42 za 336,964
43 tr 321,933
44 ro 315,409
45 no 284,939
46 vip 279,366
47 app 271,373
48 fi 265,356
49 sk 257,121
50 mx 248,629
51 nz 238,756
52 gr 232,391
53 ar 227,335
54 id 209,521
55 vn 206,402
56 il 197,364
57 icu 190,471
58 pt 190,250
59 cl 165,838
60 blog 161,373
61 tv 160,663
62 ws 139,467
63 tk 136,158
64 lt 124,535
65 ie 115,609
66 nu 105,573
67 shop 101,194
68 my 99,675
69 tl 99,106
70 th 96,940
71 by 96,576
72 pro 95,458
73 website 91,873
74 space 86,557
75 hr 85,273
76 asia 82,155
77 si 78,260
78 gov 75,336
79 ee 74,152
80 link 74,002
81 lv 72,150
82 hk 71,483
83 su 70,814
84 mobi 70,543
85 sg 69,831
86 rs 67,746
87 kz 67,246
88 bg 67,108
89 store 58,407
90 ph 54,729
91 work 51,772
92 cloud 50,910
93 live 49,752
94 tech 47,961
95 dev 47,453
96 pe 45,287
97 to 44,695
98 life 44,293
99 cat 43,240
100 All other 3,579,017