Offline URL Database 1st October 2023 changelog

From URL Classification
Jump to navigation Jump to search

Database change

Domain count and statistics

ID Name Domain count
1 Abortion and pregnancy 106,066
2 Ads 79,878
3 Adult 405,687
4 Adult dating 17,511
5 Alcohol 365,558
6 Astrology 61,736
7 Blogs 3,557,154
8 Books or comics 446,755
9 Business and services 6,358,905
10 CDN 1,065,151
11 Chats 90,280
12 Classifieds 102,469
13 Clothing and fashion 1,040,343
14 Cooking and food 1,784,537
15 Dating 79,602
16 Drugs 81,954
17 Education 1,214,590
18 Empty site 945,777
19 Entertainment 724,312
20 Error site can't be accessed 17,251,770
21 DNS error site can't be resolved 41,339,828
22 File hosting 84,557
23 Finance (Banks_Real estate_Insurance) 642,764
24 Gambling 390,547
25 Computer games 521,828
26 General (safe) 9,874
27 Government 135,336
28 Hacking 14,422
29 Hate 20,334
30 Hobbies 343,179
31 Home improvement 565,372
32 Humor 28,206
33 Hunting and fishing 104,598
34 Image and video hosting 114,801
35 Jobs 679,206
36 Kids safe 234
37 Legal 439,822
38 Life style and beauty 731,042
39 Link farm (no real content) 4,400,617
40 Local information 75,291
41 Medical 2,527,355
42 Military 29,693
43 Mixed adult 1,051,902
44 Mobile 258,319
45 Models 54,237
46 Music 1,050,247
47 News 1,435,595
49 Not child safe 20,674
50 Online drugs 30,336
51 Online marketing 573,656
52 Online video or audio 312,432
53 Pets and animals 409,143
54 Phishing 843
55 Politics 300,549
56 Porn 801,700
57 Internet portals 321,537
58 Profanity 30,775
59 Proxy 16,623
60 Religion 528,137
62 Science 348,083
63 Search engines 95,114
64 Sects 12,213
65 Semi nude and pin up 24,884
66 Sex education 64,488
67 Shopping 2,380,153
68 Social networks 407,210
69 Spam or scam 3,328
70 Sports 1,267,597
71 Suicide 303
72 Technology and computers 888,838
73 Site under construction or not available 4,878,484
74 General - not porn 8,401,464
75 URL shortener 7,498
76 Vacation and travel 1,720,686
77 Vehicles 1,275,948
78 Violence 32,723
79 Virus or Spyware 1,761
80 Warez 31,784
81 Weapons 146,665
82 Web hosting 827,766
83 Web mail 108,837
84 Reference 195,174
85 Community and society 257,747
86 Software repository 37,107
87 Philosophy and psychology 267,483
88 History 299,075
89 Nonsense and time waste 71,465
90 Local IP 62
91 Swimsuits and underwear 94,871
92 Arts 731,868
94 Login page 144,932
95 Surveys and polls 27,079
96 Tobacco 56,257
97 ISP 17,709
98 Tracker 1,697,355
99 Bypass protection 3,946
100 Search block 46
101 Image search block 247,308
102 Desktop themes 8,670
103 Depress domain 70,844
104 Depress page 2,022
105 Parenting and family 66,465
106 School cheats 4,662
107 Celebrity gossip 98,587
108 How to 93,421
109 Illegal 3,051
110 Recreation 212,328
111 Bookmarks 1,649
112 Money spam 5,367
113 Directories 4,682
114 Site_Graphic design 338,591
115 Weather 75,045
116 Knowledge 64,769
117 Kids entertainment 16,327
118 Nature 124,482
119 Diet 111,288
120 Eating disorders 5,091
121 Self help 91,261
122 Relationships 20,796
123 Paranormal 35,700
124 Images CDN 3,190
125 Images CDN Unknown 68,587
126 LGBT 16,666
127 Marketing or ads 32,437
128 Magazines 143,502
129 Forums 134,327
130 User generated content 51,860
131 Tele Communications 66,395
132 Gender specific 2,290
134 Crime 40,411
135 Person 57,627
136 Grief 2,313
137 Retirement 49,006
138 Other drugs 64,692
139 Pharmacy 40,715
140 Songs download 15,006
141 Lookup 36,241
142 Movies download 105,236
143 Consumer reviews 18,262
144 API 102,332
145 Legal movies 693
146 Legal songs 1,595
147 Bitcoin 66,821
148 Victim help 4,369
149 Rewards 9,509
150 Photography 373,432
151 Toys 122,572
152 Restaurant 378,343
153 Fitness 268,141
154 Contact sport 122,430
155 Dancing 50,831
156 Software 456,129
157 Programming 266,319
158 Registry cleaner 301
159 Online security 118,516
160 Real estate 716,957
161 Loans 123,446
162 Forex 22,621
163 Banks 236,890
164 Insurance 245,425
165 SEO 78,436
166 PPC 6,434
167 Supplements 45,591
168 URL Classification 535
170 Tatoo 30,771
172 Tactical equipment 9,719
173 Alternative medicine 241,386
174 AI 24,468
175 Comics 19,410
176 Manga 7,820
177 Captcha 409,113
178 Racism education 1,278
179 Payment 15,485
180 Brokerage 18,338
181 SAAS 14,162
182 Anime 20,989
183 Cartoon 5,842
184 Grownups 18
185 Stream converter 3,353
186 File converter 2,897
187 TV Personality 821
188 Radio Personality 703
189 Youtube Personality 8,003
190 Prevent crime or violence 6,026
191 Collaboration software 107,572
193 Internet support 2,675
194 Computer support 24,288
195 Home appliance 4,411
196 Disposable mail 419
197 Parked domain 314,415
198 Domain not available 93,057
199 Private site 138,370
200 Earth science 33,092
201 Fringe theory 2,739
202 Conspiracy theory 3,959
203 Alt right 328
204 Alt left 458

Total domains: 131,039,871

Total classified domains: 72,448,273 (Total domains excluding DNS resolve errors and other errors)

Total unique domains: 120,635,274

Total unique classified domains: 62,044,033 (Total unique domains excluding DNS resolve errors and other errors)

TLD Distribution (all domains)

# TLD Domain count
1 com 62,559,159
2 net 6,516,526
3 de 4,426,266
4 org 4,320,090
5 uk 3,537,209
6 ru 2,414,509
7 cn 1,917,567
8 info 1,745,152
9 nl 1,396,116
10 fr 1,207,199
11 pl 1,141,459
12 it 1,132,570
13 jp 1,108,821
14 br 1,049,627
15 tk 920,750
16 ca 725,662
17 tw 706,804
18 eu 648,983
19 co 628,798
20 top 621,089
21 in 613,194
22 ch 554,129
23 biz 551,448
24 us 537,300
25 es 493,946
26 cz 468,276
27 se 432,525
28 be 414,349
29 at 395,578
30 ga 362,884
31 cf 346,277
32 ir 342,808
33 au 332,071
34 dk 325,710
35 za 324,013
36 hu 308,458
37 io 301,899
38 club 295,210
39 ml 283,859
40 me 281,112
41 nz 274,311
42 ua 274,242
43 gq 271,940
44 ro 264,450
45 cc 262,460
46 tr 255,242
47 home 251,558
48 online 226,257
49 il 225,554
50 mx 225,375
51 ar 217,760
52 gr 210,949
53 kr 201,210
54 icu 200,998
55 xyz 200,560
56 live 190,737
57 no 187,215
58 site 174,336
59 loan 174,261
60 fi 171,029
61 pw 168,683
62 vn 165,047
63 tv 153,487
64 cl 148,887
65 sk 146,794
66 edu 142,598
67 id 133,530
68 pro 113,263
69 pt 113,152
70 ws 109,502
71 ie 104,993
72 su 99,233
73 shop 89,928
74 vip 81,781
75 nu 79,401
76 lt 77,685
77 space 77,161
78 my 73,140
79 kz 72,729
80 gdn 68,473
81 by 67,612
82 sg 64,787
83 win 62,954
84 asia 62,608
85 hk 62,145
86 website 61,654
87 bid 60,341
88 si 59,198
89 to 58,306
90 app 57,211
91 hr 55,993
92 tech 54,784
93 ee 53,676
94 mobi 53,314
95 rs 53,183
96 buzz 52,115
97 gov 49,960
98 store 48,411
99 fun 47,703
100 All other 6,179,838

TLD Distribution (excluding DNS resolve errors and other errors)

# TLD Domain count
1 com 34,193,195
2 net 3,523,176
3 de 2,893,325
4 org 2,370,196
5 uk 2,355,505
6 ru 1,238,872
7 nl 956,629
8 fr 741,750
9 it 732,222
10 jp 732,053
11 pl 674,576
12 br 579,207
13 ca 498,136
14 cn 460,691
15 info 400,983
16 ch 397,928
17 eu 336,078
18 cz 301,990
19 in 296,097
20 se 286,075
21 es 285,447
22 co 283,321
23 at 279,574
24 be 275,411
25 au 226,015
26 dk 219,741
27 hu 212,633
28 za 206,077
29 us 197,509
30 io 194,971
31 biz 165,935
32 nz 162,179
33 tr 161,338
34 ua 156,730
35 ro 156,618
36 ir 145,078
37 il 144,200
38 gr 140,480
39 no 136,151
40 fi 126,156
41 me 126,037
42 mx 120,463
43 kr 119,851
44 ar 116,344
45 edu 108,957
46 sk 100,140
47 tw 99,278
48 vn 92,505
49 cc 88,929
50 cl 81,313
51 pt 76,960
52 ie 70,552
53 id 68,958
54 tv 68,239
55 online 60,085
56 ws 56,357
57 lt 56,306
58 club 47,923
59 my 44,275
60 site 43,225
61 top 43,085
62 pro 42,857
63 by 41,494
64 si 40,372
65 ee 40,236
66 sg 38,808
67 hr 38,177
68 xyz 37,365
69 rs 35,843
70 hk 35,552
71 nu 33,226
72 app 32,038
73 lv 32,026
74 shop 31,224
75 ph 30,138
76 kz 29,303
77 tk 27,856
78 th 26,145
79 su 25,926
80 bg 25,846
81 gov 25,508
82 live 22,063
83 blog 21,094
84 ae 21,046
85 cat 19,507
86 pk 19,420
87 pe 19,038
88 xn--p1ai 18,710
89 store 16,830
90 is 16,615
91 mobi 16,526
92 asia 15,402
93 link 15,387
94 lu 15,257
95 space 15,035
96 life 14,042
97 cloud 14,001
98 tech 13,797
99 to 13,542
100 All other 1,532,744