Offline URL Database 1st July 2023 changelog

From URL Classification
Jump to navigation Jump to search

Database change

  • Improved support for non English language.

Domain count and statistics

ID Name Domain count
1 Abortion and pregnancy 107,345
2 Ads 77,108
3 Adult 416,211
4 Adult dating 17,493
5 Alcohol 363,998
6 Astrology 61,690
7 Blogs 3,404,162
8 Books or comics 453,504
9 Business and services 6,200,668
10 CDN 1,056,386
11 Chats 94,628
12 Classifieds 102,162
13 Clothing and fashion 1,055,373
14 Cooking and food 1,733,996
15 Dating 82,026
16 Drugs 82,077
17 Education 1,197,379
18 Empty site 1,335,551
19 Entertainment 723,922
20 Error site can't be accessed 25,600,759
21 DNS error site can't be resolved 30,615,841
22 File hosting 82,760
23 Finance (Banks_Real estate_Insurance) 625,091
24 Gambling 367,416
25 Computer games 526,312
26 General (safe) 9,574
27 Government 132,252
28 Hacking 12,412
29 Hate 20,656
30 Hobbies 352,015
31 Home improvement 476,501
32 Humor 28,209
33 Hunting and fishing 103,435
34 Image and video hosting 113,908
35 Jobs 678,960
36 Kids safe 227
37 Legal 432,615
38 Life style and beauty 728,933
39 Link farm (no real content) 6,172,564
40 Local information 74,209
41 Medical 2,499,775
42 Military 28,923
43 Mixed adult 1,052,323
44 Mobile 259,321
45 Models 55,698
46 Music 1,072,649
47 News 1,447,978
49 Not child safe 20,822
50 Online drugs 30,358
51 Online marketing 565,468
52 Online video or audio 305,988
53 Pets and animals 402,898
54 Phishing 941
55 Politics 300,911
56 Porn 840,607
57 Internet portals 304,488
58 Profanity 31,782
59 Proxy 16,470
60 Religion 520,769
62 Science 347,890
63 Search engines 88,117
64 Sects 12,320
65 Semi nude and pin up 25,576
66 Sex education 65,355
67 Shopping 2,401,804
68 Social networks 305,414
69 Spam or scam 3,555
70 Sports 1,282,693
71 Suicide 309
72 Technology and computers 893,619
73 Site under construction or not available 5,801,025
74 General - not porn 8,166,836
75 URL shortener 7,381
76 Vacation and travel 1,710,418
77 Vehicles 1,249,688
78 Violence 33,702
79 Virus or Spyware 1,747
80 Warez 34,631
81 Weapons 147,239
82 Web hosting 778,276
83 Web mail 104,708
84 Reference 175,704
85 Community and society 247,609
86 Software repository 34,560
87 Philosophy and psychology 251,557
88 History 294,594
89 Nonsense and time waste 71,989
90 Local IP 53
91 Swimsuits and underwear 96,194
92 Arts 714,051
94 Login page 129,170
95 Surveys and polls 33,939
96 Tobacco 56,874
97 ISP 17,476
98 Tracker 1,675,903
99 Bypass protection 3,443
100 Search block 42
101 Image search block 155,772
102 Desktop themes 9,029
103 Depress domain 70,240
104 Depress page 1,974
105 Parenting and family 66,325
106 School cheats 4,529
107 Celebrity gossip 105,263
108 How to 95,431
109 Illegal 3,094
110 Recreation 208,927
111 Bookmarks 21,977
112 Money spam 5,475
113 Directories 4,690
114 Site_Graphic design 336,230
115 Weather 75,665
116 Knowledge 59,980
117 Kids entertainment 17,060
118 Nature 124,714
119 Diet 112,195
120 Eating disorders 5,200
121 Self help 89,244
122 Relationships 20,898
123 Paranormal 35,158
124 Images CDN 3,184
125 Images CDN Unknown 66,116
126 LGBT 16,341
127 Marketing or ads 32,378
128 Magazines 143,429
129 Forums 134,032
130 User generated content 48,090
131 Tele Communications 64,817
132 Gender specific 2,209
134 Crime 41,205
135 Person 59,498
136 Grief 2,296
137 Retirement 48,069
138 Other drugs 67,111
139 Pharmacy 40,675
140 Songs download 14,899
141 Lookup 35,985
142 Movies download 107,528
143 Consumer reviews 18,203
144 API 93,863
145 Legal movies 630
146 Legal songs 1,540
147 Bitcoin 68,461
148 Victim help 4,220
149 Rewards 9,427
150 Photography 357,186
151 Toys 124,734
152 Restaurant 365,954
153 Fitness 263,666
154 Contact sport 121,774
155 Dancing 48,208
156 Software 451,364
157 Programming 258,280
158 Registry cleaner 305
159 Online security 120,267
160 Real estate 708,371
161 Loans 124,077
162 Forex 24,154
163 Banks 238,802
164 Insurance 260,221
165 SEO 80,442
166 PPC 6,595
167 Supplements 45,288
168 URL Classification 495
170 Tatoo 29,740
172 Tactical equipment 9,694
173 Alternative medicine 232,056
174 AI 21,587
175 Comics 19,277
176 Manga 8,003
177 Captcha 421,193
178 Racism education 1,287
179 Payment 15,220
180 Brokerage 18,923
181 SAAS 13,507
182 Anime 21,268
183 Cartoon 5,751
184 Grownups 19
185 Stream converter 3,292
186 File converter 2,815
187 TV Personality 806
188 Radio Personality 637
189 Youtube Personality 7,997
190 Prevent crime or violence 5,787
191 Collaboration software 106,497
193 Internet support 2,819
194 Computer support 23,175
195 Home appliance 4,262
196 Disposable mail 435
197 Parked domain 348,022
198 Domain not available 127,892
199 Private site 166,117
200 Earth science 33,136
201 Fringe theory 2,830
202 Conspiracy theory 4,078
203 Alt right 313
204 Alt left 446

Total domains: 130,756,298

Total classified domains: 74,539,698 (Total domains excluding DNS resolve errors and other errors)

Total unique domains: 120,569,998

Total unique classified domains: 64,354,249 (Total unique domains excluding DNS resolve errors and other errors)

TLD Distribution (all domains)

# TLD Domain count
1 com 62,524,613
2 net 6,512,825
3 de 4,425,537
4 org 4,318,270
5 uk 3,536,075
6 ru 2,413,356
7 cn 1,916,423
8 info 1,744,716
9 nl 1,395,938
10 fr 1,206,925
11 pl 1,140,829
12 it 1,132,266
13 jp 1,108,433
14 br 1,049,365
15 tk 920,672
16 ca 725,386
17 tw 706,760
18 eu 648,826
19 co 628,392
20 top 619,602
21 in 612,874
22 ch 554,005
23 biz 551,249
24 us 537,163
25 es 493,811
26 cz 468,218
27 se 431,741
28 be 414,265
29 at 395,495
30 ga 362,811
31 cf 346,200
32 ir 342,714
33 au 331,687
34 dk 324,849
35 za 323,955
36 hu 308,387
37 io 301,184
38 club 295,118
39 ml 283,694
40 me 280,909
41 nz 274,262
42 ua 274,208
43 gq 271,866
44 ro 264,406
45 cc 262,158
46 tr 255,147
47 home 251,559
48 online 225,789
49 il 225,514
50 mx 225,290
51 ar 217,728
52 gr 210,917
53 icu 200,937
54 kr 200,890
55 xyz 199,427
56 live 190,552
57 no 186,920
58 loan 174,264
59 site 174,051
60 fi 170,854
61 pw 168,652
62 vn 164,816
63 tv 153,378
64 cl 148,841
65 sk 146,744
66 edu 142,475
67 id 133,276
68 pt 113,104
69 pro 113,020
70 ws 109,440
71 ie 104,971
72 su 99,195
73 shop 89,719
74 vip 81,664
75 nu 79,393
76 lt 77,678
77 space 77,070
78 my 73,106
79 kz 72,698
80 gdn 68,471
81 by 67,600
82 sg 64,755
83 win 62,909
84 asia 62,574
85 hk 62,128
86 website 61,602
87 bid 60,327
88 si 59,175
89 to 58,266
90 app 57,011
91 hr 55,979
92 tech 54,616
93 ee 53,657
94 mobi 53,289
95 rs 53,156
96 buzz 51,603
97 gov 49,872
98 store 48,263
99 fun 47,607
100 All other 6,175,457

TLD Distribution (excluding DNS resolve errors and other errors)

# TLD Domain count
1 com 35,747,582
2 net 3,634,101
3 de 2,949,586
4 uk 2,449,303
5 org 2,445,549
6 ru 1,261,700
7 nl 986,018
8 fr 758,354
9 it 749,632
10 jp 739,520
11 pl 689,014
12 br 599,906
13 ca 511,995
14 cn 453,088
15 info 415,653
16 ch 405,621
17 eu 346,070
18 cz 312,766
19 in 305,781
20 co 302,637
21 es 293,694
22 se 292,832
23 at 285,441
24 be 284,129
25 au 224,292
26 dk 223,555
27 hu 216,158
28 us 210,321
29 za 202,948
30 io 198,314
31 biz 172,988
32 nz 166,259
33 ro 162,044
34 tr 161,028
35 ua 158,176
36 il 149,003
37 ir 145,932
38 gr 143,480
39 no 138,909
40 me 129,217
41 fi 127,615
42 mx 126,074
43 kr 121,600
44 ar 119,745
45 edu 109,392
46 sk 102,823
47 tw 100,562
48 vn 92,891
49 cc 91,333
50 cl 79,449
51 pt 78,692
52 ie 74,599
53 tv 72,009
54 id 70,671
55 online 64,671
56 ws 61,733
57 lt 57,190
58 top 51,679
59 club 50,440
60 my 46,044
61 site 44,569
62 pro 43,779
63 xyz 42,951
64 by 42,812
65 si 40,881
66 ee 40,837
67 sg 39,977
68 hr 38,724
69 rs 36,580
70 hk 36,278
71 nu 34,553
72 shop 34,243
73 lv 32,593
74 app 32,151
75 tk 30,078
76 kz 28,985
77 ph 27,168
78 th 26,581
79 su 26,293
80 bg 26,153
81 gov 25,095
82 live 24,672
83 blog 21,964
84 ae 21,819
85 cat 20,681
86 pk 20,473
87 pe 20,075
88 xn--p1ai 18,984
89 store 18,466
90 mobi 17,367
91 space 17,056
92 is 16,900
93 asia 15,743
94 link 15,698
95 lu 15,523
96 life 15,240
97 tech 14,547
98 cloud 14,207
99 to 13,926
100 All other 1,577,813