Offline URL Database 1st October 2021 changelog

From URL Classification
Jump to navigation Jump to search

Category change

  • Added Race Education category
  • Added Captcha category

Domain count and statistics

ID Name Domain count
1 Abortion and pregnancy 120,782
2 Ads 72,343
3 Adult 515,116
4 Adult dating 18,831
5 Alcohol 520,251
6 Astrology 61,651
7 Blogs 3,524,367
8 Books or comics 487,245
9 Business and services 5,882,157
10 CDN 1,027,851
11 Chats 179,521
12 Classifieds 129,149
13 Clothing and fashion 1,498,426
14 Cooking and food 1,901,013
15 Dating 111,299
16 Drugs 85,148
17 Education 1,123,623
18 Empty site 2,003,190
19 Entertainment 726,645
20 Error site can't be accessed 5,434,788
21 DNS error site can't be resolved 39,437,433
22 File hosting 68,153
23 Finance (Banks_Real estate_Insurance) 598,130
24 Gambling 375,882
25 Computer games 503,802
26 General (safe) 7,884
27 Government 106,169
28 Hacking 12,939
29 Hate 25,206
30 Hobbies 389,530
31 Home improvement 482,124
32 Humor 26,438
33 Hunting and fishing 116,290
34 Image and video hosting 107,448
35 Jobs 687,820
36 Kids safe 229
37 Legal 438,945
38 Life style and beauty 709,176
39 Link farm (no real content) 4,288,514
40 Local information 53,670
41 Medical 2,785,927
42 Military 27,774
43 Mixed adult 1,019,295
44 Mobile 282,626
45 Models 72,842
46 Music 1,145,002
47 News 1,842,410
49 Not child safe 42,218
50 Online drugs 42,632
51 Online marketing 507,712
52 Online video or audio 298,153
53 Pets and animals 348,923
54 Phishing 23
55 Politics 325,983
56 Porn 865,478
57 Internet portals 223,143
58 Profanity 33,220
59 Proxy 14,277
60 Religion 532,554
62 Science 290,645
63 Search engines 38,979
64 Sects 12,633
65 Semi nude and pin up 30,170
66 Sex education 77,882
67 Shopping 2,648,212
68 Social networks 937,741
69 Spam or scam 4,556
70 Sports 1,353,457
71 Suicide 81
72 Technology and computers 985,174
73 Site under construction or not available 5,325,089
74 General - not porn 14,899,101
75 URL shortener 5,271
76 Vacation and travel 1,821,829
77 Vehicles 1,298,420
78 Violence 37,230
79 Virus or Spyware 122
80 Warez 38,721
81 Weapons 150,740
82 Web hosting 862,134
83 Web mail 78,572
84 Reference 207,129
85 Community and society 171,376
86 Software repository 26,095
87 Philosophy and psychology 236,224
88 History 223,214
89 Nonsense and time waste 97,212
90 Local IP 258
91 Swimsuits and underwear 81,748
92 Arts 644,192
94 Login page 97,242
95 Surveys and polls 42,130
96 Tobacco 55,523
97 ISP 12,421
98 Tracker 574,066
99 Bypass protection 1,648
100 Search block 20
101 Image search block 143,902
102 Desktop themes 8,732
103 Depress domain 57,370
104 Depress page 10,062
105 Parenting and family 66,345
106 School cheats 3,759
107 Celebrity gossip 103,101
108 How to 254,470
109 Illegal 3,640
110 Recreation 146,807
111 Bookmarks 76
112 Money spam 1,969
113 Directories 4,062
114 Site_Graphic design 399,924
115 Weather 80,304
116 Knowledge 45,871
117 Kids entertainment 30,692
118 Nature 83,352
119 Diet 105,455
120 Eating disorders 5,958
121 Self help 92,622
122 Relationships 18,869
123 Paranormal 27,978
124 Images CDN 877
125 Images CDN Unknown 59,997
126 LGBT 13,035
127 Marketing or ads 36,764
128 Magazines 104,687
129 Forums 139,022
130 User generated content 46,193
131 Tele Communications 45,471
132 Gender specific 2,595
134 Crime 75,387
135 Person 61,684
136 Grief 1,094
137 Retirement 37,057
138 Other drugs 56,379
139 Pharmacy 30,201
140 Songs download 14,858
141 Lookup 26,667
142 Movies download 106,560
143 Consumer reviews 8,621
144 API 65,275
145 Legal movies 351
146 Legal songs 556
147 Bitcoin 48,814
148 Victim help 311
149 Rewards 6,079
150 Photography 199,705
151 Toys 122,117
152 Restaurant 275,565
153 Fitness 315,276
154 Contact sport 130,552
155 Dancing 45,468
156 Software 492,602
157 Programming 262,099
158 Registry cleaner 267
159 Online security 139,711
160 Real estate 661,656
161 Loans 126,569
162 Forex 36,488
163 Banks 293,295
164 Insurance 285,890
165 SEO 67,277
166 PPC 10,390
167 Supplements 20,568
168 URL Classification 501
170 Tatoo 25,798
172 Tactical equipment 4,009
173 Alternative medicine 210,414
174 AI 15,596
175 Comics 17,173
176 Manga 5,047
177 Captcha 55,697
178 Racism education 1,100

Total domains: 124,141,312

Total classified domains: 79,269,091 (Total domains excluding DNS resolve errors and other errors)

Total unique domains: 112,460,523

Total unique classified domains: 67,677,168 (Total unique domains excluding DNS resolve errors and other errors)

TLD Distribution (all domains)

# TLD Domain count
1 com 56,752,045
2 net 6,279,011
3 de 4,213,836
4 org 4,171,633
5 uk 3,438,426
6 ru 2,267,014
7 cn 1,812,080
8 info 1,709,874
9 nl 1,364,922
10 fr 1,166,440
11 pl 1,108,422
12 it 1,092,582
13 jp 1,089,867
14 au 1,043,052
15 br 1,005,498
16 tk 907,996
17 tw 702,422
18 ca 699,034
19 eu 625,344
20 top 574,829
21 in 560,726
22 co 552,796
23 biz 537,278
24 ch 535,600
25 us 519,035
26 es 478,999
27 cz 462,520
28 se 424,046
29 be 393,274
30 at 377,935
31 ga 354,933
32 cf 335,312
33 ir 326,028
34 dk 316,967
35 za 305,493
36 hu 290,421
37 club 280,386
38 ml 273,991
39 nz 265,804
40 gq 265,316
41 ua 259,192
42 me 251,757
43 home 251,702
44 ro 251,524
45 tr 246,828
46 cc 242,421
47 io 238,273
48 mx 213,056
49 ar 211,000
50 icu 198,049
51 gr 195,179
52 kr 190,584
53 online 188,165
54 no 180,842
55 xyz 179,909
56 il 179,798
57 loan 174,780
58 site 169,002
59 live 168,874
60 fi 166,385
61 pw 163,737
62 vn 151,545
63 tv 144,654
64 sk 144,355
65 cl 143,079
66 edu 137,330
67 id 118,473
68 pt 108,658
69 xn--p1ai 104,348
70 pro 102,308
71 ie 99,674
72 ws 93,419
73 nu 78,388
74 lt 75,576
75 vip 72,885
76 kz 70,749
77 gdn 68,575
78 my 68,511
79 space 68,186
80 shop 65,766
81 by 65,212
82 win 61,710
83 su 61,703
84 sg 60,217
85 bid 59,907
86 hk 59,849
87 asia 59,845
88 si 57,503
89 website 57,295
90 to 53,455
91 hr 52,656
92 ee 52,006
93 mobi 50,740
94 rs 49,712
95 tech 48,521
96 domain 46,234
97 lv 45,250
98 gov 44,807
99 la 42,085
100 All other 5,312,941

TLD Distribution (excluding DNS resolve errors and other errors)

# TLD Domain count
1 com 36,982,260
2 net 3,757,984
3 de 2,925,639
4 org 2,550,208
5 uk 2,466,372
6 ru 1,363,336
7 nl 1,049,027
8 fr 803,222
9 it 796,818
10 jp 785,304
11 au 745,790
12 pl 733,181
13 br 645,407
14 cn 595,922
15 ca 498,003
16 info 461,448
17 ch 420,390
18 eu 371,379
19 cz 358,855
20 es 335,564
21 se 325,193
22 in 313,957
23 co 310,047
24 be 294,687
25 at 290,643
26 dk 241,558
27 hu 224,081
28 za 219,118
29 biz 203,925
30 us 200,526
31 ua 187,662
32 nz 181,016
33 ir 171,322
34 ga 169,539
35 io 169,460
36 cf 166,066
37 ro 165,039
38 tr 162,417
39 ml 152,673
40 no 146,737
41 gr 141,215
42 fi 138,692
43 mx 137,054
44 gq 135,657
45 kr 130,046
46 me 129,107
47 ar 119,655
48 il 118,072
49 sk 114,910
50 tw 109,723
51 edu 105,599
52 vn 101,633
53 cl 97,776
54 cc 89,890
55 pt 83,426
56 ie 78,074
57 tv 75,394
58 id 69,091
59 xn--p1ai 65,801
60 lt 60,610
61 online 57,384
62 tk 55,758
63 club 55,236
64 my 47,898
65 ws 47,568
66 by 46,942
67 site 46,442
68 si 42,550
69 ee 42,479
70 pro 40,866
71 sg 40,542
72 hk 39,600
73 nu 38,699
74 hr 38,622
75 rs 37,166
76 top 35,133
77 xyz 34,179
78 lv 33,816
79 kz 32,418
80 su 28,660
81 ph 27,761
82 bg 26,069
83 th 26,022
84 cat 25,657
85 gov 24,329
86 blog 24,256
87 shop 23,686
88 app 23,545
89 ae 21,623
90 pe 21,406
91 pk 21,137
92 live 19,871
93 mobi 19,634
94 is 17,646
95 lu 16,705
96 space 16,222
97 pw 15,500
98 asia 15,288
99 jobs 14,415
100 All other 1,391,233