Offline URL Database 1st July 2021 changelog: Difference between revisions

From URL Classification
Jump to navigation Jump to search
No edit summary
No edit summary
Line 696: Line 696:


Total unique classified domains: 67,267,623 (Total unique domains excluding DNS resolve errors and other errors)
Total unique classified domains: 67,267,623 (Total unique domains excluding DNS resolve errors and other errors)
= TLD Distribution (all domains) =
{| class="wikitable"
|-
! #
! TLD
! Domain count
|-
|1
|com
|56,069,018
|-
|2
|net
|6,223,290
|-
|3
|de
|4,160,046
|-
|4
|org
|4,138,194
|-
|5
|uk
|2,872,991
|-
|6
|ru
|2,252,403
|-
|7
|cn
|1,799,780
|-
|8
|info
|1,701,328
|-
|9
|nl
|1,361,005
|-
|10
|fr
|1,160,908
|-
|11
|pl
|1,104,353
|-
|12
|jp
|1,086,846
|-
|13
|it
|1,084,485
|-
|14
|au
|1,033,886
|-
|15
|br
|994,737
|-
|16
|tk
|903,554
|-
|17
|tw
|701,327
|-
|18
|ca
|687,302
|-
|19
|eu
|619,926
|-
|20
|top
|567,693
|-
|21
|in
|547,017
|-
|22
|co
|536,551
|-
|23
|ch
|531,910
|-
|24
|biz
|531,447
|-
|25
|us
|510,264
|-
|26
|es
|476,592
|-
|27
|cz
|461,363
|-
|28
|se
|422,573
|-
|29
|be
|390,975
|-
|30
|at
|374,429
|-
|31
|ga
|352,137
|-
|32
|cf
|333,449
|-
|33
|ir
|316,363
|-
|34
|dk
|315,697
|-
|35
|hu
|283,986
|-
|36
|za
|275,343
|-
|37
|club
|274,045
|-
|38
|ml
|272,669
|-
|39
|nz
|264,403
|-
|40
|gq
|264,385
|-
|41
|ua
|255,879
|-
|42
|home
|251,736
|-
|43
|ro
|249,428
|-
|44
|tr
|245,061
|-
|45
|me
|243,150
|-
|46
|cc
|239,420
|-
|47
|io
|223,684
|-
|48
|mx
|211,103
|-
|49
|ar
|209,922
|-
|50
|icu
|197,020
|-
|51
|gr
|191,946
|-
|52
|kr
|189,289
|-
|53
|no
|180,096
|-
|54
|online
|178,975
|-
|55
|xyz
|175,570
|-
|56
|loan
|174,760
|-
|57
|il
|172,100
|-
|58
|site
|167,424
|-
|59
|fi
|165,809
|-
|60
|pw
|162,113
|-
|61
|live
|161,347
|-
|62
|vn
|147,022
|-
|63
|sk
|143,847
|-
|64
|tv
|142,457
|-
|65
|cl
|142,074
|-
|66
|edu
|135,480
|-
|67
|id
|114,637
|-
|68
|pt
|107,900
|-
|69
|xn--p1ai
|103,560
|-
|70
|pro
|99,684
|-
|71
|ie
|98,373
|-
|72
|ws
|90,869
|-
|73
|nu
|78,216
|-
|74
|lt
|75,326
|-
|75
|vip
|71,353
|-
|76
|kz
|70,416
|-
|77
|gdn
|68,583
|-
|78
|my
|67,121
|-
|79
|space
|65,993
|-
|80
|by
|64,785
|-
|81
|shop
|62,280
|-
|82
|win
|61,340
|-
|83
|su
|61,149
|-
|84
|bid
|59,793
|-
|85
|hk
|59,053
|-
|86
|sg
|58,919
|-
|87
|asia
|58,886
|-
|88
|si
|57,246
|-
|89
|website
|55,902
|-
|90
|hr
|52,216
|-
|91
|to
|52,127
|-
|92
|ee
|51,770
|-
|93
|mobi
|49,226
|-
|94
|rs
|49,150
|-
|95
|tech
|47,253
|-
|96
|domain
|46,208
|-
|97
|lv
|44,853
|-
|98
|gov
|43,351
|-
|99
|la
|41,742
|-
|100
|All other
|5,265,107
|}
= TLD Distribution (excluding DNS resolve errors and other errors) =
{| class="wikitable"
|-
! #
! TLD
! Domain count
|-
|1
|com
|36,837,292
|-
|2
|net
|3,760,576
|-
|3
|de
|2,916,855
|-
|4
|org
|2,567,277
|-
|5
|uk
|1,933,432
|-
|6
|ru
|1,392,601
|-
|7
|nl
|1,064,358
|-
|8
|fr
|813,032
|-
|9
|it
|810,904
|-
|10
|jp
|804,000
|-
|11
|au
|757,388
|-
|12
|pl
|739,171
|-
|13
|br
|657,294
|-
|14
|cn
|577,089
|-
|15
|ca
|500,862
|-
|16
|info
|477,761
|-
|17
|ch
|423,222
|-
|18
|eu
|375,511
|-
|19
|cz
|373,380
|-
|20
|es
|339,886
|-
|21
|se
|333,844
|-
|22
|in
|309,274
|-
|23
|co
|300,253
|-
|24
|be
|298,042
|-
|25
|at
|292,396
|-
|26
|dk
|244,551
|-
|27
|hu
|223,056
|-
|28
|za
|203,689
|-
|29
|us
|197,755
|-
|30
|biz
|195,516
|-
|31
|ua
|188,217
|-
|32
|nz
|186,105
|-
|33
|ir
|170,091
|-
|34
|ro
|168,584
|-
|35
|tr
|164,853
|-
|36
|io
|159,186
|-
|37
|ga
|156,876
|-
|38
|cf
|152,832
|-
|39
|no
|148,549
|-
|40
|ml
|141,191
|-
|41
|gr
|140,777
|-
|42
|fi
|140,540
|-
|43
|mx
|138,841
|-
|44
|kr
|132,758
|-
|45
|me
|127,088
|-
|46
|gq
|124,359
|-
|47
|tw
|123,880
|-
|48
|sk
|117,129
|-
|49
|il
|113,725
|-
|50
|ar
|106,614
|-
|51
|edu
|105,505
|-
|52
|vn
|99,965
|-
|53
|cl
|96,383
|-
|54
|cc
|91,170
|-
|55
|pt
|83,938
|-
|56
|ie
|78,410
|-
|57
|tv
|75,370
|-
|58
|id
|68,085
|-
|59
|xn--p1ai
|67,409
|-
|60
|lt
|61,186
|-
|61
|tk
|60,973
|-
|62
|club
|55,563
|-
|63
|online
|54,223
|-
|64
|ws
|49,131
|-
|65
|my
|48,443
|-
|66
|by
|48,299
|-
|67
|site
|48,179
|-
|68
|si
|42,959
|-
|69
|ee
|42,714
|-
|70
|pro
|41,569
|-
|71
|sg
|40,302
|-
|72
|hk
|40,058
|-
|73
|nu
|39,087
|-
|74
|hr
|38,907
|-
|75
|rs
|37,644
|-
|76
|top
|35,052
|-
|77
|lv
|33,949
|-
|78
|kz
|33,158
|-
|79
|xyz
|33,066
|-
|80
|su
|28,582
|-
|81
|bg
|26,090
|-
|82
|ph
|26,071
|-
|83
|th
|26,034
|-
|84
|cat
|25,954
|-
|85
|blog
|25,176
|-
|86
|gov
|23,628
|-
|87
|shop
|22,014
|-
|88
|app
|21,477
|-
|89
|pe
|21,466
|-
|90
|ae
|21,371
|-
|91
|pk
|20,839
|-
|92
|mobi
|19,262
|-
|93
|is
|17,781
|-
|94
|live
|17,523
|-
|95
|lu
|17,044
|-
|96
|space
|15,829
|-
|97
|pw
|15,268
|-
|98
|asia
|15,050
|-
|99
|buzz
|14,940
|-
|100
|All other
|1,573,051
|}

Revision as of 16:23, 29 July 2021

Category change

  • Added Comics category
  • Added Manga category

Domain count and statistics

ID Name Domain count
1 Abortion and pregnancy 124,825
2 Ads 66,401
3 Adult 523,673
4 Adult dating 17,977
5 Alcohol 508,677
6 Astrology 61,348
7 Blogs 3,577,417
8 Books or comics 184,913
9 Business and services 6,382,548
10 CDN 1,024,233
11 Chats 168,710
12 Classifieds 120,327
13 Clothing and fashion 1,482,241
14 Cooking and food 1,874,017
15 Dating 111,082
16 Drugs 87,103
17 Education 1,111,115
18 Empty site 643,091
19 Entertainment 733,595
20 Error site can't be accessed 12,179,039
21 DNS error site can't be resolved 32,089,032
22 File hosting 65,612
23 Finance (Banks_Real estate_Insurance) 587,161
24 Gambling 367,524
25 Computer games 528,949
26 General (safe) 10,064
27 Government 93,267
28 Hacking 12,103
29 Hate 48,192
30 Hobbies 378,318
31 Home improvement 473,660
32 Humor 26,859
33 Hunting and fishing 112,941
34 Image and video hosting 105,655
35 Jobs 659,259
36 Kids safe 225
37 Legal 440,618
38 Life style and beauty 705,906
39 Link farm (no real content) 4,365,547
40 Local information 52,751
41 Medical 2,633,561
42 Military 27,103
43 Mixed adult 1,025,027
44 Mobile 273,401
45 Models 79,971
46 Music 1,139,889
47 News 1,847,323
49 Not child safe 41,077
50 Online drugs 44,652
51 Online marketing 484,654
52 Online video or audio 310,748
53 Pets and animals 403,989
54 Phishing 23
55 Politics 378,921
56 Porn 891,151
57 Internet portals 187,848
58 Profanity 39,409
59 Proxy 14,129
60 Religion 575,368
62 Science 303,406
63 Search engines 52,189
64 Sects 12,212
65 Semi nude and pin up 35,189
66 Sex education 82,305
67 Shopping 2,746,388
68 Social networks 939,543
69 Spam or scam 4,972
70 Sports 1,457,906
71 Suicide 97
72 Technology and computers 1,146,051
73 Site under construction or not available 6,133,391
74 General - not porn 13,810,319
75 URL shortener 5,298
76 Vacation and travel 2,035,329
77 Vehicles 1,390,265
78 Violence 38,056
79 Virus or Spyware 92
80 Warez 40,357
81 Weapons 158,633
82 Web hosting 928,719
83 Web mail 67,095
84 Reference 214,191
85 Community and society 182,999
86 Software repository 28,626
87 Philosophy and psychology 243,552
88 History 219,300
89 Nonsense and time waste 93,215
90 Local IP 732
91 Swimsuits and underwear 90,082
92 Arts 657,403
94 Login page 91,546
95 Surveys and polls 49,482
96 Tobacco 58,511
97 ISP 11,581
98 Tracker 601,345
99 Bypass protection 1,626
100 Search block 23
101 Image search block 170,895
102 Desktop themes 8,093
103 Depress domain 45,216
105 Parenting and family 72,104
106 School cheats 5,586
107 Celebrity gossip 116,250
108 How to 120,011
109 Illegal 3,568
110 Recreation 155,734
111 Bookmarks 93
112 Money spam 2,049
113 Directories 4,770
114 Site_Graphic design 460,266
115 Weather 84,546
116 Knowledge 46,078
117 Kids entertainment 31,885
118 Nature 79,608
119 Diet 110,830
120 Eating disorders 5,934
121 Self help 97,576
122 Relationships 20,226
123 Paranormal 30,544
124 Images CDN 831
125 Images CDN Unknown 58,108
126 LGBT 8,028
127 Marketing or ads 38,303
128 Magazines 97,273
129 Forums 136,884
130 User generated content 50,143
131 Tele Communications 62,774
132 Gender specific 2,994
134 Crime 67,870
135 Person 57,588
136 Grief 1,164
137 Retirement 45,873
138 Other drugs 55,336
139 Pharmacy 32,823
140 Songs download 16,552
141 Lookup 27,041
142 Movies download 108,377
143 Consumer reviews 10,609
144 API 54,828
145 Legal movies 321
146 Legal songs 586
147 Bitcoin 44,205
148 Victim help 365
149 Rewards 6,355
150 Photography 266,413
151 Toys 132,693
152 Restaurant 314,390
153 Fitness 320,212
154 Contact sport 133,808
155 Dancing 46,838
156 Software 486,527
157 Programming 266,009
158 Registry cleaner 252
159 Online security 123,726
160 Real estate 748,244
161 Loans 128,878
162 Forex 35,878
163 Banks 288,773
164 Insurance 278,422
165 SEO 83,568
166 PPC 12,604
167 Supplements 23,209
168 URL Classification 490
170 Tatoo 30,449
172 Tactical equipment 4,667
173 Alternative medicine 216,521
174 AI 14,774
175 Comics 10,792
176 Manga 1,090

Total domains: 123,062,565

Total classified domains: 78,794,494 (Total domains excluding DNS resolve errors and other errors)

Total unique domains: 110,669,917

Total unique classified domains: 67,267,623 (Total unique domains excluding DNS resolve errors and other errors)

TLD Distribution (all domains)

# TLD Domain count
1 com 56,069,018
2 net 6,223,290
3 de 4,160,046
4 org 4,138,194
5 uk 2,872,991
6 ru 2,252,403
7 cn 1,799,780
8 info 1,701,328
9 nl 1,361,005
10 fr 1,160,908
11 pl 1,104,353
12 jp 1,086,846
13 it 1,084,485
14 au 1,033,886
15 br 994,737
16 tk 903,554
17 tw 701,327
18 ca 687,302
19 eu 619,926
20 top 567,693
21 in 547,017
22 co 536,551
23 ch 531,910
24 biz 531,447
25 us 510,264
26 es 476,592
27 cz 461,363
28 se 422,573
29 be 390,975
30 at 374,429
31 ga 352,137
32 cf 333,449
33 ir 316,363
34 dk 315,697
35 hu 283,986
36 za 275,343
37 club 274,045
38 ml 272,669
39 nz 264,403
40 gq 264,385
41 ua 255,879
42 home 251,736
43 ro 249,428
44 tr 245,061
45 me 243,150
46 cc 239,420
47 io 223,684
48 mx 211,103
49 ar 209,922
50 icu 197,020
51 gr 191,946
52 kr 189,289
53 no 180,096
54 online 178,975
55 xyz 175,570
56 loan 174,760
57 il 172,100
58 site 167,424
59 fi 165,809
60 pw 162,113
61 live 161,347
62 vn 147,022
63 sk 143,847
64 tv 142,457
65 cl 142,074
66 edu 135,480
67 id 114,637
68 pt 107,900
69 xn--p1ai 103,560
70 pro 99,684
71 ie 98,373
72 ws 90,869
73 nu 78,216
74 lt 75,326
75 vip 71,353
76 kz 70,416
77 gdn 68,583
78 my 67,121
79 space 65,993
80 by 64,785
81 shop 62,280
82 win 61,340
83 su 61,149
84 bid 59,793
85 hk 59,053
86 sg 58,919
87 asia 58,886
88 si 57,246
89 website 55,902
90 hr 52,216
91 to 52,127
92 ee 51,770
93 mobi 49,226
94 rs 49,150
95 tech 47,253
96 domain 46,208
97 lv 44,853
98 gov 43,351
99 la 41,742
100 All other 5,265,107

TLD Distribution (excluding DNS resolve errors and other errors)

# TLD Domain count
1 com 36,837,292
2 net 3,760,576
3 de 2,916,855
4 org 2,567,277
5 uk 1,933,432
6 ru 1,392,601
7 nl 1,064,358
8 fr 813,032
9 it 810,904
10 jp 804,000
11 au 757,388
12 pl 739,171
13 br 657,294
14 cn 577,089
15 ca 500,862
16 info 477,761
17 ch 423,222
18 eu 375,511
19 cz 373,380
20 es 339,886
21 se 333,844
22 in 309,274
23 co 300,253
24 be 298,042
25 at 292,396
26 dk 244,551
27 hu 223,056
28 za 203,689
29 us 197,755
30 biz 195,516
31 ua 188,217
32 nz 186,105
33 ir 170,091
34 ro 168,584
35 tr 164,853
36 io 159,186
37 ga 156,876
38 cf 152,832
39 no 148,549
40 ml 141,191
41 gr 140,777
42 fi 140,540
43 mx 138,841
44 kr 132,758
45 me 127,088
46 gq 124,359
47 tw 123,880
48 sk 117,129
49 il 113,725
50 ar 106,614
51 edu 105,505
52 vn 99,965
53 cl 96,383
54 cc 91,170
55 pt 83,938
56 ie 78,410
57 tv 75,370
58 id 68,085
59 xn--p1ai 67,409
60 lt 61,186
61 tk 60,973
62 club 55,563
63 online 54,223
64 ws 49,131
65 my 48,443
66 by 48,299
67 site 48,179
68 si 42,959
69 ee 42,714
70 pro 41,569
71 sg 40,302
72 hk 40,058
73 nu 39,087
74 hr 38,907
75 rs 37,644
76 top 35,052
77 lv 33,949
78 kz 33,158
79 xyz 33,066
80 su 28,582
81 bg 26,090
82 ph 26,071
83 th 26,034
84 cat 25,954
85 blog 25,176
86 gov 23,628
87 shop 22,014
88 app 21,477
89 pe 21,466
90 ae 21,371
91 pk 20,839
92 mobi 19,262
93 is 17,781
94 live 17,523
95 lu 17,044
96 space 15,829
97 pw 15,268
98 asia 15,050
99 buzz 14,940
100 All other 1,573,051
Retrieved from "https://url-classification.io/wiki/index.php?title=Offline_URL_Database_1st_July_2021_changelog&oldid=79"