Difference between revisions of "Offline URL Database 1st July 2021 changelog"

From URL Classification
Jump to navigation Jump to search
(Created page with "= Category change = * Added Comics category * Added Manga category == Domain count and statistics ==")
 
Line 5: Line 5:


== Domain count and statistics ==
== Domain count and statistics ==
{| class="wikitable"
|-
! ID
! Name
! Domain count
|-
| 1
| Abortion and pregnancy
| 124,825
|-
| 2
| Ads
| 66,401
|-
| 3
| Adult
| 523,673
|-
| 4
| Adult dating
| 17,977
|-
| 5
| Alcohol
| 508,677
|-
| 6
| Astrology
| 61,348
|-
| 7
| Blogs
| 3,577,417
|-
| 8
| Books or comics
| 184,913
|-
| 9
| Business and services
| 6,382,548
|-
| 10
| CDN
| 1,024,233
|-
| 11
| Chats
| 168,710
|-
| 12
| Classifieds
| 120,327
|-
| 13
| Clothing and fashion
| 1,482,241
|-
| 14
| Cooking and food
| 1,874,017
|-
| 15
| Dating
| 111,082
|-
| 16
| Drugs
| 87,103
|-
| 17
| Education
| 1,111,115
|-
| 18
| Empty site
| 643,091
|-
| 19
| Entertainment
| 733,595
|-
| 20
| Error site can't be accessed
| 12,179,039
|-
| 21
| DNS error site can't be resolved
| 32,089,032
|-
| 22
| File hosting
| 65,612
|-
| 23
| Finance (Banks_Real estate_Insurance)
| 587,161
|-
| 24
| Gambling
| 367,524
|-
| 25
| Computer games
| 528,949
|-
| 26
| General (safe)
| 10,064
|-
| 27
| Government
| 93,267
|-
| 28
| Hacking
| 12,103
|-
| 29
| Hate
| 48,192
|-
| 30
| Hobbies
| 378,318
|-
| 31
| Home improvement
| 473,660
|-
| 32
| Humor
| 26,859
|-
| 33
| Hunting and fishing
| 112,941
|-
| 34
| Image and video hosting
| 105,655
|-
| 35
| Jobs
| 659,259
|-
| 36
| Kids safe
| 225
|-
| 37
| Legal
| 440,618
|-
| 38
| Life style and beauty
| 705,906
|-
| 39
| Link farm (no real content)
| 4,365,547
|-
| 40
| Local information
| 52,751
|-
| 41
| Medical
| 2,633,561
|-
| 42
| Military
| 27,103
|-
| 43
| Mixed adult
| 1,025,027
|-
| 44
| Mobile
| 273,401
|-
| 45
| Models
| 79,971
|-
| 46
| Music
| 1,139,889
|-
| 47
| News
| 1,847,323
|-
| 49
| Not child safe
| 41,077
|-
| 50
| Online drugs
| 44,652
|-
| 51
| Online marketing
| 484,654
|-
| 52
| Online video or audio
| 310,748
|-
| 53
| Pets and animals
| 403,989
|-
| 54
| Phishing
| 23
|-
| 55
| Politics
| 378,921
|-
| 56
| Porn
| 891,151
|-
| 57
| Internet portals
| 187,848
|-
| 58
| Profanity
| 39,409
|-
| 59
| Proxy
| 14,129
|-
| 60
| Religion
| 575,368
|-
| 62
| Science
| 303,406
|-
| 63
| Search engines
| 52,189
|-
| 64
| Sects
| 12,212
|-
| 65
| Semi nude and pin up
| 35,189
|-
| 66
| Sex education
| 82,305
|-
| 67
| Shopping
| 2,746,388
|-
| 68
| Social networks
| 939,543
|-
| 69
| Spam or scam
| 4,972
|-
| 70
| Sports
| 1,457,906
|-
| 71
| Suicide
| 97
|-
| 72
| Technology and computers
| 1,146,051
|-
| 73
| Site under construction or not available
| 6,133,391
|-
| 74
| General - not porn
| 13,810,319
|-
| 75
| URL shortener
| 5,298
|-
| 76
| Vacation and travel
| 2,035,329
|-
| 77
| Vehicles
| 1,390,265
|-
| 78
| Violence
| 38,056
|-
| 79
| Virus or Spyware
| 92
|-
| 80
| Warez
| 40,357
|-
| 81
| Weapons
| 158,633
|-
| 82
| Web hosting
| 928,719
|-
| 83
| Web mail
| 67,095
|-
| 84
| Reference
| 214,191
|-
| 85
| Community and society
| 182,999
|-
| 86
| Software repository
| 28,626
|-
| 87
| Philosophy and psychology
| 243,552
|-
| 88
| History
| 219,300
|-
| 89
| Nonsense and time waste
| 93,215
|-
| 90
| Local IP
| 732
|-
| 91
| Swimsuits and underwear
| 90,082
|-
| 92
| Arts
| 657,403
|-
| 94
| Login page
| 91,546
|-
| 95
| Surveys and polls
| 49,482
|-
| 96
| Tobacco
| 58,511
|-
| 97
| ISP
| 11,581
|-
| 98
| Tracker
| 601,345
|-
| 99
| Bypass protection
| 1,626
|-
| 100
| Search block
| 23
|-
| 101
| Image search block
| 170,895
|-
| 102
| Desktop themes
| 8,093
|-
| 103
| Depress domain
| 45,216
|-
| 105
| Parenting and family
| 72,104
|-
| 106
| School cheats
| 5,586
|-
| 107
| Celebrity gossip
| 116,250
|-
| 108
| How to
| 120,011
|-
| 109
| Illegal
| 3,568
|-
| 110
| Recreation
| 155,734
|-
| 111
| Bookmarks
| 93
|-
| 112
| Money spam
| 2,049
|-
| 113
| Directories
| 4,770
|-
| 114
| Site_Graphic design
| 460,266
|-
| 115
| Weather
| 84,546
|-
| 116
| Knowledge
| 46,078
|-
| 117
| Kids entertainment
| 31,885
|-
| 118
| Nature
| 79,608
|-
| 119
| Diet
| 110,830
|-
| 120
| Eating disorders
| 5,934
|-
| 121
| Self help
| 97,576
|-
| 122
| Relationships
| 20,226
|-
| 123
| Paranormal
| 30,544
|-
| 124
| Images CDN
| 831
|-
| 125
| Images CDN Unknown
| 58,108
|-
| 126
| LGBT
| 8,028
|-
| 127
| Marketing or ads
| 38,303
|-
| 128
| Magazines
| 97,273
|-
| 129
| Forums
| 136,884
|-
| 130
| User generated content
| 50,143
|-
| 131
| Tele Communications
| 62,774
|-
| 132
| Gender specific
| 2,994
|-
| 134
| Crime
| 67,870
|-
| 135
| Person
| 57,588
|-
| 136
| Grief
| 1,164
|-
| 137
| Retirement
| 45,873
|-
| 138
| Other drugs
| 55,336
|-
| 139
| Pharmacy
| 32,823
|-
| 140
| Songs download
| 16,552
|-
| 141
| Lookup
| 27,041
|-
| 142
| Movies download
| 108,377
|-
| 143
| Consumer reviews
| 10,609
|-
| 144
| API
| 54,828
|-
| 145
| Legal movies
| 321
|-
| 146
| Legal songs
| 586
|-
| 147
| Bitcoin
| 44,205
|-
| 148
| Victim help
| 365
|-
| 149
| Rewards
| 6,355
|-
| 150
| Photography
| 266,413
|-
| 151
| Toys
| 132,693
|-
| 152
| Restaurant
| 314,390
|-
| 153
| Fitness
| 320,212
|-
| 154
| Contact sport
| 133,808
|-
| 155
| Dancing
| 46,838
|-
| 156
| Software
| 486,527
|-
| 157
| Programming
| 266,009
|-
| 158
| Registry cleaner
| 252
|-
| 159
| Online security
| 123,726
|-
| 160
| Real estate
| 748,244
|-
| 161
| Loans
| 128,878
|-
| 162
| Forex
| 35,878
|-
| 163
| Banks
| 288,773
|-
| 164
| Insurance
| 278,422
|-
| 165
| SEO
| 83,568
|-
| 166
| PPC
| 12,604
|-
| 167
| Supplements
| 23,209
|-
| 168
| URL Classification
| 490
|-
| 170
| Tatoo
| 30,449
|-
| 172
| Tactical equipment
| 4,667
|-
| 173
| Alternative medicine
| 216,521
|-
| 174
| AI
| 14,774
|-
| 175
| Comics
| 10,792
|-
| 176
| Manga
| 1,090
|}
Total domains: 123,062,565
Total classified domains: 78,794,494 (Total domains excluding DNS resolve errors and other errors)
Total unique domains: 110,669,917
Total unique classified domains: 67,267,623 (Total unique domains excluding DNS resolve errors and other errors)

Revision as of 15:05, 28 July 2021

Category change

  • Added Comics category
  • Added Manga category

Domain count and statistics

ID Name Domain count
1 Abortion and pregnancy 124,825
2 Ads 66,401
3 Adult 523,673
4 Adult dating 17,977
5 Alcohol 508,677
6 Astrology 61,348
7 Blogs 3,577,417
8 Books or comics 184,913
9 Business and services 6,382,548
10 CDN 1,024,233
11 Chats 168,710
12 Classifieds 120,327
13 Clothing and fashion 1,482,241
14 Cooking and food 1,874,017
15 Dating 111,082
16 Drugs 87,103
17 Education 1,111,115
18 Empty site 643,091
19 Entertainment 733,595
20 Error site can't be accessed 12,179,039
21 DNS error site can't be resolved 32,089,032
22 File hosting 65,612
23 Finance (Banks_Real estate_Insurance) 587,161
24 Gambling 367,524
25 Computer games 528,949
26 General (safe) 10,064
27 Government 93,267
28 Hacking 12,103
29 Hate 48,192
30 Hobbies 378,318
31 Home improvement 473,660
32 Humor 26,859
33 Hunting and fishing 112,941
34 Image and video hosting 105,655
35 Jobs 659,259
36 Kids safe 225
37 Legal 440,618
38 Life style and beauty 705,906
39 Link farm (no real content) 4,365,547
40 Local information 52,751
41 Medical 2,633,561
42 Military 27,103
43 Mixed adult 1,025,027
44 Mobile 273,401
45 Models 79,971
46 Music 1,139,889
47 News 1,847,323
49 Not child safe 41,077
50 Online drugs 44,652
51 Online marketing 484,654
52 Online video or audio 310,748
53 Pets and animals 403,989
54 Phishing 23
55 Politics 378,921
56 Porn 891,151
57 Internet portals 187,848
58 Profanity 39,409
59 Proxy 14,129
60 Religion 575,368
62 Science 303,406
63 Search engines 52,189
64 Sects 12,212
65 Semi nude and pin up 35,189
66 Sex education 82,305
67 Shopping 2,746,388
68 Social networks 939,543
69 Spam or scam 4,972
70 Sports 1,457,906
71 Suicide 97
72 Technology and computers 1,146,051
73 Site under construction or not available 6,133,391
74 General - not porn 13,810,319
75 URL shortener 5,298
76 Vacation and travel 2,035,329
77 Vehicles 1,390,265
78 Violence 38,056
79 Virus or Spyware 92
80 Warez 40,357
81 Weapons 158,633
82 Web hosting 928,719
83 Web mail 67,095
84 Reference 214,191
85 Community and society 182,999
86 Software repository 28,626
87 Philosophy and psychology 243,552
88 History 219,300
89 Nonsense and time waste 93,215
90 Local IP 732
91 Swimsuits and underwear 90,082
92 Arts 657,403
94 Login page 91,546
95 Surveys and polls 49,482
96 Tobacco 58,511
97 ISP 11,581
98 Tracker 601,345
99 Bypass protection 1,626
100 Search block 23
101 Image search block 170,895
102 Desktop themes 8,093
103 Depress domain 45,216
105 Parenting and family 72,104
106 School cheats 5,586
107 Celebrity gossip 116,250
108 How to 120,011
109 Illegal 3,568
110 Recreation 155,734
111 Bookmarks 93
112 Money spam 2,049
113 Directories 4,770
114 Site_Graphic design 460,266
115 Weather 84,546
116 Knowledge 46,078
117 Kids entertainment 31,885
118 Nature 79,608
119 Diet 110,830
120 Eating disorders 5,934
121 Self help 97,576
122 Relationships 20,226
123 Paranormal 30,544
124 Images CDN 831
125 Images CDN Unknown 58,108
126 LGBT 8,028
127 Marketing or ads 38,303
128 Magazines 97,273
129 Forums 136,884
130 User generated content 50,143
131 Tele Communications 62,774
132 Gender specific 2,994
134 Crime 67,870
135 Person 57,588
136 Grief 1,164
137 Retirement 45,873
138 Other drugs 55,336
139 Pharmacy 32,823
140 Songs download 16,552
141 Lookup 27,041
142 Movies download 108,377
143 Consumer reviews 10,609
144 API 54,828
145 Legal movies 321
146 Legal songs 586
147 Bitcoin 44,205
148 Victim help 365
149 Rewards 6,355
150 Photography 266,413
151 Toys 132,693
152 Restaurant 314,390
153 Fitness 320,212
154 Contact sport 133,808
155 Dancing 46,838
156 Software 486,527
157 Programming 266,009
158 Registry cleaner 252
159 Online security 123,726
160 Real estate 748,244
161 Loans 128,878
162 Forex 35,878
163 Banks 288,773
164 Insurance 278,422
165 SEO 83,568
166 PPC 12,604
167 Supplements 23,209
168 URL Classification 490
170 Tatoo 30,449
172 Tactical equipment 4,667
173 Alternative medicine 216,521
174 AI 14,774
175 Comics 10,792
176 Manga 1,090

Total domains: 123,062,565

Total classified domains: 78,794,494 (Total domains excluding DNS resolve errors and other errors)

Total unique domains: 110,669,917

Total unique classified domains: 67,267,623 (Total unique domains excluding DNS resolve errors and other errors)