Website classification categories: Difference between revisions
m (Barak moved page URL server categories to Website classification categories) |
No edit summary |
||
Line 62: | Line 62: | ||
The server can also extract the site's address from Google URL redirect, it uses this address when a user clicks on a search result. The server extract the target site and returns the category of it, this is needed for mobile devices. | The server can also extract the site's address from Google URL redirect, it uses this address when a user clicks on a search result. The server extract the target site and returns the category of it, this is needed for mobile devices. | ||
= Categories = | = URL Categories = | ||
Some categories like: image hosting, file hosting, social networks are to classify the sites only, but they don't classify the content per URL as there's no way to know if the picture or file contains adult or malicious content, the decision whether to block or allow those categories will be made according to your mission statement and parent decision. | Some categories like: image hosting, file hosting, social networks are to classify the sites only, but they don't classify the content per URL as there's no way to know if the picture or file contains adult or malicious content, the decision whether to block or allow those categories will be made according to your mission statement and parent decision. |
Revision as of 08:47, 4 September 2020
Categories for URL Classification service and URL Black List.
Search engines and photo hosting sites
The server supports detecting the search key phrase of various search engines or sites with search capabilities and classify the search result, which means you don't have to rely on safe search ability of the site (if it even exists).
In case site phrase is classified, the result will be composed of the parent site categories and categories of the search.
Supported sites are:
- Bing
- Yahoo
- Ask
- Aol
- Youtube
- Flickr
- Blip TV
- Soso
- Sogou
- Search.com
- Yandex
- Baidu
- Blekko
- Acesse
- Webopedia
- Dogpile
- Webcrawler
- Yippy
- DuckDuckGo
- Mahalo
- Photobucket
- Wiki.com
- Smugsmug
- Fotolog
- Twitpic
- Volunia
- EntireWeb
- Amfibi
- Lycos
- Info
- Excite
- GoodSearch
- MetaCrawler
- DeeperWeb
- Weheartit
- Naver
- So
- Soku
- Tuvaro
- Topsy
- Govome
- Globososo
- Daum
- Onet
- Goo
- Other popular Google based searches
The server can also extract the site's address from Google URL redirect, it uses this address when a user clicks on a search result. The server extract the target site and returns the category of it, this is needed for mobile devices.
URL Categories
Some categories like: image hosting, file hosting, social networks are to classify the sites only, but they don't classify the content per URL as there's no way to know if the picture or file contains adult or malicious content, the decision whether to block or allow those categories will be made according to your mission statement and parent decision.
Kids safe index:
- No - Contain content that is not appropriate for a child.
- Yes - Doesn't contain content that is not appropriate for a child.
- Depends - The category safety is determined by the view of the operator, for example some parents may choose to allow pirate sites, or require further filtering like search engine, or social sites.
- Mixed - The category contains both safe and unsafe sites.
- Danger - The category should be avoided even as an adult.
Contains nudity index:
- No - Doesn't contain any nude or partial nude pictures
- Light - No nude pictures, but can have pictures of people in underwear, bikinis, etc.
- Yes - Contains nude pictures
- Content isn't checked - Sites that either have self moderation (like youtube.com, facebook.com), or content isn't checked at all (like webmail)
- Maybe - Category warrants blocking and presence of pictures isn't relevant, or it's a CDN site and can serve any content.
ID | Name | Description | Kids safe | Contains nudity | Sample sites |
---|---|---|---|---|---|
1 | Abortion and pregnancy | Sites that talk about: pregnancy, abortion, pregnancy termination | No | No | midwiferytoday.com, caringpc.com |
2 | Ads | Sites that serve ads, or are an ads agency. | Depends | Maybe | adcash.com, paid.outbrain.com |
3 | Adult | Sites that contain adult content, either graphically or in text. | No | Maybe | discreetreports.com, lovehoney.co.uk |
4 | Adult dating | Sites that deal with adult dating (contains sexual content). | No | Maybe | adultfriendfinder.com, xdating.com |
5 | Alcohol | Sites that deal with Alcohol, this includes wine, winemaking and beer. | No | No | |
6 | Astrology | Sites that deal with Astrology and various cold reading methods. | Yes | No | |
7 | Blogs | Sites that are blogs, if the content of the site is not safe, it will be in another category. | Yes | No | |
8 | Books or comics | Sites that are about books or comics. | Yes | No | |
9 | Business and services | Sites belonging to a business or a service provider that doesn't fall under any of the other categories. | Yes | No | |
10 | CDN | CDN Sites, they serve content of others. | Depends | Maybe | |
11 | Chats | Sites that has online chats, or have chat applications. | Depends | No | |
12 | Classifieds | Classifieds sites, second hand sales/services. | Yes | No | |
13 | Clothing and fashion | Sites that are about clothing and fashion. | Yes | No | |
14 | Cooking and food | Sites that are about cooking, food, excluding restaurants. | Yes | No | |
15 | Dating | Dating sites. | No | No | |
16 | Drugs | Sites that are about illegal drugs. | No | Maybe | |
17 | Education | Sites that belong to: schools, kinder gardens, colleges and universities. | Yes | No | |
18 | Empty site | While scanning the site it didn't return any result, which means site can't be verified. | No | Maybe | |
19 | Entertainment | Sites about: Celebrity, gossip, movie reviews, entertainment (gossip, celebs), magazines, may contain streaming media, does not contain downloadable media. | Yes | No | |
20 | Error site can't be accessed | While scanning the site there was an error, which means site can't be verified. | No | Maybe | |
21 | DNS error site can't be resolved | Site can't be resolved | No | Maybe | |
22 | File hosting | Sites that allow users to host their files, files content isn't verified (may contain nudity or warez). | Depends | Maybe | |
23 | Finance (Banks_Real estate_Insurance) | Sites that are about: Financial information, Banking, Insurance, Banks, Real estate, Investing, Stock exchange, Forex, Credit, business plans and models. | Yes | No | |
24 | Gambling | Sites that have gambling games or gambling information (gambling addictions will be under health). | No | Maybe | |
25 | Computer games | Sites that are about computer games or online games (some games can be violent like GTA). | Depends | No | |
26 | General (safe) | No known category, but considered safe | Yes | No | |
27 | Government | Sites that belong to the government. | Yes | No | |
28 | Hacking | Sites that are about hacking and cracking. | No | No | |
29 | Hate | Sites that are about hate toward genders or race. | No | Maybe | |
30 | Hobbies | Sites that are about various type of hobbies. | Yes | No | |
31 | Home improvement | Sites about: home improvements, decorating and DIY sites. | Yes | No | |
32 | Humor | Sites with jokes or humor related content. | Yes | No | |
33 | Hunting and fishing | Sites that are about hunting and fishing. | Depends | No | |
34 | Image and video hosting | Sites that give the ability go host images, videos and image/video search engine. | Mixed | Maybe | |
35 | Jobs | Sites that are about: job offers, job search, freelancing. | Yes | No | |
36 | Kids safe | Sites that are just for kids and are safe (sites added to this category is only after human review) | Yes | No | |
37 | Legal | Sites that belong to lawyers and law firms, and sites that give legal advice or tips. | Yes | No | |
38 | Life style and beauty | Sites that talk about life style, beauty, personal care, personal grooming and fashion. | Depends | Light | |
39 | Link farm | Sites that has no value and contain various links that will generate the owner money, may contain pornography. | Danger | Maybe | |
40 | Local | Sites about local information (city information, state information, law enforcement), if the second category is news, then it's local news. | Yes | No | |
41 | Medical | Sites that talk about medical and health information. | Yes | No | |
42 | Military | Sites with .mil or military related | Depends | No | |
43 | Mixed adult | Sites that have mixed content, some safe and some not, this category can be treated for age 16+. | No | Yes | |
44 | Mobile | Sites that are about mobile devices and does not fit in any other category. | Yes | No | |
45 | Models | Sites that contains images and information about: models, models agency. | Depends | Light | |
46 | Music | Sites that are about music, lyrics, bands, musical instruments, may contain music download. | Yes | No | |
47 | News and magazines | News, magazines and newspaper sites. | Depends | No | |
48 | Internal category | Internal category | Depends | Maybe | |
49 | Not safe | No category found for site, but site was found to be not safe, usually because it uses "shady" advertisement that has unsafe content. | No | Maybe | |
50 | Online drugs | Sites that offer to sell drugs like Viagra, pain killers, narcotics, steroids. | No | Maybe | |
51 | Online marketing | Sites that offer online marketing, email marketing services or web analytics. | Yes | No | |
52 | Online video or audio | Sites that has streaming audio and video, will not contain porn sites, but some content may still be inappropriate, for example youtube.com | Depends | Maybe | |
53 | Pets and animals | Sites that talk about pets and animals | Yes | No | |
54 | Phishing | Sites that contain phishing and other content that is scam based. | Danger | Maybe | |
55 | Politics | Sites that are political opinion, politics, politics news, and protests. | Depends | No | |
56 | Porn | Sites that contain pornographic content. | No | Yes | |
57 | Portals | Sites that are portals or magazines that may contain number of categories (some may be related to fashion or intimate apparel) | Depends | Maybe | |
58 | Profanity | Sites that contain profanity | Depends | Maybe | |
59 | Proxy | Sites that contain proxy information to bypass web filters and other sorts of surfing limitations. | No | No | |
60 | Religion | Sites that about religion, spirituality and religion practices. | Yes | No | |
61 | Safe | No category found for site, but site was found to be safe. | Yes | No | |
62 | Science | Sites that are about science and mathematics. | Yes | No | |
63 | Search engines | Search engines sites, search result may contain unsafe content, and software vendor needs to handle it. | Depends | Maybe | |
64 | Sects | Sites that are about sects and cults. | No | Maybe | |
65 | Semi nude and pin up | Site that are about intimate fashion and apparel but in context of the images rather then shopping for them, also celebrity gossip with high percent of underwear and swimwear, this category can be treated for age 16+. | No | Maybe | |
66 | Sex education and sexuality | Sites that talk about sex educations and sexuality. | Depends | Maybe | |
67 | Shopping | Shopping and online auctions sites. | Yes | No | |
68 | Social networks | Sites that offer social networks service, may contain unsafe content, and software vendor needs to handle it. | Depends | Maybe | |
69 | Spam or scam | Sites that has no value, or trying to con the user. | Danger | Maybe | |
70 | Sports | Sports site, contains also Martial arts sites. | Yes | No | |
71 | Suicide | Sites that talk about suicide, suicide prevention or suicide prevention. | No | No | |
72 | Technology and computers | Sites that about: technology, computers and not under the other categories. | Yes | No | |
73 | Site under construction or not available | Sites that are under construction or returned an error response when checked. | No | Maybe | |
74 | General - not porn | Exact match could not be found, but it's not porn. | Depends | Maybe | |
75 | URL shortener | URL redirection or shortneres service sites. | Depends | You need to verify target URL | |
76 | Vacation and travel | Sites that talk about: travel, vacations and holidays. | Yes | No | |
77 | Vehicles | Sites that talk about: cars, boats, planes, bikes. | Yes | No | |
78 | Violence | Sites that contain violent content or extreme profanity. | No | Yes | |
79 | Virus infected | Sites that are infected with viruses. | Danger | Maybe | |
80 | Warez | Sites that contain: torrents, warez, software cracks, watch series and movie online without payment, warez sites may offer porn for download. | Depends | Maybe | |
81 | Weapons | Sites that talk and/or sell: weapons, guns, knives, body armor, tactical gear, survival gear, etc, and army memorabilia. | No | No | |
82 | Web hosting | Site belongs to web hosting companies | Yes | No | |
83 | Web mail | Sites that offer web mail services. | Depends | Content isn't checked | |
84 | Reference | Dictionary, maps, translation, general information sites. | Yes | No | |
85 | Community and society | Sites about: parenting, charity, community, motivational speakers, relationships, and personal coaches. | Yes | No | |
86 | Software | Legal software download sites. | Yes | No | |
87 | Philosophy and psychology | Sites about Philosophy and psychology. | Yes | No | |
88 | History | Sites about historical events and figures. | Yes | No | |
89 | Nonsense and time waste | Sites that are directories to humor, memes, movies and pictures that are mostly time waste and viral jokes, some sites will have a secondary category of Semi nude or Mixed nude because of their content. | Maybe | Maybe | |
90 | Local IP | Local IPs can't be classified. | Maybe | Maybe | |
91 | Swimsuits and underwear | Sites that sell or talk about swimsuits and underwear, these sites contain images of people wearing them. | Maybe | Maybe | |
92 | Arts | Sites about: arts, paintings. | Yes | No | |
93 | Actors and models | This category appears only when filtering search results in case it is classifieds as an actor/model. | Maybe | Maybe | |
94 | Login page | This page or site is part of a login or user management. | Maybe | Maybe | |
95 | Surveys and polls | Website that offer surveys and polls services. | Yes | No | |
96 | Tobacco | Sites that are about tobacco, smoking and cigarettes. | No | Maybe | |
97 | ISP | ISP sites, also maybe combined hosting/ISP site. | Yes | No | |
98 | Tracker | Sites that are tracking user behavior (web analytics). | Yes | No | |
99 | Bypass protection | Sites that are used to bypass parental controls software and components. | No | Maybe | |
100 | Search block | Used for search phrases only, this indicates the search should be blocked. | Maybe | Maybe | |
101 | Image block | Used for search results only, the sites may host bad images, usually an image hosting site. | Maybe | Maybe | |
102 | Desktop themes | Sites that offer: Screensavers, desktop themes, e cards, greeting cards. | Yes | No | |
103 | Depress domain | Sites that are about obituaries. | Maybe | No | |
104 | Depress page | Will only appear at page level classification, it indicates bad news (crime, disaster, violence). | Maybe | No | |
105 | Parenting and family | Sites that talk about parenting, may have parts which relates to sex education. | Maybe | No | |
106 | School cheats | Sites that offer ready made works for students, or custom work. | Maybe | No | |
107 | Celebrity gossip | Sites that are about celebrity gossip, if contains nudity, it will come with an additional category that indicates it. | Maybe | Maybe | |
108 | How to | Sites that are user generated content with "How to" guides, if contains adult content, it will come with an additional category that indicates it. | Maybe | Maybe | |
109 | Illegal | Sites that offer illegal products like fake IDs, diplomas, etc (sites for drugs, warez, weapons are under their own category). | No | Maybe | |
110 | Recreation | Sites that are about recreation topics which are not exactly sports and also spa and massage. | Yes | No | |
111 | Bookmarks | Sites that are a repository of bookmarks, can be a social bookmarking service as well. | Yes | No | |
112 | Money spam | Sites that deal with making money online, this niche is highly abused and sites in this category should be treated as possible spam/scam. | No | No | |
113 | Directories | Sites that directories, mostly of site index or articles and probably related to SEO, with little value to the visitor. | Maybe | Maybe | |
114 | Site_Graphic design | Sites that about sites/graphic creation and design, this may include services. | Yes | No | |
115 | Weather | Sites that talk about the weather | Yes | No | |
116 | Knowledge | Sites that provide general knowledge, or online courses | Yes | No | |
117 | KidsEntertainment | Sites that are entertainment for kids | Yes | No | |
118 | Nature | Sites that are about nature or the environment. | Yes | No | |
119 | Diet | Sites that are about: diet, weight loss and weight gain. | Yes | No | |
120 | Anorexy | Sites that are about: anorexy, bulemia, and eating disorders. | No | No | |
121 | SelfHelp | Sites that are about: self help, motivational speakers, meditation, relaxation. | Yes | No | |
122 | Relationships | Sites that talk about relationships and pickup but are not dating sites. | No | No | |
123 | Paranormal | Sites that talk about paranormal topics like: UFO, ghosts, conspiracy theory. | No | No | |
124 | Images CDN | CDN that contains safe images, but are not user generated (this is a manually controlled directory) | Yes | No | |
125 | Images CDN Unknown | CDN that contains images, but there's no way to tell which kind, only in the context of the web page | Maybe | Maybe | |
126 | LGBT | Sites that have a theme regarding LGBT (Lesbian, Gay, Bisexual, Transsexual), this can come as a primary category or as a descriptive category. | Maybe | Maybe | |
127 | Marketing or ads | Sites that ad agencies, and it's possible that the domain name also serves ads. | Yes | No | |
128 | Magazines | Magazines sites (could be online magazines or a site for offline magazines) | Yes | No | |
129 | Forums | Forums site. | Yes | No | |
130 | User generated content | Sites that contain user generated content which are not blogs or forums. | Yes | No | |
131 | Tele Communications | Home site of Tele Communications companies, which provide number of services such as: ISP, Cellular, Cable, Satellite, TV. | Yes | No | |
132 | Gender specific | Sites that have content aimed for a specific gender, for example, men's magazine, or women's portal. | Yes | No | |
133 | Annoyances | Sites that are annoying, mostly popups, this category is provided for PerPageSDK only. | Maybe | Maybe | |
134 | Crime | Sites that are about crime (either covering it, or giving crime instructions) | No | Maybe | |
135 | Person | Sites that are about a specific person (not applies to music, sports, entertainment related people) | Yes | No | |
136 | Grief | Sites that are about grief and loss. | No | No | |
137 | Retirement | Sites that are about retirement, and retirements homes. | Yes | No | |
138 | Other drugs | Sites that are about drugs that are not part of the Drugs Online drugs category, these are drugs that are legal. (because legality is different between countries, the decision is based on the views of the classifier, if you need an exact list of the drugs, contact us) | No | No | |
139 | Pharmacy | Online pharmacy sites. | No | No | |
140 | Songs download | Sites that offer songs/mp3 download (can be pirate site, if contains other pirated content it will marked as Warez instead) | Yes | No | |
141 | Lookup | Sites that offer various lookup and reverse lookup of: emails, domains, phone numbers | Yes | No | |
142 | Movies download | Sites that offer movies/series download or online streaming (can be pirate site, if contains other pirated content it will marked as Warez instead) | Yes | No | |
143 | Consumer reviews | Consumer and products review sites | Yes | No | |
144 | API | Hosts that are use as an API for software/browser, which don't have visible data. | Yes | No | |
145 | Legal movies | Sites that legally host/stream full length movies and series, this list is a manual list. | Yes | No | |
146 | Legal songs | Sites that legally host/stream music, this list is a manual list. | Yes | No | |
147 | Bitcoin | Bitcoin and other crypto currenct related sites | Yes | No | |
148 | Victim help | Sites that offer help to victims (rape, crime, etc) | Maybe | No | |
149 | Rewards | Sites that offer reward programs | Yes | No | |
150 | Photography | Sites belong to photographers or about photography | Yes | No | |
151 | Toys | Sites that are about children toys | Yes | No | |
152 | Restaurant | Sites that belong to restaurant or similar food establishments | Yes | No | |
153 | Fitness | Sites that are about fitness, like: yoga, bodybuilding, weightlifting | Yes | No | |
154 | Contact sport | Sites that are about contact sports, like: martial arts, wwe, ufc | Yes | No | |
155 | Dancing | Sites that are about dancing | Yes | No | |
156 | Software | Sites that belong to a software or software as a service, but not software repository which has its own category | Yes | No | |
157 | Programming | Sites that about programming, development languages or development frameworks | Yes | No | |
158 | Registry cleaner | Sites that belong to registry cleaners or uninstallers | Yes | No | |
159 | Online security | Sites that belong to security product like Anti Virus or firewall, or are about online security | Yes | No | |
160 | Real estate | Sites that are about real estate or house rentals | Yes | No | |
161 | Loans | Sites that offer: loans, mortgages, debt consolidation | Yes | No | |
162 | Forex | Sites that talk about or offer: Forex and binary options services | Yes | No | |
163 | Banks | Banking sites | Yes | No | |
164 | Insurnace | Sites that offer insurance | Yes | No | |
165 | Marketing SEO | Sites that are about SEO/SEM or offer such services | Yes | No | |
166 | Marketing PPC | Sites that are about PPC or offer such services | Yes | No | |
168 | URL Classification | Sites that are about URL Classification or offer such services | Yes | No | |
170 | Tatoo | Sites that are about tattoos or offer tattooing services | No | Yes | |
173 | Alternative medicine | Sites that are about alternative medicine | Yes | No | |
174 | AI | Sites that are about AI (artificial intelligence) or offer such services | Yes | No | |
247 | Upper level - content | Host classification could not be decided because either there's not enough data, host is under constructions or other reasons and received the classification of one of the next levels of the host. | Per host | Per host | |
248 | Not HTML | Content inspected is not HTML | Maybe | Maybe | |
253 | HostExt white list | This category exists only inside the SDK, it means the URL request extension will not be checked, or the site is white listed. | Yes | No |
Differences between categories
Porn vs adult
- Sites that are adult may not have pornographic images, or they are adult shopping (toys, clothes), erotic stories.
- Sites that are porn contain pornographic images and movies.
Mixed adult vs Semi nude and pin up
- Sites that are mixed adult have mixed content, images that are "almost" erotic or nude, but not 100% porn.
- Sites that are semi nude and pin up contain images of models/actors/people in underwear/swimsuits for the sake of the image rather then shopping.