Website classification categories

From URL Classification
Revision as of 13:32, 17 June 2019 by Barak (talk | contribs) (Created page with "Categories for [http://url.komodia.com URL Classification service] and [http://urlblacklist.komodia.com URL Black List]. = Search engines and photo hosting sites = The serve...")
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to navigation Jump to search

Categories for URL Classification service and URL Black List.

Search engines and photo hosting sites

The server supports detecting the search key phrase of various search engines or sites with search capabilities and classify the search result, which means you don't have to rely on safe search ability of the site (if it even exists).

In case site phrase is classified, the result will be composed of the parent site categories and categories of the search.

Supported sites are:

  • Google
  • Bing
  • Yahoo
  • Ask
  • Aol
  • Youtube
  • Flickr
  • Pinterest
  • Blip TV
  • Soso
  • Sogou
  • Search.com
  • Yandex
  • Baidu
  • Blekko
  • Acesse
  • Webopedia
  • Dogpile
  • Webcrawler
  • Yippy
  • DuckDuckGo
  • Mahalo
  • Photobucket
  • Wiki.com
  • Smugsmug
  • Fotolog
  • Twitpic
  • Volunia
  • EntireWeb
  • Amfibi
  • Lycos
  • Info
  • Excite
  • GoodSearch
  • MetaCrawler
  • DeeperWeb
  • Weheartit
  • Naver
  • So
  • Soku
  • Tuvaro
  • Topsy
  • Govome
  • Globososo
  • Daum
  • Onet
  • Goo
  • Other popular Google based searches

Google

The server can also extract the site's address from Google URL redirect, it uses this address when a user clicks on a search result. The server extract the target site and returns the category of it, this is needed for mobile devices.

Categories

Some categories like: image hosting, file hosting, social networks are to classify the sites only, but they don't classify the content per URL as there's no way to know if the picture or file contains adult or malicious content, the decision whether to block or allow those categories will be made according to your mission statement and parent decision.

Kids safe index:

  • No - Contain content that is not appropriate for a child.
  • Yes - Doesn't contain content that is not appropriate for a child.
  • Depends - The category safety is determined by the view of the operator, for example some parents may choose to allow pirate sites, or require further filtering like search engine, or social sites.
  • Mixed - The category contains both safe and unsafe sites.
  • Danger - The category should be avoided even as an adult.


Contains nudity index:

  • No - Doesn't contain any nude or partial nude pictures
  • Light - No nude pictures, but can have pictures of people in underwear, bikinis, etc.
  • Yes - Contains nude pictures
  • Content isn't checked - Sites that either have self moderation (like youtube.com, facebook.com), or content isn't checked at all (like webmail)
  • Maybe - Category warrants blocking and presence of pictures isn't relevant, or it's a CDN site and can serve any content.
ID Name Description Kids safe Contains nudity Sample sites
1 Abortion and pregnancy Sites that talk about: pregnancy, abortion, pregnancy termination No No midwiferytoday.com, caringpc.com
2 Ads Sites that serve ads, or are an ads agency. Depends Maybe adcash.com, paid.outbrain.com
3 Adult Sites that contain adult content, either graphically or in text. No Maybe discreetreports.com, lovehoney.co.uk
4 Adult dating Sites that deal with adult dating (contains sexual content). No Maybe adultfriendfinder.com, xdating.com
5 Alcohol Sites that deal with Alcohol, this includes wine, winemaking and beer. No No
6 Astrology Sites that deal with Astrology and various cold reading methods. Yes No
7 Blogs Sites that are blogs, if the content of the site is not safe, it will be in another category. Yes No
8 Books or comics Sites that are about books or comics. Yes No
9 Business and services Sites belonging to a business or a service provider that doesn't fall under any of the other categories. Yes No
10 CDN CDN Sites, they serve content of others. Depends Maybe
11 Chats Sites that has online chats, or have chat applications. Depends No
12 Classifieds Classifieds sites, second hand sales/services. Yes No
13 Clothing and fashion Sites that are about clothing and fashion. Yes No
14 Cooking and food Sites that are about cooking, food, excluding restaurants. Yes No
15 Dating Dating sites. No No
16 Drugs Sites that are about illegal drugs. No Maybe
17 Education Sites that belong to: schools, kinder gardens, colleges and universities. Yes No
18 Empty site While scanning the site it didn't return any result, which means site can't be verified. No Maybe
19 Entertainment Sites about: Celebrity, gossip, movie reviews, entertainment (gossip, celebs), magazines, may contain streaming media, does not contain downloadable media. Yes No
20 Error site can't be accessed While scanning the site there was an error, which means site can't be verified. No Maybe
21 DNS error site can't be resolved Site can't be resolved No Maybe
22 File hosting Sites that allow users to host their files, files content isn't verified (may contain nudity or warez). Depends Maybe
23 Finance (Banks_Real estate_Insurance) Sites that are about: Financial information, Banking, Insurance, Banks, Real estate, Investing, Stock exchange, Forex, Credit, business plans and models. Yes No
24 Gambling Sites that have gambling games or gambling information (gambling addictions will be under health). No Maybe
25 Computer games Sites that are about computer games or online games (some games can be violent like GTA). Depends No
26 General (safe) No known category, but considered safe Yes No
27 Government Sites that belong to the government. Yes No
28 Hacking Sites that are about hacking and cracking. No No
29 Hate Sites that are about hate toward genders or race. No Maybe
30 Hobbies Sites that are about various type of hobbies. Yes No
31 Home improvement Sites about: home improvements, decorating and DIY sites. Yes No
32 Humor Sites with jokes or humor related content. Yes No
33 Hunting and fishing Sites that are about hunting and fishing. Depends No
34 Image and video hosting Sites that give the ability go host images, videos and image/video search engine. Mixed Maybe
35 Jobs Sites that are about: job offers, job search, freelancing. Yes No
36 Kids safe Sites that are just for kids and are safe (sites added to this category is only after human review) Yes No
37 Legal Sites that belong to lawyers and law firms, and sites that give legal advice or tips. Yes No
38 Life style and beauty Sites that talk about life style, beauty, personal care, personal grooming and fashion. Depends Light
39 Link farm Sites that has no value and contain various links that will generate the owner money, may contain pornography. Danger Maybe
40 Local Sites about local information (city information, state information, law enforcement), if the second category is news, then it's local news. Yes No
41 Medical Sites that talk about medical and health information. Yes No
42 Military Sites with .mil or military related Depends No
43 Mixed adult Sites that have mixed content, some safe and some not, this category can be treated for age 16+. No Yes
44 Mobile Sites that are about mobile devices and does not fit in any other category. Yes No
45 Models Sites that contains images and information about: models, models agency. Depends Light
46 Music Sites that are about music, lyrics, bands, musical instruments, may contain music download. Yes No
47 News and magazines News, magazines and newspaper sites. Depends No
48 Internal category Internal category Depends Maybe
49 Not safe No category found for site, but site was found to be not safe, usually because it uses "shady" advertisement that has unsafe content. No Maybe
50 Online drugs Sites that offer to sell drugs like Viagra, pain killers, narcotics, steroids. No Maybe
51 Online marketing Sites that offer online marketing, email marketing services or web analytics. Yes No
52 Online video or audio Sites that has streaming audio and video, will not contain porn sites, but some content may still be inappropriate, for example youtube.com Depends Maybe
53 Pets and animals Sites that talk about pets and animals Yes No
54 Phishing Sites that contain phishing and other content that is scam based. Danger Maybe
55 Politics Sites that are political opinion, politics, politics news, and protests. Depends No
56 Porn Sites that contain pornographic content. No Yes
57 Portals Sites that are portals or magazines that may contain number of categories (some may be related to fashion or intimate apparel) Depends Maybe
58 Profanity Sites that contain profanity Depends Maybe
59 Proxy Sites that contain proxy information to bypass web filters and other sorts of surfing limitations. No No
60 Religion Sites that about religion, spirituality and religion practices. Yes No
61 Safe No category found for site, but site was found to be safe. Yes No
62 Science Sites that are about science and mathematics. Yes No
63 Search engines Search engines sites, search result may contain unsafe content, and software vendor needs to handle it. Depends Maybe
64 Sects Sites that are about sects and cults. No Maybe
65 Semi nude and pin up Site that are about intimate fashion and apparel but in context of the images rather then shopping for them, also celebrity gossip with high percent of underwear and swimwear, this category can be treated for age 16+. No Maybe
66 Sex education and sexuality Sites that talk about sex educations and sexuality. Depends Maybe
67 Shopping Shopping and online auctions sites. Yes No
68 Social networks Sites that offer social networks service, may contain unsafe content, and software vendor needs to handle it. Depends Maybe
69 Spam or scam Sites that has no value, or trying to con the user. Danger Maybe
70 Sports Sports site, contains also Martial arts sites. Yes No
71 Suicide Sites that talk about suicide, suicide prevention or suicide prevention. No No
72 Technology and computers Sites that about: technology, computers and not under the other categories. Yes No
73 Site under construction or not available Sites that are under construction or returned an error response when checked. No Maybe
74 General - not porn Exact match could not be found, but it's not porn. Depends Maybe
75 URL shortener URL redirection or shortneres service sites. Depends You need to verify target URL
76 Vacation and travel Sites that talk about: travel, vacations and holidays. Yes No
77 Vehicles Sites that talk about: cars, boats, planes, bikes. Yes No
78 Violence Sites that contain violent content or extreme profanity. No Yes
79 Virus infected Sites that are infected with viruses. Danger Maybe
80 Warez Sites that contain: torrents, warez, software cracks, watch series and movie online without payment, warez sites may offer porn for download. Depends Maybe
81 Weapons Sites that talk and/or sell: weapons, guns, knives, body armor, tactical gear, survival gear, etc, and army memorabilia. No No
82 Web hosting Site belongs to web hosting companies Yes No
83 Web mail Sites that offer web mail services. Depends Content isn't checked
84 Reference Dictionary, maps, translation, general information sites. Yes No
85 Community and society Sites about: parenting, charity, community, motivational speakers, relationships, and personal coaches. Yes No
86 Software Legal software download sites. Yes No
87 Philosophy and psychology Sites about Philosophy and psychology. Yes No
88 History Sites about historical events and figures. Yes No
89 Nonsense and time waste Sites that are directories to humor, memes, movies and pictures that are mostly time waste and viral jokes, some sites will have a secondary category of Semi nude or Mixed nude because of their content. Maybe Maybe
90 Local IP Local IPs can't be classified. Maybe Maybe
91 Swimsuits and underwear Sites that sell or talk about swimsuits and underwear, these sites contain images of people wearing them. Maybe Maybe
92 Arts Sites about: arts, paintings. Yes No
93 Actors and models This category appears only when filtering search results in case it is classifieds as an actor/model. Maybe Maybe
94 Login page This page or site is part of a login or user management. Maybe Maybe
95 Surveys and polls Website that offer surveys and polls services. Yes No
96 Tobacco Sites that are about tobacco, smoking and cigarettes. No Maybe
97 ISP ISP sites, also maybe combined hosting/ISP site. Yes No
98 Tracker Sites that are tracking user behavior (web analytics). Yes No
99 Bypass protection Sites that are used to bypass parental controls software and components. No Maybe
100 Search block Used for search phrases only, this indicates the search should be blocked. Maybe Maybe
101 Image block Used for search results only, the sites may host bad images, usually an image hosting site. Maybe Maybe
102 Desktop themes Sites that offer: Screensavers, desktop themes, e cards, greeting cards. Yes No
103 Depress domain Sites that are about obituaries. Maybe No
104 Depress page Will only appear at page level classification, it indicates bad news (crime, disaster, violence). Maybe No
105 Parenting and family Sites that talk about parenting, may have parts which relates to sex education. Maybe No
106 School cheats Sites that offer ready made works for students, or custom work. Maybe No
107 Celebrity gossip Sites that are about celebrity gossip, if contains nudity, it will come with an additional category that indicates it. Maybe Maybe
108 How to Sites that are user generated content with "How to" guides, if contains adult content, it will come with an additional category that indicates it. Maybe Maybe
109 Illegal Sites that offer illegal products like fake IDs, diplomas, etc (sites for drugs, warez, weapons are under their own category). No Maybe
110 Recreation Sites that are about recreation topics which are not exactly sports and also spa and massage. Yes No
111 Bookmarks Sites that are a repository of bookmarks, can be a social bookmarking service as well. Yes No
112 Money spam Sites that deal with making money online, this niche is highly abused and sites in this category should be treated as possible spam/scam. No No
113 Directories Sites that directories, mostly of site index or articles and probably related to SEO, with little value to the visitor. Maybe Maybe
114 Site_Graphic design Sites that about sites/graphic creation and design, this may include services. Yes No
115 Weather Sites that talk about the weather Yes No
116 Knowledge Sites that provide general knowledge, or online courses Yes No
117 KidsEntertainment Sites that are entertainment for kids Yes No
118 Nature Sites that are about nature or the environment. Yes No
119 Diet Sites that are about: diet, weight loss and weight gain. Yes No
120 Anorexy Sites that are about: anorexy, bulemia, and eating disorders. No No
121 SelfHelp Sites that are about: self help, motivational speakers, meditation, relaxation. Yes No
122 Relationships Sites that talk about relationships and pickup but are not dating sites. No No
123 Paranormal Sites that talk about paranormal topics like: UFO, ghosts, conspiracy theory. No No
124 Images CDN CDN that contains safe images, but are not user generated (this is a manually controlled directory) Yes No
125 Images CDN Unknown CDN that contains images, but there's no way to tell which kind, only in the context of the web page Maybe Maybe
126 LGBT Sites that have a theme regarding LGBT (Lesbian, Gay, Bisexual, Transsexual), this can come as a primary category or as a descriptive category. Maybe Maybe
127 Marketing or ads Sites that ad agencies, and it's possible that the domain name also serves ads. Yes No
128 Magazines Magazines sites (could be online magazines or a site for offline magazines) Yes No
129 Forums Forums site. Yes No
130 User generated content Sites that contain user generated content which are not blogs or forums. Yes No
131 Tele Communications Home site of Tele Communications companies, which provide number of services such as: ISP, Cellular, Cable, Satellite, TV. Yes No
132 Gender specific Sites that have content aimed for a specific gender, for example, men's magazine, or women's portal. Yes No
133 Annoyances Sites that are annoying, mostly popups, this category is provided for PerPageSDK only. Maybe Maybe
134 Crime Sites that are about crime (either covering it, or giving crime instructions) No Maybe
135 Person Sites that are about a specific person (not applies to music, sports, entertainment related people) Yes No
136 Grief Sites that are about grief and loss. No No
137 Retirement Sites that are about retirement, and retirements homes. Yes No
138 Other drugs Sites that are about drugs that are not part of the Drugs Online drugs category, these are drugs that are legal. (because legality is different between countries, the decision is based on the views of the classifier, if you need an exact list of the drugs, contact us) No No
139 Pharmacy Online pharmacy sites. No No
140 Songs download Sites that offer songs/mp3 download (can be pirate site, if contains other pirated content it will marked as Warez instead) Yes No
141 Lookup Sites that offer various lookup and reverse lookup of: emails, domains, phone numbers Yes No
142 Movies download Sites that offer movies/series download or online streaming (can be pirate site, if contains other pirated content it will marked as Warez instead) Yes No
143 Consumer reviews Consumer and products review sites Yes No
144 API Hosts that are use as an API for software/browser, which don't have visible data. Yes No
145 Legal movies Sites that legally host/stream full length movies and series, this list is a manual list. Yes No
146 Legal songs Sites that legally host/stream music, this list is a manual list. Yes No
147 Bitcoin Bitcoin and other crypto currenct related sites Yes No
148 Victim help Sites that offer help to victims (rape, crime, etc) Maybe No
149 Rewards Sites that offer reward programs Yes No
150 Photography Sites belong to photographers or about photography Yes No
151 Toys Sites that are about children toys Yes No
152 Restaurant Sites that belong to restaurant or similar food establishments Yes No
153 Fitness Sites that are about fitness, like: yoga, bodybuilding, weightlifting Yes No
154 Contact sport Sites that are about contact sports, like: martial arts, wwe, ufc Yes No
155 Dancing Sites that are about dancing Yes No
156 Software Sites that belong to a software or software as a service, but not software repository which has its own category Yes No
157 Programming Sites that about programming, development languages or development frameworks Yes No
158 Registry cleaner Sites that belong to registry cleaners or uninstallers Yes No
159 Online security Sites that belong to security product like Anti Virus or firewall, or are about online security Yes No
160 Real estate Sites that are about real estate or house rentals Yes No
161 Loans Sites that offer: loans, mortgages, debt consolidation Yes No
162 Forex Sites that talk about or offer: Forex and binary options services Yes No
163 Banks Banking sites Yes No
164 Insurnace Sites that offer insurance Yes No
247 Upper level - content Host classification could not be decided because either there's not enough data, host is under constructions or other reasons and received the classification of one of the next levels of the host. Per host Per host
248 Not HTML Content inspected is not HTML Maybe Maybe
253 HostExt white list This category exists only inside the SDK, it means the URL request extension will not be checked, or the site is white listed. Yes No

Differences between categories

Porn vs adult

  • Sites that are adult may not have pornographic images, or they are adult shopping (toys, clothes), erotic stories.
  • Sites that are porn contain pornographic images and movies.

Mixed adult vs Semi nude and pin up

  • Sites that are mixed adult have mixed content, images that are "almost" erotic or nude, but not 100% porn.
  • Sites that are semi nude and pin up contain images of models/actors/people in underwear/swimsuits for the sake of the image rather then shopping.