Rate Answer Credibility
Query:
ugliest group of people in the world
Query Location:
San Jose,California
Answer:
Irish men and German women are the ugliest in the WORLD according to controversial dating website beautifulpeople.com which only attractive people are allowed to join. Irish men and German women are the 'ugliest in the world' according to a controversial dating app that only allows attractive people to join.Feb 17, 2020
Answer Url:
https://www.dailymail.co.uk/femail/article-8012643/Irish-men-German-wo...
Required: What is the credibility level of the Query? (How much credibility would a user expect to need from a Source Page for this Query?)
Required: Rate Answer Authority
Optional Feedback

Instructions
Web Source
Google
Bing
Instructions
The authority of an answer’s source is very important to a user, especially when the query is about a critical topic such as health issues, legal matters, finances, etc. In this task, we provide a User Query, an Answer to their query pulled from a webpage, and the Answer URL of the site the answer was pulled from.


Your task is to identify what level of credibility a user would expect for their query, then decide whether the shown answer is extracted from a credible enough source for a user to trust the answer to their query.

HitApp Steps
Credibility level Determine how important the credibility of the answer is to the user :
High-Impact: The query is about a sensitive topic for which the credibility of the answer is important and could impact the user greatly. Eg.: health, finances, legal information, etc...
Low-Impact: The query represents every-day question that can be answered by a reasonably authoritative source. There are also queries on topics which a user would not expect there to be institutions or authors having reputation in the topic (gossip, fan fiction, etc).
Check the source page: You need to spend time looking at the source page of the answer to determine the credibility of the page.
You can check the source page by clicking on the Answer URL or the Web Source tab on the top-right.
Make sure the page is still available. If the page is unavailable or a 404 error, select "Not Credible".
Investigate the Source Page to determine the credibility by investigating aspects of it such as:
How much authority the page has on the topic
The author of the site (if applicable)
Any references/sources listed
Note: If the source page is broken or returns an error (such as 404's, page not found, etc.) the final rating should be Not Credible.

[ONLY HIGH IMPACT QUERIES] Compare the credibility of the Source Page to the Search Results:
Once the credibility of the source page has been determined, look at the Google results tab and determine if there are any URLs with higher credibility in the search results.
Note: Even if two results are “Credible” according to the table, one URL can still be more credible than the other. For example, for the query “How to Install Microsoft 10” both Quora.com and Microsoft.com would be seen as “Credible” in the table above, but Microsoft.com would be the highest authority on the topic and would be seen as more credible
Select a rating using the table below:
Rating Descriptions
Detrimental

High-Risk/Impact

e.g., health, finances, legal information

Low-Risk/Impact

e.g., every-day questions, fan-fiction, gossip

Credible

Not Credible

Credible

Less Credible

Not Credible

The Answer or Source Page has Detrimental Content that we would not want to show the user. The categories below are further expanded upon in the “Detrimental Content” section below.

Hate
Adult
Gore or Profane
Unsafe
Sensitive
The Source Page is highly credible and there are no pages in the Search results that are more credible on the query topic.

Example:
Query: US Taxes
URL: IRS.gov

The Source Page is not credible enough for the query given and/or

There are pages in the Search Results that are more credible than the Source Page on the query topic.

Answer is from a highly credible or fairly credible source for the query topic.

Answer is from a low-credibility source for the topic

Answer is from a Source Page that is actively spammy, junky, misinformative, or otherwise harmful to the user. Additionally used for a Source Page with no credibility on the topic.

Detrimental Content
There are certain categories of content that we would not want to show users in the Answer or Source Page under any circumstances. If this type of content is found in the Answer or Source Page then the final rating should instantly be “Detrimental” regardless of any other factors. The categories for detrimental content are:

Hate: Hateful content that is targeted towards a person/group that shares a certain attribute such as gender, race, occupation, age, national origin, religion.
Adult: Content that is pornographic, suggestive, or sexualized
Gore: Overly-violent or profane content
Unsafe: Content which may steer someone towards hurting themselves or others such as suicide/self-harm, illegal drugs, or weapons.
Sensitive: Content related to controversies, conspiracies, misinformation, fake news, traumatic historical events, known hate entities, and social issues such related to health, religion, politics, and civics. This can change depending on the market.
Crime: Content that is seedy or illegal. This content will depend based on market/location.
It's important to remember that Queries involving the topics above will not automatically make a Hit "Detrimental", the Answer and/or Source Page must contain detrimental information for a final rating of "Detrimental". Facts on the above topics that come from reputable sources should be rated normally, even if it's about a topic listed above.

*** In order to see the search results on the right, you need to use Chrome browser, and install W5P Chrome Extension
*** If the query or answer is in a different language from the one marked in the title, For example, if the hitapp title is "Answer Freshness [EN]" but the answer is in Chinese, please choose "In Wrong Language". Also note that English Queries with English Answers should be judged as normal.