Screen capture of RSU Libraries' Evaluating Web Sources video tutorial. Click to view the tutorial.

 

The internet is a vast source of information, with new content being added every day, hour, minute, second.  With just a few keystrokes, we have access to a nearly infinite number of websites, news, images, video, and more.  It can be easy to find yourself overwhelmed with too much information; a sense of uncertainty which sites are worth clicking on, and which ones may be inaccurate, incomplete, or outdated.  This is why it is important to know how to assess a website in order to determine if it is a credible source before using its content for your research paper or project.

That's where the C.R.A.P. Test comes in handy.  Follow these simple guidelines when evaluating a web source, and you should be able to answer for yourself if a website is credible enough, or if you should pass it by and find a more superior resource.

Currency: Is the information in the article/website recent?

  • Depending on your chosen research topic, the recency of information can play a big part in determining if a source is credible or not.  For example, fast paced fields such as science or medicine often need very recent source material; often from within the last 3-5 years.
  • Is your topic more historically based?  Is the resource being evaluated something that was published during or shortly after the event being researched?

Reliability: Where does the information originate from?  Does the information found within the resource apply to your topic?

  • Is the source a primary source or a secondary source?
  • Does the author list their references?
  • Who published the article?  Are they a reputable publisher?
  • Has the material been vetted through a peer-review process?
  • Is the information in-depth, detailed, listing specifics about the topic, or is the information generic and vague, only using broad, generalized terms?
  • Does the information present two or more sides of the topic evenly, or is there an imbalance of information?

Authority: Who is the author of the article or web source?

  • Is the work credited to a specific author or group of authors, or is it posted anonymously?
  • Is the author a corporation or other organization?
  • Does the author list their credentials?

Purpose: What is the author's intent in publishing or posting this information?

  • Does the information contain bias?
  • Is the author's intent to inform, persuade, advertise, entertain, etc?
  • Does the author gain any benefit or profit from writing about the topic?

In addition to the CRAP test, there are some other things you might consider when evaluating the reliability of a web source.

What is the domain?  Is it a .com, .org, .gov, .edu?

  • .gov and .edu - In general, these domains are reliable sources.
  • .org - Be cautious with .org domains.  Pay close attention to whether or not the information present in the site contains any information bias or imbalance.
  • .com - A .com domain can go either way.  You will need to evaluate these with the CRAP test, or other similar method to determine it's credibility.

Does the author cite their sources?  A good, reliable source will always be transparent about where they got their own information.  Check the end of the article, or the bottom of the webpage, and see if you find a list of sources, or check for hyperlinks within the text that link out to the original source material.  If you are unable to locate anything resembling a clear list bibliography or reference list, try to find an alternate source that verifies the information.  (Don't forget to check if the alternate source passes the CRAP test, and has a visible citation list for their sources!)

Also, remember to pause and ask yourself "Could this website/news article/content be a work of satire?"  Fake news, satire, spoof news, and similar stories have grown in popularity in recent years.  It is vital to research success that you stop and ensure the piece(s) you cite are legitimate stories.  For more in-depth help with recognizing fake news, continue reading in the next section below.

False, Misleading, Clickbait-y, and/or Satirical “News” Sources

Tips for analyzing news sources:

  • Avoid websites that end in “lo” ex: Newslo. These sites take pieces of accurate information and then packaging that information with other false or misleading “facts” (sometimes for the purposes of satire or comedy).
  • Watch out for websites that end in “.com.co” as they are often fake versions of real news sources  
  • Watch out if known/reputable news sites are not also reporting on the story. Sometimes lack of coverage is the result of corporate media bias and other factors, but there should typically be more than one source reporting on a topic or event.
  • Odd domain names generally equal odd and rarely truthful news.
  • Lack of author attribution may, but not always, signify that the news story is suspect and requires verification.
  • Some news organizations are also letting bloggers post under the banner of particular news brands; however, many of these posts do not go through the same editing process (ex: BuzzFeed Community Posts, Kinja blogs, Forbes blogs).
  • Check the “About Us” tab on websites or look up the website on Snopes or Wikipedia for more information about the source.
  • Bad web design and use of ALL CAPS can also be a sign that the source you’re looking at should be verified and/or read in conjunction with other sources.
  • If the story makes you REALLY ANGRY it’s probably a good idea to keep reading about the topic via other sources to make sure the story you read wasn’t purposefully trying to make you angry (with potentially misleading or false information) in order to generate shares and ad revenue. Thanks to Ed Brayton for this tip!
  • If the website you’re reading encourages you to DOX individuals, it’s unlikely to be a legitimate source of news.
  • It’s always best to read multiple sources of information to get a variety of viewpoints and media frames. Sources such as The Daily Kos, The Huffington Post, and Fox News vacillate between providing important, legitimate, problematic, and/or hyperbolic news coverage, requiring readers and viewers to verify and contextualize information with other sources.
  • For more tips on analyzing the credibility and reliability of sources, please check out School Library Journal (they also provide an extensive list of media literacy resources) and the Digital Resource Center.

OpenSources Steps for Analyzing Websites:

Step 1:  Title/Domain Analysis. If words like “.wordpress” or “blogger” are in the domain that usually signifies it’s a personal blog rather than a news source. If slight variations of well known websites appear, such as “.com.co,” this is usually a sign that the website is fake version of a source. However, remember that foreign news organizations may have country-specific domains.

Step 2: About Us Analysis. I usually google every title/domain name/anyone listed in the “About Us” section to see if anyone has previously reported on the website (snopes, hoax-slayer, politifact, factcheck.org, etc.) or whether it has a wikipedia page or something similar detailing its background. This is useful for identifying and correctly interpreting lesser known and/or new websites that may be on the up-and-up, such as satirical sources or websites that are explicit about their political orientation.

Then I look for information about the credentials and backgrounds of affiliated writers (is it a content mill or do they pay their writers?), editors, publishers, and domain owners (who.is etc.). It’s also useful to see if the website has a “Legal” or “Disclaimer” section. Many satirical websites disclose this information in those sections.

A total lack of About Us, Contact US, or any other type of identifying information may mean that the website is not a legitimate source of information.

Step 3: Source Analysis. Does the website mention/link to a study or source? Look up the source/study. Do you think it’s being accurately reflected and reported? Are officials being cited? Can you confirm their quotes elsewhere? Some media literacy and critical scholars call this triangulation: Verify details, facts, quotes, etc. with multiple sources.

Step 4: Writing Style Analysis. Does the website follow AP Style Guide or another style guide? Typically, lack of style guide may indicate an overall lack of editing or fact-checking process. Does it frequently use ALL CAPS in headlines and/or body text? Does the headline or body of the text use words like WOW!, SLAUGHTER!, DESTROY!? This stylistic practice and these types of hyperbolic word choices are often used to create emotional responses with readers that is avoided in more traditional styles of journalism.

Step 5:  Aesthetic Analysis. Like the style-guide, many fake and questionable news sites utilize very bad design. Usually this means screens are cluttered with text and heavy-handed photoshopping or born digital images.

Step 6: Social Media Analysis.  Look up the website on Facebook. Do the headlines and posts rely on sensational or provocative language-- aka clickbait-- in order to attract attention and encourage likes, clickthroughs, and shares? Do the headlines and social media descriptions match or accurately reflect the content of the linked article? (this step isn’t particularly good at helping us find fake news, but it can help us identify other misleading news sources)

 

By considering all of these areas of information we can determine which category or categories a website may occupy, although all categorizations are by necessity open to discussion and revision.

 

Note: To view this document in full, including a list of over 900 websites that have been tagged as fake/satire/bias/conspiracy/rumor/clickbait/unreliable and more, click here.

 

 Creative Commons open source copyright logo

© 2016  by Melissa Zimdars*.

The work 'False, Misleading, Clickbait-y, and Satirical “News” Sources' is made  available  under a  Creative Commons

Attribution 4.0  International  License. To  view  a copy of  this license, visit http://creativecommons.org/licenses/by/4.0/

*Melissa Zimdars is an assistant professor of communication & media at Merrimack College.