# Tools for finding information on the internet

*Edit 2023-05-09: I recorded a* [*presentation*](https://www.youtube.com/watch?v=pV28lxB6-bk) *for EA Software Engineers about this post. In it, I demonstrate each of the tools and discuss some extra ones at the end, namely content blockers, userscripts, and alternative front-end websites.*

Isn't the internet such a magically useful tool? Thirty years ago, if you wanted to know how many plays Shakespeare wrote, you would have to physically walk to your local library and find a relevant book. Now, you can find [the answer](https://www.google.com/search?q=How+many+plays+did+Shakespeare+write%3F) in less than ten seconds, at any time, wherever you are.

However, the internet is not a truthful, superintelligent oracle. Rather, it's a dangerous jungle of knowledge you must learn to navigate if you wish to find the truth. Good information is censored, hidden behind paywalls or within piles of spam, and difficult to differentiate from untrustworthy information. This post won't be a complete guide on how to navigate the world wide web of knowledge, but it will give you some tools I've discovered over the years that you can throw in your digital rucksack to aid your journey.

Search engines
--------------

*   The great internet sage [Gwern Branwen](https://gwern.net) wrote [an advanced guide](https://gwern.net/Search) on finding ref­er­ences, pa­pers, and books on­line.
*   The search engines [Brave Search](https://search.brave.com/) and [Kagi](https://kagi.com/) have the features ["Goggles"](https://search.brave.com/help/goggles) and ["Lenses"](https://help.kagi.com/kagi/features/lenses.html) respectively, which are presets that filter or re-rank entire categories of websites in your results.
*   [SearXNG](https://github.com/searxng/searxng) is a highly customizable internet [metasearch engine](https://en.wikipedia.org/wiki/Metasearch_engine).
*   [Perplexity](https://perplexity.ai) uses [natural language processing](https://en.wikipedia.org/wiki/Natural_language_processing) to answer your query with a paragraph (with sources) and allows you to ask followup questions.
*   [Metaphor](https://metaphor.systems) allows you to find websites by writing creative and long-form prompts, also using NLP.
*   [Elicit](https://elicit.org/) is a research assistant that helps you find relevant research papers, also using NLP.

Bypassing restrictions
----------------------

Sometimes you know exactly where to find a piece of information, but it's locked behind a paywall or deleted from the internet.

*   [Unddit](https://www.unddit.com/) displays deleted comments and posts on Reddit.
*   [Internet Archive](https://archive.org/) is a non-profit library of free books, movies, websites, et cetera. It's famous for the [Wayback Machine](https://web.archive.org/), which displays past archived snapshots of a given URL.
*   [Bypass Paywalls](https://github.com/iamadamdev/bypass-paywalls-chrome) is a browser extension to help bypass paywalls on selected sites.
*   The subreddit [r/piracy](https://www.reddit.com/r/Piracy/) has a [wiki](https://www.reddit.com/r/Piracy/wiki/index/) with loads of resources on obtaining copyrighted material for free.
*   [Anna's Archive](https://en.wikipedia.org/wiki/Anna%27s_Archive) is a [shadow library](https://en.wikipedia.org/wiki/Shadow_library) [metasearch engine](https://en.wikipedia.org/wiki/Metasearch_engine) that aggregates results from websites that host copyrighted books, academic papers, magazines, et cetera.

Trustworthy sources
-------------------

It is particularly frustrating to find trustworthy knowledge about certain topics because of misaligned incentives: researching which product to buy or which supplements actually work is *hard* because everyone's trying to sell you something.

*   [Consumer Reports](https://www.consumerreports.org/) independently tests consumer products and gives in-depth recommendations. It does not rely on affiliate commissions.
*   [Examine](https://examine.com/) is a database of research about nutrition and supplements that has no industry ties, sponsorships, or ads.