skysight-inc/HackerNews huggingface dataset:
The only way of solving this I can think of is sending new URL notifications to Google - if not sending the entire HTML content as well. Without the content it'd be open to abuse, and I can't any way to scale it - but then I'm not a Google engineer ;)
The work week is just starting on the east coast of the US and this has already dropped to 123rd place. Maybe it wasn't such a good idea to post it over the weekend, particularly a holiday weekend.

On the other hand, it got more posts than last month's, so maybe I'm wrong.
The Windows Power User Compendium
I am not a number, I am a classy hack
It looks like the biggest thing that efreedom.com (the most prolific stackoverflow mirror) does to rank higher in google searches is put the category as the first word in the title. What stackoverflow titles as "How do I use MediaRecorder to record video without causing a ..." efreedom titles as "Android: How do I use MediaRecorder to record video without causing a ...". So when I search for "android mediarecorder segmentation fault" all other things being equal efreedom wins.
From Lehrer's article: "Why do we overeat? This isn't just a problem on Thanksgiving, of course: More than a third of Americans are obese, which means that we eat way too much every day."

Regardless, Taubes wasn't pointing out that calorie counting fails on a once a year gorging incident, he was discussing a daily increase in intake. Calorie counting works pretty well for such things.

Time will tell, of course, but I'm betting that in the end he wins the calorie counting argument, and the idea of counting all calories as equal regardless of source won't last.

If that's all he is arguing, then he is doing nothing but pushing mainstream nutrition science. But if that were what he is doing, why mislead people about what calorie counting actually claims? Why not show the actual claims of calorie counting, and then show how they can be 10-20% off in some cases?

By the way, every single sports medicine textbook already does this.
Quite a hyperbole for a prank which was fairly limited in scale:

http://bigthink.com/ideas/24685.
It's certain that annoying gadgets such as "Instant" reflect poorly on Google priorities.

The mission of Google is to help users find stuff, not generate the maximum possible number of ad impressions per query (which would be quite short-sighted).

But, is it really getting worse? It's never been possible to use Google effectively to research dishwashers. Never. I remember using a Firefox extension to block specific domains from Google search for a long time (it's now called "OptimizeGoogle" but had another name before that).

Dishwashers aside, I still find Google pretty effective.

Jeff's post starts with a chart that shows that 88.2% of SO's traffic comes from Google; if Google was that bad, wouldn't users start to use something else? Where is the increase in traffic from Bing (0.9% from the same chart!)? Where's the nascent but so powerful traffic from blekko...??!?
Or use a GC that doesn't need to stop the world. (Or at least only does so for very small intervals.)
The example for "If the implementation is hard to explain, it's a bad idea." was very enlightening.

I always felt Ruby was a bit too irregular for my taste. Now I know why.

On the Cucumber thing, there is something similar in Pyccuracy. The Yahoo office in São Paulo is using it a lot.
The reason they're coloured like that is that you can get to the pale red (0%-3%) by putting you money is much safer vehicles like term deposits or bonds. If you're getting less than 3% out, stocks aren't worth it.
Stuxnet’s code provides a jump-start for a new generation of cyber weapons.
Social Media Communication Etiquette Tips
That seems good -- but I can imagine Google preferring to crawl the page, rather than receive it by API (so it's more likely to be what the user's going to see).

I think Google can handle the scaling problem; one not-great solution: ignore notifications except for those from people who are being scraped and need it.

Still, it's kind of a shame that webmasters have to worry about any of this.
If there was a pill with similar effects, you bet that everybody would be forced to take it.
Counterpoint: Arthur Andersen
Anyone who is a power user can simply add the icon back.
Benjamin Pierce has a course on the mathematical theory of programming languages, using the Coq Proof Assistant:

http://www.cis.upenn.edu/~bcpierce/sf/toc.html

Adam Chlipala's 'Certified Programming With Dependent Types' is a textbook about practical engineering with the Coq proof assistant. The focus is on building programs with proofs of correctness, using dependent types and scripted proof automation:

http://adam.chlipala.net/cpdt/
From a cynical point of view it seems to me that Google doesn't mind one bit if you have to click through 5 pages of links or modify your search query a few times. It's all page hits/ad impressions for them. Since there's very little competition in search they don't have to worry much about people going elsewhere.
Đặt mật khẩu cho router
Extrapolation is such a tiring business. Google is constantly changing and developing. How can you make generalizing comments about the future without knowing what they're working on?

For future reference, replace Google by pretty much anything.
If there are (or will be) investors willing to invest at the initial IPO price, how can you say that price is going to be 'artificially high'?

The IPO investors, themselves will be buying in the hope of making a gain, if their analysis/forecasts/judgement is wrong - it won't be Goldman that screwed them, it will be failure of their own judgement. And also their own willingness to join to 'bubble' to make a gain.

Also, if Goldman are the underwriters of the IPO, and they fail to sell the shares at the 'artificially high' price, they will have to take on the shares themselves. If such a high profile IPO is not fully subscribed, it won't reflect well on Goldman, so setting an artificially high price, is not in their interest, but setting a marketable price is.

Also empirical evidence suggests IPO's tend to be underpriced as opposed to over priced, to allow for gains on day one. (see http://en.wikipedia.org/wiki/Initial_public_offering#pricing)

With Goldman themselves having $450m in facebook, this also adds some credibility come IPO time, as GS themselves will have 'skin in the game'.
Whenever I find an efreedom article linking back to Stackoverflow, its on the first page.

The original stackoverflow article on the other hand is on page 3 or 5 or greater.

I'm not sure what Stackoverflow is doing, but in this case efreedom is providing me a service by making this content easily found in a search engine. Sure its one more click, but in my mind the alternative is never being able to find the SO article at all.

My workflow involves looking at multiple articles, so I can't simply put 'site: stackoverflow.com' into my search.
What do you mean "lately"? This has been going on for a long time; just search Hacker News for entries related to sluggish performance on YouTube and Gmail for example.

Their search being criticized for reasons different that made people switch to DuckDuckGo are, however, somewhat novel.
No I did mean curated. You bring up one of the key objections, with the web growing at the rate it is how do you keep up with curation? and I do have several ideas (but no pat single answer)

- Google has effectively a cache of the web

- These are the people who have figured out how to run rings around large data sets - MapReduce, BigTable, Colossus, etc

- there are aspects of information provenance that can help fix some problems (and having a snapshot of the web should help)

- Crowdsource some of the curation to improve quality

- INVEST MORE in SEARCH and drop some of the other distractions

- Resolve the basic conflict of interest with needing Ads to feed the bottom line but needing web users to use Google to get higher quality ad-free results

- Few other more focused ideas
(Really need to punch up a blog post soon :))
How do companies like this get funding?
Selling a product that doesn't work.
It's not a very difficult problem to solve. 95% of the content-farm spam comes from a few domains. In the same way that spam-blacklists have proved to be the most-effective way to combat e-mail spam, Google just needs to decide to shut these content-farms out. They don't need to do anything sophisticated like tweak their algorithm... just shut them out. The fact that it hasn't been done yet suggests to me that Google doesn't want to.
An easy easy to get better results for searches when looking for reviews as well a getting up to date content for searches has become my personal goal for unscatter.com. My first piece is up, using the blekko api. I will be adding more search filters powered by different apis in the future. At the moment it's basically a wrapper around the blekko api I admit but already useful for searching for iphone 4 cases I think. http://www.unscatter.com/search/?q=Iphone%204%20case&f=r...
Maze Generation: Kruskal's Algorithm
As noted (towards the end of the article): correlation does not imply causation.
The projection of as complex and multidimensional a thing as political views onto a one-dimensional left-right or liberal-conservative axis is necessarily an oversimplification. For example, would libertarians be classified as conservatives using this analysis because of their free-market emphasis? Would big-government neocons be classified as liberals because of their fondness for big government? If that is the case, I expect that a lot of "lefties" and "liberals" would demonstrate a "right-wing" or "conservative" mindset (and vice versa) if they participated in a similar examination.
Exactly what I expected when I clicked the article.

kb
That seems good -- but I can imagine Google preferring to crawl the page, rather than receive it by API

I'd agree with you, but can think of edge cases where naughty sites A, B and C submit new URLs within an arbitrary amount of time of the new content being published. In that case there'd be no way for Google to tell who published the content first other than to have a big list of original content publishers - and I think that list'd get messy fast.
Hate PHP all you want but the fact of the matter is PHP makes money
Possibly, though I have serious doubts that bonds make 3% when corrected for both inflation and taxes.

In any case I would love to see (or make myself) the comparison with other vehicles.
Interesting read. From the article:

"[Hadley Cantril, a Princeton University psychologist] estimated that at least 6 million people listened to the program that October night. Of those, at least 1.2 million were frightened, disturbed, or excited by what they heard."

I can't name another prank that had such impact, can you? (OK, perhaps the one about Iraq having WMDs, but that was hardly funny.)
I feel like I should introduce you to Agda2: http://wiki.portal.chalmers.se/agda/pmwiki.php

You write something, Agda2 checks it and says that you forget something, you wrote an inconsistent code or you wrote ambiguous code (it is possible to hide some parts of code).
Well, you could ban misbehaving robots by IP address. That seems like a reasonable step for bad behavior and not in conflict with Jeff's general "sharing"/"openness" values.
amazing! thanks for that. curious, how is this implemented on the server? seems like each command is posted to /session/ url.
Can you give me some concrete search terms that have this ranking discrepancy? I want to investigate and just haven't seen it yet myself.
Funny you should mention that. There was a survey of favoured web frameworks[1] in the Lojban community, and Haskell with snap won[2].

1: http://www.surveymonkey.com/s/T6B69LK

2: http://teddyb.org/~rlpowell/public_media/lojban_survey.PNG
I find far product searches to be far more efficient on Amazon. In fact, I think Amazon is the real threat to Google. I'll try to browse Google (but it's harder to do now for the reasons mentioned), but when I am ready to buy, I always check Amazon.

OT: did you type your commment on an ipad?
It doesn't necessarily have to be cellphones. The reason they are so popular in prison is because of the outlandish fees to make a collect call, and in some cases, those phones are monitored. If you're choices are a collect call with $5 connection fee and $2/min and a $300 cellphone loaded with hours of calltime than it doesn't take a genius to see that the cellphone is going to win whether its for the mob boss or incarcerated shoplifter.

A sensible middle ground would be to make collect calls affordable, or even free from a selected list, so that cost works against smuggling in cellphones. Until then, people are going to find more elaborate ways to reach outside. And they've got lots of time on their hands to do it.
I had the confirmation of an order from an online store directly into the spams recently, I guess too many people dislike their newsletter or something.

It took me a while to figure it out and wasn't sure if my order was properly registered, if I mistyped my email or if it was a problem on their side. Lesson learned, now I systematically scan and empty the spams.
Why would I want a web-based timeline? Isn't that just something you put in a PowerPoint slide and then nobody else cares so they don't read it?
Or Goldman is so loaded with money that they have to put it somewhere - anywhere.
Except that these ideas aren't worth anything on their own. The sequence of words "Matter is made of atoms of about 100 different kinds" is not something I can sell, any more than I can sell the words "Matter is the physical incarnation of the spirits of my ancestors."

They only start to have value attached to them once they've been proven - or, to put it another way, once they've been executed on. Even then I'm still not done, because just knowing that these specific statements happen to be true is probably not something I can sell, and certainly not something I can sell more than once in the absence of a patent. I need to wrap up that knowledge into something which has scarcity in my favour, via further execution.
just a question from someone who probably also would've asked this "incomplete" question (e.g. my server's been hacked what do i do): what kind of other information should be provided? sys logs apache logs ?
From the article:

> For Mr. Zuckerberg, the deal may double his personal fortune, which Forbes estimated at $6.9 billion when Facebook was valued at $23 billion. That would put him in a league with the founders of Google, Larry Page and Sergey Brin, who are reportedly worth $15 billion apiece.
Just because he's aware of it doesn't mean it's any less silly. Want to see me write a fully functional optimizing c compiler in a tweet? "/usr/bin/gcc" :/
When my post started a heated conversation in ru_lisp LiveJournal community, someone told there about his personal experience with Qi. He managed to convince Qi that 42 is of type String.

That's the price of freedom of Lisp.
Amazon is an example of a niche vertical. A pretty big one mind you but nonetheless they specialize in the products they sell.

I can't seem to remember Amazon coming up on product searches I've done. I have to wonder:

- Is this because I went straight to Amazon?

- Am I misremembering?

- Is there something wrong with Amazon's SEO?

- Is Amazon restricting the their content being indexed (I can't imagine this is true)?

- Is Google actually failing here?

OT: Yeah my typo rate on my iPad is pretty terrible. I'm too used to touch typing on a keyboard. Still, I find myself reading the Wen on my iPad instead of a laptop/desktop these days so I need to put up with the typos (and get better with any luck), not comment or move to a computer to comment (not going to happen).
Apologies for nitpicking, but your post was quite hard to read due to typos. Most of the time my brain auto-translates typos without me realizing it, but the ones in your post really interrupted my reading flow. YMMV.

The content was interesting, thank you. Good point about niche sites like dpreview.
You're right, there's an exploit there for the re-publishers. Great point.
Do these content farms run Google ads?
You need to suggest to us at what level you're at. Are you familiar with HTML/CSS? Are you competent with any other languages at all?

Guessing that your familiar with HTML, I'll mention that you'll probably find it easier if you set a target end-product for your efforts. Like, planning to make a simple blog system or a rss parser. Don't overplan it. Just sketch it out, so to speak, try to find a guide for it (there are plenty of guides for creating a simple blog or rss reader in php) and then try to tackle each part of it in turn.

You might also want to try using a PHP framework like Codeigniter (which is nicely documented), CakePHP or Kohana.
#include <stdio.h>
#include <stdlib.h>

void main(int j) {
printf("%d\n", j);
(main + (exit - main)*(j/1000))(++j);
}

Somehow the solutions that crash on exit are cheating too much. The above doesn't (obviously) compile to something which uses conditionals at the assembly level. This solution probably wouldn't be by the book. That takes a few more lines of code.
It's a bit more difficult with programming languages where you can thrash the server its hosted on with simple commands.

Redis on the otherhand is designed for exactly this kind of insane throughput.

On another note, I'm loving that you are putting the time complexity of the commands right on the page.
No, JA told that they planned to add type system, but their users didn't feel they need it.

And, actually, they added types into Erlang: dyalizer.

As for optionality of static types... What is your experience, precisely? My tells me that type systems are, actually, your partners in program development. Quite intelligent partners - Haskell type system, Agda2 type system...
Perhaps because of legal issues, particularly when Google is being sued for tweaking its ranking algorithm to boost their own pages higher.

I dont understand the legalities of that lawsuit though. A ranking is an opinion. Its not that its some fundamental physical constant or a formally well defined quantity. Can I be sued for my subjective judgment ?

OT: Will appreciate if you let me know why you down voted.
No....

1) in reality you're constantly investing. nobody invests a lump-sum one time and hopes they chose a good moment to enter the market. the chart gives you some idea of your long-term chances.

2) "* if you happen to have invested in a fund that took a nose-dive, hang on to it and don't sell for a long while*"

unless it goes bankrupt in which case you definitely want to sell. This is one reason why strategists advocate diversification and investing in index funds: you're sheltered from the (possibly poor) performance of any single company/stock.
How to stay safe at a public Wi-Fi hotspot
I'd rather there not be 2 million people locked up in prison. Placing a significant drain on society and only becoming stronger criminals.

But in a perfect world the punishment would fit the crime instead of the insanity in the current criminal court process.
Predictions: Past And Future
This reminds me a bit of generating constants in BF: http://esolangs.org/wiki/Brainfuck_constants
I had no programming experience outside of VBA Excel macros and just jumped in with a project. I googled everything I needed. Within a month, almost everything I needed was exclusively in the online PHP documentation manual.

Start with a project. Build a login system, from user sign up to sign on. That will teach you sessions, user input validation and interacting with your database.
I don't understand those lawsuits either. Isn't Google a private company? Aren't they entitled to do what they want with their product? I see no reason why their results must be "fair", legally.
Generally good stuff, but my personal taste for the command-line stuff would run more towards awk -- it's lighter weight and easier to pick up than full-blown perl.

On the other hand, if you're going to do a lot of this stuff it's worth tracking down a copy of "Data Munging with Perl" by David Cross ( http://www.manning.com/cross/ ) which, while slightly out of date (it covers classic Perl 5 OOP, not New Perl) gives a solid grounding in how to do almost all of this stuff entirely within Perl.
Curation predates algorithmics, but things like web directories don't have that much traffic. Although Wikipedia is an example of a successful curated site.
Well, if they're actually a monopoly, then it does change what they can do, legally.
Or can't. It's hard to make an argument that you are not a monopoly when you put Demand Media out of business in 30 days by blacklisting them.
Jeff has more reason than most to be irritated by Google results (really, I doubt you could find ten people that would bemoan the loss of (e.g.) Developer IT in they smacked a big penalty on it - if you need a pretext to do so then using link rel="canonical" to your own page full of scraped content would appear to suffice...).

That said, some of the complaints I hear about Google being unable to help with shopping queries baffle me. When I search for dishwashers all the results (bar the EnergyStar one, arguably) look helpful. They won't give me an objective recommendation for the best dishwasher for my personal needs, but how the hell is a search engine supposed to manage that?

Likewise, I'm admittedly probably not being served the exact same results as Jeff (I get a couple of local UK ones for a start), but I can't really see how he found it so difficult to find iPhone cases for his wife using a search for iPhone 4 case

The top result is iphone4case.com, which is rather nicely designed even if the purchase links do go via another merchant. The next four results appear to be legit merchant sites - sandwiched in the middle is Google's suggestion you try a shopping search with its own custom price comparison engine.

Only one result on the home page is a splog and whilst four of the sites have "buy" links that redirect you to the purchase page of a separate merchant, the average internet consumer isn't going to mind, and certainly isn't going to find the results "useless" in their quest to buy a case online. It's not that big a flaw to the usability of Google given the average user really couldn't care less if the helpful site with the big pictures of phones is simply deep affiliate linking to Casemate.
All keys are namespaced to a unique session identifier, so parallel sessions are isolated. You can check out the code for the interactive stuff here: https://github.com/antirez/redis-io/tree/master/lib/interact...
600 sites on a single non-redundant box? Ouch.
This is all good and well -- but good luck with XML data. :-(
Google Hires Crowdsourcing Guru to Manage Africa Policy
Nice talk, but in the questions and answers it would be better to see people instead of the blog address all the time.

+1 For the grammar graphs :)
It reminds me of the reddit IAMA a while back by an affiliate marketer [1]. There were lots of responses by people claiming he was the scum of the earth, poisoning the web, not adding value, but he just calmly stated his position that affiliate marketers are a significant source of income for Google, and "Google == value", therefore affiliate marketing has value.

Same might be said for content farms, so I reckon your last sentence is on the money.

[1] http://www.reddit.com/r/IAmA/comments/azcni/i_made_62232296_...
bond yields rise with inflation

http://www.hussmanfunds.com/rsi/yieldsinflation.htm
I’m Still Here (2010) – But Most of Us Aren’t
I am also in the same situation! I googled and found some intresting resource:

1. List of books stackoverflow.com/questions/90924/what-is-the-best-php-programming-book

2. Book tuxradar.com/practicalphp

3. Community and much more phpkode.com