skysight-inc/HackerNews huggingface dataset:
They must have never heard of Groucho Marx glasses
Great work, thanks for sharing this.

Feedback -

- I'm a fool and was looking around for somewhere to click to go through to my site - what about a small link somewhere around http://d.jdkram.net/W7nY? Or maybe a second button the "Welcome" tab.

- Hovering over all of the entry titles in 'Account' (Facebook, Google+ etc.) switches the cursor to a hand. Apologies if this is intentional.

- It would be nice to have a little explanation regarding what you're asking for in the box: something like http://d.jdkram.net/4GEL would help keep the look clean and let you explain where to get the info you're asking for. Alternatively continue with your current norm and use greyed out text within the boxes saying "e.g. 107633175658115732197".
This blog post linked to from the comments in the article explains the "ecological correlation fallacy"[1] being described in the article:

http://ed2worlds.blogspot.com/2013/01/gates-foundation-waste...

Key quote:

"...it has been known for more than 60 years now that correlating averages of groups grossly overstates the strength of the relationship between two variables"

Apparently, this was also used in the past to show high correlation between African-Americans and illiteracy.

[1] http://en.wikipedia.org/wiki/Ecological_fallacy
Interesting, can you give any examples of these issues?
I'm surprised at the comments here. Seems that nearly everyone disagrees with the blog? Is Bill Gates such a saint among the HN crowd that we ignore statistics for him?

Also, see this blog for some more discussion along the same lines: http://ed2worlds.blogspot.com/2013/01/gates-foundation-waste...

Seems pretty clear that Gates' study presents the data in a very misleading manner to make a very weak correlation look like a very strong correlation.
Firstly, thanks to GitHub using HSTS on github.com (although not www.github.com), the certificate error will be fatal in Chrome and (I believe, but haven't checked) Firefox as long as you have visited GitHub previously.

(It's not preloaded HSTS so it would have to be learnt from a previous, unattacked connection.)

I know that the unbypassable errors for some sites upset the more technically minded people, but I think that incidents like this show its value.

The CloudShark trace shows what appears to be Firefox connecting to the GitHub IP address, but the server clearly isn't GitHub from the config. The server appears to be configured to accept the client's ciphersuite preference, but doesn't support DHE nor ECDHE.

The server is also only 9ms from the client - that's clearly not crossing any oceans. I'd also guess that the server is overloaded at the time because the ServerHello (which doesn't take significant processing to generate in this case) takes 900ms to come back.

Sadly, it appears to show the user overriding the certificate error and talking to the server anyway :( Hopefully that was a fresh FF install just to see what would happen (which would explain why HSTS didn't prevent the override).

Lastly, the certificate appears to be self-signed, but the Authority Key Id doesn't match. One assumes, based on "OpenSSL Generated Certificate" that OpenSSL was used, but the person may have had some trouble. I'd guess that they generated a CA certificate first (with the same Subject) and then signed the certificate in question as a leaf. Many of the tutorials that you'll find online are for that sort of setup so perhaps they weren't very familiar with X.509 certificates.
Thank you for posting the link. Mr. Sinek does manage to put it in a more elegant manner. Very enjoyable and profound.
Yes, that is what the people at Lehman Brothers were saying about the Mortgage market for some years.

But anyway, each one is free to reach his own conclussions.
Sound. Networking. Decent async file I/O. Threading libraries. Dynamic loading of components. Anti-cheat techniques (or any other security stuff you might need). Device input. Choosing and supporting a platform (and the follow-on customer support issues). Diagnosis of customer problems (because they _will_ have them).
Wrong - the user may collect them to try to find patterns.

The user may do a lot of things. But that doesn't mean they do. You're bring up an edge use case at best in trying to disprove an idea for the mainstream.
It depends. When I'm on the desktop, I generally do the mod-click so I get a new tab, and for those, I'd want a new page. When I'm on the iPad, I'd want a modal.
It seems to me that the evidence of weak correlation isn't quite as weak as you imply :-) If there's a dense line in there, how come it's not sticking out of the blob even a little? Do actual phenomena often yield "deceptive" blobby scatterplots with dense lines hidden inside them? That seems apriori improbable to me, thus increasing the Bayesian probability that the blobby scatterplot is not a misleading picture after all. Though of course some more numbers would've been nice.
I think you're taking the metaphor a little too literally. My understanding of the author's argument was that every email should have a date and time attached to it, not for the client to delete it outright but for the client to be able to sort by time and date, as well as keep separate folders of past email and future email. I would LOVE this idea.
That makes sense, and I agree, but this seems orthogonal to cloud vs non-cloud. If there were two cloud providers in different cities, and they allowed you to buy a good link, then the cloud meets this need too.
Both sides are right but they seem to be concerned with different things.

Grouping data points does mask volatility. This doesn't make the effect any less real on the societal level. If we seek to improve student performance, skewing the pool of teachers towards the better ones will do that.

Yet there is also an enormous amount of volatility which is also real. Ideally we would just create better predictors. Constraining ourself for the moment to this set, since they have high error rates on the individual level, it's also reasonable to assert that in relying on this metric, we will make unfair decisions for many teachers.

The right solution depends on how much you value optimizing student outcomes vs. optimizing fairness as well as second order effects such as driving away teachers. My bias would be to use these scores for economic incentives to attempt to ensure that retention for the best teachers is higher than for the worst. Without additional work, termination likely isn't warranted based on this data.

To those who argue that pay differentials require better evidence, I would suggest comparing the validity of performance evaluations across any other job. It's imperfect but better for society than doing nothing.

For long-term fairness, it's important that there isn't a single value-added model. Competitive pressure can do wonders to improve model quality and it's also fairer since those who don't do well on one model can move to a different rubric.
Even if Bill Gates isn't doing the best job, every time I see one of these articles, it appears that there isn't any advice on better ways to grade teachers. Did I miss that in the article? Are there a lot of other people in the field that are doing better work? (I would really like to read if anyone can provide links to papers to other ways of analyzing teachers)
There is a lot of politics in the process of funding science and I would argue the system is quite broken, but it still operates within the scientific community. There may be a new class of hybrid scientists-bureaucrats (aka professors) that have a strong grasp on research direction but they are still scientists. Each individual may have their biases but the sum of all of the scientists is made up of so many different people that the only common link between is their belief in the scientific method and this collective ultimately guides its progress.

Also, I have to nit pick, science is by no means an expensive human endeavor. The net global societal benefit per dollar spent, even with all of the added bureaucracy and other overhead, far outweighs other spending, maybe even spending on education. The problem is that science is long term, something few seem to have the stomach for.
Do you have a convenient link to the data set you used to generate the first plot in your article?
But being newsworthy does and this man wants to be newsworthy apart from trying to convey a message (which may be right, may be wrong, but he is not Bill Gates).

And really you would be amazed at the titles (and abstracts) of papers in journals of Pure Mathematics. Really. I've seen thing you people would't believe.
We tried it "not existing"?
it's important that someone speaks up. I am pro DMCA!

The petition isn't entirely anti-DMCA and neither are many people on HN. The DMCA offers a safe harbor for websites that host user submitted content and it gives a mechanism for truly infringing content to be taken down. There are alternative approaches that some might like better but they are unlikely to happen anytime soon. In the meantime, these two aspects are both good for businesses and I doubt that they're as controversial here as you state they are. There are, however, serious issues with the DMCA. One of these is that there's little to no recourse when the DMCA is abused by a company to take down materials that they don't own the copyright to (this happens frequently). Another issue is that circumventing DRM is illegal even if no copyright infringement is taking place (this is the actual point of the petition). It's not impossible to support the positive aspects of the DMCA while simultaneously recognizing that it is far from perfect and in need of reform.

PS - I downvoted you. It had absolutely nothing to do with whether or not I agree with you. You're baiting for upvotes/downvotes with statements like "I'm ready to get downvoted to hell on this one" and "I know there are other startups out there who depend on DMCA, and if you're one of them, upvote this." You're also being unnecessarily insulting and condescending when saying *"I stand loud and proud against 'the HN mob' of wanna be's and know it all's," when this adds nothing to your argument. This behavior is clearly against the Hacker News Guidelines (http://ycombinator.com/newsguidelines.html) and more importantly it's both rude and nonconstructive.
Its an interesting analysis, the general principle isn't whether you 'sound black' or not, its whether your sound 'correct socio-economic class' or not. Similar research was done in England comparing the wages and job prospects of people with accents from working class towns and neighborhoods versus people with accents from upper class towns and neighborhoods. (and they were all white, no racial biases) finding essentially the same result, if you talked like an upper class person you were treated better.

On a personal level I grew up with 'air force' kids since my Dad was in the Air Force and we moved from base to base, and we all spoke alike (in terms of accent) pretty much regardless of race. One year when my Dad was stationed at Andrews AFB, one of my friends, who was black, was taunted by other blacks in our public school in Maryland because he 'sounded white' which I found really confusing. It was hard on him and I really didn't know what to make of it. That said, later in life I found that generally teasing on accents was common. So it was clearly something which caused others to respond.
This is a philosophical stance that goes beyond the article's point. We have very good models for most of technology but we don't know enough about how Lithium batteries fit into those models. It's kind of tangential though. The point of the article seems to be that we ought to pay more attention to tangible things that we don't understand (like how to design more efficient batteries that would improve people's lives in real ways) then on pointless interpretations of string theory. I tend to think there is value in keeping in mind that we can't actually be certain of things because the alternatives seems quite pompous to me.
I think it was saying that if "happiness"="the pursuit of meaning" then "pursuit of happiness"="pursuit of the pursuit of meaning." Which is redundant.
But Bill Gates is not putting out the graphs.

This looks to me like someone trying to make the report look good so that Bill Gates will get positive press, think this was worthwhile, and fund them again.
Paralellizing CPU-bound tasks with Python 3.2's concurrent.futures
That should be nullable, not billable.
I think his point was that we don't even have a model for Li-Pol battery.
Getting Your Startup Ready For An Acquisition (2011)
Free, no ads... what's the business model here, if you don't mind sharing?
We didn't know exactly why lots of pharmaceuticals worked either, and we still don't in some cases.
I am spinning a speculative argument here. I'm not defending this seriously, but just constructing a possible answer to the question posed in the parent post by jhull.

I'm suggesting that people who have an English public school type education are less likely to engage in organised political action that is oppositional to the current arrangements than those who have not had that education. The immunisation comes from the presentation of Banksy as a lone and mysterious eccentric by publications such as the Smithsonian Magazine. That would be harder if there was an organised Banksy posse with a programme who ran summer schools &c
There's no business model, as I never wanted to make money with this. It's a fun project and it's hosted on existing infrastructure.
I don't think that's what the author is saying..I think he's literally saying the email will be deleted on the server if the time expiration occurs, unless the user specifically says to store it anyway (even after expiration). This would clear your inbox for things like invites to parties which have past without the need to manually delete them.
That's true, and Google explicitly granted their free usage, thus the codec is open in all senses of the word. I'd expect the same story with VP9. So what's your point?

http://www.webmproject.org/license/bitstream/

http://www.webmproject.org/license/software/

http://www.webmproject.org/license/additional/
This is funny, one of the reasons I dislike developing on Windows is exactly because of debugging.

Sure, gdb is awful, and don't even bother with the IDEs, but in Linux you have: strace and valgrind, and they are very helpful.

Visual Studio is great (except for, ahem, having to use MFC) but at other occasions I was using MingW on Windows.
I agree, but in practice they'd have to block entire sites due to HTTPS.
I studied computer science at a university, not just a college, and coroutines weren't covered during the course. So even if you've got a degree, there's no guarantee you'll have met a coroutine!

(I do agree that a formal education is valuable, even if you already think (or know) you're good at programming. I learned a lot from my course. There's a lot to be said for being forced to learn a bunch of stuff, and when you're under 25 it's not like it's going to hurt.)
Loads of people didn't go to college, and program. Loads of people went to college doing something other than CS, and program. Loads of people haven't yet been to college, and intend to go and do CS, and program.

Why do you look down on all these people?
I was thinking more of the common types of gun. Much more likely someone would try and make an AR-15/whatever than a self designed thing.

Again, I wasn't meaning this to be air tight. Just more doable than nothing.
Well my apologies then if I misinterpreted -- now I think the author is taking his own idea too far then :). Deletion isn't necessary, just get it out of the regular inbox, and leave it somewhere else for later consideration if need be. That'd be the best of both worlds in my opinion.
Nice tut on git. Although not very real-world practical in case of Wordpress.

First - wordpress core does version control itself and offers one-click update for core files that are updated frequently.

Second - wordpress website consists of ever updating database (that is hard to version control) + set of custom files (like custom plugins, themes, uploads, images, media, etc...).

It does not really make sense to version control wordpress-based website although it makes perfect sense to take care of backups, especially comprehensive off-site backups in case of hack-attack or crash.

For that I use backupbuddy plugin (not affiliated, just grateful customer).
It allows you to automatically create unattended, complete, compressed backups for your whole website: core files + your files + database. All in one piece - without you lifting a finger.
Plus it auto-uploads your regular backups to chozen destination like amazon S3 or another FTP server and allows you to keep, say, last 10 backups.

This allows you to accomplish two very important things (that git does not do):

1. You may restore complete website from scratch in minutes - including full database structures.

2. You may copy your website to different domain and it will automatically update all URL's from old to new URL - again - in minutes.

That's a perfect tool for the job.

Thanks for putting tutorial though - I love git and use it often for separate projects.
Currently the number of public school teachers fired or sanctioned per year is much less than 0.1%. Which is a bit different than 30%.

So I'm thinking they're not too worried about this.
This Week I Downloaded
Apple and MS just don't like open codecs, period. That's the whole reason they sabotage them. It's not about belief - it's about the struggle between closed and open.
This is a solution to a problem that doesn't exist. In the meantime, real unsexy problems are ignored. It reminds me of this post:

http://raganwald.posterous.com/why-the-fuck

I meet too many startups in SV working on questionable incremental improvements to social networks and communication tools. Not enough people think about low-hanging fruit problems that affect the quality of life of millions of people.

I'm trying to compile a list of some problems in that category, and I'll share it at some point.
My point is that your personal opinion, as highly as you might think of it, is actually irrelevant in determining how successful a service will or will not be. You can pander all you want about how Twitter is useless except as a link-sharing service, but the reality of the situation is far different.

http://en.wikipedia.org/wiki/Twitter_Revolution
It took me a long time to learn that if you aren't failing occasionally, you probably aren't pushing your own capabilities.

It's dangerous to be scared of failing. Yes, you can and should learn from both succeeding and failing, but continue to work hard and push yourself either way.
Great article! However please consider updating the examples to use the full git commands instead of the aliases. I think it would make it more approachable for beginners.
The parent edited his comment after I posted. Originally it said "was banned".
It's an exaggeration (a huge one) to say that many native Japanese cannot write by hand anymore due to technology. Rather, they have forgotten the stroke order on certain characters, or often confuse two similar characters. It's very debatable as to whether this has been caused by more widespread use of computers, or if such "character amnesia" has always been present. The same can be said for spelling: Do you think English speakers never made spelling mistakes before spellcheck?
Are you serious? I'm flabbergasted that you think this sort of racism unlikely in the U.S. to the point that it is absurd ...

When you say US do you mean "United States of America." Racism is so common in the US that I'm surprised that anyone would not know.
With MS-DOS games quality, no thanks.
Well, it's just ridiculous. YouTube can be a cesspool of racism but if Twitter has any comments related to one particular group, it faces legal action. I don't want to preach to the choir about free speech; however, what do people really expect from censorship?

Let's say some racist group was spewing hatred on Twitter. Now, let's say someone was, rightfully, offended and then went and tattle tailed to Twitter or the legal authorities. What is their benefit from that? Those people still think and believe exactly the same things. You could say at the very least it reduces the spread of certain and so forth, but I don't think it does; just because they can't say it on Twitter doesn't mean it is not said hundreds or thousands of times a day. I don't know why anyone would want the government to be our nanny in this case. If anything, taking action like this just eggs them on.
Do you have any examples of racist hashtags trending on Twitter in the US?
stch - your account has been hell banned, for nearly a whole year.
You're not counting the rest of the world that may be traveling in the US =)
Help me with Programming Pilgrimage
How is this different from how consoles work?

They are no short of games.
I agree with Jacques here, its not depressing it is enlightening to know what complexity lays below.

If you have the chance, a simple FPGA evaluation board (my suggestion is the Altera DE-2-70) and some time reading about computer architecture, and you will know a ton about how computers really work. And that will give you insights into all sorts of things.
Thanks for your feedback!

- This has just been added.
- The text was ment to be a label for the input box. I'll fix that.
- Yeah, there's a lot of explaination and help texts missing. I'll add this when I got more time this week.
So if the teacher evaluation method is alleged to be inferior, please provide a new evaluation method which is superior to it.

Can't? Won't? Then be quiet.
or a 6502
That's a bug in 0.12 that slipped in before the release. It's fixed in the hg mercurial and there will be a bugfix release soon.
Thanks for your feedback!

- That has been added
- Yep, indeed. I'll think about what's best in this place.
- That's what I initially planned and that's going to come for sure :-D
- Great idea, thanks!
Fair point. But with Heroku, you still need to build your app yourself. Coming up with a recipe is really easy compared to build an app from scratch. Maybe we're the Ruby on Rails of cooking. What do you think?
How NASA’s 10-Year-Old Opportunity Rover Survived So Long
loved the first answer. I still remember the opengl 2.0 debates.

what puzzles me is the little mention of the horrible state of video, and audio in linux. alsa was an attempt to "fix" the audio sub(eco)system. the broken audio is probably one of the reasons why theres still no proper audio apps in linux.

video? well if you have a recent nvidia card on a desktop system you can at least play games. but that's about it. kernel developers make sure the closed source blobs don't use too many gpl features. nvidia blames it on the kernel devs, the kernel devs blame it on nvidia.

everyone talks about how awesome the opensource intel drivers are, and even though they got a lot faster recently with all the valve feedback, they were an order of magnitude slower than the windows drivers(i don't know if that's still the case). and mesa? well, you judge yourself.

I completely agree on your whole developer ecosystem. To me that is the sole reason why mac osx desktop utility apps strived while linux' more or les stagnated(no data just feeling, and maybe that's a bit harsh, but compared to osx apps that's certainly the case).
I actually would prefer people on my team NOT use these shortcuts. For example:

numbers = [1, 2, 3, 4, 5, 6]
even = []
for number in numbers:
if number % 2 == 0:
even.append(number)

is much easier to read and maintain imho then

numbers = [1, 2, 3, 4, 5, 6]
even = [number for number in numbers if number % 2 == 0]

Also:

for x in range(1,101):print"Fizz"[x%3*4:]+"Buzz"[x%5*4:]or x

is a piece of code I never want someone else to write that I may someday have to maintain. Write it out the long way and make your teams lives easier.