skysight-inc/HackerNews huggingface dataset:
HN has always been rather intensively curated. You may be right about the statistical trend, but conscious intervention can reverse this "entropy" somewhat in our limited context. The question is how we can do this better.

Fascinatingly, the number of stories posted to the site has not been increasing:

https://news.ycombinator.com/item?id=7446750

That might be a good thing. The number of substantive HN-appropriate stories in the world is not growing by leaps and bounds; neither, therefore, should our story stream. We want quality, not quantity.

There's a lot we can do about story quality, because the front page is so limited, there are many fewer stories than comments, and because we manage the front page for quality in ways we could never manage the threads. However, there's no way we can scan the universe of stories to find all the best ones. We rely on /newest to be our universe of stories. If /newest is broken, we'll fix it. But we're going to focus on the problem of bad comments first.
I switched from commuting to working remotely about 6 months ago, and, unsurprisingly, I drive much less now. I can walk almost everywhere I need to go, and at night I usually take Uber – especially when out drinking. My car payment is becoming harder and harder to justify.

I would strongly consider getting rid of my car and exclusively using Uber if they offered some kind of subscription. Plans could vary based on your expected usage. For example, for $150/mo you would get 10 UberX rides, 5 black car rides, and 1 SUV – all within some reasonable distance. If you use all of your credits, any overrages would be billed normally. If you don't use all of your credits, Uber wins. A subscription to drop the minimum fare would also be compelling.
i wrote a blog post on this, but i believe crowdfunding, assuming regulation and government policy don't interfere, will accelerate the demise of patents, especially software patents. the purpose of patents is to foster innovation, but they arguably seem to have the opposite effect today.

effectively, patents protect the two constituent groups required for innovation: (1) creators and (2) investors.

music, art, film, restaurants, and mobile apps demonstrate that patents are not necessary for people to invent (though some IP like copyright seems mandatory). in some fields, the joy of creation and the promise of financial gain, even if unprotected and unsustainable, is sufficient motivation for invention.

the common thread, of course, is capital efficiency. it's far easier to risk investment and innovation when little money is required. investors are needed for innovation in capital intensive areas, but investors historically have been ROI motivated and sought assurances, such as patents, that their money will yield a return.

crowdfunding enables creators to break from ROI-investors and find financing from a different set of people: those who want not a ROI, but a specific product or service. most importantly, these "investors" care less about patents or the long-term viability of a company. they just want a product/service to exist -- from anyone.

we're already seeing this unfold on kickstarter and indiegogo. the question is whether lobbyists and governments cripple crowdfunding, or allow it to reach its maximum potential.

if people will innovate, regardless of patents, and other people will underwrite products, regardless of patents, why do we need patents to foster innovation?
How long were you involved with Linux before you knew everything in that list?
>For HN to be "marketing for YC" would be like a newspaper's stories being "marketing for its advertisers". That would be a bad newspaper. //

Many (most?) newspapers have some stories that are very directly marketing for their advertisers - newspaper runs a story on bra-fittings and so sells advertising space to fashion companies.

In fact isn't this how newspapers work: they sell advertising. If the stories are "poor" (which characteristic is modified according to the target audience) then the paper doesn't sell and the advertiser gets fewer impressions. The paper promotes itself, wins pageviews and sell ads on the number of pageviews it's getting. Advertisers get impressions and the system feeds-back allowing the paper to grow, charge more and continue creating "news".

Isn't that exactly marketing for the advertisers?

Indeed looking at a NYT Magazine story at random I find not only regular advertising but the author's byline is also advertising a book. That makes me wonder if they're managing to sell much of the story space too.

In part I'd assumed that HN was created in order to provide buzz/feedback for YC companies and serve the purposes of YC (eg market information)? Indeed from the user perspective there's no way to know, with secret moderation, if any particular story has been "unfairly" promoted or quashed; just as with dead-tree publications.
Paul Graham Steps Down From Daily Hacker News Duties
I don't know of anything that does exactly that, but there are certainly various AI projects out there that crowd-source some aspects, like coding if nothing else (counting all of the various OSS AI/ML related projects).

I think something like OpenCyc gets closer to what you're looking for, or maybe a project like OpenWIMS. Neither of those has a "chatbot" aspect though.

That said, I have recently been toying with the idea of trying to build an "open source Watson-like" system, as a platform to learn more about natural language understanding, and some other AI topics. If you're interested, shoot me an email and I'll loop you in on that.

Short-term, I'm just working on re-implementing the "ArrowSmith" Literature Based Discovery system as an intermediate learning project. That's OSS as well, and if you'd like to take a look, have at it. https://github.com/fogbeam/arrowsmith
"I've already spoke some possible future corporate clients, all of them found it great and would like to use it after it's ready."

If that's the case, then they should be willing to put their money where their mouth is.

Ask them how much they would be willing to pay for a solution like yours and whether they would be willing to pay (even half of) that upfront.
If they don't want to, perhaps they don't really need it or are not your real customers.

There is nothing that will validate your idea better than pre-paying customers.
I agree with the comment given the background of the devs, but less the general concept. I think games like Guild Wars (at least the first one) have shown that levels and classes can work. Similarly the Elder Scrolls games show alternate approaches that can also work, especially when combined with mods.

But strict levels/classes on a system that is supposed to give players design freedom? Probably not a wise restriction, especially not if they want to use their old fan base - which is desperately looking for newer games!
Yup, I agree 100%. The lack of transparency is incredibly frustrating, for all of the reasons mentioned above.

I wish I had more to say than "+1," but I wanted to give more than just an upvote. "you tend to assume the worst" really resonates with me.

This comment went from +3 to (currently) -1. Interesting.
I just wish Hacker News would become a much better place for showing off and discussing projects. We have so many hackers here making things and it's almost entirely hidden from view. There's too much noise and no real place to post. A very simple but huge improvement would be a dedicated place for "Show HN" posts, but so much more could be done.
http://www.cyc.com/platform/opencyc
You don't need a facebook account to use Facebook Messenger, Parse, Instagram, or Whatsapp. I don't understand why people are worried about needing one for the oculus rift.
I feel like OS X has a big hand in this discussion. Most developers I know now use OS X and only touch it's Unix underpinnings when required to do so. They don't use SSH so much, they'll use sshfs or some other remote file system setup, they'll use a git GUI in their IDE and a (S)FTP client more often than not. The dev community over the past few years seems to have embraced nix styling in their projects more and more so I think en mass people are getting more exposure to the CLI and therefore, getting more curious about what else it can do, leading to another blog post about nix commands, how to use them, etc.

The irony is I remember when people gave me shit for running OS X back in 2001 and being "stupid for not running windows" and "making my life harder". The schadenfreude of a Windows user watching me when something didn't just work automatically or I had to boot up VirtualPC back then was far from subtle and peppered with reminders I could "just run windows dude". Now days, it's still there, but it's much more common and much stronger coming from a Mac user than any Windows users I've encountered as of late.
> We’d ignored and subsequently embraced three good design principles for reliable systems: Fail fast, Process Supervision, and the End-to-End principle.

Can't you have a message broker AND embrace those design principles... without pushing responsibility onto your crawler? What happened to the Single Responsibility Principle?
two or three years as a casual user.

a seperate issue : if you're going to make lists like this, please don't include distribution specific commands (like yum or apt-get) on 'linux' cheatsheets. they belong on redhat or ubuntu cheatsheets, respectively.

Similarly irritating : the use of distribution specific package names.
Wearing bright lights next to your face with the intent of quickly flashing them in the darkness seems like a Bad Idea.

Just sayin'
Creating a Blog without a backend
How to make your blog social
Google apparently scrubs military partner listing, after report
I think the analogy would be a bubble that grows but never enough to pop.
Is there any data available for acceptance to the program? If so, someone (or I) could run a T-test and find out if there is any statistical significance.
What? There is almost no evidence that your comment is in any way true.

Ubuntu has great Long Term Support - which is exactly what this is about and the apt package management is far superior to Yum (IMO at least) - Plenty of high profile companies use Ubuntu for servers.
Well, Europe's a big place. The average may be higher, but the minimum wage in some countries is lower - for example here in Portugal, it's equivalent to $4.16/hour.
These reckons you mention. Over the years I have come across people suggesting the same approach to a problem. It makes sense in theory and it should work. Yet it doesn't. And I cannot explain why it does not work. Queueing/throttling/steering/pub-sub, caching, and synchronization seem to be three areas that spawn unintended consequences like crazy. If some young'un suggests something you have learned will fail, let them try it if you have the time. And then ask them to explain why it did not work. It's fun watching people learn.
Yeah, whenever you cd, OLDPWD gets set to the directory you just changed from. cd will substitute $OLDPWD when you cd to "-". Perhaps even less well know, the shell itself will expand ~- to $OLDPWD so if you ever want to see where cd - would take you, or just list the files from your previous working directory you could do "echo ~-" or "ls ~-" respectively.
Surprised that there is no single comment here about other options like ant and gradle. I personally hate anything where tab has a different meaning from 4 spaces, but maybe it's just me. Anyway, my personal choice for any kind of automation would not involve make if I can use the tools I mentioned.
If anyone is in Turkey and can configure their system to use Google Public DNS IPs / OpenDNS IPs as their resolvers, I'd be interested to learn what you see on: http://whatsmyresolver.stdlib.net/

It's clear that addresses such as 8.8.8.8 are being intercepted. But it's unclear if the interceptor is passing on the uninteresting queries to the "real" Google Public DNS / OpenDNS, or if they are acting as standalone resolvers. The above website records what IP address the resolver uses to communicate with authoritative DNS servers.
This is bad if true, but there aren't any technical details concerning the nature of the attack or how they discovered it.

Is it possible to claim that you are 8.8.8.8 from within Turkey using some sort of BGP wizardry?
I'm willing to bet there isn't but a handful of people in this community that "knows everything on that list", remembering everything on that list is... well, unneeded?

9/10 times when I'm using a command that isn't part of my "daily list" I'll need to consult man pages and/or Google.

I've used xargs hundreds of times, but depending on when I used it last, I can never remember if I need -0 or not, and is it $1 or {} or wait, no no, I'm using awk, so it's $1, and I need to changes something... is it needle, haystack, replacement or... hell, I'm not even sure if it's substr or just sub... errrr.

Not to mention some of these are distro specific, in some you use service name start, in others it's /etc/init.d/service start. Some it's adduser, others it's useradd, etc. It's relative to the distro a lot of the times... are the files in /usr/opt/ or /opt/... or maybe they're in /usr/local/opt/... Also they list stuff like locate, but not updatedb. Not a single mention of dd or shred or /etc/resolv.conf or netcat (I fucking love netcat!) or unzip (far more likely to need to unzip an archive than add a user in your day to day life).

We're not command libraries, we're duct tape mechanics.

http://xkcd.com/1168/

edit: if you're interested in learning more... I honestly can't recommend this book enough.

http://www.amazon.com/Linux-System-Administration-Handbook-E...
They've had some pretty horrible mistakes with respect to security though (before Andreas' time though, so no reflection on him), and the basic model of a web wallet is inherently broken...
Everything I would want to buy I can pay for with a free international credit card my bank issues. The only real incentive to use a cryptocurrency for me would be for things like giving and receiving online tips, like a site independent karma system, but as soon as you need to actually buy the coins from somewhere it is just as convenient or inconvenient as tipping fiat money.
This can depend more on the particular product group and manager you work for than which company. All big companies have less than perfect managers, and some people have a hard time accepting work/life balance choices that are different than their own.
I'm using tup right now (lightly) and rather enjoying it.
Andreas is the man. One of the best voices in the Bitcoin community. Looking forward to this.
So why not be transparent about those reason? Who does it hurt to have a heavily flagged post display "this post was flagged by 15 people", or to let a post that's against the guidelines be identified as such?
Debt tracking can also be done with Splitwise: https://www.splitwise.com/

which is good for when you don't have cash money at the Redwood City taqueria.
I dream of a system that allows me to swap my citizenship with a similarly qualified EU Citizen that wants to come to the US.
Interesting how many of those commands are not compatible with FreeBSD.
What application is this?
I agree, the main site seems to be 90% "Write code for beginning programmers who are too lazy to do any research on their own."

However, the chatrooms are an excellent place to have those opinion-based off-topic discussions. I find I've spent far more time idling away the hours in JS chat and learned far more.
Oh, is that what happened? I saw it as an .au (I'm in AU) but couldn't work out what the heck RPI was (why do people still assume that their blog readers are in the same region they are?). Happily the dodgy "May 16, 2011" subtitle was a giveaway that it was somewhere in North America.
The "!" acts equivalently to a "." in ending a sentence. No need to use both!. But it is kind of fun, now that you mention it!.
Demonstration of DSP for Musical Applications from the 1980s
Take a look at http://marvinapp.com. It has some fancy typographic and organizing features. I found it not to my taste, but YMMV.
Yes, but when an implicit conversion has been applied to an implicit conversion has been applied to a... ...well, underlining it helps but can't convey all that has gone on.
Ooops. Never seen that before. My mistake.

Thanks
Yes! Browsing the site logged out is much faster! I gather they use less caching for logged in users etc.

It takes 2-3 seconds to load my profile page and another 2-3 if not more to load my comments page..
Could be what I'm looking for and how far I'm willing to drive to get somewhere, but as a subjective feeling, Copenhagen feels like it has a bigger concentration of intellectually stimulating "stuff" happening on a regular basis than either the SF Bay Area or Atlanta did (the two places I lived previously). This is probably not literally true numerically, but in terms of things I hear about, are accessible to me (usually for free), and easy to get to, I run into a lot more, despite being a foreigner who doesn't even speak Danish, which you'd think should be a handicap.

There are always interesting talks and meetups happening, from regular events like SpilBar (http://english.dadiu.dk/invitation-spilbar-14-0-surprise) or Science & Cocktails (http://www.scienceandcocktails.org) to active hackerspaces (https://labitat.dk and http://www.illutron.dk), a whole building hosting an indie-game community (http://www.dfi.dk/nyheder/filmupdate/2010/velkommen-til-spil...), etc. Events at universities also feel more "open to the public": if I want to hear a bunch of internationally famous visitors talk about biotech or experimental mathematics, I can go to something like http://danstem.ku.dk/events/seminar_series_2014/ or http://www.math.ku.dk/english/research/xm/seminar/ respectively. Whereas apart from a handful of advertised public talks, the large amount of stuff undoubtedly happening at Stanford or UC Berkeley didn't feel like part of "my" neighborhood, something I'd hear about or go to as a non-Stanford, non-Berkeley person (or necessarily even be allowed into).

There was certainly interesting stuff in SF as well, but it felt less like it was always happening, and more like I had to seek it out and drive anywhere from San Jose to Oakland to get to it, more like a "trip" to an event (like SuperHappyDevHouse, which is great) than a feeling that stuff is always happening all around me. The videogame-dev scene in particular was very scattered, with a good number of studios generally in the area, but that meant anywhere from Marin County to Santa Cruz, so you didn't really end up at the same events on a regular basis.
I have another good title for the second in the series: "Biting Mastercoin"
It's a pre-order and scheduled for August. Sometimes <cough>massively and all the time</cough> book schedules slip. When Amazon lists it it is probably in editing.
It sounds the real problem is there might be a lack of production caliber load balancers for $MQ, rather than HTTP possessing any intrinsic advantage.

How is load balancing anything but an implementation detail, since one can usually be written as a service utilizing the same protocol in question? That's how HTTP reverse proxies usually work (notwithstanding other methods of balancing load such as DNS).

Other monitoring aspects such as feedback are already built into well-designed MQs. If that feedback isn't being acted upon properly, then that's again a problem with the implementation -- the same could be said for a HTTP-based task queue that simply ignores errors. It's not "extra work"; it's just different.
Bitcoin: The 6 innovations that changed the world
Yeah, that's what happens. Blogspot detects which country you're in, silently edits every URL accordingly, and redirects you to that. Argh!

Maybe we'll change our code to make it always be blogspot.com.

p.s. I've added .au to the list :)
I'm in an intership in France , and that's true , I get 15K EURO , that's the maximum salary for interns in France!
Guild Wars worked because it focused on combat and the rest was never a focus, once you got to level 20 there was a grind for items and nothing else.

The problem with level based systems is you end up with zone restrictions. There's no reason to explore most of the map because its too low level, items are not useful, etc.

UO worked cos you could go anywhere, at any time, and harder places usually meant you needed a few friends to go with you. You could still do it yourself by pulling and picking off mobs, if they didn't respawn while you were killing stuff that is.

I miss UO...

The creator of Ultima and UO is making a new game called Shrouds of the Avatar.
Wrong and Right Reasons To Be Upset About Oculus – with Carmack response
So this will finally make it impossible for judges to arbitrarily impose punitive measures on people who have not been proven guilty?
Yes, in France out of one of the "top" schools, in Paris area. As yulaow mentions, it can be cheaper in other areas.
Wow down voted, must be from someone who never played Ultima Online.
Only minified JS? Open source? So disappointing.
I was kind of hoping to read about leftover swap space on Linux :-(

What gets put there? Could passwords be on it even after you shut down your computer?
Ah, a friendly reminder than in a gold rush it is best to sell shovels.
195.175.255.82
I know a lot of people coming from both sides of the fence and there is a huge difference of level. I challenge you to find just one university in France that gives you a formation equivalent to those of epitech et al.
This goes against commonsense, why was this done?

Others have speculated it was done for liability reasons, that's IMO the most likely explanation. The beauty of civil litigation is there's an easily accessible paper trail. It would be interesting to see whether or not GM has a habit of changing designs without changing part numbers.

However, frequently designs get changed by "marketing" without a part number change, even in situations without possible liability. E.g. wireless routers are sometimes totally revised while retaining the same part number. Apple also likes to implement stealth changes.

Most engineers understand "commonsense", most marketing pukes don't.
Depends, in good-faith communities like these they more bring harm, than say a standard phpBB forum.
Fraud is a deception deliberately practiced in order to secure unfair or unlawful gain (adjectival form fraudulent; to defraud is the verb).[1] As a legal construct, fraud is both a civil wrong (i.e., a fraud victim may sue the fraud perpetrator to avoid the fraud and/or recover monetary compensation) and a criminal wrong (i.e., a fraud perpetrator may be prosecuted and imprisoned by governmental authorities). Defrauding people or organizations of money or valuables is the usual purpose of fraud, but it sometimes instead involves obtaining benefits without actually depriving anyone of money or valuables, such as obtaining a drivers license by way of false statements made in an application for the same.[2]

http://en.wikipedia.org/wiki/Fraud
"I'm not aware of any message broker that lets you throttle messages on a per-consumer basis"

depending quite what you mean here, ActiveMQ supports this.

"With an MQ, no component of the system has a global overview of load."

except the MQ surely? Again, ActiveMQ supports multiple consumers on one queue and handles balancing the messages to workers at the rate they require.
As someone who is working on an AR project and has to constantly explain to people WHAT AR is, I find it a tad disheartening that this is the top comment in HN comments. I would have expected that the readership would have been well versed enough that it would have been mid-level.

This does serve as a good data point about technology penetration though. Thanks.
Thanks! that looks like they are running standalone resolvers:

inetnum: 195.174.0.0 - 195.175.255.255
netname: TR-TELEKOM-960902
descr: Turk Telekomunikasyon Anonim Sirketi

in that case, each ISP is probably running their own standalone servers.