skysight-inc/HackerNews huggingface dataset:
I'm just getting this from Wikipedia, but: "Health care in Australia is universal. The federal government pays a large percentage of the cost of services in public hospitals."

I would happily have Australia's solution in the US. It would go much farther than Obamacare.
No worries.

The OP requested an explanation so I provided one, however I readily agree that what he requested is not what HN is for.

I can post this stuff at my own website if it comes up again in the future.

My mail is mdcrawford@gmail.com if you have any other concerns to bring up.
http://www.pasthorizonspr.com/index.php/archives/07/2015/a-u... ?
GPS was developed primarily to improve the aiming of nuclear weapons, afaik, let's not fool ourselves.

Neural prosthetics sound like they want to create automatons, but it's possible that they want to deal with the military's epic mental health crisis.
This is exactly right and further I think comments like above scare a lot of people out of posting information that may be useful to others. I'm quite surprised by the sourness. Thank you for sharing!
I think the topic of measuring productivity is a little more nuanced than what you think.

Something could be unmeasurable (unquantifiable), but comparable. Consider a contrived example: Two cars start a race at an unknown time - you are allowed to watch the end of the race. Which ever car finishes first is faster (on average, more fast). However, since you don't know when they began, you cannot measure their average speed.

I think a great deal of the headaches concerning productivity is comparing it between people and trying to put an exact amount on it. It is quite possible to say that one would be more productive in one environment vs another. Sometimes it is quite clear (I am less productive if I have a broken hand) and sometimes not so clear (not being in an office makes me more productive,... maybe).
I often do just that. For example Richard Stallman and I both purchase meals for panhandlers.

Many of our professional colleagues gripe about Richard for many reasons. They gripe about me too. It can get really old but I don't let it get me down.
Nope. No. They didn't.

What they did was some perfectly legitimate duplicate content protection.

Will write it up in a bit more detail...
The C64's SID sound chip was ages ahead of anything else on the market when it was released, and it was nearly a decade before the IBM PC produced anything comparable with decent software support. As far as I know, the C64 was the first platform ever to produce dedicated game-music composers.

Here's a sample of what it could do, by the legendary Martin Galway: https://www.youtube.com/watch?v=nf29ShkoAiA

And here's a netradio station that exclusively plays remixes of C64 game music (!): https://www.slayradio.org/ (listening links on the left)
"more common situation is that a crop is GMd to not need pesticides"

Is that based on research you've done, or are you just going with your gut?

This[0] article explains how "Roundup-ready corn and soybeans"(roundup is an herbicide) has caused the near disappearance of milkweed and because of that the near disappearance of Monarch Butterflies which need the milkweed to survive. What does "roundup ready" mean? It means the corn and soybeans can tolerate the herbicide, so the fields are coated with it indiscriminately.
I'd wager that acres of corn and soybeans planted exceeds acres of papaya by a fair bit.

This[1] well-sourced[2] article describes "Herbicide and Insecticide Use on GMO Crops" as "Skyrocketing."

This[3] article describes how corn crops that are gm'd to be resistant to pests have actually become susceptible to pests because "nature will find a way." This has resulted in even more use and need of pesticides for these crops, a vicious cycle.

By the way the crops that are modified to "not need pesticides," still actually need and use pesticides. The pesticides are just incorporated at the gene level, instead of after they've already been planted.
For example, the use of systemic insecticides, which coat GMO corn and soy seeds and are incorporated and expressed inside the entire plant, has skyrocketed in the last ten years. This includes use of neonicotinoids (neonics) which are extremely powerful neurotoxins that contaminate our food and water and destroy non-target pollinators and wildlife such as bees, butterflies and birds. In fact, two neonics in widespread use in the U.S. are currently banned in the EU because of their suspected link to Colony Collapse Disorder in bees.[1][4]

And the roundup ready type gm is one of the main things I've heard touted about gm over the years, I'm not sure where you're getting your information.

Over 99% of GMO acreage is engineered by chemical companies to tolerate heavy herbicide (glyphosate) use and/or produce insecticide (Bt) in every cell of every plant over the entire growing season. The result is massive selection pressure that has rapidly created pest resistance--the opposite of integrated pest management where judicious use of chemical controls is applied only as necessary. Predictably, just like overuse of antibiotics in confined factory farms has created resistant "supergerms" leading to animals being overdosed with ever more powerful antibiotics, we now have huge swaths of the country infested with "superweeds" and "superbugs" resistant to glyphosate and Bt, meaning more volume of more toxic pesticides are being applied.[1]

[0]http://blog.nature.org/science/2013/04/04/the-monarch-butter...

[1]http://www.huffingtonpost.com/david-bronner/herbicide-insect...

[2]http://static.ewg.org/agmag/pdfs/pesticide_use_on_geneticall...

[3]http://www.wsj.com/articles/limits-sought-on-gmo-corn-as-pes...

[4]https://en.wikipedia.org/wiki/Neonicotinoid#Toxicity
Most of those who know me really well agree that were I not Schizoaffective I would be a tenured professor by now. We will never know but maybe I would be well on the way to that Physics Nobel I always coveted.

"Coveted" is the just the right word.

I would still be down with that but these days the Nobel I covet is Literature.

But Life is what happens when you're making other plans.
you could also use a library to handle captchas. have a look at 'tesseract'
I've had a very slow-moving hobby project to parse and analyze a subset of this data: https://github.com/rcompton/black-market-recommender-systems

So far I've had some ok results along the lines of "91.7% of vendors who sold speed and MDMA also sold ecstasy" http://ryancompton.net/2015/03/24/darknet-market-basket-anal... I am working on extending this to markets besides evolution now.
I found the animated GIF next to the article to be incredibly distracting while reading. I had to remove it using the inspector to be able to get through the article.
Gwern has a Patreon page now for anyone interested in supporting his research: https://www.patreon.com/gwern?ty=h
By the standards of US prime time television, almost all of Reddit would need to be on UR, even the heavily moderated parts.
I tried, in my previous two posts on this thread.

At this point, I think we're in an infinite loop. AnimalMuppet out...
I don't know what the market will do, maybe fall hard, but I can tell you from personal experience it has utility over the alternatives in situations I've come across
11/6 may have been a valid expiration date before November 2006, but not anymore. So a smart algorithm could tell that you meant 1/16 rather than 11/6.

It even works if you put the year first. 16/1 is valid, and it's clear that 16 is the year. Meanwhile, 1/61 either contains an invalid month or is too far in the future to be a valid expiration date.

NearlyFreeSpeech.net [1] does it right. It accepts anything between 3 and 6 digits (MYY, MMYY, MYYYY, MM YYYY, YYYY/MM, etc) and only throws an error if parsing it results in an impossible date.

[1] https://blog.nearlyfreespeech.net/2015/05/13/new-payment-fea...
If you're intending to use it for biological samples, how are you intending to address biofouling?
The motivational aspect is, in my experience, a consequence of working 100% from home. Spending that much time at home can make it hard for me to get stuff done. I'm perfectly capable of being productive when I work from home occasionally...possibly even more productive than I am when I'm in the office since I'm less distracted, but find that my productivity drops off considerably when I work predominantly from home.

There's easy fixes for this--headphones, coffee shop Wi-Fi and a VPN connection work well for me--but I have to do something or I go stir crazy and can't get much done.
On startup valuations
I'm curious if, as an alternative, you'd rather see decentralization (smaller population units), some kind of global superstate, or something else entirely?

We've all seen the poisons of nationalism, but I wonder if what one might call "tribalist" tendencies are so easy to vanquish - assuming one even wants to.
No one said that regulations are going to make everyone perfectly safe all the time.

However, you cannot convince me that people will somehow be safer with no regulations.
You should take the time to read his other posts. Gwern is one of the most fascinating people/websites I know of.
I see roughly 1 certificate error per week browsing the web "in the wild". I've learned how to click through. I barely consciously notice them anymore.
I think part of the value is that it is Instagram that's doing it. It's reassuring to know that some method is actually being used at scale by a service with millions of users, rather than having to rely upon the experience of someone who merely knows the theoretical side of things.

Instagram's database sharding post was reasonably detailed and good at explaining things. Yes, the same info is probably on stackoverflow, but I'll waste a lot of time there trying to understand untested opinions.
I really don't understand how they interact.

Is it because they are unaffected by electromagnetism that they seldom interact with each other despite being gravitationally attracted to each other? It seems given the sheer amount of it, that the universe should be taking a radiation bath from the past history of insane amounts of dark matter anihilating.

If they don't interact often, then why isn't the Earth's core filled with dark matter?

I'm also curious what particles they decay into.

Also, read this just the other day:
http://www.nature.com/news/did-dark-matter-kill-the-dinosaur...

/ramble
These are probably at least half the software engineer positions that pay more than $150k+ in the DC area. Most of the software jobs among start-ups and even commercial software development pretty much capped out a fair bit below that. I know I was dropped from several interviews just asking for a base of only $130k and not being very good exactly.

There's a demand for people that are actually serious security professionals in the engineering sense just as much as there is a massive demand for the bureaucratic "security" folks (that focus upon certificates and such to get their feet in the door of some random defense contractor).
Just because they did $7.1 billion in transactions last year, it doesn't mean they're not rookies.

Most of the big IT companies in this side of the world follow the ideology of "we don't care about doing things correctly, we only care about getting the stuff done" and succeed because of the traction they generate due to the lack of serious competition.

Recently Amazon joined the e-commerce arena in Mexico, but my expectations are that Mercado Libre will follow the footsteps of Ask.com, Source Forge, etc. instead of improving, they have been arbitrarily doing UX anti patterns in the last years in order to protect their income at the expense of the users.
Moore's Law starting to falter?
Wonder just how secure the @keybase.io email part of this is going to work? Would you have to load this email into a client or would you just pull down the email in Node?

Thoughts anyone?
Note Emacs uses http://git.sv.gnu.org/gitweb/?p=gnulib.git to abstract away platforms differences
Blessed makes sexy terminal apps easy. But of course I wanted more, like making terminal apps in the React (functional reactive) model[1], using ClojureScript (running on nodejs). And then at some point cross-compile simple text-based interfaces to both terminal (through blessed) and to the web and mobile (with React and React Native.) So I've been at this for a while, when time permits, assembling such a library on top of core.async:

https://github.com/goldfeld/i9n

I'm going for simple and declarative, especially for common terminal interface navigation, such as menus, lists and dashboards. Now I'm working on a built-in tiling/split windowing system and on to become a terminal multiplexer toolkit builder of sorts I guess. The whole motivation behind this work is automation of developer environments through an efficient interface (inspired by vim and implementing its command mode).

[1] There's still quite some state from blessed to abstract out.
YEC
Is YEC (yec.co) worth joining? Any members here?
Just FYI, MDMA is ecstasy.
Interesting. I'll have to look into this more. Never can have too many fuzzers.
This is an advertisement for a $50 quiz with 36 multiple choice questions.
(1) I'm working on simple programming language, like forth, but in Chinese. It may also control a tortoise like logo. Just for fun. http://qinmishu.org/static/wangbalang/repl.html

(2) I also created an illustrator software called Suosuoban. It is an illustrating tool that allows you to express your ideas by drawing pictures quickly on computer screen. I think the most important feature that discriminate it from others is "bubble clusters". It is an opensource software, find it in https://github.com/henryscala/suosuoban.
Airbnb is a great example of how date science, metrics, users feedback and growth hacking have been totally integrated to the marketing development of the service.
Their amazing growth proved how important it is to focus on people more than numbers.
Honestly, what would be nice to see, is the breakdown: who is making money, and how much, when one rides the taxicab, i.e. Uber vs Yellow Cab vs whatever-cab.

Also, whether the price is sustainable, or is it just price-dumping.

I want to give more money to the cabbie driver, and then less and less to the broker (Yellow Cab or Uber) (10% finders fee is what is common in other businesses), medallion owner (0% - provides no value), car owner (investor - 10% a year would be great investment), licensing board (fixed fee, say $300), insurance ($thousands per year for sure), and whoever else is trying to make money on this.
> generate at least $1 million in annual revenue, or…

That is one of the requirements to see if you qualify to join YEC. I would say that if you are making 1mil in annual revenue then you are doing good without YEC
I find it pretty annoying how often things are advertised as C++ but are Unix specific. As someone who ships Windows + OS X + Linux I'm pretty biased though.

Anyhow, there's pretty good support for stack traces on Win64. For 32 bit it's less good. https://msdn.microsoft.com/en-us/library/windows/desktop/ms6...
It's very easy, civil disobedience is one of the fastest ways to change laws. Especially if you have a large base of support, which uber has. Uber uses civil disobedience very well to achieve its goals and move into new territories. Just because we aren't talking about freedom or human rights doesn't mean that this isn't the same exact behavior.
It's not unreasonable to expect better transparency, that's something that's improving too slowly. We don't even know if this was exploited yet and it's been a couple months and there's always a lot of opacity around hacking incidents.

Security is hard and accidents are easy, dropbox once had a four hour period where they didn't verify passwords!

http://techcrunch.com/2011/06/20/dropbox-security-bug-made-p...
Most companies do exactly that, everyday. If the penalty is less than the cost to follow the law most companies will not follow it.
New Deadly Weapon Used by French
Some is still pretty appropriate

Monitors performance using task manager. When spikes show up he investigates. Problems were usually blocking in the database. It's always database issues. Rarely any problems in .net. Because POF doesn't use the .net library it's relatively easy to track down performance problems. When you are using many layers of frameworks finding out where problems are hiding is frustrating and hard.
Well, this seems fitting here: http://www.pagetable.com/?p=53

"The Ultimate Commodore 64 Talk @25C3"
Getting too little sleep can have serious health consequences (2013)
By exactly the same arguments, you should have been buying loads of CDOs and mortgage-backed securities in 2006 and 2007.

It's actually very scary how many people have already forgotten the lessons of the causes of the Great Recession.
I'm far from an expert on economics, but I thought a large part of the value of a currency is the country backing it. If you are a business in the US, you are required to accept payment in the form of US legal tender. i.e. Walmart can't decide tomorrow that they will only accept rubles (or, more relevantly, Bitcoin). So as long as there are people in the US doing business, the US dollar retains value.
http://sweetj.co clickable
If you're considering changing companies, check out http://www.glassdoor.com/ which provides compensation estimates for roles within companies as well as employee reviews.

I've found their reviews and compensation estimates to be reasonably accurate. I follow a few companies there, and get updates when folks post new reviews. Just for fun, try following your own company to see what others think.
I like AirBNB, but this article doesn't seem to espouse much besides "AirBNB has grown like crazy and that makes things tricky" and "We don't treat numbers like medieval doctors treated the humours".

Data-driven decision making is a generally dope thing, but the number one pitfall of using data as your number one periscope is that for anything more complicated than Yes/No questions, you can pretty much skew things however you want. [^1]

Along those lines -- the article talks about the importance of customer-driven decisions, which is something I 100% agree with, but doesn't really expand on it. It ends with the thesis "Data is the (aggregated) voice of our customers", but what steps do the folks at AirBnB take to make sure that this data is more than pale proxies for voice?

[^1] I'm probably the umpteenth person to invoke this in the past 24 hours, but lies, damned lies, and statistics, you know?
Thanks for sharing your stories and lessons learnt. Also appreciated is your explaining in the context of the larger Fb sys infra and the services instagram engg. deliberately decide to rely on.
Ask HN: How do I break into management?
As a senior engineer and tech lead , who is very good at analytics, how do I break into management?

My company structure is very flat. There are 8000 employees and about every manager has 15 to 20 reports.
It's very hard to go up ladder. I just switched job last year so can't switch it again for another year.

I do want to practice and hone my management skills though. Any suggestions?
This is a little tricky. A friend of mine has significant equity in the company he works for and they spotted the K-1 in his returns. It took a lot of work for him to convince his mortgage banker that he truly isn't self-employed.
Should one add WebGL to the list?
Never too late to switch to Linux. As an ex Amiga fan Linux is the closest I can get to what the Amiga could do.
The preposition at the end of that sentence is unnecessary. Guessing you're from the midwest? :)
Cool, thanks for changing it. I'm not quite sure why the slightly rebuking tone of your comment, but no worries.

> the story is obviously interesting.

That's far from obvious. I have a PhD in evolutionary biology and a background in natural history and visit Ethiopia from time to time and yet it seemed to me of interest to that journal's audience but not beyond. Definitely no particular reason to be discussing it here, but of course I'm not against doing so!

If the critical tone is because I was making a negative comment and negative comments are somehow unwelcome on HN, then I object. I don't care what the community guidelines are in that respect if they tell me to be kumbaya positive.
Woman has to change name by deed poll to log in to Facebook
How spyware peddler Hacking Team was publicly dismantled
It seems very likely that CDNs will acquire special rights designations when it comes to content responsibility, much like search engines have. Whether that will occur through judicial precedent, or through specific legislation, is the only question.
Hacking Team Emails Expose Death Squad Deal, Secret U.K. Sales Push and More
Unrelated to the darknet, but this Twitter account evoked a very similar feeling in me (random snippets from userboards in the 80's and early 90's):

https://twitter.com/wwwtxt
I'm sorry, but my take on your comments is that you haven't actually been on any SPA projects (yet). Having been on several over the past two years, I have a clear understanding of the trade-offs, benefits, and complexities. I was very skeptical two years ago, but that skepticism has been mostly eradicated.

Sure, if you have bad programmers, no pattern will save you. But if you want speed, agility, and separation of concerns, SPA + services is currently the way to go.
1. "No-SQL land" - Most of those things are NoSQL databases?
2. ""Traditional" Schema'd SQL" - Amazon RDS isn't a database, and those are relational databases.
3. DynamoDB has effectively the same data model as Cassandra.
4. "Hadoop" isn't a database. Cloudera is a database vendor. EMR (what you call Amazon MR?) is Hadoop as a Service.
5. I don't even know what to say about the "batship crazy" thing.

Every data store has a model. Typically we classify them based on their model.
I don't think SSL/TLS allow key lengths > 128 bits with RC4. Export is 40 or 56 bits. You can see most supported ciphers here: https://www.openssl.org/docs/apps/ciphers.html

e.g:

TLS_RSA_WITH_RC4_128_MD5 RC4-MD5
TLS_RSA_WITH_RC4_128_SHA RC4-SHA
TLS_ECDH_RSA_WITH_RC4_128_SHA ECDH-RSA-RC4-SHA
TLS_ECDH_ECDSA_WITH_RC4_128_SHA ECDH-ECDSA-RC4-SHA
CHCF: Nurturing Innovation for the Common Good
Microsoft’s PhotoDNA: Protecting children and businesses in the cloud
There is no requirement to sign up. The link is to the abstract, but if you read it and find it interesting, there are two links to the full paper, as both pdf and text.

http://www.security-informatics.com/content/pdf/s13388-014-0...
The biggest one for me is that bug management tools tend to be "another app" that I have to deal with in addition to issue tracking (not necessarily bugs) and task management (also not necessarily bugs), as well as potentially being separate from code changes (i.e. matching commits to bug fixes or features). The cognitive overhead is pretty high.

At my previous team, we largely used Github Issues to track everything. This worked, for the most part, but it made tracking things that weren't code-related iffy. For instance, designs for new features don't necessarily belong in Github Issues, nor do feature requests, or non-code related tasks like setting up a new server.

There's just only so much cognitive overhead we can have to track all of these things, and adding Yet Another App for bug tracking is tricky.

That's just the first thing that pops into my head. Good luck. :)
Texas House Panel Approves Full Legalization of Marijuana
A hamburger sushi roll sounds kind of intriguing!