skysight-inc/HackerNews huggingface dataset:
I use 1Password as well, but instead of using its secure notes section for "security question answers," I put these inside optional fields in the 1Password logins records for the particular site. You can create whatever additional fields you like, or just use the note field. Further, instead of adding "valid" information, I use random strings of characters for my answers, and store them here as well, unique to each site. Seems much more secure than telling a whole bunch of sites my first pets name.

Another nice feature of 1Password is that it can store/generate the rolling Google Authenticator style 2 factor authentication codes right inside the login details in one of the additional fields.
I tried to acknowledge that HT is jurisdictionally complex; they are probably allowed, under the same charter that allows CIA to conduct HUMINT missions, to attack Italian security companies (modulo treaties, I guess). The issue though is that those attacks have direct impact on US companies, who (again) may rely on HT products for "zero day pentesting" (among other things).
The was a post like this just 10 days ago that got significant discussion (78 comments):

https://news.ycombinator.com/item?id=10175465
https://news.ycombinator.com/item?id=10175465
Show HN: Memory Reference Rails
3 Forms of Centralization That Have Crept into Bitcoin
Shit. Scooped. In 42 seconds...
Explorations in Parallel Distributed Processing
> The Jews, Italians, Irish, Chinese, and many more peoples all overcame decades, centuries, and millennia of brutal oppression to develop successful societies

> Why is that? Because African Americans have an average IQ of 85 and only 11-16% have an IQ > 100 (the national average).

You're comparing Jews, et al, to a specific group of Americans, African Americans.

While it may be true that the average IQ of African Americans is low, that is not inherent to their race, and more likely a massive by product of 400 years of American slavery, and then the continuation of oppression of Jim Crow laws.
Any links to the design philosophy behind the Frutiger font?
Putting on my tin foil hat ... one could imagine a box the size of a phonebook (or just a laptop) that could, when it encounters packets or encrypted data, send signatures and packets to the NSA data centers, and do the kind of matching/etc that they are building towards.

Heck, even having it try to decrypt the packet(s) in a distributed manner with $ALL_THE_KEYS that might have already been collected via nefarious means, and then return the key + plaintext that is most likely, certainly seems possible if the box was created by someone with the resources of the NSA.

I would be extremely surprised if someone were not already working on (or had not already created) something very much like that.
Because contemporary historiography has moved on and refutes many of Gibbon's propositions. So Decline and Fall is a good read, but also old enough to be a part of history itself.
I didn't know PNG was so simple. Encode scanlines in terms of each other, then pass the whole thing to DEFLATE... and it is effective. That's very elegant.
I'm not sure whether the U.S. actually has less regulation or it's just a matter of the fact that most regulations that affect small businesses are handled at the state level, and the states are pretty lax about enforcement.
Tell HN: Clickable domains and other new features for story quality
Here are some experimental new features to help improve story quality on HN.

We've adjusted the dupe detector to reject fewer URLs. If a story hasn't had significant attention in about the last year, reposts are ok. That's been the policy for a while, but we've brought the software closer to it. It will still reject reposts for a few hours, though, to avoid stampedes. Allowing reposts is a way of giving high-quality stories multiple chances at making the front page. Please do this tastefully and don't overdo it.

When reposting, please don't delete the earlier post. Deletion is for things that shouldn't have been posted in the first place, such as if you regret having said something publicly.

When a story is a duplicate—that is, has had significant attention on HN in the last year or so—it's helpful to post a comment linking to the previous major thread, so users and/or moderators can flag the dupe. In addition, when a URL isn't the best source for a given story, it's helpful to post a better URL in the thread. We often see those and change the posts to use them.

Both these practices are common in the HN community and make a big difference to story quality here. Thank you all! The following features are intended to make them quicker to do. We built them to make moderation easier for ourselves, but hope they'll be helpful for community moderation too.

First, you can click on a story's domain to see the previous HN
submissions from that site.

Second, when you're logged in, stories on /newest and on /item pages have 'past' and 'web' links. Click on 'past' to search HN for previous stories with that title. This helps with finding duplicates. Click on 'web' go to a Google search for the story title. This helps with finding better sources and catching spam.

Finally, when a story is the first post from a site, logged-in users will see the site name in green, by analogy with the green usernames of noob accounts.

These really are experimental and if any proves unhelpful, we'll toss it. We want HN to stay simple and coherent and not just be an agglutination of features. Your feedback will mostly decide what we do, so feed away!

Edit: ok, we tossed the green sites. More people disliked than liked them, and the same information is available just by clicking on the site name anyway.
Nope. Congress gave NASA more for their 2015 budget than the Administration requested [1]. In other words, the Republican-controlled Congress is more supportive of NASA than the Obama administration. Assuming it's partisan is ill-advised: the extra congressional support came from both parties.

[1] http://www.slate.com/articles/health_and_science/space_20/20...
Show HN: Deep Learning on Spark Notebooks
You only get one chance to make a first impression, etc.

I have a similar antipathy for Quora for requiring facebook logins to view their content (not actually theirs, their users' content) that came up during search results.

I believe they've now dropped the facebook login requirement, and I think they now show a lot of content from organic search traffic, but I plan on ignoring them anyway for as long as possible.
I agree and tend to think of it in terms of how the movie 300 depicted the Persians as monsters. They were nowhere near as monstrous in real life but the Greek saw them that way. And the only way to convey the sense of how the ancient Greek viewed them to our modern eye was to make them hulking giants.

In much the same way, Hackers had to do something to depict how we felt about computers at the time. I remember thinking how silly it looked at the time but I also remember it resonating.

Though, I have to say, I was much more inspired by Sneakers a few years earlier which was much more accurate from a visual and technical standpoint.
Thanks. Got me for a second.
Or Erlang, or rust
It shouldn't be a "dislike" button if it is only meant for sad posts. If anything, it should be an "sympathize" button.
The box in Sneakers is a valuable theft target, implying it is not merely a frontend, or if the Russians got it the NSA would simply revoke its API keys, so to speak. It's also the product of a stroke of genius by a single cryptographer.

It has to be a breakthrough in factoring large numbers very quickly, like what quantum computers are promised to be. So maybe possible after all, I guess. It's also very clearly a device, not an algorithm, so probably not a Von Neumann machine.
Found a reference: Driving Germany: The Landscape of the German Autobahn. p.130 onwards.
If there is one thing you should know about your medical record
Instead of the asinine speculation currently below your comment, I thought I'd post a helpful link explaining Obama's relationship with the surveillance state.

http://www.newyorker.com/magazine/2013/12/16/state-of-decept...
Pitch to Win the Meeting, Not the Sale [BD Bootcamp]
You have a legal and civil right to get it! Seriously. This is the one thing everyone should know and DO to change healthcare.

The more patients ask for their records, the more the establishment will twist/turn to make good on that legal obligation >> more disruption >> more innovation.
Schneier apparently doesn't even know what the NSA stands for (National Security Administration?) and yet seems it's safe to assume that they had infiltrated Hacking Team, and then proceeds to make a whole bunch of judgements and follow-on assumptions based off that first baseless assumption all while pandering to his userbase.

Well done, Bruce.
>tfw i have never gotten numbers like that in 7 iterations

:]
> Crime is primarily a function of opportunity. When opportunity is taken into account, the main reason for the discrepancy is blacks are simply more likely to come into contact with whites day to day than the reverse.

Crime is primarily a function of opportunity in environments prone to crime. In environments not prone to crime it is primarily a function of motivated offenders, and most opportunities are not taken advantage of.
My 7 year old recently asked me, "What were iPhone's like when you were a kid?"

Uh...
So what's the incentivization scheme for banks to run their own mining operations? And is there any real threat of a fork?
I have designed a few of these over the years and worked on others implementations. The common one I see the most is taking a 1x1 transparent image in the email with query string parameters to provide the specific data. Usually something like a this img src="/domain,com/imagename.png?i=UID. Also sometimes we will use the company logo as the tracking image, simply because it doesn't look like a "tracking pixel" by default.

The other way that I just did was basically the same thing, but the image doesn't really exist, like img-uid.png where uid is the uid I care about for tracking purposes. Then in my webserver setup I pass the details to a server side component to manage the tracking and return a generic 1x1 transparent image. There are lots of ways to do that, but it protects you for those cases where an email client strips query string params on img src's.

Of course if the user doesn't allow the images to load you get no tracking, so that is a limitation but most systems have that limitation. So you should also have link tracking etc.
Just because C is my primary tool) and I have created yupp, to do things like X Macros simpler.

yupp can even be used with Python, as it allows to make the right indentation, e.g. https://github.com/in4lio/yupp/blob/master/eg/dict.yu-py
Ask HN: 60-70% of our Stripe charges are failing. Help
We have a lot of unique payment failures on Stripe for a subscription product.

We've put measures up to try to reduce these issues including rejecting prepaid credit cards and doing a $1 authorization charge for our free trial. Surprisingly often, solid customers with a history of payment will suddenly stop charging.

Help please.
The medium is different. Sound travels 4 times further and faster in water than air. Dolphins even use sound to stun their prey.

Sound in water is a more effective weapon. The ping of a sonar is a weapon within the medium of water. A quick search:
"There are no noise-cancelling headphones to stop the U.S. Navy's 235-decibel pressure waves of unbearable pinging and metallic shrieking. At 200 Db, the vibrations can rupture your lungs, and above 210 Db, the lethal noise can bore straight through your brain until it haemorrhages that delicate tissue. If you're not deaf after this devastating sonar blast, you're dead."
This result was (as far as I know) first published in 1990 by Aho. [1]

In 2001 I posted online a reduction from SUBSET-SUM to regular expression matching with back-references (which I worked out on paper while on holiday, in the days before the internet was readily accessible from Greek islands). [2]

1. A. Aho. Algorithms for finding patterns in strings. In J. van Leeuwen, editor, Handbook of Theoretical Computer Science, volume A, chapter 5, pages 255–300. Elsevier, Amsterdam, 1990.

2. http://bumppo.net/lists/fun-with-perl/2001/06/msg00008.html
I have a Raspi and have been researching how to control my sprinklers with it. The old sprinkler control box is flaky, failing, and inflexible, so I'd like to replace it, and it seems like a good excuse for a Raspi project. I have 13 lines, each controlled by a 24 VAC solenoid. The Raspi GPIO pins put out 3.3 VDC. So I need to convert 13 GPIO signals from 3.3 VDC to 24 VAC. If it were one line I'd buy a relay and be done, but I don't want to buy 13 relays. I think a couple of these will do the trick:

http://www.ti.com/product/uln2003a

http://www.ti.com/lit/ds/symlink/uln2003a.pdf

But I'm pretty fuzzy on electronics stuff.

If anyone wants to confirm that I'm on the right track that would be nice. :-)
Maybe it pops out as dark matter somewhere else in the universe or something equally strange.
Or we could celebrate another 'Hackers' at 31 -- the 1F-th anniversary of Steven Levy's "Hackers: Heroes of the Computer Revolution", a fantastic book on the origins of hacking, which also helped me get my first job as a programmer. (My employer-to-be had just finished reading the book too and we talked about it during the interview.)

Thanks Steven. (And Greg.)

https://en.wikipedia.org/wiki/Hackers:_Heroes_of_the_Compute...
Related - online tool to play with JPG glitching: https://snorpey.github.io/jpg-glitch/
Wine is hell of a project. Having all those windows programs running on linux/os x is really a huge achievement. I know that there is still a way to go, but I really admire this herculean effort put into this project.
(In the first line, I forgot about the less ubiquitous Johnston as a slow cooking predecessor to Gill Sans, sorry)
Samsung Foldable Smartphone (Project Valley) Coming in January?
My point is just that there was a chance (probably not a good one, but a chance) to have the war end so that Nixon could be a peacetime President like you're speculating about, and Nixon himself made sure that didn't happen.

I see what you're getting at, I just object to the presentation as the war as something Nixon got saddled with, rather than something he actively worked to have around for his own Presidency.
The hierarchy at the bottom is interesting, because going down the hierarchy doesn't get you a bunch. Why do I want gift cards? Or your shitty voucher? Mostly, I don't, though airline points are interesting because I can get them faster than money if I fly a lot.

There's another way to go down that list, and it's risk for monetary instruments. Cash is always at the top, with government bonds lower than that. Bank deposits like CD are lower and a bit riskier. At the bottom, you have things like sketchy companies issuing bonds with 20% interest, or vague promises from a founder that "this 1% equity will be worth 1% of a billion dollars!". Sounds better than cash, but definitely risky.

Anything that doesn't fit somewhere one that curve doesn't exist. Your IOU doesn't get me more money, and I incur a bunch more risk. Since nobody wants that, you don't see it unless it shows up on the price / risk curve somewhere sane.
What rights do I sign away when I bring in VC as investors? I've never seen this as "common practice" here in the states so I'm genuinely baffled. The most aggressive thing I've seen them is to demand a part in future rounds via prorata rights.
This one uses the shift/reduce approach but can be applied to any context free grammer, efficiently: [1]

[1] http://scottmcpeak.com/elkhound/
Very good improvements!

However, the green-URL-for-noob-domains may be problematic. The green is used to give an indication for potentially low-quality content, but public startup/project launches would all fall under the noob-domain heading.
Thus, with great fanfare, did they begin their own obsolescence...
Optimises what exactly?
I think asking this question without addressing the overall cost/benefit to society is not very productive. The overall goal, I think, is to allow startups to grow and thrive while at the same time being a net plus for society. I would argue that "ask for permission later" mentality of some US based startups is a net minus to society overall. While I don't have any love for the taxi industry the regulations around cars for hire were put in place for consumer protection. These are some of the same regulations Uber is currently trying to get around (surge pricing in particular). Similarly, while I don't have any love for the hotel industry the regulations around short term housing exist to allow ample housing supply for long term residents of that city.

While inconvenient for the entrepreneur/investor/1%class most regulations exist for the common good of society. If a startup can prove that the regulation is outdated and doesn't make sense in the context of a new technology they should be able to convince the regulators that the regulation needs to be adjusted.
For those who are wondering what exactly "a special wine version" is, it isn't some new version of the drink, it is "a free and open source compatibility layer software application that aims to allow applications designed for Microsoft Windows to run on Unix-like operating systems". "Wine" stands for "Wine Is Not an Emulator".

https://en.wikipedia.org/wiki/Wine_%28software%29#Pipelight....
> But just so I can understand what you're saying, why do you think it's a big assumption?

Are you serious? Because there's no proof or mention of it anywhere. You're making an assumption based on literally nothing more than "well obviously, based on what I've read on the Internet, they could have done it so they must have". You're bending facts to fit a worldview, something I'm sure you yourself detest elsewhere in life.

This is like Russell's Teapot but for the NSA. You're shifting the burden of proof to someone who now has to prove a negative.
From the GitHub README:

Interim

Interim OS is a radical new operating system with a focus on minimalism. It steals conceptually from Lisp machines (language-based kernel) and Plan 9 (everything is a file system). It boots to a JITting Lisp-like REPL and offers the programmer/user the system's resources as filesystems.

Interim runs on:

Raspberry Pi 2 (Broadcom VideoCore4/ARMv7, Bare Metal)
Olimex Olinuxino (Freescale IMX233/ARMv5, Bare Metal)
ARM5+ Linux (Hosted)
Intel/AMD x64 Linux (Hosted)
This is just speculation, but I'd think it would be important for the brain to have a way to manage it's memories... you wouldn't want memories just randomly appearing, all the time There has to be some way to orchestrate memories, and I wouldn't be surprised if the more active neurons are involved in that orchestration. In other words, couldn't those exceedingly active neurons be contributing to suppressing memories?
Finding the right career after college (nerdy light)
"The Potato Factory: The Australian Trilogy" - Bryce Courtenay
From the Cox article:

As far as the theoretical term is concerned, regular expressions with backreferences are not regular expressions. The power that backreferences add comes at great cost: in the worst case, the best known implementations require exponential search algorithms, like the one Perl uses. Perl (and the other languages) could not now remove backreference support, of course.

Cox then proposes a hybrid engine that can be quicker when capture groups aren't needed. TCL has this sort of hybrid implementation, http://wiki.tcl.tk/396. It's worst case performance won't be big-O better than Perl's for pathological cases that require backtracking.

If P no more or less equals NP today than in 2001, the article's conclusion has not lost correctness.
I'm guessing your CD player was workman.
You clearly have never dealt with the Professional Services & Consulting arm of IBM.
You could and probably should just include the information about parties joining, leaving or changing keys in the blocks so that there is no ambiguity about the involved parties. The fundamental issue is really making sure that a new party is authentic and not the equivalent of a fake account of an existing party.

You could come up with something like the process when verifying a domain for a certificate, creating a special DNS entry or serving some specific content at a specific address. This doesn't really work because nobody stops you from registering arbitrarily many domains, it is just meant as an example that the process does not necessarily require a central authority.

But there is a hard problem here, who is a party and gets one vote? Could a bank just create ten shell companies and then obtain eleven votes? Bitcoin kind of sidesteps this problem by implicitly declaring you a separate party if you possess some mining hardware and weighs your voting power by the hash rate of your hardware.

So you are definitely right, Bitcoin achieves a degree of distribution that is probably really hard to do without a trusted central authority that has the power to decide who is a separate party and who is not.

If the number of parties is small you could maybe still do it in a distributed way with some manual work. If a new bank wants to join they broadcast a request, use something like the mentioned DNS record to prove that the request is genuine and then all existing parties have to manually decide whether to accept or reject the new party and cast a corresponding vote. But this obviously doesn't scale well.
I don't think a little typo ("Administration") weakens his argument. I think this post is more of a thought experiment than a serious analysis of what most likely happened.

Though I agree that over the past few years, Schneier's posts have been less substantial in analysis and contain more "thought experiments". I enjoyed his blog way more when it was restricted to the subject he has expertise in, i.e. cryptography.
There is good decade between when you graduate and when you expect children.

Starting a business before 20-21 is not really ideal. Yes, some people can do it. But those people have an over the top mental and emotional maturity that nominal case is lacking, and college is a great way to get there.

Are you really suggesting that you see a CEO in a nominal high school graduate? Most of them don't have a slightest clue how to deal with people, let alone negotiate their terms -- knowledge in domain being aside.
Well it seems like he correctly predicted JavaScript would take over the world.
Beyond that, there’s the expense of having to make long drives to prisons that are commonly built in rural white regions, far from the incarcerated’s family.

It suits some politicians to have a large prison in their district, since the inmate population is included in calculations of representation (in accordance with the Constitutional design for representative government), but as the inmates can't vote, the number of people the congressperson has to actually answer to is that much smaller.

http://www.demos.org/publication/census-count-and-prisoners-...
Assuming you're not bound by rate limiting on the remote hosts and the average page crawled is < 1 megabyte, and you're running on something comparable to a medium EC2 instance, yeah I would say that is fairly slow.

I've written more web crawlers than I can count in php, python, scala, golang, nodejs, and perl. Right now assuming you want to just gather some form of JSON/HTML from the response, I would use golang and gokogiri with XPaths (and of course json unmarshal for json). It will make you laugh at 120k per day. Feel free to ping me if you would like to discuss making me one of those freelancers.
Prolly off topic but: I show my code to my sister who is a professional artist every chance I get. It demystifies the process in her mind and makes me better at understanding what is happening around her.