skysight-inc/HackerNews huggingface dataset:
The tests are flawed. He concats all the json in the BOOKS into one file yet loads them as 3 separate files in XML....

Really?
That should just be http://lively-kernel.org/
You get a bunch of positives and check/bruteforce afterwards. This system couldn't distinguish my creditcard PIN from my office alarm PIN code, but it can give a shortlist to try.
Richard Clayton did some research (some time ago) about cleen feed.

The paper linked on his page here - (http://www.cl.cam.ac.uk/~rnc1/)

> I examined BT's CleanFeed system (its proper name is the BT Anti-Child-Abuse Initiative). This was designed to be a low cost, but highly accurate, system for blocking "child pornography". At first sight it is significant improvement upon existing schemes. However, CleanFeed derives its advantages from employing two separate stages, and this hybrid system is thereby made more fragile because circumvention of either stage, whether by the end user or by the content provider, will cause the blocking to fail.
Google Security Rewards: $2 Million Later
Yes, it's unfortunate that I lost a bunch of articles in a drive corruption on linode: http://bluishcoder.co.nz/2013/04/03/parts-of-this-site-tempo...

I've been going through archive.org recovering posts when I can. I do have a bunch of the factor articles in my project that produces a PDF from them: https://github.com/doublec/factor-articles
Carbonara :-)
I'm surprised no answer mentions the Kolmogorov complexity [1]. There's a fascinating link between how a given series seems "probable" to humans and its Kolmogorov complexity.

[1] http://en.wikipedia.org/wiki/Kolmogorov_complexity
"The 4xx class of status code is intended for cases in which the client seems to have erred"

vs

"Response status codes beginning with the digit '5' indicate cases in which the server is aware that it has encountered an error or is otherwise incapable of performing the request."

There's always that quote people chuck around a lot about censorship being an error so the internet routes around it. By that definition the server knows it has errored so it should be a 5xx response.

[Nerdit: Fixed the quote marks]
I have no clue about US politics but this sounds cool!
Could you gradually re-introduce air pressure at the end of the tube before the payload exits towards orbit?
It's like twitter with no ads and no one on it. Also the api is less restrictive than twitter's but you have to pay a small fee to use it. The fact that the api is less restricted allows devs to build any kind of apps on top of it and this is what they are trying to push right now.
Front-End Web Dev Trading Cards
Interview with Stefan Vladimirov from Swipes
PDF Service Memory Leaks
Who is offering that?

I know Google has a $30 million prize for putting a rover on the moon.
if someone's brain is backdoored, does that mean they are likely to enjoy anal sex?
Who said that it had to be one of two models? Microsoft Windows works much the same way Android does by running on lots of vendor hardware. People don't have to wait for Dell to push out updates, for example.
I'm not sure that just this one word 'editorialize' is clear or specific enough, particularly given that a person much more readily identifies an 'editorialized' headline if it's one s/he disagrees with.

Perhaps we should add an information criterion? E.g.

"Otherwise please use the original title — unless it is linkbait, or misleading (or uninformative) about the content of the article."
Excellent and long awaited initiative! I have a genetic hearing loss on both ears. It's a bit different on both ears though. Now I use Poweramp for Android with its excellent EQ to tune the audio as good as possible after my "cookie cutter" audiogram. On my computers I use the system wide EQ "Hear" [ http://www.prosofteng.com/products/hear.php ]. One inherent flaw with all solutions I've come across so far though (as with yours?) is that EQ can't be tuned differently for each channel (left and right).

Nice idea though. But I'll have to wait for a system wide Android EQ (there is one, but it has too few bands https://play.google.com/store/apps/details?id=com.smartandro... ). Preferably combined with your hearing test based EQ (can't say much about it as I don't use an iOS device other than at work).
What do you eat that costs that much? I spend ~¥25,000 ($250) a month on food for two people (not including eating out once a week or so) and that's making no special attempt to save money on food. We eat a lot of fresh veges, fish and meat.
Pilots who have actually flown the F-35 would argue with your claim that it can't turn with the "Teen" jets. The kinematics of the F-35, when compared with comparably loaded Teen fighters, is superior.
UK ISPs might not have to block websites for much longer
Schneier had this posted on The Atlantic two days ago, previous discussion: https://news.ycombinator.com/item?id=6199706
There are two types of foods I find depicted in those documents :
- "Emergency" foods used to prevent malnutrition
- Supplements in order to balance an unhealthy diet and/or reach individual needs

It seems that these goals are completely different from the one of Soylent, which is to provide a food replacement altogether (meaning people will expect it to taste good, make them feel replenished and won't use it as part of a treatment).
At 92, a Bandit to Hollywood but a Hero to Soldiers
I don't think it's about built-in support. I believe it's about how JSON maps to common language constructs such as lists and hash tables. XML on the other hand needs to map to a complex tree structure that requires another level of abstraction.
It's actually not that misleading when you consider that that's the technique scientists have been trying to make work for humans all along. They use a solution to strip the donor heart of all of it's cells, leaving only the scaffolding, and then re-seed it with the recipients own cells:

http://singularityhub.com/2009/06/23/stem-cells-used-to-grow...
Megaupload, the Copyright Lobby, and the Future of Digital Rights
Then buy a commercial MRP. There are cheap ones around.
The origin of the 8 hour work day and why we should rethink it
That can also be a symptom of depression. You need the endorphin/dopamine/serotonin/etc rush to help bring you out of that state for a few hours. At least that's how it works for me.
Your attack relies upon security by obfuscation, hoping that no-one will notice that the behaviour is incorrect (we obviously disagree about the chance that such an attack will be spotted but I think to some degrees that's irrelevant).

The RNG attack has correct behaviour under every statistical and blackbox analysis. The only way you can break it externally is if you have the key.

If you were designing a cryptosystem you'd pick the one where the security lies in the key and not in obfuscation. The same applies when designing an attack you want to keep secret.
Isn't this the new go-to startup strategy? Startups for startups?

Not a bad strategy - especially when you can very closely identify with the problems your new customers are experiencing.
I meant that he's trying to hide HN's real intention, publicity for YCers - their job ads and blog posts are on front page but no one else is allowed, and if anyone else's story gets up there it's dealt with by his algos. Algo's are good, but his algos are specifically designed to promote his content while not revealing that.

Google has a strict policy of separating ads and organic, "do no evil". PG doesn't adhere to that. He even openly boasts about how he tricked his investors back in the day by having random people show up on meeting days, and encourages this type of behaviour in YCers - all the while expounding he doesn't like a-holes. Couple that with his decidedly evil hellbanning policy, he needs to do some serious soul-searching.
Here's a cheap alternative from an actual dietian:

http://www.reddit.com/r/TrueReddit/comments/1jvsie/the_man_w...

Spoiler: he doesn't think highly of either Soylent or its creator.
Read the following, and see if you haven't changed your mind!

http://www.datagenetics.com/blog/january42012/
Does anyone here know why they call those structures Enums rather than Unions?
> Sure if you prefer static typing then JS is not for you.

I did not say anything about static typing. Most dynamic languages are not forced by their specs to coerce disparate types into utter garbage. I invite you to type the examples in the Wat talk into a REPL for any other dynamic language and see how many of them produce exceptions.

> Continuations seem to be rare among other languages you could choose. Personally I have only seem them in LISP, what else is out there?

Before answering, I will point out that coroutines are equivalent to one-shot continuations, and coroutines that can be copied are equivalent to multi-shot continuations. Then, I am familiar with continuation implementations in the following languages: Python [1][2], Scala with any JVM runtime[3], Any JVM language with a particular runtime[4], C[5], Lua[6], Julia[7], and C++[8]. Of these, the ones for the JVM, C/C++, and Lua[9] are multi-shot continuations or equivalent to them, while Julia and Python are a bit more limited. I am not familiar with many languages, so I'm sure I've missed a lot of instances of this sort of feature.

> I would love to use LISP, but the libraries simply aren't there. Last time I tried Racket, there wasn't even a library for JSON.

I can't really speak to this because I haven't spent time trying to build real software using lisp.

[1] https://pypi.python.org/pypi/greenlet

[2] http://www.stackless.com/

[3] http://jim-mcbeath.blogspot.com/2010/08/delimited-continuati...

[4] http://oss.readytalk.com/avian/javadoc/avian/Continuations.h...

[5] http://en.wikipedia.org/wiki/Setcontext

[6] http://lua-users.org/wiki/CoroutinesTutorial

[7] http://docs.julialang.org/en/latest/manual/control-flow/

[8] http://www.boost.org/doc/libs/1_51_0/libs/context/doc/html/c...

[9] http://lua-users.org/lists/lua-l/2006-01/msg00652.html
Introducing Stripe UK
I discovered this the other day, and I was really surprised at how silently it happens. So, plover.net is run by a writer called Stephen Bonds. He's got article upon article doing what I believe is very insightful criticism of nerd/programming culture, explaining how he believes the artistic and political biases of "nerdy" people come about.

Someone linked to his article about Ender's Game (https://news.ycombinator.com/item?id=376820), which opens up with a comparison to pornography that he carries throughout. The original submission title was something like Ender's Game Review: It's Porn. It's an accurate edit.

Reading through the comments I found this exchange

> jimbokun 1723 days ago - Ugh. My kingdom for a submission down arrow. Citing Jesus and mocking Christianity as part of reviewing Ender's game totally jumps the shark. This is such an obvious troll, I am utterly disappointed that Hacker News has collectively up-modded this close to the top of the front page (as I write this). I thought this community was better than this.

>>pg 1723 days ago - Yeah, I thought the same thing. I considered killing it, but it didn't seem quite deliberately dishonest enough. I just took "it's porn" out of the title. I suspect that's why this got so much attention.

So, here's an author with a website full of essays talking about the issue with the unacknowledged self-selection bias that afflicts geeks, criticizing one of their most beloved works, and the response is "he must be fishing for views. let's not give him attention" (btw, Bonds' website does not have ads in it).

Truly bizarre.
Slightly related: https://developer.android.com/reference/android/media/audiof...
Also, of dynamic languages, JS is among the most performant, and many times faster than (say) Ruby.
I've heard picking a lot of high numbers is a better strategy than picking pseudo-random numbers.

The logic is, sharing the prize greatly hurts the expected value (when N people win with the same numbers, they split the jackpot 1/N). Certain people like to play numbers corresponding to their birthday, anniversary, or other meaningful dates that range from 1 to 31. In the big US lotteries (Mega Millions and Powerball), the numbers range as high as 59, so picking a bunch of numbers in the 40s and 50s greatly reduces the chance of having to share the prize.

Another interesting story I've heard (no source sadly): one time the winning numbers were exactly the same as the "lucky numbers" printed on the back of a fortune cookie. An inordinate number of winners shared the prize, all Chinese food eaters who received the same fortune that week.
Yes, that's why we built that airport and hospital on the North Pole. Now intercontinental flights can make emergency landings in under 30 minutes at all times.
IT careers: Does it pay to become a brand specialist?
Not really. One could try an experiment to go 40 days without pants, and the fact that it's an experiment doesn't mean that one has an unhealthy relationship with pants.
It's significantly harder to write a compliant and performant parser for XML, even if one might be able to make it as fast. But, after parsing, the application developer still has to transform XML data into something usable to their program. This is much easier with JSON since it's information model (map/list/scalar) matches the information model of most modern programming languages.

XML is a poor choice for most serialization since it has the wrong information model. It's designed for extensible document markup and most application data packages aren’t documents that require markup.
On the Texas lottery site they list counts of how often every number is picked. It wouldn't surprise me if other state lotteries were similar.
Yes, I also find this expensive (but not insanely given that I probably pay around 300 EU a month for now). I guess the high price could be explained that you are not only paying for the food but also to fund the Soylent campaign (with all the R&D, industrial process behind it). I surely hope it gets cheaper though.
Perhaps the original title could be kept as a tooltip, so people could see both.
Perl PDP-11-endianess bug story (2013)
In 1997, I had just started my consulting company (wasn't really a 'company'..it was just me). I was asked to provide technical project management help on a web site rewrite bmgmusicservice.com. Kind of a lame ecommerce site, written mostly in client side javascript (which now would be cool, but it was pretty hacked up then). Anyway, we worked with a company Boston (ATG), who had this new thing called a 'java application server' called 'Dynamo'. At that point, the category didn't even exist.. you had to pay for JDBC drivers from Weblogic (because that's what they made back then).. things like that. These guys from MIT invented this cool technology called a 'servlet', which was a completely different use of Java than most had seen before and incredibly useful for developing web applications. It was one of the coolest technologies I had ever used, written by some really brilliant guys that became very rich in the process.
None of us really had any idea what we were doing, but we figured it out as we went along. We launched the site and it became the 6th most trafficked site on the Web within 6 months.
It launched a category, an IPO, and has been the cornerstone of my career (still going over 15 years later).

ATG Dynamo, even now, is still one of the most brilliantly conceived, elegant pieces of software I've ever used.
And when the engine cannot do that for you, there is always Math.imul
What confuses me is why many submissions are killed off and hidden. For example, right now, if you click new is show dead on you will see this grayed out:

15.[dead] Oracle's Larry Ellison enthusiastically applauds NSA spying (techeye.net)
1 point by Mitt 17 minutes ago | flag | discuss

I copy and paste it in to google, and find what looks to me like a reasonable article. It even has a CBS video source(1). It is a legit article and fits in HN guide lines. The submitter has a decent karma level too.

Why was it banned? Could one suggest that HN is protecting Larry Ellison from the likely criticism? Should I hold on to that, or will we get "openness", "transparency", and all the other things HN members seem to want from every one else?

Looking at these dead submissions makes HN look like one of the most oddly censored sites on the net. Many of them seem perfectly legitimate. Of course, I have no real idea how censored other sites are. Maybe we cant trust any one at all.

I'll tell members this: It would come as a real blow to find that a site and community one comes to trust, may not be trust-able after all. Title manipulation is bad enough, true, but what we have here is what we accuse others of, opaque censorship. With out frank explanation, I have to conclude that Hacker News is hypocritical.

Lastly, I do hope this isn't censored. Wouldn't that be ironic?

(1) http://www.cbsnews.com/8301-18563_162-57598390/tech-tycoon-l...

"ROSE: Let me just hear you clearly. You were saying whatever the NSA's doing is okay with me?

ELLISON: It's great. I wish, you know, it's great. It's essential. By the way, President Obama thinks it's essential.

It's essential if we want to minimize the kind of strikes that we just had in Boston. It's absolutely essential."

And, even if we disagree, its a reasonable position to take.
This deserves discussion. The parallels are striking and all but undeniable.

<edited for clarity>

I suppose the question business owners have to ask themselves is, do they feel that their country is at war in dire enough straights that they feel the need to surrender control of their businesses for the war effort?
That article is from years ago, and this current article is based on a paper published a few weeks ago. Science advances.
Just remember under the covers Akka is still using synchronization.
It's a little unfortunate that the author did not at least try to hunt down a few of them and present a conlclusion about if the warnings are benign or serious.

I don't have the exact version of Mesa that the blog-post (http://www.americanteeth.org/2013/08/14/valgrind-is-not-opti...) seems to refer to. But the first two functions in the i965 driver code that valgrind complained about basically do something like the following code:

uint32_t *surf = brw_state_batch(...)
surf[0] = ...stuff with flags for the GPU-code...
(...)
surf[5] = ...even more stuff, encoding coordinates and so on...
(...)

Unfortunately that pointer "*surf" seems to be allocated by some batch-buffer-memory allocation magic, so (after only greping through the source for 5 minutes) I would not be able to conclude if it's a fake warning (maybe refering to some memory that is allocated by some DRI kernel interface mmap-magic) or indeed serious (say, a mistake when calculating the proper boundaries of allocated pages). But with a library used as regularly as Mesa I'd give the authors the benefit of doubt and guess that to detect the subtle errors, one would first have to educate valgrind about that DRI-specific way of allocating memory.
I agree there's an annoying mismatch between how XML treats data and almost any programming language does. Without an XML-Schema saying otherwise (and, yuck), XML supports arbitrarily interleaved sequences of mixed elements, which can't be mapped cleanly to data structures in common programming languages without extra meta-data being supplied somehow.

Consider for example trying to map:

<some-data>

<a>...</a>

<a>...</a>

<b>...</b>

<a>...</a>

</some-data>

You can automatically map the first sequence of a's to a "aList" collection in your programming language, but then what is the automatic mapping of the one or more a's that follow the b element? Should it be a list or a single item ? Or is it semantics preserving to just combine it with the previous collection? If it should be mapped to a collection, what would that collection's name be in the target language, so that it doesn't clash with the previous collection's name? Etc. Formats like Json avoid this problem by only supporting sequences as explicitly named collections, like most programming languages do within objects or structures.

IOW with XML you can't really do a proper mapping without an accompanying schema or other metadata, which is not true for the Json data.
You can. Rollercoaster tycoon was originally written in pure ASM.

Allowing programming to be more widespread is a noble cause, but there comes a point (and I think it is approaching rapidly) where you layer so much abstration between the machine and the programmer, that they're guaranteed to write poor, or at least slow code. We need to find a middle ground, and I think javascript pulls in the wrong direction to this.
I agree that knowledge workers will be more productive if they reframe their time spent working to match their ability to focus on a task, but the logistical challenges behind managing people who work in this way would be a nightmare- it is easy to say that you would only track outcomes; perhaps I am not visionary enough but I think that the challenge is far greater than the author suggested.
Take a coin. The winning flip combination will be a somewhat random sequence like:

> heads-tails-heads-tails-tails-heads

Now what are the chances that you're going to flip:

> heads-heads-heads-heads-heads-heads

Is that chance equal to you flipping the winning combination?

And I don't mean for this to happen anywhere between the first and the million'th try, but the first try.

Sequences have different entropy values, which means they are not equally random.
http://en.wikipedia.org/wiki/Entropy_(information_theory)

Edit:

Also (but unrelated to the above), can you look at it this way?

There are X amount of same-number sequences (ex: 2222222, 3333333).

There are Y amount of non-same-number sequences (ex: 2449776, 4553219).

Y >> X

If that is true, then getting a same-number sequence is not just as likely as getting a non-same-number sequence because if the lotto draws from a pool of all sequence numbers, there are much much more non-same-number sequences in there.
I believe the D language and Rust both support this kind of model, where functions can be optionally pure, and data optionally immutable. They are both C-like as well, though D seems to be closer to C than Rust.
These articles are funny, coming up with all the negative possibilities of future technology. Elysium (new movie) showed another one, allowing a full download of people's brains, also to ill effect.

I can't wait until this technology is improved, so I can "search" my own brain to find all the stuff I seem to forget. I'm sure it's locked in my unconscious somewhere...
If we want to effectively fight censorship, we should stop using the language of those who falsely claim this is not censorship, and the courts that abuse their power to violate the people's rights.

It's not the sites that are being blocked, it's the people.

The sites are still there, fully connected to the internet, and there are dozens of ways to access them.

It's the people who's digital movements are being restricted, in a way that is virtually analogous to the restrictions totalitarian regimes impose on the freedoms of their citizens to access information and leave the country.

We are becoming the virtual prisoners of a regime not formed by politburos or generals, but judges with a total and complete disregard for the very foundation of the legal system they are supposed to serve.

Because let it be abundantly clear: as a citizen of a free and democratic country, I have every right to visit the Pirate Bay, read their blog or browse the thousands of torrents they have to offer. Nothing about this is illegal, in fact, my right to do this is supposed to be protected. It is part of the very foundation of our society that these rights are protected. Blood has been spilled to protect them, and these courts are spitting on the graves of those who have laid down their lives for our freedom.

There cannot be a functioning democracy if the courts can restrict the freedoms of millions without while the government looks the other way.