skysight-inc/HackerNews huggingface dataset:
More specifically for people not following jgrahamc's full story, he and co-authors wrote a paper making the argument that data and code need to be submitted with academic papers, and the pre-eminent scientific journal, Nature, saw fit to publish their paper. So the idea is getting attention; hopefully it will also gain traction, too.
A few things really stand out for me:

1) I am shocked how slow EC2 is and how expensive. A m1.large is $0.240/hr or ~$175/month. And it's 7-10x slower than a $350/mo dedicated box. You would be spending $1500/mo to equal one dedicated box (not including bandwidth and S3 fees). A reserved instance is cheaper of course.

2) The multiple queries test would seem to be the best one to really simulate real-world usage. JSON-serialization is mostly testing the language.

This test pretty much puts most of the interpreted languages on a full stack framework together at the bottom. Although django seems to come out at the bottom of the pack for some reason.

Then come the "raw" tests and JIT languages running full stack frameworks. And at the top are the compiled languages. Not really surprising there.

3) I'm surprised php-raw did so well. And that go did so poorly.
Ancient history: my press badge from Apple's final COMDEX.
The Demo link at the top of ptable.com is still powered by Kera's first generation demo software. It's a shame to lose it, but it seems their target demographic was more sales-oriented sites that would find high monetary value in people converting. That wasn't me.
In which way does it break user experience. Would like to know so I can try to address that and figure out a work around.
Great! This will come in handy for new projects. Unfortunately we had to create the same thing for our existing stuff.
Windows is clumsy on the network unless you've built up a suite of tools and know-how to manage it. The extra cost doesn't help much either.

As someone is said to be working on .net benchmarks, you may get your wish.
Iron Man mouse fuels your hot-rod red obsession, is all about the next mission
You submitting this on HN means you are open to have a conversation. So let talk about it. Give us some details, tell us how you need our help and how can we help you?
AngularJS + Bower: Writing Reusable AngularJS Components with Bower
> Because they broke the web for their users.

No, they didn't. The web works fine. They can browse it without any issues. The problems occur when they're trying to do stuff on their local machines.

> Not for users, no. The only gain here is facebook's bandwidth costs, at the expense (and inconvenience) of its users.

Change rarely occurs smoothly.
This is brilliant, looking forward to using this.

Is this in use anywhere?
From Jelte Wicherts writing in Frontiers of Computational Neuroscience (an open-access journal) comes a set of general suggestions

Jelte M. Wicherts, Rogier A. Kievit, Marjan Bakker and Denny Borsboom. Letting the daylight in: reviewing the reviewers and other ways to maximize transparency in science. Front. Comput. Neurosci., 03 April 2012
doi: 10.3389/fncom.2012.00020

http://www.frontiersin.org/Computational_Neuroscience/10.338...

on how to make the peer-review process in scientific publishing more reliable. Wicherts does a lot of research on this issue to try to reduce the number of dubious publications in his main discipline, the psychology of human intelligence. It appears that the discipline of economics research needs help with data openness too.

"With the emergence of online publishing, opportunities to maximize transparency of scientific research have grown considerably. However, these possibilities are still only marginally used. We argue for the implementation of (1) peer-reviewed peer review, (2) transparent editorial hierarchies, and (3) online data publication. First, peer-reviewed peer review entails a community-wide review system in which reviews are published online and rated by peers. This ensures accountability of reviewers, thereby increasing academic quality of reviews. Second, reviewers who write many highly regarded reviews may move to higher editorial positions. Third, online publication of data ensures the possibility of independent verification of inferential claims in published papers. This counters statistical errors and overly positive reporting of statistical results. We illustrate the benefits of these strategies by discussing an example in which the classical publication system has gone awry, namely controversial IQ research. We argue that this case would have likely been avoided using more transparent publication practices. We argue that the proposed system leads to better reviews, meritocratic editorial hierarchies, and a higher degree of replicability of statistical analyses."
Ask HN: True mobile testing - hot or not.
I'm building a prototype of a service that will let you test your mobile site or app on real mobile network - i.e. you will be able to see how your app will perform on various mobile networks in London/UK or New York/US. Please let me know if you'd be interested in testing it, have feature ideas/requests or have seen something similar out there. If you're interested in talking - shout out on twitter - @3marcin or email me on grodzicki on gmail.
Wow, I was floored at how slow Symfony is...

I have a feeling it's ORM that's killing these frameworks in the DB portion.
Due to a malicious denial of service attack, likely by our competitors, in which they leverage forum-promulgated references, which through human-mediated multiple hyper-text transfer protocol requests to our blog hosting infrastructure, attempt to access proprietary information about our strategic positioning viz a viz current nonpositive media attention,

we are unable to provide this patent pending document at this time.

Our legal department will be shortly dispatching a DMCA infringement notice to all parties "mirroring" our content as a sign of our ongoing commitment to protecting our valuable intellectual properties against these thieves and scoundrels.

If you should encounter any further difficulties with our information dissemination services, please sign the following non-disclosure agreement[1] and affix the supplied Fedex label to your firstborn. We aim to respond to all communications within 6 working months, as part of our Quality Commitment Assurance.

[1] Whilst blood is preferred, red ink will suffice.
In the case of the images linked in the CNet article (https://www.facebook.com/photo.php?fbid=457095677701847&...), it gives you a download link for the jpeg. However, the images in that album are displayed as jpeg (for me), and the only way to view the .webp image is to open in a new tab and add the .webp extension in the url myself.
Really glad to see the performance of Yesod has moved up closer to where I'd expect now that some of the mistakes in the original benchmark have been fixed. One thing I do notice is that Yesod is using MySQL as the DB backend for the DB tests, but it does have support for MongoDB as well. Looked at from that perspective it's actually one of the higher performing frameworks for all the DB tasks, but it's hard to say for sure because it's never tested with MongoDB (it usually lands somewhere above all the MySQL based tests, but below all the MongoDB tests). Would be interested in seeing how it performs with the MongoDB backend used instead. Maybe if I get some time in the next couple weeks I'll try to swap out the backends and make a pull request.
Based on there being no charges filed in the US related to Operation Payback even though the FBI served 50+ search warrants I think the DOJ's opinion is that it's not illegal.
"Searching encrypted data is impossible without fully homomorphic encryption"

That is not true; a private information retrieval protocol can be used to search encrypted data:

https://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=568331...

You could also use an oblivious RAM, although I do not think that is practical yet:

http://eprint.iacr.org/2010/366.pdf
including the data uri for the svg only makes sense. to include the data uri for all the images would be the same weight as downloading all the images plus about 10%.

The method at this link: http://estelle.github.io/clowncar/bgonly.html only does two http requests, the svg and the image used. We can bring that down to 1 by using data URI for the svg logic only.
How people are led to believe the lie, its only available in 4 devices..they compare it to instagram's android entry..how dumb can one get..

facebook should have released it as a beta product, it feels very barebone
NCSA Mosaic Turns 20
It doesn't seem that they're trying to actually build better workers, just that they want to select against poorer workers. I'd be more interested if someone tried to teach people the traits that make more effective workers rather than just using this data as a selection tool
I like getting different levels of detail from different networks, particularly since I've never seen a good implementation of multiple views at different "noisiness" on the same network. So it would be a net negative for me to combine all my streams in a single view; facebook is at one priority level, email is another, rss is another.
Evolve or die? How today's hardware giants are steering a course to irrelevancy
> Because they broke the web for their users.

No, they did not. They broke it for the people who download the image for viewing outside of their web browser.
I'm sure they're great guys, but I found it interesting how many obvious suggested changes were not incorporated at all. What's honest about it?
Python for Finance
What's reasonable about it? Why not use a non-broken hash algorithm?
Weasel wording filter:

Graf 1, sentence 1: "a few board threads" -> Internet's current most important programming forum.

Graf 1, sentence 1: "contributed to by our competitors" -> Smoke screen, unsupported, irrelevant.

Graf 2, sentence 2: "basically admitted they really didn't know the facts" -> Because the facts weren't provided, the contributors set about reversing them from published material, the point of the thread.

Graf 3, sentence 4: "does use publicly available, well researched, and NIST validated cryptographic algorithms" -> Virtually all cryptography anywhere can make a similar claim, and most of that code is broken. NIST validates primitives and a few basic constructions, but tying those primitives into a functional cryptosystem is outside their purview.

Graf 4, sentence 1: "for any customer deployments" -> Leaves open the question of whether they implement semantically insecure constructions in any setting.

Graf 5, sentence 2: "fundamental security features (full field encryption, randomization through IVs) were disabled" -> Randomized encryption isn't a feature, it's a fundamental property of a cryptographic construction.

Graf 6, sentence 1: "currently in the process of obtaining our FIPS 140-2 certification" -> FIPS 140-2 doesn't involve a rigorous analysis of cryptographic primitives; the crypto-specific components focus on use of NIST-approved ciphers and block modes, but do not assure that those primitives are used securely. To illustrate that point: every vulnerable version of SSL3 and TLS1.0 and TLS1.1 has had a FIPS-compliant implementation somewhere.

They should just be honest about their desire to suppress the use of their copyrighted IP in critiques of their product. They're in a competitive space, they're a small company, hard to manage their online reputation and build product, &c. The Reddit/HN/Stack Overflow scene wouldn't like that response, but it's better than this one, which actually creates more questions about their product capabilities.
Yes! We need to see more material under Matt Might's CRAPL license. I feel a strong urge to write off any result that doesn't have accompanying code with it.

http://matt.might.net/articles/crapl/
Basically, someone called out CipherCloud on apparently bogus claims about what they provide (homomorphic encryption). CipherCloud responded with DMCA takedown notices. Now they are trying to explain their actions, with a lot of "trust us, we are only hiding the crypto details because we need to maintain a competitive advantage!"
Step one, acquire billions of dollars...
For beginners I would suggest something like HaxeFlixel or HaxePunk (also based on nme)
There have been news about a security breach on Linode, do you have an account with them?
> However you should -never- -ever- -ever- indicate a preference towards a race, gender, sexual orientation or religious affiliation. Did I say ever? Ever. Ever. Ever. It's discriminatory, it's demeaning and it's illegal

Discrimination by private employers based on sexual orientation is not illegal in the United States under Federal law, nor under the state law of approximately 60% of the states.

There are long standing efforts to make such discrimination legal at the Federal level, and they have come close a couple times. [1]

[1] http://en.wikipedia.org/wiki/Employment_Non-Discrimination_A...
A foodie revolution cooking in West Africa
I had no idea that "open" Android was so locked down for your average (ie, non-rooting) user. Combine with bootloader locks, and you have mandatory privacy invading apps.

And some people think Apple is Big Brother?
Pee-pee Sucking Rabbis Infect Two More Babies
> Truly classic internet delusions of grandeur.

The delusion is yours : you don't know who you are talking to on the Internet, and you have assumed that the other anonymous writer is as mundane as you are. Says something about you, not me.

The irony of thinking, "Since I think Asimov / Steve Jobs / Linus / whoever is awesome, and so many other people agree, it MUST mean that the dissenting commentor is a troll or having 'delusions of grandeur'" is that when these people started out, I'm pretty sure self-appointed X Factor judges of the world future such as yourself told them exactly the same thing. "How deluded to think you can write an Operating System, you puny mortal, you Linus?!"

You are a follower, not a leader.

Edit : the person who wrote, "Asimov was an atheist. You misunderstood the story" is the one you have to learn from.
>> "How can I send someone a check?" is a counter-intuitive business model for most people

Great Point. This was the sole reason for Groupon's success even though were a lot of coupon companies before. Imagine what would have happened if Groupon charged small business to distribute their coupons instead of paying them?
Absolutely correct for an entrepreneur.

But If you are in good job but feel bored. here is my version

You may have the right job but the wrong working model.
Fixing the working model can fix ur work life.
All videos from wroc_love.rb 2013 conference
Now contrast that with Fred Wilson's post today, titled "You're Working Too Hard and Not Getting Anywhere":

http://www.avc.com/a_vc/2013/04/you-are-working-too-hard-and...

Grit is certainly useful when you're going in the right direction. But it's a giant waste when you're not. Which for startups, statistically, is normally the case.

That's what the Lean Startup stuff is for: frequently getting data to check your instincts. It takes a lot of grit to continually test the thing you're sure is going to work. And more to test the thing you're scared won't work.
Sounds like a ponzi scheme. Get a lot of big name investors to put money into Detroit, providing social proof, then pump it up with hype, hoping lower-profile money follows. Then exit. I see no fundamental reasons why Detroit should be a major city. Strategic location? No. Hub of its region? No, Chicago (which is also in decline). Competent city leaders? Not at all. Attractive climate? No. Safe? No. Historically significant commercial city? No, it was the home of the auto industry for about one generation; while NYC did recover strongly from a low point in the 70s, it had been a historically important commercial hub and trading post since the 1600s.

What is the appeal other than low cost of living (which I can get in many other parts of the country that offer better living conditions)?
Garantia Data Named to Inaugural CRN Big Data 100
Recognized for its outstanding data management technology that offers developers fully-automated cloud services for hosting and running Redis and Memcached datasets http://www.crn.com/slide-shows/applications-os/240152660/big-data-100-data-management.htm?pgno=12
The funniest thing about this article was the image comparison between JPG and WebP, saved as JPEG-vs-WebP.jpg. Nice one CNET.
I've had a similar question before. I have heard of as few as 60,000 observations was considered "big data" [1], yet at my company, we generate about 60 million pharmacy claims every 3 months, and no one here calls it big data. In terms of storage, it's on the order of a couple hundred terabytes for all our data. This is considered small enough that we can query it with traditional SQL.

Big Data, the experts say, is more about the novel way you analyze data, relative to the difficulty of the problem. A speaker at PyCon who was talking about algorithms and data structures for handling genetic data had a term that I like quite a bit better: "Data of Unusual Size" (C. Titus Brown at MSU was the speaker).

"Big Data" is a really big buzzword right now, but the term is overused and often does not convey the meaning it's supposed to. "Big" is a relative term. The novelty of how much data is being used as opposed to how much used to be used (in the sumo case, they had never handled so much data before) is what makes it big.

As for Hadoop, you'd want to use it when it's no longer feasible to keep your data stored in an RDBMS, or when speed becomes an issue, or when you want your schema to be more flexible than an RDBMS. If you are not concerned with the reliability of your data (RDBMS make the safety of the data a paramount priority--read the wikipedia page on ACID to see these guarantees), there's plenty of reasons for choosing Hadoop.

[1]: http://www.wired.com/wiredenterprise/2013/03/big-data/
[2]: http://en.wikipedia.org/wiki/ACID
[3]: http://hortonworks.com/blog/4-reasons-to-use-hadoop-for-data...
I haven't seen the case law which prohibits hiring for diversity. Could you direct me to some which demonstrates your assertion?
Yes and no. I think they're doing a variant of cache oblivious buffered B epsilon trees. Ill have to go code spelunking (now that the source is available. Boy am I glad it's gplv2 and not some (a)gplv3 variant).

Thanks for the interesting reference!
ErSo, there are a few things I don't quite understand. In the original study, Renhart had erroneously averaged 7 numbers together to get a slightly negative growth. The 'correct' result is obtained from averaging eight numbers together, resulting in slightly positive growth. What is unclear to me, is how are either of these numbers considered to be very significant? With so few samples in the average, I would draw the conclusion that both measurements agree with one another and the error bars for their measured result are quite a bit larger than they seem to be suggesting. Is this common in economics?
The Pirate Bay’s Gottfrid Learns of Hacking Charges via TV News
Ok, the website is starting to come back online after our huge spike in traffic.

Thanks for all the interest and for your patience...

-Tokutek
Making a Living Without a Job
As rayiner points out elsewhere in this thread, they should have had the comment period before they first deployed the technology - but they didni't. EPIC sued and in 2011 the court ruled that DHS needed to adhere to the law and go through the commenting process. After delaying for a couple years, here we are.
A PHP framework has to initialize all its systems from zero for each request. It may because of that, it may not, it's just a guess.
Stop voting for politicians who have proved themselves to be servants of lobbyists and corporations, start voting for these guys:

https://en.wikipedia.org/wiki/Third_party_%28United_States%2...
In the previous benchmark it was pointed out that they don't use connection pooling [1], I don't know is it fixed in this round

https://news.ycombinator.com/item?id=5499490
Those systems don't eliminate the need to trust, they shift trust from trade counter parties to the government that enforces the relevant agreements. The framework would crumble if e.g. we didn't trust the courts to hold escrow agents to strict fiduciary duties.
This is a prime example of how QS is supposed to work. Many people talk about deliberate practice, but the truth is, you can't practice deliberately unless you are tracking what you want to change. Of course, the other half of deliberate practice is knowing the most effective way to induce change, but much like in programming, how do you know it is working if you aren't tracking/testing it? Temet nosce.
I think one persons "you think she'll be better at hiring women" is easily another persons "she'll be good at making sure women are not unfairly turned away".

>>It's a strategy.
Yes it is. It is a strategy to avoid over looking awesome female candidates, intentionally or otherwise. Calling this a strategy is fair, calling is hypocrisy is not.

>>She's in there not because she's a great engineer, but because she is a woman who happens to be a great engineer.

No, she is there because she is a member of a group you think you may be discriminating against AND she is a member of the group you are seeking to hire for. Like you said it is a strategy.

You seem offended by what I think are very pragmatic ways to deal with the issue, care to suggest your alternatives? If you recall the OP is looking for legal ways to address the issue-
Leap Motion + Google Earth
Information about the Nature paper: http://blog.jgc.org/2012/02/case-for-open-computer-programs....

My co-authors and I chose Nature as the target for the paper because of its reputation and because I believe in going to 11 (http://en.wikipedia.org/wiki/Up_to_eleven).
"If a program manipulates a large amount of data, it does so in a small number of ways." Alan Perlis

"Big Data" has an operational definition. It's relative to current technology. Less than two decades ago a terrabyte was big enough that Microsoft created TerraServer as a technology demo [http://en.wikipedia.org/wiki/TerraServer-USA]. Terraserver would dwarf big data of the time when Perlis wrote Epigram 4. Today, TerraServer is dwarfed by Youtube.
woowww! What a great tool!!!! i´m fascinated!!!
This specifically refers to a call of strategies that are the equivalent of writing a put option. The short term cash flows from the premium are not commensurate with the tail risk. Both LTCM and CDS on subprime are examples of this type of strategy going up. Typically the options have a duration of years which raises the probability of a tail event significantly.
Robert McNamara and the evolution of modern management
Have I read it correctly that you are writing a system to distribute jobs among real people? When a person has a queue for assigned jobs? Then this is totally not suitable for a message queue system (AMQP/JMS). MQ system is for distributing messages among software components at runtime. Specifically it is not designed for querying messages or doing other stuff typical for RDBMSes.
I would say that "a couple hundred terabytes" IS pretty big.
EPIC has recommendations for commenters and a preliminary analysis at http://epic.org/TSAcomment/

Anybody interested in getting involved with an education/activism campaign to get more people to comment? If so, please let me know!
> They dropped the Microsoft Exchange format

For free customers. It's still there for us paying customers. Google pays Microsoft a licensing fee for use of the EAS specs.
Pekk, we'd love to address any problems you can point us to. Obviously we have limited time to work on this, so the best way to get a fix in is via a pull request. Are there any issues in particular you think are especially high-priority?