skysight-inc/HackerNews huggingface dataset:
>ideally, one not written in a bloated language designed for remote controls and set-top boxes

I don't know what you'd have to be smoking to use Java in a remote control.
I have; it usually is characterized by a collapse in real output (or loss of a war), accompanied by madly buying foreign currency at increasingly poor rates to pay off foreign debt.
Eyes on you: Experts reveal police hacking methods
Thanks. Will get that fixed.
I think it's just that they had nothing interesting to announce and not the the speakers.
Yes, definitely. We're keen to explore and include more testing and optimization models into VWO.
Dealing with frequent machine failure is one major issue, for example.

The original GFS and MapReduce papers (http://static.googleusercontent.com/media/research.google.co... and http://research.google.com/archive/mapreduce.html) go into detail.
A majority of educated Indians see Baba Ramdev as crook. A self-styled guru curing cancer with Yoga and whatnot. So yalogin's response may not link to hard evidence but just because Ramdev can get behind a cause does not mean majority of Indians believe in it.

EDIT: If anything - if you take intersection of salaried Middle class and Baba ramdev's followers, you will be left with a small set. I am not saying Bab ramdev does not have a large following, but in a country where literacy is 72% (with number going lower in north india, where majority of Baba ramdev's followers are), it is hard to argue that middleclass supports this man's viewpoints.
Actually one of their guys approached me last time explainshell appeared on HN. I think he suggested I implement it as some sort of shortcut, but I haven't had time to look into it.

I have a branch somewhere that exposes the results as JSON, which should make it easy to integrate if they were interested.
Interesting post, but I feel it might do with a rewrite. It has quite a few minor mistakes and odd formulations -- it feels a bit like a first (or second) draft -- not a final post.

Now, for a normal blog post that isn't such a big deal (in the sense that publishing an interesting idea usually trumps simply not publishing it, due to never getting it "done") -- but in this case it doesn't reflect very well on the author -- and that reflects negatively on the book (unfairly, I think -- AFAIK Armstrong usually writes well).

Or am I the only one that gets that impression from the post?
I'd say the Django equivalent for Node.js is http://keystonejs.com

It's in very early stages, but it looks very promising and similar to Django.
Hey from where are you shipping this from ?? I mean r manufacturing ??
Ordered one. Supposedly ships next week though I'll probably not get it before the 4th.

I decided to embrace the rectangle. Round UI is going to be tough to do right, except for UI built for roundness. Text is too rectilinear for roundness. Charging two things on the nightstand isn't going to be more onerous than charging one thing.
Deep, complicated inheritance hierarchies loaded with virtual functions is among my least favorite kinds of code to have to debug.
Interesting how what they were running is not only perfectly legal but also big business in other parts of the world. E.g. Where I live in Germany
Looks like the important thing here is now is that you don't have to care that Android runs on your dash computer. It's that the phone is using your cars built in display, touchpad, buttons, microphones and speakers as an attached display, speakers, and inputs to the phone.

The actual apps run on your phone and so your car gets updates when the software on the phone gets updates.

This mode is highly preferable to the end-user apps living in the dash computer as that will not get upgraded worth a damn over the life of the car no matter what.

This is exactly what I'd want to see in this situation and I can't wait to get an aftermarket replacement to cover the gap until I need my next car.
> Many people had advanced copies of various drafts of the book

Seems like you cherry-picked who got the advanced copies...
"bundled with a service that streams over the air broadcasts via the internet to wherever you happen to be"
Generally, if you're using MongoDB with a Node app, most people use http://mongoosejs.com as an ORM/ODM.
Not entirely true. The only free version is the "Community Edition", which runs on a single node; no clustering support, no monitoring, no hot backups, no caching. [1]

It's pretty much useless in a server environment since even replication isn't possible; if you want a redundant setup -- which you will -- you will have to keep the nodes synchronized yourself. Not to mention that since Neo4j is an in-memory database, it puts a hard limit on your dataset size.

They have a "Personal License" [2], but it lasts for one year and you're not allowed to use it if you have capital funding or a certain amount of revenue.

[1] http://neo4j.com/subscriptions/

[2] http://www.neotechnology.com/terms/personal_us/
>What would be your language of choice for the next gen, stable distributed file system?

Here's my heavily biased subjective opinion on this entirely hypothetical software:

I think we should do one or both of two things:

A) Do it in very clean, fast, simple C. Put an emphasis on speed and simplicity.

B) Do it in very reliable, secure, simple Haskell. Put an emphasis on correctness and simplicity.

With some effort, the C one could be correct and the Haskell one could be fast.

I mention these two languages because they compile to native code and have very good cross-platform support. You won't have any trouble running either of these on embedded devices (which I can't say for Java or Go. Go has some weird compiler bugs on ARM platforms, and the JVM is frequently too memory intensive for embedded). C has an advantage of allowing the absolute minimal implementation, and Haskell has an advantage of allowing a massively concurrent implementation. Yada yada yada

Of course, it could be that the question is completely irrelevant. Just define a spec for a DFS, and then let different implementations pop up in whatever language is best suited to that implementation's specific details.
Well, one key element of the original map-reduce paper is the way the data is spread around. Instead of building a giant NAS with specialized (expensive) systems, and then building a bunch of specialized (expensive) compute systems, and then shipping massive quantities of data around on fast (expensive) network, the map-reduce system is built on a bunch of well balanced systems in terms of CPU/ram vs. disk, and the job is designed in a way that it can be distributed to these systems and data transfer is minimized.

So in a way, everything is happening in the storage nodes and they need to be much more than just a filesystem.
Five real problems I really think need solving
That's not my point at all. That is, in fact, a gross misstatement of my point. Rather than assuming that everyone on the other side of this is an idiot and/or corrupt you'd be better served to step back a bit and try to work from the assumption that there are reasonable people on the other side of this.
Are web workers,any way related to service workers ??
If you query the two databases parallel then the response time should be equal to the slowest one of the two database responses (not the sum of them).
But if you use two database then you have to maintain both of them and if they are on the same server then sharing the same resource could make them slower than just using one db.
That is wrong. The law specifically says that cable companies cannot transmit TV that is broadcast over the air unless they pay rebroadcasting fees.
No, your A/B test did not increase conversions by 200%
Ugh, the verb form of "impact" is so gross.
White House losing Twitter war to India’s Narendra Modi
Sure. But most people think that people who create content deserve to (mostly) own that content and have the right to charge money if others want to use it.
Someone should write an article about how some Indian writers need to stop eviscerating "millions of indians" based on imagined opinions.

This article is downright insulting. I am an Indian, and I don't believe that the "black money" is going to solve all of india's problems. That isn't even the point. The investigation is a good thing not because of the actual sums of money, but because some extremely powerful people who have stashed away the money need to be brought down. As the author himself says, the siphoned-off money is used to manipulate markets and elections. Shouldn't it be taken off their hands?

And trust me, hardly anyone who ever read a newspaper would take Baba Ramdev seriously. The author just kinda threw that in - "hey check out how stupid these indians are... they listen to a yoga teacher lol"
> Having to charge my watch every day is annoying to say the least.

I used to think the same thing about smart phones when I only had little Nokia; now I don't even think about it.
RSpec or Minitest, How Does One Choose?
I agree with you somewhat that using curse words in book titles can be amateurish, like clickbait in the physical world.

PS the reason you're being downvoted is most likely because you prefaced your comment with "I know my karma is going to get nuked, but...". That's very Redditesque and is usually not tolerated.
> (That was a silent tax on anyone holding cash.)

Not really, because...

> To inject this money into the economy, they bought a bunch of securities.

Trading one financial asset for another is not the same thing as handing out cash for nothing.

Unless you want to make the case that a torrent of spending was being frustrated by being stuck in illiquid assets (and has subsequently materialized but has not been reflected in official statistics).
Yeah, that $500 is really a huge difference on $12,000 tuition, too.
How we created spooky experimental music in a superconductor lab
Would it make sense to use a bitwise test and two 128-part switch blocks?
I'll say the same thing here that I said in a response to the survey: I'd be interested in taking part in a CA co-op that seeks membership/sponsorship to cover its infrastructure costs (including the huge initial cost of becoming an accepted CA), but that does not charge to issue certificates, including wildcard certificates.

Certificates cost approximately nothing to issue, and most of the CA's infrastructure would not need significant scaling with the issuance of more certificates.

Manual validation of human/organization identities (the type that requires reading identity documents, such as for EV) costs money, and that could have associated fees, but it doesn't need to occur on a per-certificate basis. And automatable validation costs nothing.

In particular, wildcard certificates don't need to cost any more than standard certificates, and no-cost wildcard certificates would change the SSL landscape significantly. Today, any service that uses subdomains incurs significant fees to secure those subdomains.
I first started with neo4j as a primary data store for our semantic graph but there are some limitations that are forcing us to look for alternatives.

1. Adding edges to a neo4j graph is a painfully slow process. For a large graph with a few million nodes - it'll take days.
2. Scaling neo4j on a cluster is either not possible or it's a painful process. I'm yet to discover this.

However, the greatest advantage that neo4j offers is the ability to query a path. So far, no other graph databases that I know have this ability (including Apache spark and giraph).

It's quite possible to build a directed graph database as an adjaceny list in redis. We tried this and it's super fast and scalable. However, querying is very painful.
Google I/O: Ray Kurzweil – Biologically inspired models of intelligence
I'm pretty sure that absolutely nothing is preventing this, and you could start sending emails with JSON inside right now. The hard part is probably finding something meaningful for it to do.
> an important new business model

Nothing new in that business model. I have seen several popular bloggers do the exact same thing way before this initiative. That's natural : build your audience through a free service, then monetize goods targeted to this audience.
Looks like something you might get with CRAPCHA:

http://crapcha.com
"For one, we don't really use Map-Reduce any more." https://www.youtube.com/watch?v=wtLJPvx7-ys#t=9454
Money stashed by politicians/rich-beyond-measure industrialists are a black box for majority of Indians. This money is not understood in terms of the impact it will make even if it flows back. Apart from this money, there is admittedly $20 Billion stashed in the form of gold in temples in India, this money is untaxed and not accounted for. For reasons that don't reveal themselves to me, no one speaks of such godly tax havens.
Not so sure about this. I was at the conference and captured the exact wording from Urs, "We don't really use MapReduce anymore" (https://twitter.com/sylvinus/status/481864384981913601)
Though it seems to be quoting Urs accurately enough. All I can guess is that he meant MR isn't used for some particular context. MR is most definitely still heavily used inside Google.
What about Nokia's Disco project, which uses Erlang and Python?

http://discoproject.org/

From http://disco.readthedocs.org/en/develop/intro.html

What is Disco?

Disco is an implementation of mapreduce for distributed computing. Disco supports parallel computations over large data sets, stored on an unreliable cluster of computers, as in the original framework created by Google. This makes it a perfect tool for analyzing and processing large data sets, without having to worry about difficult technicalities related to distribution such as communication protocols, load balancing, locking, job scheduling, and fault tolerance, which are handled by Disco.

Disco can be used for a variety data mining tasks: large-scale analytics, building probabilistic models, and full-text indexing the Web, just to name a few examples.

Batteries included

The Disco core is written in Erlang, a functional language that is designed for building robust fault-tolerant distributed applications. Users of Disco typically write jobs in Python, which makes it possible to express even complex algorithms with very little code.
For those at IO - there is a 10AM session tomorrow about cardboard:

https://www.google.com/events/io/schedule/session/603fe228-8...
You just blamed the victim. Again.
You won't have any trouble running either of these on embedded devices (which I can't say for Java or Go. Go has some weird compiler bugs on ARM platforms, and the JVM is frequently too memory intensive for embedded).

Why is this important in this use-case? If the DFS is being used for data processing then presumably the nodes are reasonably capable machines.

There may well be a difference use-case for a DFS for embedded and resource-constrained devices. That's not what Google or Hadoop is doing though.
Thank you, I appreciate the support. We are lucky enough to have our own factory here in San Francisco so can hop on oppurtunities like these quickly, one of the benefits of DIY manufacturing.
P.R.I.D.E.
He is, and yet the GP is right there is zero resentment middle class people feel towards farmers. I think what most people feel is a mix of gratitude and pity.
useless truism.
> It's equivalent to the SQL JOIN...

Don't you mean GROUP BY?
http://www.cacert.org/ is a similar-ish effort that's been ongoing for quite a long time.
really helpful info. thanks!
I don't think anyone in India thinks farmers are given any unfair advantage. Actually all part of society is screaming to provide help to these people who still dare to farm instead of selling of their lands to real estate mafia even after all the stories of farmer suicides [1]

[1] http://en.wikipedia.org/wiki/Farmers%27_suicides_in_India
MapReduce is difficult to implement well. It's just ironic that the hard part is the part that's not in the name: the shuffle phase.
We (http://grexit.com) let users share Gmail labels. We're very happy to see this release as it has been a pain to build and scale our service over IMAP.

It'd be interesting to see what kind of limits (no. of calls, concurrency etc.) that Google has put on the API. Has anyone trying this out hit of any of these issues yet?
neo4j uses the GPL (specifically version 3), not the Affero GPL. You can build a service based on the community edition without sharing the source of your service; you only need to distribute source (under a GPLv3-compatible license) if you distribute your service to others.

(Summary of the Affero GPL: you must distribute the full source of your service, under an AGPL-compatible FOSS license, to the users of your service. Summary of the GPL: you must distribute the full source of your program, under a GPL-compatible license, to anyone you distribute your program to.)

It does look like the "Community" edition leaves out the clustering features, so if you need those you'd likely need a license for the proprietary version.
Well, you would expect there to be legacy applications around for a while, if they decided not to use MR in future algorithms.
Read this overview: http://jakearchibald.com/2014/service-worker-first-draft/
You may want to correct Urs Hölzle, Senior VP of Technical Infrastructure at Google, then or at least tell him to choose his words better.

From today's I/O keynote video https://www.youtube.com/watch?v=wtLJPvx7-ys#t=9454

This is the exact quote:

"... and today even when you use map-reduce, which we invented over a decade ago, it's still cumbersome to write and maintain analytics pipelines, and if you want streaming analytics you are out of luck. And in most systems once you have more than a few petabytes they kind of break down. So we've done analytics at scale for awhile and we've learned a few things. FOR ONE, WE DON'T REALLY USE MAP-REDUCE ANYMORE. It's great for simple jobs but it gets too cumbersome as you build pipelines, and everything is an analytics pipeline."

emphasis mine

Of course the word "really" in the middle of the sentence gives semantic wiggle room, but it's still a pretty big statement.
That sounds very much like the service that is already offered by StartSSL.com. You pay for identity validation, but you can then create as many regular and wildcard certificates as you wish. It's a superb service.
I think not being able to transfer or to resell is the right thing to do..

The "money generate more money" circle is not possible.. instead it would be always a virtuous cycle of "work generate value that can be convertible into money"
Hey, you guys are about 2 blocks from my apartment it seems like; if you need someone to beta things out or give a hand with something, let me know; my email is my HN logon @gmail.
Yes, it all seems very hand-wavey to me. "Map reduce is finished, and it's been replaced by... some other thing."
Weechat doge
Does this help with getting the new Gmail Inbox in the IMAP clients?
I've already got a form of cloud debugging on Azure. I'm honestly surprised all cloud services don't offer it.

I was happy with the auto integration, but didn't really think it was tremendously new. The new design stuff raised more questions than answers for me.
I'm mostly just disappointed that this tiny peripheral costs more than the last few phones I've purchased. Nexus 4 and Moto G have destroyed my expectations. For that price I'd expect it to be a fully-functional phone.
Heartily agreed ! Or at least Hadoop does it poorly. It is really that bad. I say this with hesitation and a lot of reluctance, its an open source project, I have not contributed anything towards it, so it is really unfair of me to complain.

Here is my personal experience with these tools at Google and at Yahoo (lightly edited from an old comment)

==

I have had the opportunity to try out Google's implementation of mapreduce implemented in C++ way back in time (6 years ago). These would run on fairly impoverished processors, essentially laptop grade of that time. Have done stuff on Yahoo's Hadoop setup as well, these used high end multicore machines provisioned with oodles of RAM. If I were to be generous, Hadoop ran 4 times slower as measured by wall clock times. Not only that, Hadoop required about 4 times more memory for similar sized jobs. So you ended up requiring more RAM, running for longer and potentially burning more electricity. This is by no means a benchmark or anything like that, just an anecdote.

That Hadoop would require much more memory did not surprise me, that was expected. What was really surprising was that it was so much slower.

Four times might not seem like much, but I was being generous to Hadoop. It makes a big difference when you can make multiple run through the data in a single day and make changes to the code/model. Debugging and ironing out issues is a lot more efficient when your iteration loop is shorter.

I think Hadoop (by virtue of its comparative crappiness) gave Google a significant competitive edge over the rest, probably still does.
Mou's live preview was neat for about a week, but eventually I just switched to Sublime Text with the MarkdownEditing, Markdown Preview, and Markdown TOC packages. Powerful stuff, and as-good-as-live preview in your browser.

https://sublime.wbond.net/packages/MarkdownEditing
https://github.com/revolunet/sublimetext-markdown-preview
http://dotcypress.github.io/GitHubMarkdownPreview/
Kinda surprised by the rise in markdown editors whose selling point is the live preview mode. I always felt that the best feature of markdown was that the raw text made it somewhat obvious how it should be rendered. If a preview mode is need I almost want to jump straight to a WYSIWYG editor
Watches have tiny batteries, or they are huge.
Why Nobody Listens To You
The lack of any mention of Google+ was absolutely deafening. If we needed any more confirmation that it's been dismantled within Google I think this would be it. Interesting though that nothing was mentioned to take its place or give us any hint about the future. At very least, they need an identity service of some kind to power the other platforms.
They are gigantic though.
Icelandic yogurt (or at least Siggi's) is great! Much "Greek yogurt" on the market is not once-extra strained milk and cultures. This impostor yogurt has added thickening agents like pectin and/or added protein to be like (what I would call) real Greek yogurt (although I think sheep's milk is the original milk for the yogurt- but like mozzarella di buffalo coming from buffalo milk but in general people in the US accept any cow's milk based mozzarella as mozzarella). I'm all about the Chobani and Fage and Siggi's and hate the impostors just after the money, riding the popularity.
Alfred Remote on iOS for Alfred 2
https://www.schneier.com/crypto-gram-sub.html

http://www.homelandsecuritynewswire.com/topics/cybersecurity

http://www.sans.org/newsletters/
A big part of implementing the shuffle correctly at a large scale is having a good distributed filesystem upon which to build.
Feature – Product – Platform
I made a site that dedicated to Ruby developers. It's mostly about searching a RubyGem's source code. RegExp supported.

http://rubycodesearch.com
Meh.

http://www.iconbit.com/products/108011/
The Strength of the Strongest Ties in Collaborative Problem Solving
I think it's the government's job to make sure that the candidate flow is balanced across those facets. As a private corporation, when there are N candidate for a position, the best one should get the job. Doing something else makes charts look better, but hurts corporations, the economy as general, and is totally unnatural. Enforcing diversification also assumes wrongdoing without a proof.
Ask HN: What browser add-ons/extensions do you use?
I currently use AD-Block Plus and Ghostery. (Opera)

Wondering what other add-ons that are out there that seem like a necessity for you?