skysight-inc/HackerNews huggingface dataset:
A possible solution to the firehose problem are stream-databases, the catch phrase is "rather than data waiting for queries, it is queries waiting for data".

The people behind Truviso (http://en.wikipedia.org/wiki/Truviso subsequently bought out by Cisco) had an implementation of stream processing, an overview is here:

http://www.neilconway.org/docs/cidr2009_franklin.pdf

We looked at Truviso when we had to solve video-player-analytics and it seemed to us to solve that problem. I imagine a tree-structure of stream-queries where the leaves are the data gathering points, aggregating up the tree for summaries would address the scaling problem.
The problems in the article have nothing to do with the source; it assumes that a source of randomness already exists. Mersenne Twister provides you with some random numbers (generally sequences of random, uniformly distributed, 32 bit integers). It does not solve the problem of picking a random double between 0 and 1.
I felt like the author not only decried projects where the kids have access to parental help, but projects where the kids have access to good facilities. And motivation. I'm not sure what's left to measure if we attempted to remove support, facilities, and motivation.

The author seems to support the idea that schools should provide more support and facilities. That sounds good, but the outcome of some schools doing this (the infamous ones near New York, apparently) seems to be the focus of criticism. I'm left not understanding the thrust of the article.
- http://www.codenewbie.org/podcast

- http://devchat.tv/js-jabber (from DevChat.tv)

- (edit to add) http://nodeup.com/ (great content with awesome Aussie accents)

- http://devchat.tv/adventures-in-angular (also from DevChat.tv)

- I've also heard good things about, http://devchat.tv/freelancers (another DevChat.tv offering), but haven't had time, between the other podcasts, to start working my way through it

edited: trying to provide a list of links, not a code snippet; why isn't standard MarkDown supported on Hacker News?
Does anyone doubt this will technology will be the biggest advance in human-computer interactions in decades?
Hmm,
Do you have to index intervals directly?

Algorithms for spatially indexing points are tractable - see k-d trees etc. R-trees seem pretty lame to be honest, like an ad-hoc data structure to partly meet a number of requirements.

Of course, some kinds of indexing and searching are inherently harder than others. But I don't see why one couldn't program any needed spatial algorithm directly from just an index of all points in the system.

For example, suppose you have an index of triangles. If want to find all triangle intersecting triangle (x,y,z), you could itterative expand a near-neighbor search from each point. Every point you find close than the given triangle-point's further point is a potential neighbor and could checked reasonably quickly. This gives the set S of intersecting triangles to a given triangle in log^n(size(S)), making the process relatively scalable.

K-d tree seem more sensible:
http://en.wikipedia.org/wiki/K-d_tree

And there's more:
"Storing objects in a space-partitioning data structure (kd-tree or BSP for example) makes it easy and fast to perform certain kinds of geometry queries – for example in determining whether a ray intersects an object, space partitioning can reduce the number of intersection test to just a few per primary ray, yielding a logarithmic time complexity with respect to the number of polygons."

Lends credence to my argument that a polygon-polygon intersection should be obtainable in log^n or maybe even log time.

Space partitioning in general does cool stuff:
http://en.wikipedia.org/wiki/Space_partitioning
Censorship of things you find offensive is not a great answer.
One article by two journalists for one paper does implies nothing about the British opinion of reddit.
I was thinking more along the lines of smalltalk/croquet, and the Alan Kay quote/talk "Doing with images makes symbols". But yeah, if all you have are nouns, great lack of verbing also.
EmulatorArchive
Well, since it uses multitouch and some smarts to figure out which letter in one of the merged keys you wanted to type, I imagine it would be more useful to update that algorithm than in a keyboard where one button press = one keycode. This goes especially so if that algorithm uses any text based prediction, although I don't know whether it does. The multitouch, combined with an accelerometer I read the device has, could also be used to add interesting gestures or pressure-sensitive functionality that don't directly map to key presses. You could send the raw data over the air instead of using firmware on the device, but then nothing would be able to use it out of the box, so what's the advantage?
>SRS moderator: "but there are hate movements that use Reddit as a propaganda organ… and someone needs to step up and get rid of them.”

Well yeah... like SRS. These people are oblivious to irony.
I'm sure that there are valid reasons to want to do this, but if your find yourself needing to do this, I think you should at least consider whether there might be some other way to get what you want.
You're putting lots into the market this year then, I trust!
Spoof Apple Engineer Interview – [video]
I would like a comment system that lets me choose my own moderators either directly or indirectly based on comments that i upvote. Then, if enough of my moderators downvote a comment, i wouldn't see it.
Go on the JVM completely defeats one of the biggest Go selling points for me: compilation to native code.

Debuggers are definitely a weak spot, though, I agree. Luckily it's being worked on (https://github.com/derekparker/delve).
AskScience and AskHistorians are two of my favorite subreddits due to the strict rule enforcement.
I did a lot of science fairs in high school. I was pretty good at it, too; I'm currently paying for college with the help of some military research scholarships I won at an international science fair.

Here's my perspective on the whole thing. Take it as you will.

At the regional science fairs (where everyone starts out), there are a lot of people there who are only doing it because they have to. Usually, their high school requires it. A lot of these projects are shit, and a lot of them also clearly stole the idea or got help from their parents. All of these get eliminated at the regional level.

Then, we have the state level fairs.

When it comes to engineering projects (mechanical, electrical, or computer), almost 100% of the projects are actually done by the students themselves. It's very easy for engineering judges to tell when someone's bullshitting or didn't actually put in the work, so almost none of the bullshitters make it to the state level. Most of these people don't have any immediate family members who could help them, even if they wanted help.

When it comes to biological sciences (medicine especially) the situation is much different. Almost everyone in this category knows their shit, but it's a lot harder to say if they actually did the work themselves or not. A lot of the projects absolutely require that the students work in industrial lab environments. It's impossible for a student doing MRSA research to work in a lab below BSL-2, for example. A lot of these students get lab access through their parents (who may be doctors or researchers or something), so it's very likely they are working alongside their parent, and it's possible that they are working with the help of their parent. A huge portion of students doing this kind of research do have an immediate family member who can (and, with some likelihood, does) help them.

Because it's much harder for judges to sniff out people who didn't do original work in the biological sciences category, you get a lot more bullshitters in this category making it all the way to the top science fairs. They're still usually experts in whatever they're researching, but they didn't necessarily put in the thought or effort themselves.

When I was at Intel's international fair, the guy who won the top prize claimed to do some sort of cancer-detection research. It was pretty impressive stuff, but after the science fair a whole bunch of incriminating stuff came out. IIRC, there was some situation where his parent had a position of power at some major research university, and he essentially plagiarized the research of some researcher there with minor changes, but it was soon enough after the actual research that no one caught it.

I can't speak as much to the other categories (sociology, mathematics, etc.). I didn't have a lot of experience with those.
I don't think Twitter has anything against scraping lists of followers of public accounts -- after all, that's available to everyone. (One exception I think is geolocation data which can't be stored.) It's then using that information to spam Twitter itself that's the problem.

Facebook, OTOH, has pretty much turned off access to the friends graph for apps other than games.
Are Streaming Music Services About to Bite the Dust?
For programming/design, download youtubes from Pando and convert to mp3s. easy. Same for the sam altman/ycombinator lectures.

For real thought, Long Now. http://longnow.org/projects/seminars/SALT.xml
For current thought, the RSA (including design). https://www.thersa.org
These are good because you get great question sessions at the end of the talk.

Interviews with "spiritual" leaders
Sara Trippet's On Being http://www.onbeing.org/sites/onbeing.org/files/xml/podcast.x...
For more relaxed, WTF with Mike Marron. Really awesome interviews with tons of fascinating people.

The Buddhist Geeks podcast, if you are into that. http://www.buddhistgeeks.com/

For fun, Nerdist/ Captain Laserbeam and also Sparks Nevada, Marshal on Mars.
Here, let me help you - clickables:

* http://decentralizedmodel.wordpress.com/2014/10/15/the-decen...

* http://decentralizedmodel.wordpress.com/2014/10/15/my-social...

* http://decentralizedmodel.wordpress.com/2014/10/21/what-face...

* https://www.loomio.org/d/Pd3ec8nu/revenue-model-for-diaspora...

Putting these links here is not an endorsement - it's taken me almost no time, it helps you, but I haven't read them.

Let me add this. Although a lot of HN readers will disagree with me, I find it a really, really strong negative indicator when someone doesn't do this themselves. It means you haven't bothered to take the time and effort to make it easy for people to click through to your writings. If you simply aren't aware of how to make links on HN then it means you haven't bothered to look up the technical aspects of a system you use.

Either way, it's not a good sign, and for me, personally, it makes me much less likely to take the effort to read what you've linked to.
Did you just ddosed them to get the list? Why there is no down vote button here?

Please respect others' work. Writing a scraper nowadays is not cool any more!
Right, which is why I said you'd have to account for the log bias when you pick a random integer exponent. Otherwise most of your results would be really tiny.

The method bhickey suggests above sounds like a nifty workaround for the problem as well.
The majority of them seem to be verbs.
The core Midwest doesn't depend on that. The great plains do, but Iowa, Indiana, Illinois, etc. don't. You would probably get bored as fuck with corn and soy beans. But it would v feed tons of people if we didn't feed it to cows or gas tanks.
This quote shows something really bad, although it wasn't explicitly discussed:

"But at the three fairs I’ve attended over the last several years, the unknown rarely makes an appearance. At my son's fair last year, at least a handful of students did the popular "experiment" in which the "scientist" waters plants with three different liquids—one of which is typically soda or detergent—to determine which is best for plant growth.

"Were you surprised that water made the plant grow?" I asked one child after she presented her experiment.

"No," she said."

Aka "Science = boring and predictable and uncreative" Which is pretty much the opposite of reality, although a fairly accurate example of K12 science education...

Try harder kids? I put 10 seconds into it and got the idea of pond water, fresh chlorinated tap water, and collected rain water?

Then again, some decades ago I successfully won the local grade school with what boils down to a grid of detergents/soaps vs sources of dirt. (edited to highlite that dumb project ideas are not a recent invention of 2015, I mean think about it, a hypothesis that clothes detergent cleans dirt from cloth the best is lame, although what cleans kitchen grease was a good question, I think hand soap won?)

There is an interesting side dish of some fairs in some decades have allowed research projects or "inventions", which is pretty lame. Do science, do a book report, or do an art project, but don't confuse yourself into thinking the three activities are indistinguishable.
At the risk of sounding hyperbolic, the utility of some means of surveillance in apprehending criminals is not itself a good enough criterion for justifying any means of surveillance. If it were, so the hyperbolic argument goes, we could minimize crime by locking people in cages.

Of course, the two extremes are ridiculous and so we use a balancing test: how does the state's compelling interest compare to the cost to personal liberties.

If 99.8% of license scans/photos are not useful for apprehending criminals, then I'm not sure the technology can be justified. Moreover, as the parent points out, license metadata is another tool that could be used by third parties (e.g. advertisers, insurance providers, etc).

It seems to me like the RFID suggestion could solve (or at least help alleviate) the problem of third party scanning while preserving some of that utility for the police. This, combined with reasonable retention limits (14-21 days) would make the whole matter much more palatable to me.
Yep. Freenet is basically this plus a bunch of really complicated mechanisms to create anonymity in who shoved the documents into it. If you take those bits out† then you're left with a DHT that:

1. lets you talk about individual objects by hash-based URNs;

2. or lets an publisher insert versioned streams of objects using document-signing with deterministic subkeying‡; gives the stream as a whole a UUID-based URN; and then lets clients query for either the latest, or for any fixed version-index of a given object-stream;

3. and which does a sort of pull-based store-and-forward of content—every node acting as a caching proxy for every other node.

I'm really surprised nobody has just built this trimmed-down design and called it a "distributed object storage mesh network" or somesuch. A public instance of it would beat the Bittorrent DHT at its own game; and private instances of it would be competitive with systems like Riak CS.

---

† Which is perfectly sensible even for Freenet itself; you could always just run your Freenet node as a Tor hidden service, now that both exist. Tor cleanly encapsulates all the problems of anonymous packet delivery away; the DHT can then just be a DHT.

‡ This is similar to Bitcoin's BIP0032 proposal, but the root keys are public keys and are available in the same object-space as the transactions. Given that you have the root public key, you can both 1. prove that all the documents were signed with keys derived from this key, and also 2. figure out what the "nonce" added to the root key to create the subkey was in each case. If the inserting client agrees to use a monotonically-increasing counter for nonces, then the subkey-signed documents are orderable once you've recovered their subkeys.
Sane people?
Meerkasting in a Brave New World
My experience has been the opposite. It is much better for me to have a separate modifier key (Command) for separate things. Want to make a new terminal window? It's Command+N, not Alt+F2. Paste? Command+V, not Shift+Ins. Copy? Command+C. New tab? Command+T. None of those things are possible with Windows shortcuts. If I didn't need a shell all the time it would probably be more uniform, of course. The only really good thing about the keyboard shortcuts in Windows is the Alt+<underlined character> which I have always hoped would be part of OS X someday. (Is that what you're referring to when you say "2 or 3 basic principles?)

I definitely agree with you that Apple prefers form over function, but I don't think keyboard shortcuts are the best example of that. I could personally never get away from a Unix-like operating system, which is why Linux is really best for my needs.
> no high school student can do graduate-level scientific research.

That's not true. I've seen better (original) science fair work than some PhD theses. It's just 1/1000 students that can pull it off.
Yes, the success metrics are measured on the training set.

I just ran a measurement with a separately generated testing set consisting of 52k characters which yielded a success rate of 98.53% on letters a-z. This turns out to be almost exactly the same as the rate presented on the repo page (98.52%). Will upload the result for your perusal as soon as possible.

You will have to browse the synaptic neural network library [1] for an answer to your second question.

[1]: https://github.com/cazala/synaptic

EDIT: A separate testing set is now generated in addition to the training set. I updated the success rates of the examples in the readme accordingly.
At least for those who can afford it. We'll see how this works out over time. But I really look forward to it. Especially together with some "real" SciFi-Style Cyberspace.

I however don't see me running around with that in my room. Maybe I'm too old for that but it's not what I have in my mind when I think about VR devices. What I think of is Cyberpunk. Gibson. Guys starving in their chair having such a device on my head. I still have a Wii flying around somewhere in the dust...
Thanks for the suggestion, I just watched this and it's really worth those two hours. Who is looking for a (relatively) quick glimpse at what a complex mess the situation in the middle east was and is, this would definitely not be the worst choice. And it is kind of beautiful in a strange way I can not really pin down.
Forgive me for my lack of knowledge, but where would one use this vs. just using Python?
> I can't see anyway to consider that "good".

Of course it's good. If the frog could engage in abstract reasoning, he would have no reason to care about evolution or reproductive success.

If you just substitute "human" for "frog", you can see it's true for us, too (and we can reason). You'd be badly mistaken to define good and bad by "repdroductive success." That would be committing the naturalistic fallacy.

The reason taking some kind of pleasure-drug goes against people's normal moral sentiments is because it's too much of a false hypothetical. A true pleasure drug would be very dangerous, so we wouldn't take it.

> Now consider the wide range of what humans consider pleasurable. A community of sadist may derive great pleasure from tormenting an animal. In your argument, that makes it "good"

That is not actaually an implication of my argument, because sadism is not going to lead to long-term, fulfilling happiness. There is no deductive argument I can offer for that; you just have to look at and observe human nature honestly to see it.

> Is your argument ignoring people who derive pleasure from harmful things because you don't know anyone like that"? That seems a bit of a hole in your point of view.

No, it's a turn of phrase. But I am making the point that the way I know what I know is by observing human beings. It is empirical.

Anyway, I didn't write my long comment (above) for you---I wrote it for someone who was asking a genuine question. Somebody who is instead just trying to defeat my argument can always go one step more fundamental until we cover all of ethics, epistemology, and metaphysics. I'm not going to do that on hacker news. You can go to philosophy books for that. People can certainly learn things from some of my comments, if they want to learn, but my comments are not very useful for debating/winning arguments, which is not what I am into. That said, I am happy to chat.

To put it more simply, yes, there are holes in my argument---because I am not going to wrie a philosophical treatise on here. You can fill the holes in yourself by thinking; it's left as an exercise for the reader. (However, there are not holes in the sense of fallacies or contradictions; that is not what I mean by "holes" here.)
Curing Writer's Block
Me.

It will, for sure, improve some human-computer interactions in a few domains where it is easily deployable (mainly entertainment and industrial manipulations).

Other than that, I don't see it used that much. It is still cumbersome to wear, doesn't seem to be usable in mobility, and won't solve common problems in a business environment.

(But I'm still waiting for it, heh.)
Yesterday was Pi day. 3.14.15, so at 9.26:53 I had a piece of apple pie and a slice of key lime pie. On such a special day we went full circle, two pie.

My wife is a great cook
This is so true. I frequent a wide variety of online communities and the same can be said of any of them. Any increase in the rate of new posts always leads to a degradation in post quality until 'stream rate' is reached and people are posting without the expectation of their posts even being read. Maintaining a healthy post rate is crucial but, as you say, quality also needs to be enforced by some form of moderation with unambiguous rules. Evolutions of a community can be tied strongly to post-rate fluctuations over time and most long term users are well aware of these iterations. On forums, large communities can be splintered for the benefit of quality and discussion.
If you enjoy stuff which deals with spirituality you may want to check out Tapestry http://www.cbc.ca/radio/tapestry.
The subject is not my cup of tea, but I have heard many rave reviews of it.
Valve – Virtual Reality in 2015
Why not something like Bit.ly Combination of 6 Chars?
57+B Combination is a good number. For a short URL website.

For content website, something like Youtube which has combination of 11 Chars. It's pretty good. For them but surely will have a problem in future but that might be after 5+ Years. But if they add one more char, it will have more combinations.

If this is about URLs and not files. Can any one correct me if I am wrong.
"Still, those two funds did manage to perform splendidly in that study. Their stubborn persistence at the top of the heap over that five-year period suggested that there was some hope for active fund managers. If they could do it, after all, others could, too."

If the authors expected randomly picking stocks to churn out 3 mutual funds that beat the market 5 years in a row then this explanation is nonsense. Their "stubborn persistence" is just an empty narrative slapped over a blatant case of survivorship bias. This paragraph makes it seem like whoever wrote it didn't understand any of the rest of the article.
The simplest way to understand OCC is to basically take any of your models and add a version attribute and whenever you update an object you also do an UPDATE ... WHERE version={obj.version}.

This is useful when you don't want writes to overwrite previous writes. If the version check doesn't hold it fails letting your client know that your assumptions about the state of the data are wrong. You then have a few options, like either redoing your computation using the new state or not doing anything at all because the current state is good.
On the world wide web, jumping to Hulu, an explicitly US-only site that blocks all of the rest of the world, is a bad decision overall.

I guess everyone else will be pirating that new series if they want to watch it. He's made that choice. Sorry, FreddieW, whoever you are, on one level I kind of hope it doesn't work out for you: balkanisation of the world wide web is not really something I want to encourage and thrive.