skysight-inc/HackerNews huggingface dataset:
[Author here]

I'd love to see a decentralized image naming and distribution system. I'm pushing hard for this to happen as part of the OCI. See https://groups.google.com/a/opencontainers.org/forum/#!topic....
> If football came into being today, people would riot in the streets. Who would pay money to watch mostly lower-class, mostly black[1] players permanently damage each other's brains and bodies?

Mixed Martial Arts is a very popular sport which is exactly this (maybe not the 'mostly black' part), and as a spectator sport in the US has only really risen recently. No rioting in the streets against it yet.

Also, given your criticisms, how do you find football more repugnant than professional boxing, given that the latter's explicit goal is to literally beat your opponent into submission?
It's hard to feel bad for an industry that just flat out refuses to offer the products and services it's customers demand. 15 years ago I considered it ridiculous that TV shows weren't offered online. Popcorn Time should never have been able to get a foothold in the first place because people should have been able to access it's services legally. The video game industry has somewhat learned its lesson now that we have steam which has been great for gamers and developers (especially smaller developers). So, yeah, it's illegal and I understand why we have copyright laws. But people have been bitching about this and taking copyright law into their own hands since napster. Reading articles like these is like watching a youtube video of someone obnoxious get their ass kicked. I don't condone violence, but you get zero sympathy from me.
I was running IPFS as "my own pastebin for files" for a while (it's great!), but was wondering what can they do to improve adoption / popularity. This move is amazing! Useful, interesting for people who care, and visible for others.

Next, I'd really like someone to implement git backend in IPFS / IPNS. Right now there's https://github.com/whyrusleeping/git-ipfs-rehost but that's just simple hosting.
Exactly, what I noted was the most likely temporary/possibly long-term solution to the problem.

What about hashing an object that contains the hashes generated by x hashing algorithms? an extra step of resolution, sure, but some way to easily demarcate that some file experienced a collision with another file, and had to have the number of hashes increased to stave off further collisions?
The C64 had the KERNAL OS that loaded from ROM, only had like 49K free in BASIC. The C64 DOS was on the 1541 drive which had its own CPU and memory and the DOS was on a ROM.

Both the Atari ST and Commodore Amiga had Mac emulators with a serial port or printer port dongle that loaded a Mac 128K ROM onto it to boot up Mac System floppy disks. Atari ST had Magic Sack, Amiga had AMax. Both had the same 68000 CPU as the Mac but had better graphics and sound chips so things ran faster.

As I recall there were viruses for the Atari ST, Commodore Amiga, and Macintosh even if most of their stuff was on ROM. Just not as many viruses as DOS had on PC Clones.
This really blows my mind if it's what's happening. Are you saying that kindergartens are getting rid of 'nap times'?!?!

Why would they do this?!?!

I thought it was obvious that children need sleep in order to learn and grow.

Secondly even if I put on a tinfoil hat I can't see even a financial incentive for getting rid of naps. That's down time that kindergarten teachers get to relax in the relative quiet and organize things.

So what possible rationale is there for getting rid of nap time?
Yes, and unfortunately now we have a mob of idiots in the Channel 9 Commentary box. ABC Grandstand radio all the way....
This is a very naive (and perhaps unsatisfying) answer, and I haven't read CTM so I may misunderstand the real concept of the kernel language, but you may be looking for either the Relational Calculus or Algebra[1][2] or, for less math and more application, straight up database-independent SQL[3].

These pretty much describe the underlying set of the things you can do with database systems, and different databases provide different implementations of them with different tradeoffs and abstractions.

[1] https://en.wikipedia.org/wiki/Relational_calculus
[2] https://en.wikipedia.org/wiki/Relational_algebra
[3] https://en.wikipedia.org/wiki/SQL
Someone should update that GIF to show the people using the subway. That frame would show the street empty, everyone being underground.
"First, R is written by statisticians, for statisticians." To see the fallacy of this statement substitute "statistician" with any other profession, e.g. farmer, philosopher, doctor. Good software is written by programmers.
Yesterday: https://news.ycombinator.com/item?id=10180818
(NB: the article was written in May 2014. There are many comments at the bottom of the page.)

"This has been the subject of huge controversy over the years, so Guido Van Rossum, inventor of the language, added a multiprocessing module."

I think that assigns too much agency to van Rossum. PEP 371 describes the justification for bringing pyProcessing into the standard library. The primary developer was Richard Oudkerk, who along with Jesse Noller volunteered to maintain it in the standard library.

While it's true that van Rossum accepted the PEP (on Thu, Jun 5, 2008 at 1:22 PM according to the mailing list), that's not quite the same thing as adding it.

For that matter, the version control logs point out who originally added the code, in its most literal sense:

user: Benjamin Peterson <benjamin@python.org>
date: Wed Jun 11 02:40:25 2008 +0000
summary: add the multiprocessing package to fulfill PEP 371
Ah, good to know. The last set I purchased from was Alliances.
"let's look at NYC and Tokyo: despite all that density, the problem of housing availability remains."

NYC has a housing availability problem. It's the same one as San Francisco: new denser construction is near impossible to get a permit for. If NYC permitted lots more housing to be built, the cost of housing would become affordable.

Tokyo does not have a housing availability problem. The vast majority of families in Tokyo live in single family homes they own close to parks and rail transit. The ratio of housing cost to family income in Tokyo is more like affordable Dallas or Atlanta than nightmarishly expensive NYC or SF.

How did Tokyo do it? It permitted lots and lots of by-right building on small lots, issued permits automatically for new homes, didn't require any parking at all for every unit, platted out narrow streets, and built lots of rail transit at reasonable prices. There are few skyscrapers -- Tokyo's density is 150 (people/hectare), only double SF's average density and similar to North Beach, Pacific Heights, or Russian Hill.

It's too late for SF to build narrow streets, but permitting multi-story rowhouse construction throughout the city could easily add a few hundred thousand units and substantially reduce housing prices. A full solution will require other Bay Area cities to also permit reasonable density construction.
They're great for on lounge/bed browsing. Also for travel to consume media in downtime or work information if you don't have to type too much. And if you have kids they are almost a must for easy entertainment.

As a workstations I don't think they would suit most computer dependent roles.

I'd say overall they are great to have and use mine a bunch, but they're a luxury not a necessity. If you can afford this level of disposable income Id say get a reasonable one and try. Cheap ones tend to lag from reviews and disappoint from performance. If your budget is tight Id put the money into a more quality laptop/phone. Also cost wise tablets tend to last longer than phones in my experience. If you buy a decent one you might get 4/5 years out of it vs 2/3 for a phone.

I'm sticking to iPads for the moment. I use Android and Windows phones so definitely not a fanboy. I would be open to a cheaper Android/Windows if they have improved tablets UX but last Android one I used 12+ months ago didn't seem to work as well as the iPad.
The fact that "We need to get in on the streaming thing" is probably said in the boardroom of every media company is exactly what's going to kill it.

I am willing to pay for exactly one streaming service. The idea that streaming services will become the "pay only for the channels you watch" is second to the fact that all but a few streaming sites will wind up being complete shit.

So far only YouTube and Netflix have passable interfaces, cross platform support, and a half-decent discovery algorithm.
Previously: https://news.ycombinator.com/item?id=10189288
San Fransisco has a lot of land zoned single family.

http://www.sf-planning.org/modules/showdocument.aspx?documen...

You could easily rezone and up the density by a factor of 4 or 5.
I have always wondered if there is some way to make a distributed network which provides content in such a way that users' freedoms are maximized. I don't particularly like handing over all control of my data and internet presence to cloud providers. IPFS looks really, really cool!

As ot asked, I am also curious about how this compares to other efforts to create decentralized networks, like Freenet and GNUnet. I definitely plan to pick one in the coming weeks and start using it, hope this catches on.
While running an IPFS node does supply some utility to the DHT, the primary utility you can provide to the network is providing files.

You only provide files that you have previously accessed via IPFS or added yourself. So even without any external motivations to sponsor other people's content (which are in the works), you have the motivation of sponsorship of content that you wish to increase the robustness and accessibility of. Increasing access to public utility can be itself an incentive.
Definitely look at this before you use React Native. RN makes heavy use of flexbox for layouts, and if you come from living in a world of <div style="position: relative; margin-left: x;"> then it can be a bit foreign. As for browsers, I'm still waiting on more flexbox adoption.
Go at Basecamp/37Signals
We're way past my personal knowledge, but what I was thinking was that the probablistic combinations of two algorithms outweigh (in terms of probability of a collision) the likely hood of a single algo.

IE if you have some hashing function with a 1/2^5 chance of a collisions, using that in conjuntion with another hashing function with say 1/2^3 requires that both unlikely probabilities occur, resulting in 1/2^8, where a "stronger" hashing function might only have 1/2^6 (technically stronger than either one of them, but still not as strong as both)

I'd really love some correction on the logic above though, I am by no means well studied in probability or hashing functions, despite some effort, and would really appreciate any corrections.
Transfer payments would also work.
An Apple ISA is coming
Apart from the few star players, professional football doesn't pay that well. Certainly not enough to make up for it being a pretty short career.

I'm not sure what it is today, but "roster fillers" in the NFL were only making $50k/year not all that long ago. The average career length is 6 years according to the NFL, and 3.3 years according to the players' union. Decent players will make over 100k, but it's still a pretty short career.
Have you tried asking people living in those homes about your "easy" plan? The one that would involve them living somewhere else for a couple of years during construction and then moving back to a smaller, less appealing place? As I said, San Francisco residents mostly seem pretty happy where they are.
Montessori-based education revolves around learning and working with physicality[0]: "Exploration, Manipulation (of the environment), Activity, Order, Orientation" etc.

Disclosure: I was put into a Montessori school when I was young.

[0]https://en.wikipedia.org/wiki/Montessori_education
yep, exactly!
I judge the religiosity of the scientist by the field they're in.

Social sciences and economics get more leeway than say...physics or chemistry. Then you have a few in the middle like biology or math.
I find python's multiprocessing module to be simple to use. I would be interested in hearing the author elaborate on why he feels it is clunky and has not had a good experience with it.
Preach. I inherited a Node project for which Rails was a much better solution for our use case. It's been fun learning a new platform, but for our needs Rails would have been fine. The only conceivable reason I can see they chose Node is because it's cool.
Although tangential to your question, I feel you might enjoy presentations by Rich Hickey wherein he describes traditional database architectures and presents the whys and wherefores behind Datomic. For example:

[1] https://www.youtube.com/watch?v=Cym4TZwTCNU
[2] http://www.infoq.com/presentations/datomic-functional-databa...
HTTPS wouldn't necessarily help with this. You can track on the station's MAC address, rather than the content of their HTTP connections.
Obviously libraries would be a starting point. Then connecting schools and public spaces would be next. You need to start somewhere.
HTTPS has no bearing on the ability to track traffic volume, sites visited (DNS), and device location (mac address).
FWIW, the Wall Street Journal's data team has also posted its repo of code for processing the Clinton emails:

https://github.com/wsjdata/clinton-email-cruncher

Kind of fun to compare methods...converting PDFs can be such drudge work sometimes. I'm interested in the data-cleaning/name-resolution aspect...though that is also another deadly boring programming task.
Awesome. I didn't know the raw data was available anywhere publicly. I thought only journalists/gov had it
> For example, in some european countries, Game of Thrones is available through Netflix.

I'm not questioning your conclusion but your premise is false. Game of thrones is not available on Netflix in any country (https://flixsearch.io/search/game%20of%20thrones)
So the penalty is just having to switch to *BSD and LLVM?
Hmmm... BART was supposed to go up into Marin county and down to San Mateo county, but it was killed by the local populous.

I guess it was all those right-wingers in Marin?
I've always found a strange dichotomy in this. On the one hand, we're supposed be these extremely socially-driven creatures.

Yet on the other hand, it seems like we very easily gravitate towards isolation. The gravitation towards on-demand media and 'looking at the screen' has to be appealing, more appealing en-masse than socializing, otherwise why would we collectively gravitate towards it as a large group?

I think what I'm saying is that I think people gravitating towards TV and solitary activities is the symptom, not the cause. The real question is - what's making people more anxious about being social? Is this really a rise in social anxiety, causing a rise in people being isolated?
why is it just a mobile app? why is there no web ui or a rest api?
I lived quite far from school in my middle and high school days. It meant an hour long bus ride both ways (plus a 1.5 mile walk from the bus stop), and having to wake at 5AM to get ready.

The only way I had any free time was staying up late, which occurred every single school night. I got horrendous grades because focusing was impossible.

I actually blame this single circumstance for a large share of my life problems. It forced me to work my way up from a crappy community college after high school, and everyone I encountered just sort of assumed I was mediocre.
All I could find was "download the app".

What if I want to do it via the website?
It was when the DK2 first came out that I realized VR was not the slam dunk it is often portrayed as. The DK2 was bought by many people, many more than the DK1. And once all of those customers started posting feedback on the internet it became clear that motion sickness was still a huge problem. And motion sickness will not be resolved with higher frame rates or lower latency as most of us believed prior to the DK2. Oh well.
You can free space, but how that happens is not explicit.

The more people a file is requested by, the more places it is stored. If the file ceases to be requested, and all the participants decide to remove it from their caches, the file is gone.

DHT records are slightly more persistent, but without a sponsor they fade as the network's churn removes the nodes that once hosted them.

It is very hard to delete things, and the most likely things to be deleted are things people are not providing effort to preserve (even one person providing such effort is sufficient to maintain the DHT records.)
Most people are proud of their open source contributions; they're part of your personal brand, and people in the community like to look good/get discovered that way. It builds credibility and shows goodwill.

I use pseudonyms when I wish to speak freely to a larger internet-only community, away from scrutiny by people who know me in real life but may not understand the context of the community in which a discussion takes place. I suppose I would construct an alter ego on Github if I were working on something illegal in my country.

Anything targeted at people who know you should be under the name they know you by. It's not as if pseudonymity defeats Big Data - all they care about is which ads you're likely to click on, whether there is a correct name associated with that profile is of no consequence. And of course anything not done through Tor can still be traced through your ISP's subscriber records. Using a pseudonym on, say, Facebook mostly just inconveniences people. I suppose it could be a reasonable countermeasure against a stalker, but locked-down privacy settings (or just not using Facebook) are probably safer bets.
Echoing some of the others here too...

As a DK1&2 owner, I had a similar experience, but what brought VR back to me was Elite: Dangerous, a space sim. FPS's are a horrible VR experience currently and likely will remain so until we redefine FPS for VR. With Elite + joysticks, I've not experienced any of the motion sickness in the DK2.
In 2012 walmart spent 1.89 billion dollars on advertising while target spent 1.6 billion. Only about a dozen companies spent more than walmart. Amazon wasn't in the billion dollar club, but it isn't a slouch either.
Actually the GIL is not necessarily an issue for NumPy since C extensions can break the GIL. I don't see why this needs to be a winner take all competition between languages for statistics. It's worthwhile to have different approaches and just because in the author's opinion R is better than Python and Julia doesn't mean that it is always the better option no matter what.
The poorly discussed situation is that California High Speed Rail really is a backbone type service. While SFO<->LAX is certainly the big point, the intermediary cities -- San Jose with a million people, Fresno with a half million people, Bakersfield with 363 thousand people -- are going to see substantial benefits too. Add in the cities that are planned for subsequent phases -- San Diego with a million people, Sacramento with a half million people, Oakland with 400 thousand people -- and the reasons for the project start becoming more obvious.
US policeman goes war-driving to find stolen kit by MAC address •
Actually, in NorCal there's also Oakland. And San Jose Airport is not at all busy - they just blew 1.2 billion on Terminal 3 with no airlines committing to use it.

And in SoCal, I normally use John Wayne, not LAX - one of the worst airports in the world due to endless construction.
Because, and I wish I were making this up, calling establishment figures on racism is itself considered racist if the racism being called out favours certain groups.

It'd be A-OK if a black person did the same thing, pretending to be white, but flip the races and the person exposing the racism is pilloried for being a racist.

And, not only did he call them on it, he did it in a very public fashion, and in a manner to which the only real rejoinder is a smear campaign against him.
Why are the emails being released as PDF's?
This may be useless, but here is how I would do it. Its kind of related to the "kernel" idea in that I try to discover the heart of the problem a technology solves, what the traditional problems are and how a given technology overcomes them.

Figure out the problem something solves, try a bunch of simple solutions and see why it fails, ask questions about why things are done a certain way.

Example is much more helpful:

Q.Whats a database?

A. thing to store data

Q.why not use a simple text file?

A.well there is no way to enforce a schema that way. whats to stop me from adding a line "a,b,c,d" when the schema of the database has only 3 fields?

its probably not good for binary data either.

ok so well use some specialized format

Q.whats an index? why do the use indexes?

A.<do research - find they are B-trees that allow you to maintain an order over data>

Q. so what happens if multiple people try to write at the same time

A. we could global lock the whole table. so only one write is allowed at a time.

we could lock on the specific row.

with something like CRDTs, order of writes doesn't matter.

what if we didnt lock at all?

data will be corrupt. this is where consistency models like ACID etc. come in.

So my advice is think deeply about the problem being solved, what the difficult sub-problems are and then see what kinds of trade-offs different databases use to deal with them.

The more questions you answer, the more questions you will have, but about increasingly detailed slices of the DB/framework/etc. This is learning.
We can't expect great PC experiences to be great VR experiences. Great VR experiences are built for VR and rely as much as possible on 1-to-1 mapping of actual motion to virtual motion.

I see a lot of parallels with early mobile app development. Early mobile games often plastered the screen with virtual buttons, poorly replicating controller-based UI's onto a touch screen. The experience was bad and plenty of people wrote off mobile gaming as impossible. Then we learned how to build mobile games with a touch-centric UI.
How to get better at data science
I've tried to learn R several time, but its index started with 1 always stop me from learning.
Self driving cars are still subject to congestion in identical ways because they take up just as much space and need safe distances between cars. It also adds noise & pollution, not to mention the fact that the energy to build a car is really really large (and they don't last as long per total miles per person).

As linked to above, see this gif: http://i.imgur.com/kw8DaST.gif
Beats President Luke Wood on the Apple Acquisition
This appeared in Show HN a few weeks ago [1]; really awesome visualizations.

https://news.ycombinator.com/item?id=9955553
Intel to End Sponsorship of Science Talent Search
Another little issue: the country is made up of over 7100 islands.