skysight-inc/HackerNews huggingface dataset:
Wow, that's an impressive collection of people! Looking forward to seeing what they come up with.

Quite surprised to see so many corporate AI people being in on this. I'd have thought that Google and Facebook would prefer to keep their research secret.
I think the smiley at the end indicates that it is a joke. After all it was created as a fictional plot device for a comedy.
DNS Censorship (DNS Lies) as Seen by RIPE Atlas
Tens of megabytes, times the number of people downloading it, can get pretty significant pretty fast. And costly.
This is always the first comment, and its always the easiest. You do not treat your information as a scarce resource when it is not. You treat your scarce resources as scarce. Seek payment to develop, not for the fruits of development, at least not to be treated as a falsified scarce commodity. The time and mental energy to create is the limited resource, not the creation itself.
I did that; but they got buried in the $rand stuff - not sure how this got traction but I'm totes happy.
The winning contractor most likely proposed drupal, by showcasing a large number of government websites they built using... drupal. It's an endless cycle of past performance coming out on top, regardless of how creative or customized another bidder might have been. Not that drupal is bad portal software, but contracting officers that don't know any better will just pick the (cheapest) company with the longest track record of success.
> So, who does use xz?

Arch Linux started using lzma2 compression for their packages nearly 6 years ago!

https://www.archlinux.org/news/switching-to-xz-compression-f...
I see we mostly agree, but one thing here is a glaring error :

> It has the good parts of both cooperative and preemptive scheduling, but yes, it's certainly cooperative.

For me, the best part of cooperative scheduling is that you can work entirely without locking shared data structures, because you get "transactions" for free. This means it's rather difficult to get data races, deadlocks, etc. Go's scheduler certainly does not give you that, trades it for spreading work over different cpus.

So it has problems:

1) necessity of locking, using IPC mechanisms, ... (like preemptive schedulers, and let's face facts here : channels aren't enough in real world apps)

2) everything gets blocked by large calculations (like cooperative schedulers)

3) more generally, easy to crash by misbehaving thread due to unrestricted access shared resources (not just cpu) (like cooperative schedulers)

And advantages:

1) Actually uses multiple cpu's/cores/... (like preemptive schedulers)

2) integrated event loop that scales (like cooperative schedulers)

If you want to see a programming language with a "scheduler" that doesn't have the bad parts of cooperative schedulers, check out Erlang. If you attempt to crash erlang with infinite loops, bad memory allocation, ... (on a properly configured system) that just won't work, the offending threads/"goroutines" crash leaving the rest of your program running fine. The offending threads will restart if you configure them to do so (which is really easy).

The same can be achieved, with much more work, on the JVM, or, also with much more work, with python's "multiprocessing" library, part of the standard library.

> > On the linux scheduler with proper ulimits it's bloody hard to crash the system, for instance, forkbombs, memory bombs, ... won't do it. I hope we'll get a language where you can do that too.
> I don't understand the analogy. It is not clear what "crash" means here, and it is not clear how it would apply to a runtime environment. All that stuff, forkbombs, etc, means that you can configure the system so arbitrary code can't affect the system in those particular ways.

Crash means that the system/"program" doesn't respond (in a useful manner) anymore.
Wow, really? Honestly I've never used the z or j flags, I could not even tell you what they do. I use `tar caf whatever.(txz|tgz|tar.lz|tar.lzo) /path/to/files` to create, and just `tar xf whatever` to extract.
From Soup to Fish
Correct me if I'm wrong but there doesn't look to be any kind of compression supported.
And all are valid examples of potentially backwards thinking, and the many more even us are not recognizing because we have not dedicated the mental energy required to break out of our respectively imprinted expectations of social organization.

I only speak of one example amongst many, but I stand by it being in our best interests to recognize and correct them before they cause too much injury to either individuals or the collective.
This seems to be one of those broad "change the research culture and its rules" essays rather than anything about a specific technology or scientific insight that could truly cure cancer.
lbzip2 is pretty good
Side note: `xz` only got -T option in stable releases less than 12 months ago (5.2.0 in 2014-12-21), so it hasn't made it into every distro yet.
That makes sense in the context of a window manager, because the processes live outside it, meaning it has very little to no state of its own. But when developing a web app, you have to login to it every time you reload the code, because being signed in is in-memory state.
A Heuristic Analysis of Your Game
My anecdotal experience from a recent job search suggests that many employers ask for senior devs but will quickly settle for someone when their requirements and pay expectations are out of kilter with the rest of the market. I applied to a couple dozen positions (mostly asking for more experience than I have), had interviews with a decent number of them, and was eventually hired for a position that had asked for a lot more experience than I had. Turned out they hadn't managed to interview anyone at the seniority level they wanted and decided to go with their best interviewee rather than go through another search (at a big place where HR mandates searches as a waterfall process to use a SDLC analogy). I would wager than in these situations fortune favors the bold, regardless of what the job ad says.
"This package has been orphaned, but someone intends to maintain it. Please see bug number #777123 for more information"

https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=777123 - get in touch with the new owner of the package if you're interested. It's probably on their Never Ending Open Source To Do List.
And this is the reason I am still supporting Python 2.6 even-though I wish to drop it, drop it hard.
Rigetti Computing is hiring the world's first quantum software engineers
As the history of science & technology shows, by the time there is any proof of the concept of a technology lethal to the human race, it is already too late.

I would suggest you read the history of the Manhattan project if you want to continue in your belief system regarding "impossible" deadly technology.
typical bait question that takes you to a super long and convoluted article
I think it's libarchive used by BSD tar that allows this auto detection as well
thanks for summarizing
Google Wallet killed independent settlement solutions on Android by demanding that applications on the App Store (now Google Play) settle via them. I implemented (one of?) the only major carrier settlement capable applications prior to this ban for a preloaded flagship application for Samsung in 2010. We billed AT&T and T-Mobile, both of which had almost the same API for client billing running through the Israeli (now apparently rebranding to appear American) company AMDOCS. (The rumours are true: by providing 'outsourced billing' they can basically spy on most mobile networks' customers... read the public portion of their client list sometime) Anyway, we were already doing pay by text (a carrier-specific configuration) for many years all over the world before that. There are providers who set up these integrations for you and provide global multi-market pay-by-SMS services, but the problem is that the average mobile carrier does not have a unified view of its customer: particularly pre-pay and post-pay customers may be subject to very different limitations on pay-by-text availability and maximum charges. Then there's backend settlement, often time-staggered on a monthly basis and incorporating exchange rate risk exposure, etc. It's a PITA to do manually for multi-market, but a real solution (settlement method neutral and incorporating the real qualities of a settlement chain, including risk, legal jurisdiction for issue resolution, insurance, maximum and minimum settlement time, maximum and minimum volume, supported asset types, etc.) has been indefinitely deferred by the likes of Google who seem happy enough to cozy up to the existing financial establishment instead of rocking the boat. Possibly we have some hope now with Chinese device manufacturers and WePay that the Chinese government's huge push for the RMB to become a global reserve currency and their rapidly growing global network of banks may yet provide for some cross-border payment innovation where the west's incumbents have so far failed.
Not sure if this is a parody or not
> I can see how it's both harder and slower to have someone who doesn't know the code base fix bugs on the spot.

Except you don't do that, you fight operational fires and other such bullshit and things don't get fixed.

Their broken oncall system is one of the reasons why I don't want to go back to Amazon.
Nanotechnology
WiFi portal accepts Bitcoin for connectivity
The fact that we don't understand how neural nets work despite the excellent results makes an AI apocalypse more likely, not less. This means that if we ever create strong AI, we will likely not understand it initially.

Note: I'm personally not too worried about the AI apocalypse, but I think "we don't even understand neural nets" should cause more concern, not less.
Is xz greppable?
More specifically, a free market system can solve most problems it is applied to, given:

1. Property rights exist and are enforced.
2. There are minimal barriers to entry.
3. Transaction costs are low.

(#2 is of less interest here.)

The classic market failures all involve a violation of one of these. The tragedy of the commons is a property-rights failure, monopolies are a barrier-to-entry failure, and lots of other miscellaneous exploitation and big-corporate-player centralization issues are related to transaction-cost issues.

In this case, it's quite clear that property rights do not exist and are not enforced on things like the Atmosphere or the Ocean (good luck doing that internationally), and even if they did, imagine the transaction costs of tracking exactly how much in microbead pollution a given person has flushed down the drain? Anyone crying 'free market solution!' is being quite silly.
> Most arguments that the free market can handle these problems start out with the recommendation that the resources involved (rivers, lakes, ocean) should be privatized. Economist Walter Block and others have written about ways this could be done. To fault free market arguments for not working when the waterways aren't privatized is to misrepresent the arguments. Most people aren't arguing that the free market is going to solve problems relating to unowned, unownable, or government owned property without first recognizing private property rights in those resources.

So the arguments are lunacy. Gotcha.
I don't believe that's true, though there are multiple projects that offer that feature. lbzip2.org and compression.ca/pbzip2 to name a couple.
How high, exactly, is the bar for an O-1?
Human brains are far more efficient than computers. We tend to forget how efficient human brains are. You might find this post interesting [1].

1. http://chrisfwestbury.blogspot.co.il/2014/06/on-processing-s...
I'm not equating it. I'm comparing it. They are simply explicit and blunt examples to make a point, more relatable examples would be traditional models of miasma causing disease or of the Earth being flat. But you also reinforce my point - it feels more explicit when the consequences of a misguided social order have physical ramifications in the immediate, rather than the sociological spanning the entirety over a long time. Probably the greatest relatable yet poignant example would be the cultural view of women as helpless or lesser than men for most of history since cultivation of crops began. It started as a tool of control, and was passed down in an ingrained psyche we have still not fully escaped. But we can fully understand both that people borne into it assumed it to be an absolute of the world, the same as how many think copyright and intellectual property must be, while also recognizing how wrong they can be.

> Almost everyone I've ever discussed copyright with is perfectly capable of appreciating the systemic perpetuation of privilege that inheres in copyright monopolies. You're waving a bloody shirt for the moral equivalent of a paper cut; it's not OK to borrow the vastly more intense sufferings of others to make more of an emotional impact.

This is also the point. It is not about the privilege of the owners, it is about the damage inflicted by it. It is not about money earned but history, knowledge, and potential lost. You can see the immediate consequences of slavery, but also recognize that such a sin of culture has consequences in the potential of everyone involved beyond the subjugated. If a debate on copyright devolves into pursuits of wealth or privilege, the macro impact is already lost. In addition, anyone you are having a debate with is probably already putting in the effort. I speak of the other 99% of peoples who give it no consideration and assume it as natural as gravity or light.

And I'm not claiming to be some enlightened saint. As others have said, these flaws in social organization of peoples require mental effort to grasp and overcome. You always want to presume what you know is what is right, and I am certain I have my own assumptions that are as moralistically wrong as copyright that I have not yet, or may never, challenge. And hopefully whatever we are in that thousand years looks back and sees them all as backwards and unreasonable as we see so many historical practices as wrong.
How is it that in the 2:1 environment developers aren't held accountable when problems turn up in code they're responsible for?
If you are building for client side Windows machine there is no better solution. Its just that simple.

Visual Studio is the best IDE available, bar none. Eclipse has everything you'd need but takes a long time to configure. Visual Studio "just works".

I'm not a Microsoft troll, I've just been around long enough, seen the different koolaid commercials and tasted a few.
ftp://ftp.freebsd.org/pub/FreeBSD/releases/amd64/amd64/ISO-IMAGES/10.2/
The mis-quoted headline here doesn't help at all.

Currently on HN: "How to Cure Cancer".

The actual headline: "Tough Medicine - A disturbing report from the front lines of the war on cancer."

The HTML <title> is indeed "How to Cure Cancer". I wonder if it was changed?
Wow, that is a lot, I wonder if there could be some innovation done.

Although that numbers sounds suspiciously large.
It's certainly a lot cheaper and quicker to use rats! Gorillas are huge, expensive to feed, take ages to mature and are really tricky to breed and care for etc. Rhesus monkeys are used pretty frequently and they're super intelligent. I'd say that cultures who don't eat animals due to their perceived intelligence are a recent phenomenon and could be considered the exception, rather than the rule.
Sundar Pichai: Let’s not let fear defeat our values
I was an electronic tech in the air force back then and a buddy and I disassembled a couple of Sony laser disc players for the lasers. We got a pair of servos and created a 2 way mirror deflection device. We used the STEREO output of an Amiga 500's audio to control the servos' deflection, one channel for each servo/direction. With a little programming, we were able to "paint" a picture on the wall with the laser.
But for non-programmers, I would say that user-friendliness is very nearly everything. They are never going to keep the "simple" underlying model of an directed acyclic graph in their heads to let them intuit how to work with it. For them, they need an interface that baby steps them through the process and makes it obvious what to do at every turn.
I'm sure in the same way many people can own and ride horses, or own their own boats while most travel on communal naval vessels, the option will still exist to own your own private auto. The technology needs to advance to the point where it can handle human drivers, and at that point it will be more than sufficiently capable of handling peer autos who behave much more logically.

It will just be way more economically efficient to have the subscription model so you maximize vehicular utilization, so you just pay the premium difference of that efficiency. I cannot imagine they will be significantly more expensive than a Tesla is today.
Didn't see the Reddit thread, but don't get discouraged.

One other thought...consider a different name that is more descriptive, or double-down on your existing one and blow out a creative logo and brand tone & voice around the "puppy" concept. But please please please get a nice logo to use so people at least start remembering what you are called.
> ... being signed in is in-memory state.

Can be in-memory state. Everything beyond toy-sized I've ever worked on has externalised this sort of state to a database of some kind, if only so you can run a second copy for the sake of failover. I don't believe your example is relevant.
This doesn't reflect the content of any econ course I've taken, nor the views of any of my econ professors. There's a ton of study in economics about the types of effective roles government can play when dealing with positive and negative externalities, and "tragedy of the commons" situations.

Economists that believe everything can be sorted out in the free market are pretty fringe.
Agreed. I've been using a brand of face soap with little scrubby beads in it for years, and had no idea the things were made of plastic. There's no way that the level of public awareness on this is anywhere near that of something like CFCs.

Guess I'll go find a new brand of face soap.
Unless they access a different data feed [1] [2], both should be as (in)accurate.

[1]: https://www.citibikenyc.com/stations/json

[2]: https://member.citibikenyc.com/data/stations.json
Seconding this, but for the Bay Area real estate market. My theory is that raising rates will reduce the number of people in the market because money won't be as cheap, however what I'm not sure of is the sheer massive amount of demand from people with money (investors and highly-paid techies) and whether it will be enough to cancel it out.

As someone who bought earlier this year I guess I'll see. Sure as heck hope it keeps going up for a bit more.
That's only really much good if you're in the business of archiving things like that. For most people, source trees are ad-hoc downloads for patch fixes, oddball platform compiles, etc. And then the universality of gzip is better than any marginal space savings from xz.
So we can expect the price of glassware and plastics to what, at least double right? Capitalism. Gotta love it. If you're rich.
Fortunately, the same is not true of time or memory.
Computer Learns to Write Its ABCs
I believe you're looking for pbzip2. Parallel bzip2 file compressor. I've replaced it as my go-to compression.
Fix my autocorrect
You missed his point. People are the problem, not computers. Computers can help people hurt other people, just like guns help people hurt other people. But instead the hype is about the possibility of computers hurting people, on their own. Which, at least at this point, is about as alarming as the possibility that a gun will go off on its own.
I replied to this here: https://news.ycombinator.com/item?id=10721068. Short answer is that collaborations don't look unlikely, and we'll be able to say more when OpenAI's been up and running longer.
This seems to come up in every discussion of intelligence here on HN. General intelligence isn't a thing, it is a statistical measurement of the correlations between specific intelligences (11 from memory). It is rather useful as it allows you to make quite good predictions about many areas of human behaviour.
The 1970 Kidnapping of an N.Y.U. Computer
DO NOT WORK WITH HIM. Can't believe he made it to HN!!
He somehow became a thing but I can't stress out enough how much money he had cost me while providing either no service -even declined to work on my first case- or really shitty service, where i ended up writing all docs myself.
He does not think out of the box at all or provides any value bigger than digging into Google. He didn't have any plan B or even replied to my emails asking what we should try next after we had lost. The only thing he ever did for me was sending the invoice. Everything else was taken care of by his assistant, sending information and documents i had drafted to the government, trying things that i had researched myself.
Please feel free to reach out to me for a curated list of good immigration lawyers. I would have taken my return flight back to Germany more than a year ago if i listened to his advice, which has been "i don't see any options here" when there WAS an option for another year.
I wonder why in general this kinds of things happen.
I mentioned it when it came up on another thread. Compare apples and apples -- use one of the standard corpuses when running bench marks.

Ian Witten put together the Calgary corpus - https://en.m.wikipedia.org/wiki/Calgary_corpus
"re-election would probably be the only one"

Unfortunately (in the USA) due to our current campaign financing situation, lobbying and media outlet consolidation the elected representatives voting to write big government checks are far more beholden to the corporations than to the people, which explains the crazy boondoggles like the TSA and congress buying military hardware the military doesn't even want (causing it to be regifted to local police, causing all sorts of carry-on negative impact).

And then those same corporations/wealthy individuals that profit from this system point to it as an example of how the government can't be trusted with our money and thus shouldn't be allowed to regulate anything they do.

The entire system is just ridiculous at this point and possibly unfixable (without some kind of huge society-shifting event).
Blind, unsupported conjecture from McAfee thoughtlessly regurgitated on IBT. Sad.
The same animals adapted to oil spills.
I'm looking into integrating my nginx containers with LetsEncrypt too. Maybe with a dedicated container for the LE client that accepts new domain requests and keeps certs up to date, and confd + etcd/consul/etc to deploy certs and configs to nginx containers.
I think you're pretty far off on all of this. Most Uber drivers own their own cars. Uber doesn't do any of the leasing itself, instead sending drivers to 3rd party leasing companies. Uber gets either zero or very little kickbacks since Uber's primary motivation is getting drivers in nice cars on the road. The California decision was by some employment office with no real authority on the case of a single driver and so pretty much irrelevant.
I read that answer, and don't see it point out harm? You do mention some general harm in community friction and worry, and I do agree that is a concern - but that's happening anyhow right now. Yes, it's bad, but removing the word "slave" won't change that.

I do get the worry about overreach. Node.js has a PR that will automate looking for "problematic" words, which starts to sound Orwellian. However, the opposite extreme of "change no words no matter who is offended" can't work either. We need to find a reasonable middle ground.

It seems like removing "slave" is fairly reasonable - that's my feeling. What I find far more unreasonable are drive-by comments that complain without offering to do some work to help. But work to help is exactly what's happening in this (small part of this) story.