skysight-inc/HackerNews huggingface dataset:
I do love reading an article that supports my contention that ETL is the Charlie Work [0] of software engineering.

Though I've never formally done work with the "ETL" label, what I've seen of it reminds me of the work I used to do for client years ago where I'd take some CSV file (or what have you) and turn it into something that their FoxBase-based accounting system could use. It was boring grunt work (or shall we say, "Charlie work"), but I billed it at my usual rate and it paid the mortgage. I would never, ever wish to make a career of it, however. (And if my assessment of what someone knee-deep in ETL does all day is completely off base, I apologize.)
Always a favorite, that one.
Yep, any time I have an assumption about how code should work, that's a good starting point to write a test. Even if it's vaguey like "should not throw when given inputs X Y Z that I expect will be encountered"
Without having read the code but how it would usually work: would be that the first password is required for the encrypted private keys to be sent to you, and the later to decrypt the keys -- so one is hashed and goes to the server and the other is used to decrypt the keys sent back in the response client-side.
+ oh, the irony that the tool is written in Rails. :D
There's a vast spectrum of possibilities between Hacker News as it is, and "ads, trackers, pictures and videos."
They're not asking for 1 specific phone to be unlocked here. They're asking for ALL Apple phones to be built to withstand brute force attempts without wiping data in case they need to access it in the future.
Steam powered engine drives a Raspberry Pi Zero
Just chiming in with anecdotal evidence that I've used this package to edit remote files for years. It might just be some sort of scp mechanism though; can't remember as I haven't used it for quite some time (for unrelated reasons.)
There are many of us here who are not in the field.
Your analogy requires:

A. the person to have convictions for dealing, not just possession, and

B. mobster-era Italians to be just about as likely to engage in illegal bookmaking and racketeering as the general population, and

C. a history of hundreds of years of imposing underclass status on Italians (like that imposed on African Americans), with modern-day policing skewed very heavily against them.
Then you change the test. They are not supposed to be immutable.
sshfs is the shit. And using a solid piece of work like sshfs vs having some one-off thing for sublime is much preferred.
I don't believe in that particular form of racism. I think it's a rhetorical trick employed in defense of the status quo, like people who say we're being racist for not having a white history month.
Lagonaki, First Blockchain Testnet Based on Proof-Of-Retrievability
That's pretty blunt, but you are pointing out something real: all traits including intelligence are normally distributed, and the average IQ is 100.

Nobody wants to talk about this for the same reason that the abused wife and children who live under a borderline-psychotic alcoholic father don't talk about it: it's "reality," and we don't feel like there's anything we can do about it, and talking about it threatens our coping mechanisms. The human ability to not see is prodigious, probably an adaptation that has arisen precisely to help us cope with our condition. I once heard an anecdote from a psychologist about a woman who was raped by her father in the bed with her mother, and the mother claims to have seen nothing.

In our case the abusive father is "nature," a soulless chthonic process that did not think about the ethics of imbuing the agents in a Darwinian system with self-awareness, empathy, and consciousness. As far as we can see it just happened as a result of runaway evolution for central nervous system capability.

So nature builds random assortments of genes and throws them at the wall. Never mind that these "agents" experience their existence. If you happen to be born with no legs, then... well... you are born with no legs. If you happen to be born with a less efficient brain that makes the world a bewildering haze of incomprehensibly complex systems that all seem arrayed against you, then... too bad. You're just a trial permutation in an algorithm.

Watch the film Dark City. That is the human condition, only it's not being done to us by creepy aliens but by an unconscious natural process.

I happen to think we might be able to do something about this this century, and that Silicon Valley might have some part in that. But the irony is that the sort of folks who write screeds like this Medium piece would be the first to shriek and condemn any attempt to interfere with holy Nature and its blessed bell curve distribution of genetic traits. Even talking about it is threatening our coping mechanisms.

Society is getting more complex, but our genes are not changing that fast (if at all). Eventually a huge number of people are going to fall off a cliff where the economic value of their labor in a free market is <=0. That's actually completely disastrous for the entire economy, since it will cause the velocity of money to collapse and lead to political and social instability. Guaranteed minimum income is one way of dealing with this problem. Personally I think CRISPR is another. It's time to open our eyes and start doing something about our condition.
Black underemployment is not an issue specific to the weed industry, it's a problem in all industry. Duh.

Also, legal weed is supposed to deal with racial inequalities. Legal weed means less people being caught and jailed. This is good.

Though, to be perfectly honest, I am not into the idea of states using Marijuana as a profit vehicle. It's about as cynical and without class as state run gambling. Hopefully more people will grow their own and once the rest of the US legalizes, weed will be about as profitable, no more or less, than a tomato.
But not the imperative:

Google "Google beats go champion".

Which it interprets as:

Noun Noun Noun Verb Noun
Truman issued an ultimatum to draft coal and railroad workers during the steel strikes.
https://en.wikipedia.org/wiki/1952_steel_strike

There was a doctor's draft in the 50's, there was a more recent general "health care workers" selective draft but I'm not sure where it exactly stands.

Basically what Obama can do is issue a requirement to register with the Selective Services Administration as a threat failure to do so can incur heavy fines on each Apple employee. Once they are registered they can draft any engineer they need into military service and order them to do so, if they refuse they can be court marshalled.
https://en.wikipedia.org/wiki/Selective_Service_System

This ofcourse will never happen, the most extreme case was under Truman and it was an ultimatum with an apparent executive order drafted but that was enough to bring the steel industry to it's knees and to the table.

The funny part is that if anything even remotely extreme happens we might start to see the seeds of the "2nd American Revolution" the one from so many dystopian novels where the world is ruled by corporations Apple, Google, Microsoft and the likes have enough power to seed the "corporate congress" :)
This is not entirely true, ancient Egyptians used chariots in warfare, which they originally picked up from the Hyksos [0].

[0] https://en.wikipedia.org/wiki/Chariotry_in_ancient_Egypt
> Have you ever set up postgis? I'd much rather make a geo index in MongoDB, do the geo queries I need and call it a day than spend a day setting up postgis.

I think you should try it again. I felt the same way when it was in the 1.5 version, but post 2.0 it is really easy. And the documentation has gotten so much better. It really is as simple as `sudo apt-get install postgis` and then `CREATE EXTENSION postgis;" in psql.
Uber seeking to buy self-driving cars: source
I don't think arrogant means what you think it means
> Of course I was paying rent, what a ridiculous assertion.

A lot of people learn to code while living with the parents, I don't see what is ridiculous about me mentioning it.

> You can all construct all kinds of fictional scenarios

Look, these scenarios exist. It isn't the scenario you experienced, and I'm not saying it's some widespread epidemic that is taking over the country. But they absolutely exist. It's why things like scholarships exist for universities - to help give people opportunities they would not be able to reach otherwise. There are no scholarships for self-taught programming, so it is not a realistic option for everyone.
Another take on this issue is that the FBI and NSA have a strong opposing interest. While they may not lobby in the same sense as Apple etc., they do represent law enforcement, which is an enormously powerful lobby in the US. So all those private companies are on one side, sure, but US law enforcement is on the other, and that's quite a fight (and one that law enforcement has been winning for a long time now).
But how does demonizing the legal weed industry by accusing it of being racists accomplish anything useful?

They are clearly NOT being racist and just following the legal requirements for their industry. The fact that the ones being excluded are mainly black is not some conscious decision to exclude blacks but the result of the current laws and enforcement saddling them with felony drug convictions. The author's time would be better spent addressing the real problem of the disproportionate number of black males with drug felonies for simple possession.
There are seven billion people - we can't all live in separate little groups. Obviously, it's silly to design a system for a world we don't live in.
Product development isn't actually the purpose of science.
People frequently think that their sub-petabyte dataset is a big data problem.

Time and again, the tools prove that it's not.

To recollection, I can count the number of publicly-known companies dealing with these datasets on two hands, if being generous.
One author (Lenny Mendonca) is an ex-senior partner at McKinsey who worked with the finance industry. Pretty sure he's not an anti-capitalist.
I didn't say double the price. Also, jobs are also a valuable resources for the poorest people.
It makes me wonder though: could excel formulas be sped up using the GPU?
Serverless Delivery (1 of 3): Architecture
The paragraph immediately after discusses whether they should be controlled for, and provides further evidence.
If most DUI convictions were white males and a delivery company didn't hire you if you had a DUI then that too would be racist? Seems like a reach.
"Big Data" is like good analogies. Few people really have lots and some just don't have any. ;)
This only works if the albums you enjoy are a static set. New releases and discovering existing but unknown albums means you are already paying a recurring cost if you buy all of your content. The main advantage of owning over renting is that you can keep your existing collection if you stop paying.
It's a typical response of denial from someone who's job is at risk: the journalist.

First of all, before any of this can come to pass, SV will have to deal with the government. They control over a third of the country's spending. And they're not just going to allow subcontractors to automate all those jobs away to the most cost effective bidders/ most efficient solutions. Ever hear of no-bid contracts - they're the norm. There's no rule that says Government has to use tax money in an efficient manner, just look at what's going on right now.

There will eventually be some degree of automation. But, unfortunately for society, I don't think it will ever become as widespread as alluded to in the article.
Welcome to Objective-C!
38 tons for RTLS is 76,000 pounds, so the figure isn't really all that exaggerated for the worst case.

In any case, the fuel is cheap relative to everything else so as long as they can put the payload on orbit expending almost any amount of fuel to recover the rocket is perfectly reasonable. Not sure why the ULA guy thought spending 100,000 of fuel to recover a 15 million dollar core would be a bad thing.
Ask HN: Physicists working in tech, what was your career path?
There have been a few threads on HN asking how to transition from a career in physics to tech. I think hearing stories from people that successfully made that transition would be more helpful. For those now working in tech, how did you transition from physics? Did you make the leap after your BSc, MS, or PhD? How does the day-to-day compare between the tech industry and academia?
For people looking to do interesting things with MQTT messages passing between devices, take a look at Home Assistant.

https://home-assistant.io

You can use it to integrate various 'smart home' devices, generic MQTT messaging, and a variety of web services.
> Postgres cluster

This write up post [1] mentions your InfoQ talk. The general philosophy I got from it is that postgres is used for the source of truth, gets all the writes; and then reads can be offloaded to slave instances, or other specialized engines like Cassandra.

However there are no details at all about the replication solution. If you don't mind sharing, how was you general experience around it? Was it trigger-based, WAL-based? Was it the postgres solution, or Slony/Bucardo/etc? What were the hurdles/gotchas you encountered? Did you have to compromise between synch/asynch? It is said that there are two big problems in computing: naming things and cache invalidation. Did you have to design a specific caching policy? How was it enforced? How did you decide what to put to Cassandra vs postgres slaves?

Also, what features did you use in postgres? Did you chose it specifically for hstore?

[1] http://highscalability.com/blog/2013/8/26/reddit-lessons-lea...
I also want to thank you. For making me bust out some google-fu to figure out what "Poe's law" and a "fugue" are. And for the lulz of course. That goes with out saying.
And this is the real issue the author should be addressing instead of trying to accuse the legal weed industry of being racist.
> You still have to know javascript

Yes, you have to be familiar with the underlying platform. This is also true for languages running on top of the JVM, as you have to be familiar with the JVM and Java's ecosystem and with POSIX and with the target operating system and so on. And that's not just for Scala and the JVM. Don't get me wrong, you don't have to be an expert, but some knowledge of your underlying stack is always required.

> Having a problem with the scala version of the react library you want to use? Write up a question for stack overflow, post an issue on github, and then hunker down in the source code and try to find the answer on your own while waiting a few days for a response.

Isn't that, you know, how programming works? Yes, you end up interacting with other people through GitHub Issues, Gitter/IRC channels, StackOverflow, etc. It's actually rewarding, because you end up learning a lot. Us developers, we tend to be introverts. It's hurting us ;-)

> The compilation down to ES6 is so trivial that I don't have to try to guess what the compiler is doing.

It also means that Typescript is barely a step up from Javascript, so why bother? If you're going to be hip and choose an option that isn't THE mainstream choice, don't you want to pick something that brings enough benefits, to counter-balance the disadvantages of not going for straight Javascript?

Scala is a statically typed language in a way that Typescript will never be. Scala enables functional programming in a way that Typescript will never do. For all the bitching and moaning about Scala's SBT build tool and Maven's repositories, it's light years beyond the clusterfuck in Javascript's land when it comes to build tools, continuous integration and dependencies management.

And the best part of Scala.js is that you get to use many Scala libraries that are now cross-compiled. That means for example many of the Typelevel libraries, like Simulacrum, Cats, Shapeless, Spire and as a shameless plug, my own Monix: https://github.com/monixio/monix/

Scala's ecosystem isn't huge, like that of Java or Javascript, but you know, libraries tend to be in much better shape. For example Scala always had good Future implementations (again, versus the clusterfuck that happened in Javascript) and now Scala has Scala-Async which gives you async/await keywords without having to sacrifice browser compatibility: https://github.com/scala/async

Have a problem with React? Fix it. That's how you and the community can grow.
Crack is highly physically addictive. People aren't out robbing houses to get their next acid fix.
Is it though? Is it increasingly terrifying, or does the media just portray it that way?
You know those streets changed names 80 years ago, right? Monroe/Boulevard split in 1932, for example. You also know that every American knows about the civil rights era, too? They teach us that in school. You can keep pointing back to history and saying 'Hey, it was unfair!' and I doubt anyone is going to disagree with you. My point is that things are changing for the better, whether you want to look forward or behind is up to you.
Ultrasound tracking is always problematic, because of all the noise.

I have the feeling, every few years someone has the idea again, to use ultrasound for something and it starts promising, but then the accuracy and lag doesn't go away and dogs and cats go wild.
He hits upon a quite interesting division of labor. Where I've worked in finance, there's been "strategists" and there's been "developers". You can guess which one is seen as high prestige.

The problem arises when someone gets into a position where they can think big thoughts without having to do any nitty gritty. Effectively, they end up jumping in right when the real producers have finished the actual work, and then coming up with some polish that makes it look like they came up with some interesting result.

This is not actually a way to get work done. It's a way to play politics.

Worse yet, it's actually completely detrimental to getting things done. When you have things split up between thinkers and doers, what do the incentives look like? It's quite simple. I may order some analysis, and I may not fully understand the nuances. But whatever happens, as a thinker I'll have to have something grandiose to say, and I'll need to keep the doers busy. That way if I don't find a real conclusion, it's everyone's fault. If I do find something, it's thanks to me.

Where I worked the people with the big plans couldn't code their way out of a paper bag. Ask them what Big-O is, they draw a blank. Ask them how their trading strategy will actually send orders to the exchange, they draw a blank. But ask them something that sounds like strategy, and they will feed you plenty of unsubstantiated BS.

My new venture is coders all the way down. Strategists who can actually use git without asking what it is, understand that algorithmic complexity actually matters, and so on. Coders who understand what the market is.
Microsoft releases new Windows 10 preview with Edge extensions
It's not just router firmware. Its firmware for ANYTHING that has radios.
Mathematicians shocked to find pattern in ‘random’ prime numbers
Very poor article. I doubt anyone in Silicon Valley, especially Y-Combinator is postulating that the rest of the world isn't capable of being successful or any other nonsense like that.

All that is being observed is that the natural tendency for technology is remove the need for manual labor. This first happened to agriculture, then manufacturing and now the push is to automate services that can be. Over time this naturally leads to people needing to move into work that creates this new technology or create new industries in order to work in. If indeed they need to work.

The idea that technology will eventually power our basic needs without human assistance isn't that far from reality, sure we may still be decades away but decades aren't really that long. We need to think about the problem well before then because even small amounts of unemployment (10-15% or greater) causes serious problems given societies current structure.

It's not just work that breaks down on this automation horizon though but also money/wealth/capitalism. Whatever you call the current state of affairs. People will still need to live, do something day to day etc but they will no longer need to work just for society to function. So money as an incentive doesn't really need to exist at that point.

Ofcourse this is very pie in the sky but even so I don't think people realise this is a very real possibility and may happen sooner than many of us think, not in it's completion but sufficiently to force significant numbers of people out of work and make people consider it as a real future.
I don't have a toddler or own a gun. Clearly, I am invincible.
It seems like becoming more aware of history (and the present) and using that to make better decisions and relate better to the people you meet is virtuous. Feeling guilty about what you're connected to doesn't help anyone.
I read the entire article. The man was duly convicted of a crime in Oklahoma. He broke the law, regardless of what anyone thinks. Fast forward to when black people owning property in certain places is now legal and this guy wants a piece of the action, but...he cannot legally do so because he fled from his master. Should we undo his conviction? No. He was tried fairly and found guilty based on the laws of the time and place. His fault. His color has nothing to do with it, and quite frankly, I'm sick to death of everything in this country now revolving around the blacks, sodomites, and women.

Laws are made by humans, and there is no guarantee that they are fair or ethical. The man in the article was caught with a couple cigarettes filled with a shredded plant (the illegal one, not that legal yet much more harmful plant). He served a felony for it because we instituted a draconian and racist class war under the guise of "saving the children from reefer madness". This country is finally instituting some sensible drug legislation, but the people that were most disproportionately affected by the War on Drugs are now disproportionately locked out of this new market. That is neither fair nor ethical.
What Does Your Reaction to a Robotic Trash Can Say About You?
Thanks. Yeah you're absolutely right about content, that has come up in discussion. Basically AlienTube for the entire internet, sourcing multiple comment systems, with my own on top too. If I can't get enough users organically I might have to turn to that. I'd prefer not to because it might be a pretty big undertaking, and I'd prefer to have users in my own ecosystem.

So tough getting early users!
Imperva Incapsula Releases IP Protection: The First in Protecting Single IPs
Frankenstein Robotics
The UK has a welfare state that tries to ensure that people don't have to worry about freezing to death, starving or not being able to afford basic shelter.

The reasons for homelessness are complicated and often heavily influenced by drug/alcohol dependency and/or mental illness. Things like the Big Issue are an example of projects that tap into the industriousness of people that the GP mentioned.

There may be some people for whom the existing welfare state is too difficult to interact with but UBI is easy enough, but we should not believe that UBI will help everyone. Indeed the sheer cost of UBI is likely to require removing the funding available for the most needy.
Mr 'Don't Do Evil' has patented deep Q learning,it is getting a patent on brain
An article about being smarter than the rest of the world and UBI written without mentioning Milton Friedmans concept of negative income tax or Götz Werner's basic income concept left me skeptical about the scientific
entitlement of Ross Baird and Lenny Mendonca. E.g. Falsely crediting Nixon makes me furious. IMHO this Click-Baiting pseudo journalism constitutes a lot more about silicon valleys ignorance instead of its arrogance.
Apple software won't be illegal because they can very easily apply for the certifications.