skysight-inc/HackerNews huggingface dataset:
Exactly.

Lots of people don't want to play in the Eastern European basketball league. They specifically want to play in the NBA. It's not about basketball, it's about the perks.

Sidenote: Other than the height, the absurd athleticism and skill at shooting ball are grown over a long period of hard work. Nanotechnology cannot substitute for hard work and years of learning the strategies and techniques of playing the game...
You probably mean "data analyst".

"Data scientist" title would apply only if you are applying scientific method to discover new fact about natural world exclusively through data analysis (as opposed to observation and experiments).
Python and Async simplified
I think Delaware has no state corporate income tax and that's why a lot of businesses incorporate there.
Excel, VBA, SPSS ;)
Brushing all of what off? The controversy itself? No, that's not what I did at all. I recognise that it's controversial; I simply don't think most people commenting on it have read Damore's memo, especially if "women are inferior to men" is the mangled message they managed to extract from his writings.
>That and the way the steering seems super sensitive to various snow remainders on the side of the street.

Yes, I also noticed it, it seems like there are continuous micro (and not so micro) corrections on the steering wheel, with such behaviour the passenger (besides the driver that has some more chances, being attentive to the road, to not get it) is likely subject to get car-sickness.
Hah, just yesterday I have browsed your github again. It's my go-to resource for clear and beautiful C, Python and go code. And Craft is awesome!
Plenty of developers have significant Scala experience and like working with it, but the demand greatly outstrips the supply - if you look at a chart of average salary by language Scala is a huge outlier.
Probably http://restya.com/board ? In some aspects like offline sync and list view, it is better than Trello
Yes, that paragraph felt quite horrifying to me. Does the whole "rule of law" thing mean nothing to the author?
Article 1:

Multiplexed and portable nucleic acid detection platform with Cas13, Cas12a, and Csm6

Jonathan S. Gootenberg1,2,3,4,7,, Omar O. Abudayyeh1,2,3,4,5,, Max J. Kellner1, Julia Joung1,2,3,4, James J. Collins1,4,5,6,8, Feng Zhang1,2,3,4,†

Abstract
Rapid detection of nucleic acids is integral for clinical diagnostics and biotechnological applications. We recently developed a platform termed SHERLOCK (Specific High Sensitivity Enzymatic Reporter UnLOCKing) that combines isothermal pre-amplification with Cas13 to detect single molecules of RNA or DNA. Through characterization of CRISPR enzymology and application development, we report here four advances integrated into SHERLOCKv2: 1) 4-channel single reaction multiplexing using orthogonal CRISPR enzymes; 2) quantitative measurement of input down to 2 aM; 3) 3.5-fold increase in signal sensitivity by combining Cas13 with Csm6, an auxilary CRISPR-associated enzyme; and 4) lateral flow read-out. SHERLOCKv2 can detect Dengue or Zika virus ssRNA as well as mutations in patient liquid biopsy samples via lateral flow, highlighting its potential as a multiplexable, portable, rapid, and quantitative detection platform of nucleic acids.

http://science.sciencemag.org/content/early/2018/02/14/scien...
Scaling Collectives on Large Clusters of X86 Processors [pdf]
WadhwaniAI.org a nonprofit research institute doing AI for social good
Well actually, we're not all still here!

Those shifts - i.e. the industrial revolution - were enormously disruptive!

Assuming that this is happening; or going to happen, how can we smooth it out a bit?

And of course; that is on the basis that this is not a science fiction AI special; in which case an even more thoughtful approach might be required to minimise the damage and maximise happiness; or whatever variable you prefer.
In case you missed it - from another top-level comment: http://pixelatorapp.com/
Article 2:

CRISPR-Cas12a target binding unleashes indiscriminate single-stranded DNase activity

Abstract
CRISPR-Cas12a (Cpf1) proteins are RNA-guided enzymes that bind and cut DNA as components of bacterial adaptive immune systems. Like CRISPR-Cas9, Cas12a has been harnessed for genome editing based on its ability to generate targeted, double-stranded DNA (dsDNA) breaks. Here we show that RNA-guided DNA binding unleashes indiscriminate single-stranded DNA (ssDNA) cleavage activity by Cas12a that completely degrades ssDNA molecules. We find that target-activated, non-specific ssDNase cleavage is also a property of other type V CRISPR-Cas12 enzymes. By combining Cas12a ssDNase activation with isothermal amplification, we create a method termed DNA Endonuclease Targeted CRISPR Trans Reporter (DETECTR), which achieves attomolar sensitivity for DNA detection. DETECTR enables rapid and specific detection of human papillomavirus in patient samples, thereby providing a simple platform for molecular diagnostics.

http://science.sciencemag.org/content/early/2018/02/14/scien...
> what tools should be in my arsenal

A sound understanding of mathematics, in particular statistics.

It's amazing how many people will talk endlessly about the latest python/R packages (with interactive charting!!!) who can't explain the student's t-test.
The buttons on my original Pebble fell off in the first 5 minutes I owned it.
JUnit and Cucumber test reports based on source code and behavior
Samsung Begins Mass Production of Industry’s Largest Capacity SSD – 30.72TB
please don't provide such lazy sources for your broad generalizations. I would challenge you to provide a study that used WHOLE fruit as the variable (not fruit juice or sugar alone) and showed it had a negative effect on insulin response.

In an effort to do as I say, here are some studies/articles showing the opposite:

1. http://journals.plos.org/plosmedicine/article?id=10.1371/jou...

2. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3836143/

3. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3978819/

4. http://www.berkeleywellness.com/healthy-eating/food/article/...
inequality is rising because some people are simply more skilled than others.
I'd like to see numbers here. There are huge industries that have been built around entertainment and recreation forever: sports, hunting, movies, television, books, music, etc. I expect, as a ratio, we're collectively spending far less on e.g. baseballs and far more on video games. It'd be interesting to see the net real change in society's total non-essential expenditures. I would be quite surprised if it was all that large especially if we do not consider ultra-high end recreation to account for the fact that there are far more upper class and rich individuals now a days, so their recreational spending could make it look like all of society is spending that much more - when that's certainly not your hypothesis.

And Facebook complicates the matter even more. They do not make money by "building things for the entertainment of others". They make money by building one of the most effective datamining and human profiling systems in existence, enabling companies to pay money access the product of this by precisely targeting individuals to compel them to either buy things or be influenced by their brand. It doesn't really answer the question of where money is being spent. Those companies are giving Facebook money because you give those companies your money. What is the distribution and gross effect of that spending?
Yes, you can export all notes/notebooks as an .EXEX file. Granted this is a file extension that only Evernote uses, but there are converters out there.

Also, I keep copies of the most valuable data (photos, documents that I really want to keep safe) both offline and in online cold storage.
"Given a single facial image, a classifier could correctly distinguish between gay and heterosexual men in 81% of cases, and in 71% of cases for women"

I can guess if someone of gay or straight with 98% accuracy - just always guess they are straight.

Tha ratio of gay to straight in the test data set is perhaps the most important part in determining how well the algorithm actually performs.

Are we supposed to assume the computer was shown a 50/50 split of gay and hetero people? It appears that way. But please, tell us.
Another one of these foggy articles.

Wish people would understand pioneer, settler and townplaner.

http://blog.gardeviance.org/2015/03/on-pioneers-settlers-tow...
Anecdotally.

When I play youtube videos in my browser I'm getting about 1/3 of the view time before the battery is out compared to using mpv with youtube-dl on my laptop.

It's not just about being able to run it at all but run it efficiently.
These days anything on the web feels really sluggish and I miss the days when optimisation was a priority.

Also for me, I vastly prefer writing C++ code over html and the few times recently where I had to write webpages I used libwt[1] in C++.
It's almost like using QT but for html.

[1] https://www.webtoolkit.eu/wt
End game is to move back home and bring back the share of the first world which was stolen from my home and planted there.
http://micheleincalifornia.blogspot.com/2017/05/how-to-effec...
Similar, except I want to get all my grocery shopping in the back.
Question to OP - Did your team check out NATS (https://nats.io/) ? What are your thoughts on that ?
I absolutely agree. I think that the whole notion of automation being responsible for job losses is also lies and misdirection. The man behind the curtain is telling us to avoid paying too much attention to austerity, outsourcing, offshoring and union busting.

In 2011, for instance, amid a period of labor unrest, Hong hai announced to the world with much fanfare that they were going to soon eliminate 1 million jobs with robots. They subsequently created about 400,000 jobs. Nobody noticed.
Theoretically, it should be possible to recompress the video back into the compressed file with no loss, provided the same codec is used, but it would be far more expensive computationally.
what is your point? fruits are infinitely better than sugar. fruits still contain sugar, which is why it is recommended not to drink too much fruit juice.

what specifically are you contesting about the claim that sugar causes insulin spikes?
Deep Learning with Apache SystemML
Plain vegetables are not palatable because they have very little nutritional value, like saw dust. If you were as rewarded for eating vegetables as you are for foods with actual nutritional value you would quickly be malnourished. If you ate a vegetable only meal you wouldn't even absorb the fat soluble vitamins from them because they don't have any fat.

In the wild where the immediate pressure is on getting enough calories and macronutrients while lack of micronutrients only cause problems in the long term, any human wasting energy collecting and digesting food that doesn't have calories and macronutrients (vegetables) would be quickly weeded out.

Look at the nutritional information of any vegetable for yourself. Fruits, nuts, legumes, grains, potatoes etc all come with the fiber, vitamins and minerals that misinformed people think can only come from vegetables while also being loaded with calories, protein and essential fatty acids all which are pretty much completely lacking in vegetables.
Maybe this was the case with Qt4, but Qt5 (that is, QML) is a dream.
A really surprising thing here is that their analysis is also based on an somewhat unrealistically negative datum. They're using the labor force participation rate. The labor force participation rate counts people who are happy to not work, which is not a problem - and probably to be expected as the total number of upper and rich class individuals increases over time as a share of society. A much more useful measurement is the U6 unemployment rate. The U6 counts people who are involuntary part time (want full time work but can't find it) as well as those who want to work but who are no longer actively searching as part of the number.

And the really surprising thing is that even the U6 is reaching record lows [1]. If the current trends with unemployment continue we'll have the lowest 'real' unemployment rate since the U6 started being recorded, 24 years ago. The one 'zinger' I'd add here is that even the U6 does not account for underemployment. Many of the jobs created in recent years have been McJobs and if somebody has e.g. a STEM degree and is serving coffee, then they should probably count as unemployed. Perhaps it's time for a U7. On the other hand, I do not think this would meaningfully change the numbers.

I still do think automation is going to be disruptive since I simply don't see how transportation automation, which is an enormous industry that offers relatively good wages, can end up otherwise. But I've also become less cynical since we've undoubtedly been sending productivity up, and even with the outsourcing of desirable jobs or bringing in workers to fill those roles domestically for lower wages, our economy seems to be doing phenomenally. And that's something I certainly would not have predicted.

[1] - https://fred.stlouisfed.org/series/u6rate
Also in busy carparks, reverse parking certainly feels like it can inconvenience other drivers since (for me at least) positioning takes longer.
Futuristic
I worry that attempts to smooth it out can actually cause worse disruption.

Like, let's say we know factory workers will be laid off, so we need to allocate resources to retrain them.

Very likely the resources will not be enough for all the workers. So who gets them and who doesn't will become a political battle, with the left-out group resenting everyone in society and society ignoring their needs because it reminds them that they left them behind.

And then you build a society where one group's triumph is based on another's suppression, and you can see where this is going...
Fast Optical Circuit Switch for Data Center Networking
Clairvoyant Dynamic Bin Packing for Virtual Machine Placement
>> But Qt is also significantly harder to develop and maintain, especially if you want optimized application for minimal hardware.

If by that you mean it's easier to hack together some awful JS+HTML compared to hacking together a Qt application, I agree. If you want to build a maintainable, reliable and efficient solution, I don't think there is that much difference between the two. Qt has bindings to many languages, and even if you are forced to use C++ because of hardware constraints, the fact that the Qt front end API is a million times better (easier, better documented) than whatever JS frontend, offsets the language overhead.

I'm not really sure anyone could say React or Bootstrap or whatever is 'easy to use' if you are not familiar with it. Easy to get a button on the screen, maybe, but that hardly makes a user interface.
Eat food. Not too much. Mostly plants.

Personally, I conjured up the following hypothesis and think it might be somewhat correct. Note that I am not a biologist/nutritionist (I'm an applied mathematician) so bear with me. What I claim is the following:

> The less some kind of food wants to be eaten, the healthier it is.

For example, fruit wants to be eaten (hence its sweet) to reproduce and spread it seeds. Verdict? Not so healthy. Offal, however, is significantly harder to acquire (you'd have to kill a beast, which is a group task). Verdict? Extremely healthy.

I'd love to have some comments on my theory from more knowledgeable people.
Violin Lessons at Dhwani Sangeet Mahavidyalaya
To plagiarise myself from another, similar HN thread (https://news.ycombinator.com/item?id=14504306):

That's not self-evidently a bad thing.

For example, here is an article about Ellie, a South-Carolina University virtual therapist used in the treatment of PTSD. It notes some explicit advantages which at least complement humans:

“One advantage of using Ellie to gather behaviour evidences is that people seem to open up quite easily to Ellie, given that she is a computer and is not designed to judge the person”, Morency explains to news.com.au

...

Morency stresses she is not a substitute for a human therapist. Rather, she is used in tandem with a doctor as a data-gatherer, able to break down walls which may exist due to a patient’s unwillingness to disclose sensitive information to a human.

As Morency explains, “The behavioural indicators that Ellie identifies will be summarised to the doctor, who will integrate it as part of the treatment or therapy. Our vision is that Ellie will be a decision support tool that will help human doctors and clinicians during treatment and therapy.”

- http://www.news.com.au/technology/innovation/meet-ellie-the-...
I agree with everything except one minor detail. Not sure if outsourcing and offshoring are such bad things. I mean, if someone will work for less than you, you either need to do better work, do cheaper work, or find different work.
There can be a substantial difference between what the company and the employee "do."

I walk by a twitter building every day. Probably about 500 people, maybe more. What are they doing in there? They sell ads, manage ad accounts, moderation, data protection audits... stuff that David Graeber wold call BS jobs. Now... I'm not in the same camp as him entirely. I think it's rash to just write off 70% of modern, white collar work as "paperwork" that could just go away.... but I'm not entirely not in his camp too.

Either way, that building is full of "marketing and social media" graduates doing stuff that doesn't need to be done for twitter to be twitter. Twitter was twitter before they had all those people.

You could call what twitter does creative work. That resonates with me. They invented a communication method with all sorts of cultural impact and value. That's creative. But, extending that to the median employee... I think we might divert here.

I think you have your finger on an interesting point, even if I don't know how to articulate it. A generation ago, a lot of the ecoomy could be measured in stuff with value that one could reason about. Cars, tothbrushes, haircuts, podiatrists.... You can count and weigh and value that stuff. Media was always more abscure. The tv viewer mightn't be the customer. The purpose of a paper might be do get a classifieds insert into your hands.

Once you throw in social/user-generate services make the picture more messy. Once you go to Google/FB territory, it's all very obscure. Half of what they do doesn't have any direct economic benefit to them, it's more a way of keeping them in a massively powerful position.

I'm not sure creative is the right word, but here's somethign going on. Ever increasing (already majority) sections of the economy are producing very ethereal things, with obscure business models...
The difference is that Dropbox is only allowed to access those files I tell it to. If the Dropbox client would start crawling my filesystem for 'password.txt' or 'banking-tan.list' this would be illegal, no matter what clause is written in the EULA.
It also contradicts PG's advice that startups should hill climb.
Really cool, really creepy. Best of luck, I guess? I think it's kind of unsettling someone could track where I'm reading on a PDF ...
I'm somewhat surprised by the article's conclusion, but will accept it, given that Scott is pretty thorough with his sourcing and analysis. Even though he says we're getting the worst outcome (something is happening, but it's not apocalyptic, so people won't notice in time to coordinate at scale), it shifted my internal doomsday countdown ~20 years to the future.

One thing I wonder though, and it's a general concern for such analyses - just how reliable are the official statistics? Given the unreliability at every level (which I sometimes personally observed) - from people reporting bogus data, data entry people faking it to make their job easier, to bogus statistical analysis and biased reporting at the top - just how much faith we can put in all of this? I get that it's the only thing we have, but I wonder if someone tried to analyze those issues.
>Is this true? The stocking frame (and the reactionary group of Luddites that it incited) didn't really increase productivity. It just did work humans were doing for less money than a human salary.

Mechanisation of the textile industry led to vast increases in the quantity of production. Prior to the industrial revolution, most peasants would have owned only one set of clothes and replaced them only when they were entirely beyond repair. Cheap cloth created demand for wardrobes and dressers, because a lot of people were now in the peculiar position of owning more clothes than they could wear at once.

The luddites were ultimately wrong because of Jevons paradox - labour efficiencies in the textile industry vastly increased the demand for their product, and with it their demand for labour. Hand-loom weavers didn't lose their livelihoods to the power loom, they just made ten times as much cloth for twice the wage.

Automation and mechanisation in other manufacturing sectors likewise stimulated vastly increased consumer demand, contributing to a virtuous cycle of increasing profit, wages and living standards. Over the course of the 19th and 20th centuries, the efficiencies of mass-manufacturing gave ordinary people secure employment and access to a dizzying array of consumer goods. The more stuff we made, the more stuff we could afford to buy.

I don't see AI/ML following the same pattern. A lot of tech-heavy businesses seem to be startlingly close to zero-sum. Uber has decimated the taxi industry, but it doesn't seem to have vastly increased overall ridership - the most generous figures I've seen suggest perhaps a 40% increase in some markets. Google and Facebook have become multi-billion dollar companies through advertising revenue, but the overall growth of ad spending across all media has barely outpaced inflation, with the newspaper industry being the most obvious casualty. I can't think of many major tech companies that didn't kill an industry.

I'd love to be proven wrong.
If the test data does not have a 50/50 split (or something around that ratio), the headline is straight up lies.

Skewed test data is the most common problem with research, reminds me of this great video by Veritasium (Is most published research wrong?): https://www.youtube.com/watch?v=42QuXLucH3Q
The Eskimos traditional diet is a good example of this. Their diet also includes organ meats, so they got all of their vitamins and minerals in good amounts.
Yeah, I've decided then that the 140EUR of costs per month were worth it in terms of mental health and motivation. The difference in rents between the company HQ and my city made up for it anyway.
Fructose is unhealthy... but glucose is healthy. How they are metabolized is key. :)
Making Cloud Applications Too Fast and Furious for Attackers
Lots of AI journalism refers to "beating humans" but that's a hopelessly vague and unhelpful comparison. No AI can ever beat a human if by "human" you mean a human equipped with whatever tools the human may choose to use, because those tools would include the AI against which you would have it compete. So the comparison only makes sense if you restrict the human in some way. Depending on how you restrict the human, beating the human may be very easy or very hard. For example, if you insist that the decision be made within 100 ms then beating the human is very easy.

I think the usual way in which these experiments fiddle things so that the AI wins is by giving the AI lots of training data but giving the humans no training whatsoever, which may seem grossly unfair, but apparently that's acceptable in AI research/journalism.
Very true. As a Korean, it really annoyed me that there were products that Korea or Japan had the first foot out on but could not go globally because it's not based on USA.

Although nowadays I don't think that's so much the case. Currently, I think America has more ideas coming out because it really is more innovative
In particular, the idea we have a safety-first culture is still a fair way off.

If motor vehicles were held to the safety standards of nuclear power, we would all be riding bicycles.