skysight-inc/HackerNews huggingface dataset:
I'm not totally sure whether this analysis captures the true extent which R vs SAS vs SPSS is used.

If I use R for a plot, or a simple bit of regression, or anova, or even cross-validation. I don't reference it in a paper. I only cite it if there is a package designed for a particular type of data (e.g. a Bioconductor package) or something a bit more esoteric (e.g. apcluster). About 95% of the work is data munging and - sorry Hadley - I don't cite dplyr, purrr, magrittr etc...

However I have notice that in clinical trial or small social science papers simple analyses of this type are often cited as being done in SPSS or SAS. I think this just reflects the fact that non specialist data analysts are more likely to cite SAS or SPSS for simple procedures such as graphs or anova as an appeal to authority.

So I reckon the data may reflect a trend but tells us little about the true levels.
A radical approach to gun crime: paying people not to kill each other
When I was a kid I daydreamed about connected devices and how cool it would all be. Now the devices I actually love:

Casio A168W-1 Electro Luminescence Silver. 5 years old.

Ipod Classic. 8 years old.

Kindle Keyboard. Maybe 7 years?

I actively loathe my phone. I like my laptop when I'm on the command line.

I think the essence of what I am trying to say is that I like devices with low visibility connectivity.

We need to turn ubiquity into something much quieter.
I use Google Voice as a landline replacement with an Obihai device and effectively get free service, minus E911, but I have a cell phone for that. The costs for wireless must be much higher for Google to be charging, although I manage to get service on Sprint through Ringplus that is effectively free too. There are limits, I am charged for overages and I do not get roaming, but I have real SMS and can use any CDMA capable device. I see no reason to pay for Google Fi as long as I am in an area where Sprint's network is good. Their network was terrible on Long Island in 2014, but as of 2016 it seems decent.

If anyone is in an area where Sprint is decent, I suggest trying Ringplus. You can use an old phone to test it. In my case, I gave a neighbor who did not have a cellphone an old phone and set it up for him on Ring plus. I heard a few months later that the coverage was good, so I switched and found that it is indeed better than it was in 2014. Consequently, I can put the money saved from not paying a monthly fee into something tangible, like equipment.

It would be nice if Google could offer a similiar service for everyone, but until either then or Ringplus decides to stop providing free service, I am sticking with Ringplus. There is no point in paying for a service that a competitor offers for free.
HN is in the pockets of Microsoft. They could eat children and any post mentioning it would still be downvoted.
Every time I see an article on flying cars, I can't help but be reminded of an old IBM commercial[0] from 2000.

Deliciously ironic considering it represented the fact that mainstream culture had all but written off the idea entirely.

[0] https://youtube.com/watch?v=vzm6pvHPSGo
That's why I was surprised that the launch went on and on about watches and watch design and how they paid attention to watch heritage. They said "ooh, complications." They clearly wanted to say this is first and foremost a watch. But if you want a watch this is the last thing to buy.
To be fair, that was a total outage of every region on the planet in google cloud platform's 18 minute outage case.

Compared to the sole region ap-southeast-2 (for you) in AWS's case. (though it was a longer outage).

That being said, I 1000% agree that Google cloud platform's response to fix issues, postmortems and actions to make things right are top notch.
This is a very naive view. It will ruin life, some people will protest, but the majority, will, as with the proverbial frog in the hot water, stay quiete. And it will just be one additional step toward a totalitarian state. It's just tiny steps. It will take time. But here the regularity matters.

The simple existence of the Patriot Act, which destroys the very basis of the US legal system (the habeas corpus) and ignore blatantly the constitution, proves that the Suprem Court is not the democratic safety net it's supposed to be.
Performance as in ad performance as in impressions as in money. for them. Their performance, not yours.
Your Privilege – Yes Your White, CIS, Male Privilege
That would mean something if Ruby apps are 100% Ruby and/or are performing binary tree operations all the time, or doing similar kinds of CPU-intensive operations as depicted in the alioth benchmarks. But they don't. Ruby web apps perform lots of string manipulation, memory allocation, I/O. A lot of expensive things are offloaded to C libraries. Things like XML parsing are offloaded to native libraries like libxml; nobody uses an XML parser fully implemented in Ruby. Ruby does not reimplemented gzip compression in Ruby, it uses zlib. So the alioth benchmarks are not representative of real-world performance.
A dashing freeWordPress theme for (un)sophisticated bloggers
The theme can be downloaded from here : https://www.dropbox.com/s/srlq1u... and you have ideas for us the Github link is : https://github.com/Codeinwp/zillah ( if you get it directly from the github, you aren’t getting updates since the update script is added later on )
Here's the actual project page - http://graphics.wsj.com/hamilton/

For those unfamiliar with Hamilton — you're missing out — it's worth noting that, while I think the algorithm appears quite over-generous with rhyming syllables in the middle of words, Hamilton does have quite a bit of these.
Unless we were overpopulated, it would still work out. That is, if everyone could go out and find a plot of land to live off.

Better yet, all the people without access to automation could in form an entire economy among themselves. They would live like we do now, or like we have done at some point in history. Even without any support from the more developed society, they could develop like we do now.
I would love to do this and I'm convinced this would land me a job 90% of the time. But laws and privilege and all that stuff prevents me from doing what I believe is in my best interest.
> using csv or whatever format to exchange data sets

Have you used Pandas in the past year or two? I'm curious why you would exchange data sets using csv or another format between Python and R when you could easily call the R function of interest from within Pandas (using rpy2) and not even worry about data interchange.

It's definitely not vastly more work to do statistical analysis using Python Pandas than in R anymore, perhaps it was several years ago.

EDIT: And carlmcqueen mentioned feathers in response, which is a collaboration between the developers of Pandas and R to create interoperable on-disk data frames for both languages. Point being, between rpy2 and feathers (and probably other projects), you definitely don't need to use intermediary csv files anymore to move data back and forth between R and Python.
T-Mobile was the first US carrier to give free Intl roaming. I'm currently using it and it's worked great for months.
I'd second this -- it's worth the hassle of re-installing the OS to get the security benefits of 64-bit, etc.
Could you explain what you mean by "The main drawback with it is the overhead of dispatching the job and waiting for the result."?
I have used Gearman for a long time and I like it a lot, very simple to use, lightweight, does its job and doesn't get in the way. It's one of the few cases where something literally just works.

If one would just want a job queue to fanout jobs in a network transparent fashion, would moving to Celery provide any advantages? With regard to Celery's broker, which is most preferable, Redis or RabbitMQ?
> depending on work factor

Right, but therein lies the strength of bcrypt. You can set it so it will be several thousand per second, or several seconds per thousand. This comment seems a little like saying "I can run faster than a car, depending on how hard you press the accellertor."
Mobile Phone Records Reveal Largest Gathering in the History of Humanity
It has been done already:
http://arxiv.org/abs/1502.05700

Edit: Although what they seem to describe is replacing GPs with neural networks in Bayesian optimization which is supposedly more efficient.

Since the point of Bayesian optimization is to limit the number of times you have to evaluate a new set of hyperparameters, I am not sure how useful it is to "be able to scale" (i.e. even if maintaining the GP is O(n^3) with the number of evaluations, the costly part should be to evaluate the hyperparameters in the first place) but I haven't read the paper so they may show some high dimensional hyperparameter cases where performing a lot of evaluations pays off.
I don't know why for a second I've read that he lived more than a year without internet.
Manufacturing output didn't actually decline, it's at the highest levels ever, it just got fully automated. The real problem under Thatcher was that no-one put in place a decent plan for all the people losing their jobs.

Take the steel industry crisis in the UK at the moment. The steel mills were having to close because they can't produce steel at a competitive price. No-one is buying.

There are around 35,000 workers, and the figure for the government nationalising the industry was about £10bn. If instead, they let the foundry collapse and get sold off for pennies, they could use that £10bn to pay each and every worker over £285,000 each... That would be plenty enough to see the older people safely into retirement and a lot of the middle-aged into early retirement. The younger ones could use the money to retrain or start a business. It's a huge chunk of cash.

What happened instead was they scraped together a private buyer with huge government subsidy and now people have jobs. Or at least some of them. It doesn't change the profitability of the steel... But apparently it's the job that's important, not the outcome.
Dammit smartwatch industry, this isn't rocket science. The core values a watch brings are time on your wrist, notifications, and low maintenance. The core upgrades are simple apps (stopwatch, timer... ), waterproof-ness, and fashion.

Those are your dimensions. If you do anything that compromises those product fundamentals, you are making a bad decision.

If Pebble came out with a good looking, waterproof watch with a week long battery, they would dominate the market. The fact that they have done so well against the marketing juggernaut that is apple, is a tribute to how close they've come to these core product traits.
Open Source Business Intelligence Product
Need customized and innovative Business Intelligence tools??

We have developed the world's first open source developer friendly Business Intelligence platform called "Helical Insight" with unique features like machine learning, InstantBI and more

Visit Helicalinsight.com to learn more.
FREE trial available
It's pretty damn easy actually, once you're a certain size at least. The hiring and retention pipeline makes it painfully obvious.

As an employee, you don't get to see all of the requests for raises, all of the people negotiating salaries, etc. But there's people in the company who do. That's all the data you need.
With over 270 million accounts (the largest number I could find) at only roughly 12% of the accounts leaked I'm wondering where the leak occurred? Or possibly the hackers were interrupted mid-download stream?

edit That number is actually active users and I do apologize the number of registered accounts is estimated to be over 645 million! edit2 Actually 4.9% of the estimated accounts were "leaked" (if this is an actual twitter leak since still no official word)
https://youtu.be/mGcHNnI2mh4
The Beginner's Guide to Intermittent Fasting
John Goodenough brought us the lithium-ion battery and has ideas for a new one
Can you give an example from the code of how this shows the power of lisp? From reading the article it sounds like it's a port from the C version.
Cool work! Appreciate it's not your mission to say 'this will or won't happen' and is just a bit of fun.

But the great thing about football is that interesting as this is, I won't be placing any bets off the back of it. Too many variables in human nature, playing conditions, external factors, and maybe even luck. It's what keeps the game interesting and millions watching.

It would be interesting as a question to wonder what parts of human behaviour can be predicted accurately in this way though!
It was not simply the consolidation of our petroleum interests we were after, no? Hamid Karzai (our man) afforded us unprecedented access to humans favorite narcotic. Poof! An unprecedented alkaloid epidemic.
Admittedly it is the kind of argument that needs some justification. Roughly what I mean is, a car in the middle of the desert will just roll until it stops because there is a lot of friction between the tires and the ground. By contrast a plane flying above the desert left to its own will crash and burn, because the dissipation of energy occurs at the end of its trajectory.
Was curious what you guys do, but honestly, every page redirects to a signup/login page.

"A social community of makers building, selling, and crowdfunding together"

There is no clarity as to what you actually do.
Everyone say they want to only hire A players, then crappy people interview, and they get an offer anyway because "they had so much potential!", "we can train them where other companies didn't", and "I didn't think he sounded THAT much of an asshole". Oh, and the ever popular "I think we have enough easy shit to do for this guy to be useful!".

And then it goes to hell.
> If Pebble came out with a good looking, waterproof watch with a week long battery

I'm curious which one of those you think they currently aren't meeting, because they currently have the latter two, and the Pebble Time Round is a fairly attractive looking watch IMO.
6 Proven Strategies to Drive Sales Productivity
How do I make software to withstand a Nuke?
[New Ponemon Study] 2016 State of SMB Cybersecurity
it was a bad idea #savedyouaclick
Done a lot of code-review of Linux lately?
I'm on mobile, not using an ad blocker, and I still got this message... really Bloomberg...?

Also by performance being affected perhaps they are referring to the 5 extra secondtheys make you wait.
"Money has never made man happy, nor will it, there is nothing in its nature to produce happiness. The more of it one has the more one wants."

Benjamin Franklin
I think the idea is for many things you don't sit around and wait for Celery to complete.

User clicks "send email"? You throw a send email task in Celery. If it takes .1 seconds or 12 seconds, the user doesn't have to wait for it, because they don't care. This is perfect Celery use.

Now when you are loading a page to display to the user, and that page makes a bunch of celery tasks that you NEED To complete.. this is more iffy.. in most cases, you may just want to run those inline in the webrequest. Needing a bunch of tasks to complete to show a user a result is not an ideal use case of Celery.
I'm interested in how you model the strength of players, is that for the whole squad or the expected starting eleven? The prediction that stood out for me was the Wales vs Slovakia which FIFA rankings and betting odds would both suggest will be closer, would love to hear more about the factors behind that particular prediction.
FWIW I used sikuli(x) and found it very useful, but I have a chronic allergy to Java[1], so I've been re-implementing the same API in pure Python --> https://github.com/shish/sikulpy

[1] more specifically, I found sikuli scripts pretty painful to debug, since neither java debuggers nor python debuggers seem to work quite right.
Actually, the whole Mathematica kernal is exposed via a C API. I wrote a Python-Mathematica bridge based on this and it was wonderful. You could sit in Python, and send Python expressions with variables, etc, to Mathematica for evaluation, and get the results back as Python objects.

The interface was trivial.
I wouldn't have minded reading someones process of learning a new design pattern if it wasn't asserting so many things that are silly or flat out wrong during the process. That's why I originally wrote, "this is a bad article." I edified that bit out because it detracts from my point unless I take the time to go through and fisk the article.
What problems with bcrypt/scrypt does argon2 solve?
Basemark Web 3.0 launches
Report: Nest isn’t for sale
This link (recently on HN) provides an interesting analysis of the options:
http://spectrum.ieee.org/aerospace/aviation/how-i-designed-a...

It seems like a fuel cell could be a viable option in the not-too-distant future, but still comes with a good number of trade-offs...
Swift HRM Framework
What I'm saying is that lack of food, lack of health care etc aren't means to get you to conform to a social norm. They are simply a consequence of that you're not providing for yourself.
Good luck outbidding rich folks for land.
I used a Pebble for about a year, but the problem to me is that it never really looks like a "watch", but more like a "computer that's on my wrist".

I'll admit that's a kind of pedantic little nitpick, and the Pebble is a great little thing, but I switched back to my old Invicta chronograph after awhile.
The biggest overhead is really setting up RabbitMQ right? Because Django and Celery play nice, you can just deploy one codebase and run 1 Django process and 1 Celery + Celery Beat process pretty easy...

Bummer you lose so many Celery features when you use Amazon or Google Cloud Queues instead of RabbitMQ....
If money becomes some kind of automatically traded around thing with artificial value changes based on interacting algorithms, will it still be a useful for humans to trade physical goods and services?
feather is a great way to move data between the two as it is blazingly fast and native in python and R.
Ask HN: Private API Aggregation Services
I am currently building a personal dashboard that visualizes the various web-connected activities I participate in day-to-day. I am still in the scratch pad stage, but the general idea is to have various sections that have dedicated visualizations for:

What I'm Learning - Data from coursera, udacity, etc.
What I'm Working On - Data from github, trello, Upwork
What I'm Reading - pocket, kindle
Who I'm meeting - meetup.com
What I'm saying - twitter, reddit, HN, blog, SO.
And an overall classification viz to automatically identify themes across my activities.

Currently mocking up early designs, and a design decision that's come up is if I should develop this to be easily customizable for other users who might find the final product useful. But developing this would dip into the world of user authentication and web security, something I do not have experience with.

The Question(s):
1. Are there existing solutions that handle private account API calls across multiple services geared towards applications like the described use-case?
2. Are there other options to provide individual use, but avoid handling authentication (ie. opensource github repo with config file for individuals to setup API keys and Auth.)

I've done some of my own research, and I'm not opposed to learning Authentication and Security best practices, but it's something I want to consider carefully and include opinions and suggestions from those more experienced than myself.

Thanks,
-pH+
Hi, I'm the author. Please point out the nonsense :)

But honestly, what I'm trying to advocate here is that if we remove the problem of what's executing your tasks and the problem of implicit locking, we can stop worrying about GIL.

A very good implementation of that is how Grand Central Dispatch works.
Will a self-improving AI not do all the things you mention?
Issues closed is probably a better metric, though there's no actually good metric for software development.
> On the margin, someone will stop working. There will be less wealth.

Because apparently all work is generating equal wealth, and this is not offset by people becoming entrepreneurs or investing into their own education to work higher-wage jobs once finished.
I was just trying to convey the sensitivities of the era. As a Quebecker, I am not averse to expletives :o)
> (1) a different measure for results, or (2) give an objective mechanism for evaluating the "worth" of a technique that doesn't involve looking at results.

One does science also to understand why something works (i.e. what is the theory behind it). Deep learning gives something that (perhaps) works, but doesn't give an any clue to the question why it works - on what theory does the neural net internally compute in its black box.

Based on this criterion one can even argue that deep learning papers should not be considered as science as long as the authors of the deep learning paper make no really hard attempt to present at least a partly understanding of the internal theory that the trained neuronal network executes (i.e. a very detailed interpretation of the weights with ideally falsifiable predictions). This is hard work, I know, but isn't that nearly anything in science?
How to Produce High Quality Content with an Entirely Remote Team
> In the last 10 years I've never met a case where someone pointed out that "this code needs to be concurrent, but single threaded".

I wish I could have slept through the circa 2012 Node.js hype cycle like this person clearly did.
The TL;DR (tl;dr: this explains how Celery obsoletes GIL and coroutines) is only telling half of the story.

Celery solves some cases for Python:

- background tasks;
- tasks queues;
- cron tasks.

And it's nice, I used it extensively. But in NO WAY it totally solves the GIL problem nor does it render coroutines obsolete.

Here are some celery limits:

- you need to calibrate the number of worker you have to match your workload.

- You are limited to x number of blocking operations, where x is the number of workers. It means you cannot do massively parallel I/O such as network operations with it (e.g: a web server).

- Tasks don't have access to your main process memory, and vice versa.

- Tasks cannot communicate with each others;

- You must juggle with the workflow of your tasks (is it ready ? it it dead ?). You can use await stuff() with a try/except;

- Celery is an additional process to setup and start, with backends to choose from and tuning to do. It's a lot more work than just importing an async lib.

Granted, celery is a very useful piece of software, but not the silver bullet this article depicts.
As others have pointed out, platforms to fund work on open source projects already exist, and the best part is: they're open source themselves, so you can contribute! In fact I was the top developer of Gratipay for a year myself, and now I've created a fork called Liberapay (the reasons were the legal difficulties Gratipay faced in the US, and the decision its founder made to turn it into a non-neutral platform).

Links:

https://liberapay.com/
https://github.com/liberapay/liberapay.com (Python)

https://gratipay.com/
https://github.com/gratipay/gratipay.com (Python)

https://salt.bountysource.com/
https://github.com/bountysource/core (Ruby)

https://snowdrift.coop/ (not operational)
https://git.snowdrift.coop/sd/snowdrift (Haskell)
This theorem assumes that having basic income does not afford for more meaningful wealth opportunities, which is pretty much the economic reason it's brought up. In fact the author of this article never mentions or refutes this point, so someone didn't do their homework.
I comment on the advice given on that page here: https://news.ycombinator.com/item?id=11867375

I've never had a single issue with "async things suddenly becoming synchronous which blocks the main thread" -- if you architect things properly that just never happens, blocking operations are off the hot path, and when you absolutely must block, IOCP's concurrency self-awareness kicks in and another thread is scheduled to run on the core, ensuring that each core has one (and only one) runnable thread.