skysight-inc/HackerNews huggingface dataset:
Thanks. Indeed, I'm just using one PostgreSQL master, with no HA, but plan to set something up later, and have put repmgr on my todo list. (I'm the post author.)
One job I worked in had a slave set up with 30 minutes if replication lag intentionally applied to reduce the impact of someone accidentally nuking a table.

Then as someone else mentioned you can stream your replication log to storage elsewhere giving you the ability to do point in time restores.
The DOD's budget is much more of a sacred cow than the Dept of Education's, Lockheed Martin is much better at lobbying than Pearsons. Plus, entrenched interests like CoreCivic are actively lobbying against effective education as it creates a cash cow down the line for them.
Build a company that cures cancer, it can make you much richer, than just the low ball $1M/year.
Bingo. Well said
That assumption is addressed in the article.
I was waiting for this post... are you saying traders at hedge funds can make this money... but engineers don't? I thought algo traders required engineers, or is there a systematic split from the pure traders who look at funky graphs and the engineers who work on the backend systems?
That site sold me on F# and functional programming! Really good content I can recommend too.

Another good Source: http://blog.ploeh.dk/
You can compare it against 1960s healthcare items, like doctors vists, basic blood tests, dental work, basic vet work, medications, broken bone surgery, etc. It will still be much cheaper than today.
Transferwise is a great service, I use it myself. They even give you a volume discount if you ask for it.

But what really surprises me is that it got to where it is at all. If you look at it, their business model is not revolutionary. Their prices are not cheaper than for example UKForex (OzForex), who provide the exact same service, and were around years before.

The business is simply a click interface for exchanging money; you send in your currency, and they send in the agreed amount to the other side. The price difference between these shops is minimal.

It could not be simpler. I've traded currencies as a professional, there's not a whole lot of other steps behind the scenes.

But I doubt most people have heard of UKForex. Transferwise however are on billboards everywhere, acting as though they invented the idea of swapping one currency for another. And acting as though you are cutting out the middle man, which you are not. You still need a bank.

Well played to them though, it seems they've used some of that startup hype attitude to get themselves a nice little business.
Top 1%? Not many. There might be few tens of millions of software devs in the world; let's say 30M (in reality this number is probably higher). 1% would be 300k people -- of course they don't earn above 1M. So maybe you should be in the top 0.01% or so, and be a top dev/lead at a large company (Google, MS, IBM, etc.).
It's funny that you mention that, because I just wanted to have a site I could optimize to hell, and it seemed apt to make an informational site about optimization for that . AppCache is obsolete and harmful now (yes, already), and I should link to the articles that talk about that, thanks for reminding me.

As for the "come browse" approach, you're definitely right, and I don't intend the finished site to look like this, but I'm also not sure how to structure the content. What do I send the user to first? Maybe I'll write a tutorial hitting all the bullet points with links, though (eg add caching to static media, bundle them, don't use heavy libraries, load js async if you can, etc etc).

Thank you very much for your feedback!
What's new in Mercurial (HG) 4.1?
Today I learned that $HOME/Library/Preferences/com.apple.LaunchServices.QuarantineEventsV2 is a sqlite database. The LSQuarantineEvent table contains every file you ever downloaded, the source URL is in the LSQuarantineDataURLString column.

sqlite3 $HOME/Library/Preferences/com.apple.LaunchServices.QuarantineEventsV2 'select LSQuarantineDataURLString from LSQuarantineEvent'

sqlite3 $HOME/Library/Preferences/com.apple.LaunchServices.QuarantineEventsV2 'delete from LSQuarantineEvent'
Note that this is not guaranteed or even expected at a prop shop or hedge fund either. I know of a very large hedge fund where pay is not as good as you think. I will just say that I have never seen a trader who makes $1 million per year claim that this is a good way of doing it.

You're probably better off as a SWE at Google than as a trader at this hedge fund.
But how about spain, france & the UK?
I really wish this article had explained how each method works. It's going to take me some time to analyze each method to see whether any of them are the method I was taught in elementary school.

It extracts the square root to any desired precision one digit at a time and it looks a lot like long division. In binary you get one bit at a time and there is no guesswork so it goes pretty quickly.
I only use xe.com as my go to website for looking up current exchange spot rates. I didn't even really know they had a transfer service.

I am a very happy Transferwise user. I used to always check the exchange rate on xe.com, then switch to Transferwise to compare before transferring. Now I don't bother, because Transferwise has always been very close to the spot rate.
The fasthttp library is good if you don't need to support corner cases of HTTP and you don't need HTTP/2.

If that is given, yes, it's faster.
Ugh, sounds like Leica's B.S. M.O. http://www.popphoto.com/gear/2015/02/new-gear-leica-m-p-corr...
Thanks pk3 and baddox!
>Everything is an order of magnitude more efficient using PostgreSQL than it was with RethinkDB.

A large part of the sales pitch of "NoSQL" was that traditional RDBMSs couldn't handle "webscale" loads, whatever that meant.

Yet somehow, we continue to see PostgreSQL beating Mongo, Rethink, and other trendy "NoSQL" upstarts at performance, one of the primary advantages they're supposed to have over it.

Let's be frank. The only reason "NoSQL" exists at all is 20-something hipster programmers being too lazy to learn SQL (let alone relational theory), and ageism--not just against older programmers, but against older technology itself, no matter how fast, powerful, stable, and well-tested it may be.

After all, PostgreSQL is "old," having its roots in the Berkeley Ingress project three decades ago. Clearly, something hacked together by a cadre of OSX-using, JSON-slinging hipster programmers MUST be better, right? Nevermind that "NoSQL" itself is technically even older, with "NoSQL" systems like IBM's IMS dating back the 1960s: https://en.wikipedia.org/wiki/IBM_Information_Management_Sys...
A 25% improvement over h.265 is surely impressive and having the cloud computing alternative buys them a lot of computing power. I'm sure that it's possible to brute force your way to a lot of optimizations, so due to this there will be a lot of improvement still.

However if the AV1 codec will be a success depends on hardware support as always. How well supported is VP9 which this is based on? And also how well has google kept the VP9 codec stable. If there are a lot of variations on the format that might lead to problems.
Sure but I think that it is still recognisable, which was the question.

25 year ago isn't //that// long ago? People using IRC at that point (I guess techies) surely would recognise it fairly easy.

Similarly you could look at a brand new Tesla and recognise it from a 1st car model or even a wagon.
NASA bakes Venus-proof electronics
Put out the UDP's on pasture [illustrated]
That would be a kernel patch then. Good luck getting that upstream.
How did you solve the problem of bypassing modelforms? Same roadblock here...
This kind of pay is very highly correlated to excellent social skills. There is also luck involved and you need to be at the right place at the right time.

I agree with Patrick that you are far more likely to achieve this through entrepreneurship than through working in technology (or finance for that matter).
After a crash Safari is nice enough to restore your open windows and tabs... I've noticed several times that it's also nice enough to re-open your private browsing windows, too. That throws up some red flags for me.
I agree. For me I have seen far more gain from learning a new tool, figuring out corner cases in my code, or coming up with miltiple ways of tackling code infrastructure issues rather than doing puzzles.
I believe it is coming soon yes.
Thanks!! Also, here's EXPLAIN, examples with timings, and the relevant part of the database schema:
https://gist.github.com/williamstein/fb31e07d4057232bd3a3e78...
(My email: wstein@sagemath.com)
Author visualized data from 4,700 games of Hearthstone they played.
I've become more and more convinced that $1M+ per year is not realistic as an engineer.

There are compensation spreadsheets floating around and I've been privy to Facebook's and Google's. Assuming the numbers there are accurate (and anecdotally they are), even the "top 5%" engineers getting discretionary equity and bonus don't make more than $600k.

Meanwhile, executives easily make twice that in yearly cash bonuses.

I've grown a disdain towards said execs for being paid incommensurate with their actual value generated. Perhaps that's just my naïveté, and indeed they are that valuable. But I don't think so.

In short, to command astronomical salaries you need a pyramid of people working beneath you, so that you can garner part of their productivity for yourself.

Charisma will help you get there.
> I'm speaking from one data point sample, my current stat grad program. My undergrad is comp sci and I did a few years in the tech industry before coming back to grad school.

If you don't mind sharing details; why'd you choose your current grad program?
This perspective is common amongst people who are making "enough".

But most people in the world don't. Enough with the moralizing.
Yeah it's not guaranteed at all. You have to be at a profitable desk to make it happen. I don't want to give any numbers since it's too variable, but I would guess it would still be a minority of the traders who pull 1 million+ even at the most successful firms. But I think if you are aiming for that number it's the most straightforward way - it has the least amount of variability and just relies on your own personal skill generally.
Google Introduces Android Basics Nanodegree
> Making a lot of money is considered the primary goal in our capitalist society

It might be the goal of people lacking empathy and people who think happiness comes with money, which is true only up to an amount far below 1M. Unless, again, the money is meant to be given to others. I am not sure what you mean by considering my argument a non-sequitur, could you elaborate?

> the sheer mechanics of our economy would guarantee it to be a net positive

By "Making a positive impact on others" I didn't mean making a positive impact on the economy. I meant helping actual problems like hunger, diseases and pollution.
I've heard this as well. Didn't Chris Sawyer make $30 million from the RollerCoaster Tycoon?
This is pretty amazing. Now, would you mind showing me a situation when the raw insert performance is the single dimension when we are making a technical decision?

Hint: you probably can't, the reason why you store data is that you can read it (query it) later. MongoDB could be 10000x faster with inserts, still not a considerable solution for us because it fails with many of the other aspect of providing a great data access layer.
Healthy Domains Initiative Isn't Healthy for the Internet
Why Our Super Bowl Ad Failed – Medium
I do remember jQuery 1.0. And I do remember what was before it. That time is now called Browser Dark Ages - for good reasons.

Your description of "magic band-aid at expense of performance" is IMNSHO unfair - before it became a huge golden hammer (and long before small replacements like Zepto), jQuery brought usable, cross-browser scripting, with features that the browsers themselves did not have (We're talking IE6 here, remember?). This allowed robust coding, and it was actually more optimized for common operations than a naïve "pure" JS implementation.

This is indeed becoming a problem of the past, precisely because browsers started to implement those features natively - but the choice of features was often driven by "oh, and jQuery does this, it would be nice if we didn't need a library for it".
Once my total transfers had exceeded £15k, I was required to undergo further identity verification checks. Pretty standard KYC procedures I thought.
Storing data on Apple's cloud services is a privacy risk given their inability to keep it secure. We had the celebrity iCloud hack, caused at least in part by Apple not using 2FA for iCloud logins. And now this privacy failure.

Storing your data on a cloud service that isn't competent is a privacy risk.

And a reliability risk, as I found out last year when my albums on iCloud Photos disappeared. Not the photos themselves, just the albums in which I organised them, but organising data can take a lot of time, and any data loss is unacceptable. They weren't in trash.

Apple's "self-professed privacy narrative" is partly right, but partly marketing, and partly disingenous, as if collecting data has no other purpose than advertising: https://dcurt.is/privacy-vs-user-experience To be clear, I'm not taking a black-and-white view; it's partly right, partly wrong.

BTW, The Verge wasn't clear — was the forensics firm getting data from an iDevice or Mac's local storage, or across the Internet from iCloud servers?
If the Efficient Market Hypothesis is valid

... More like Efficient Market Fallacy. Information asymmetry, propagation delay, and feed back loops in the dynamical system that is the economy almost surely forbids for such a grand Hypothesis.

But people without social skills end up working for people who do have social skills. The latter collect the money, the former do the work.

Amen.
I don't think the concept of a genius programmer is detrimental attitude. Some people have competitive attitudes, and will only push them self further if there is someone which they could potentially compare themselves to. What this article really is is an attempt to deal with the impostor symptom by using the example of a genius programmer. A good read nevertheless.
Good point, but I think that doesn't explain the "why" of the graphs, this observation only explains the fact.

The "why", then, in my (also non-expert) opinion, is (once again) globalization: We produce cheap electronics in China, so phones get cheaper, while we maintain the same, relatively high expenses for products and services that cannot be outsourced to countries with cheaper work-forces.

And because those local products and services are already "overpriced" (relatively speaking), there is also no way salaries will go up and will just stagnate from an inflation-adjusted point of view.
Great answer. I have noticed that because of the extreme focus on technology, our community is tuned to finding ways of becoming a better engineer, but not how to climb the corporate ladder the old-fashioned way.
And it is processed not by Vim itself, but by the terminal emulator that sends Esc character to Vim. So the shortcut Ctrl+[ was not invented by vi author, but is a consequence of using Esc to exit from the edit mode.
The TV adverts and billboards where also particularly good, involving people spitting out their cup of tea in surprise when they realised they could save money with transfer wise.

Very English, very effective.
You're right; they didn't get anything for free. They gave up access to their logo and the story for discounts. That's how the game is played. And there's no problem with that! Both sides win.

I just thought it was funny that they mentioned the donuts at all. Sales/solution teams bring stuff like that all the time. It's totally irrelevant, until you realize that the original article was a puff piece.
For more information about Smullyan, just read some previous discussions here on HN:

https://hn.algolia.com/?query=smullyan&sort=byPopularity&pre...
Different culture. People like, use, and depend on subways so they like the extensions and expect their governments to get shit done. And in Europe the power of a single individual to block major project is limited.
Great to see these efforts attacking the "tyranny of charts" by which I mean visualizations created with GUI editors.
If you are planning to have a REST API. The single best thing you can do is to setup automated API documentation.

Checkout https://dredd.readthedocs.io/en/latest/
Safeguarding Passwords Against Data Breaches
At the company I work for we've had a few developers who would've done a lot less damage if they hadn't written any code rather than the code they did write, which we then spent months on to detangle afterwards.
On an unrelated note. Any company doing 'Technical Documentation?' Are you hiring?
On mobile so no URLs, etc, but cf. "hidepid" mount option for /proc.
Is gluing front end together really what you want to build your career around?

I would think that what the font end is for would be more important that the technology powering it.

I would look for a job in an industry you find intresting rather than a job that uses a tool you know.
Red Hat has 10000 employees, a large proportion being remote (including me - about half of all developers work remotely). I can assure you that remote workers at Red Hat are not out of the loop on anything.

The thing is that even if I went into the local office, I would still be "working remotely", because the development teams are distributed all around the world. Therefore everything has to be done on mailing lists, IRC, bug trackers and occasional conference calls.
I don't quite understand how you jump from "sacred cow / cannot be cut" to "insisting on service value is viewed as treason".

I'm firmly in the camp that wouldn't cut education, but does consider the state of the system somewhat prolematic. Those two opinions aren't in conflict.

But, having experienced both the US and the German school systems, they were ultimately pretty similar: put 20-something children in a room with a teacher (where variability seems to be extremely high everywhere). Do calculus for 45min, repeat. Even though outcomes are quite similar as measured by PISA, there is a lot around the margins even these countries could learn from each other: extracurricular are virtually nonexistent in Germany and added so much, at least to my experience. OTOH I felt US high schools tended to be too large.
Messages are limited to 8KB, so if the buffer is 8GB, that's a lot of messages that can be queued up.
I've been using react for various components inside a somewhat standard django application through https://github.com/owais/django-webpack-loader . It works by having your webpack pipeline spit a webpack-stats.json that a django's template tag reads and uses to output things in your template.

The setup is not really straight forward, and generally I have problems mixing django static files in my .scss url() , so this is far from perfect. I'm using it with a main .ts file that requires various components based on the class of body tag, so I can use this in simple reload request use case. Also I've complicated things a little so my webpack bundles are collected as other static files and my static template tag also works.

But yeah, using react in typescript and sass in this way for the frontend has accelerated my development a lot.
I read such articles more like a general guideline than a strict requirement. Of course it is bad to split up commits, which are one unit, into several parts. But when in doubt, you should try to commit in smaller batches. And by all means try not to commit unrelated changes in one commit.
> I am not sure what you mean by considering my argument a non-sequitur, could you elaborate?

It shouldn't matter what I do with the money. I don't even have it. The larger point I disagree with is that it's a losing battle to somehow tune their career to fix all the ills of the world, it's better to make as much money as possible to hope that our economy will efficiently distribute the resources for the greater good.
Yes, for the most part. It really varies of course, but traders are traditionally the top dogs. Engineers at a hedge fund / prop firm will generally get paid very well, but 1 million+ would be an extreme outlier, even for a quant dev unless they are also actively trading what they build.

Traders are usually the ones coming up with the strategies and executing them. They also take the most personal risk, since they can be held directly liable for mistakes. That is, the SEC can directly prosecute them, fine them, take away trading credentials, and so on - basically ruin their career if they make a stupid mistake. Very few engineers at these firms are credentialed traders or take any personal risk at all.
Take it easy on the judgement
Doesn't work for me, console shows CORS errors. Anybody else see the same?
Thanks.

> I know a count of the whole table takes about a minute tho. But the filter > group by was ~1s as the grouping was done on about < 50 rows of the filtered result.

Yeah, that makes sense.

I'm running some queries in production that take a 150 million row table, filter it down to ~100-300k rows which are then aggregated/grouped. This usually takes < 1s. However, if I'd try to do a count(*) on the table, that'd be around a minute as well.

> Without knowing the original query above was using it's speculation on why it was slow and mine was fast. My argument is just that SQL Server isn't magically slow. MySQL/PostgreSQL/SQL Server are super fast. And if you don't massage the database it can be super slow too.

Yeah. The query / query plan will be needed to go more in-depth on these kind of discussions. The amount of disk vs memory hits during execution obviously as well.

Anyway, I just wanted to understand if SQL Server was e.g. an order of magnitude faster than Postgres when scanning a large number of tuples. But I guess the answer to that is: probably not.
Having worked as a trader, a lot of it comes not from personal skill, but just from being in the right product, at the right firm, at the right time.

Even at firms/desks that are in the right products at the right time, few people actually make 7 figures. If I'm not mistaken, you should be aware of this for a variety of reasons. I'm not convinced that making this kind of money is easier or more likely in finance than in tech.
You are right that many poor people have cell phones, but as of 4 years ago, a majority of them had computers, and I expect that number has and will continue to rise. http://www.cnsnews.com/news/article/terence-p-jeffrey/census...

I am not familiar enough with the history of paying for infrastructure by taxes to comment, except to say that sin taxes seem to be more likely to pass then a general tax increase. That said, I think relatively small fees and taxes assessed on items where demand is inelastic probably work fine to promote investment and growth, especially if they were provided directly to municipalities for high speed rollouts and state and federal restrictions were reduced on municipal broadband organisations.

Not sure about Baltimore either, though I wonder if it follows the pattern I've seen in a few other American cities where there is a large urban center surrounded by smaller wealthier townships/suburbs who's residents take advantage of the city as a resource by aren't part of the tax base. Maybe the Balitmore Broadband Coalition will comment though.
2017 Alfa Romeo Giulia Quadrifoglio vs. Everything
Work on the remote engineering at Close.io
It's those dreaded words: Minimal Viable Product.