skysight-inc/HackerNews huggingface dataset:
I knew linear algebra in high school. I taught myself matrix math because I wanted to make games, and because the most challenging math my lackluster rural public high school offered was basic calculus.

My top university's CS program had a linear algebra class that loaded me up with theory though like Hilbert spaces, wavelet transforms, spectral theory, abstract algebra, and of course, principal component analysis (but the latter, along with SVD, is becoming more valuable these days with data science-y type jobs).

It was more concerned with proofs and advanced concepts than applications, which was fine for me, because I already learned the applications in high school because I was bored and self-motivated. The most valuable benefit of learning all of this extra theory to me was learning how to solve problems because doing proofs isn't some algorithm like long division or evaluating a derivative that you can just crunch as a cog-in-the-wheel.

The question is whether all of that extra rigmarole is worth it in my day-to-day development work. The answer to that is "no." Occasionally, I'll borrow some code that does thing X that is tangentially related (like convolution for computer vision and deep learning), but the theory behind it rarely comes in handy because I'm not doing academia or R&D work.

Of course, your usual full stack developer job won't even come close to touching any of this, but if you're doing moonshot type work like self-driving cars, you're going to need all of this theory to really attack the types of unsolved problems you're facing. Those types of jobs are rare, sometimes highly-compensated, and inaccessible to your Hack Reactor grad.
Hey - I am one of the authors on that paper. One of the ideas behind relating bidding behavior to real life performance was that you don't want to be super aggressively, because if you overbid, that actually is worse for you. But obviously you are more likely to win if you bid more, so this gives incentive to be truthful.

Right now the plan for when we get tons of new users, is to be way more successful as a hedge fund and increase user payouts a ton. That way more people get a chance to earn money and good users get a chance to earn lots of money.
You might have seen this but I put it out for other people to see it. Recently It came out that climate scientistic have been manipulating weather data. Essay from the whistleblower:

Climate scientists versus climate data https://judithcurry.com/2017/02/04/climate-scientists-versus...

I posted it to HN as well but it never got any traction. Great read nevertheless.

Anyone who has lived for a while has seen multiple climate doomsday predictions that didn't pan out. The end prophecy reminds of a religious sect.
Training Neural Networks
While trying to find the cause of slowness in Rails requests, I was running strace on an unicorn process when I encountered the same thing mentioned in the article.

Rails instrumentation code calls current time before and after any instrumentation block. So, when I looked at the trace there were a lot of `stat` calls coming for `/etc/localtime` and as stat is an IO operation, I thought I discovered the cause of slowness(which I attributed to high number of IO ops) but surprisingly when I saw the strace method summary; while the call count was high, the time taken by the calls in total was not significant(<1% if I remember correctly). So I decided to set TZ with the next AMI update 15 months back but forgot about it totally. I guess I should add it to my Trello list this time.

Also, I think he should have printed the aggregate summary of just CPU clock time(`-c`) as well as that is usually very low.
> IBM’s Watson proves useful at fighting cancer–except in Texas

Is there any proof that Watson is useful for cancer? Like a published study with many patients in a well known peer review journal.

I think it looks useful and it is been tried in a few places, but I don't remember any good clear success story.
> A lot of content is not from the sites you visit. Ads, often videos, things that your cdn hosts etc.

Yes, that's why I'm asking about a way to unequivocally recognize that a dialog is from the browser, for example, drawing things completely outside the viewport (without overlapping it) or changing the browser chrome's colors.
This is the impression I get from reversing it: the virtual machine mostly assists quickly porting to other platforms.

I previously reversed another game engine called Comprehend (for 1980s text/graphical adventure games) which also had a VM. I ended up talking with one of the original developers, who said that portability was a major reason. Their company wrote the original Apple 2 implementation, and then contracted development for the other platforms out, so they just provided specs for the VM. The Lost Vikings development may have been similar.

In the Lost Vikings the VM implementation was almost certainly written in assembler. There are various tricks used in the binary which I don't think compilers of the day were capable of. The other parts of the game also appear to have probably been written in assembler, which I think is interesting since it was developed quite late in the DOS era.
One honking big Supermicro SC836 chassis with a Supermicro low power board in it.

Stuck FreeNAS on it and backup everything to it using nightly rsync and ZFS replication where possible. It has 48TB of storage (16x 3TB).

Critical bits get synced to Amazon Cloud Drive (which took an age).

For backing up my ESXi VMware box I use Nakivo - it's an amazing piece of software - never once had an issue with it and I've used it many times to revert a broken virtual machine.

I've had a lot of experience with hardware failing in my IT life. Been close but very lucky that I've never lost data from a disk or corruption failure. Finally bit the bullet and bought all that kit just for backups. Well worth it.
The success rate for new ground-up modern OS projects achieving broad adoption isn't great - Microsoft's Midori, GNU Hurd, Apple's "Pink", etc.
AFAIK there basically hasn't been a broadly successful one since Windows NT in 1993. Which isn't to say people should stop trying and it'll be fantastic if they do succeed with this, I just wouldn't count on it.
Except for the fundamental human tendency of greed that is all the more common (for reasons of causation, not failure of character) in those who are above a certain profit margin. No plea for individual charity and philanthropy is ever going to be as effective as taxation in the aggregate.
Building products that stick
Having lived for >2 years in 6 different US states (NY, CA, TX, MA, NV, MT) and cities with populations ranging from 2,000 to 20,000,000, I can absolutely guarantee you that rural white areas have the least internalized racism of anywhere in the US. The communities are small enough that racial classification isn't actually a useful heuristic, so people just use social connections and character instead. Second to that are places where what people in CA and NY often call "casual racism" (I.e. Humor based on racial/ethnic stereotypes) is acceptable; it allows people to recognize and accept cultural differences (that might otherwise cause conflict) in a friendly way. Texas is a great example of this; San Antonio is majority Mexican background, with a huge Muslim population as well. People across ethno-cultural lines bond over good-spirited racial jokes about super tacos, Los Espurs, canned queso, and the Israeli-palestinian conflict.

By far the most internally racist populations I've ever lived in were those where any recognition of ethno-cultural differences was explicitly verboten. If you make a joke about Mexican culture in SF (even if you're Mexican), there's a good chance you're getting fired, so internal thoughts about ethnic differences are suppressed and allowed to fester, and then people cover it up psychologically with a huge dose of self-loathing and, externally, doing the exact opposite of whatever is thought to be racist. The result is a modern version of "white man's burden"; a lot of the people in SF are absolutely convinced that without their help the poor, trod-upon people of color (replacement for "minorities" after that phrase starter to apply to white people in many US regions) would surely starve.

The point being, being a straight white male has nothing to do with it. For the record, I'm neither straight nor white, and I agree with the GP that I felt safer expressing disagreement in conservative environments than I do in very liberal cities like SF and NY.
> Please stop with the weasel-worded equivalencies.

If you engage in a course of action with an intent to harm another in any way, or behave in a manner likely to result in harm to another, you have committed violence, whatever form that action takes — words, bullets, or anything else.

If you can't accept that basic definition, "then you're already beyond help."

(See how easy it is to poison a discussion with accusations and snide remarks?)
> and hasn’t read a whole book in decades

source please.
For example, let's say you were born in 1980. If the global surface temperature average, according to NOAA, was greater in march of 1980 than it is in march of 2017, I will pay you $2k. If, on the other hand, march of 1980 was colder than march of 2017, you pay me $1k.

Happy to put $24k into the reputable escrow service of your choice and wholly pay for the escrow fees myself, if you'll do the same with $12k, ensuring that the bet can last a whole year. I'm also happy to scale down, if that's too rich for your blood. It must be for the full 12 months, as I have found the educational value of this bet increases substantially if it lasts for more than a few months.
At some point you draw a line, and Google/Amazon/Microsoft/etc. have very clear pictures of where their respective lines should be. It seems to work well for them.

Think about it this way. 1st principles knowledge, like algorithms, isn't at all useful 90% of the time. But 1% of the time, not knowing it will cause very out-sized penalties in efficiency or debugging costs. Now take the frequency of the occasional 1st principles usefulness penalties and multiply it by all of the developer-hours at Google/Amazon/Microsoft.

That is why Google/Amazon/Microsoft do that!
Encouraging is not the same as enforcing. People should have the freedom to say what they want. Just because someone cries and says "they hurt my feelings" doesn't mean we should put mandates and rules in place to stop it from happening again. It's a pretty slippery slope, and complete liars can take advantage of this to basically make new rules for everyone else, and we'll also end up with a fundamentally broken society who can't handle any kind of criticism at all and who don't understand that their feelings don't trump other people's rights.
It's just simple gatekeeping. People are finally having to admit you can be a developer without a CS degree so they're moving the goalposts.

"Fine, you're a webdev, but you'll never be AN ENGINEER."
Bulletin (YC 17) offers a flexible approach to shared retail space
Makes sense - though if you add some kind of validation to the trained model you could build a continually improving 'ground truth' and automate the training and improvement over time.
I wrote a javascript game based on anagrams as part of a 'get to know your team' exercise at a previous job. It was a weekend project.

The game asks the user to guess the name of a team member from anagrams of that name displayed for short time periods on screen.

Click the 'automate with answers' button for a nice animation of rearranging the letters.

http://tomcdonnell.net/submodules/anagram_game

Here is the tool I used to find the anagrams:

http://tomcdonnell.net/submodules/anagram_finder
The only thing that could cause such a "ditch and switch" would be Oracle screwing up - which let's face it is quite possible with the way things are going for them. But in any case, I never alluded to that. I simply said enterprise apps that might traditionally have been "built" with JVM will in the future be built on .NET CLR. I stand by it. The JVM is ancient and it seems they are scared to improve it because nobody at Oracle dares touch it these days. Just look at their attempt at lambdas (aka. delegates in .NET as I'm sure you know). And it still doesn't have value types. Anyway, this is highly tangential now.
Have you tried Sci-Hub?

https://en.wikipedia.org/wiki/Sci-Hub
I certainly wouldn't want to work with you!
I live in a town with a truly world-class bookstore (no accident, that) and I have a rule that I will return any book that turns out to not be worth finishing for store credit, which they (Powell's City of Books) are really good about. Unfinished books used to pile up on my nightstand, even if they had stellar reviews (looking at you, "The Nix"), but being ruthless with this rule has really cut down on wasted reading time and expense.
(I work at Google, I have my biases, but…)

You might find good fun with our Preemptible VMs, which I think will land about ~$7/month: https://cloud.google.com/compute/docs/instances/preemptible
They say everyone has their flaws... unfortunately, that's mine :D
Dart website down due to invalid DNS
Wow, surprisingly interesting.
> He never said they are worse

This is why i asked for clarifications. the OP said
'Google is incapable of hiring the engineers I want to work with', which implies that the engineers he is looking to work with are NOT there. Google is incapable of hiring them, and since they are top quality devs, someone else (more capable) did.

> Do I have to explain why that's not a good argument?

Yes, please explain.
Because you only took the first sentence of my argument. the second sentence was that those "many people" are going to do what it takes, even if it means taking 'stupid' tests, smuggy interviers, and some other large corp bureaucracy (which to me personally is more concerning, but is not specific to Google, rather to any large corp).
And why ? My guess is that it's probably so cool,curious, challenging to work on something like Google Maps/Balloons/Self driving cars that they will be willing to make a lot of sacrifices and tradeoffs.
THAT was my argument.

> Other people don't mind shitty treatment, so what?

please explain, i didn't understand your point

(edit: spacing)
https://blogs.msdn.microsoft.com/dotnet/2016/11/09/net-core-... ?
It is worth noting that BuzzFeed's (considerable) clickbait revenues are being used to fund serious journalism (and that their investigative team is one of the few in the industry that has been expanding instead of downsizing): https://www.poynter.org/2016/how-buzzfeed-built-an-investiga...
I tried with AWS GPU once and only once. Probably if you spend time and effort you can get it down a fair bit
Yep, I'm running 16.04 on my machine. Works great.
"Need" for what?

To get any job? No

To get some specific jobs? Yes

To learn how to program? No

To learn computer science? Technically, no. But may be an easier path for most than self-study.
Thanks to whoever posted this, and glad that people are enjoying a little bit of DOS games nostalgia. The tools I've developed (also linked in the blog post) are all public domain if anybody wants to play around with them: https://github.com/RyanMallon/TheLostVikingsTools
Embedded Firmware Security Training
You can simplify that code a bit, since the contents of a `std::vector` are guaranteed to be contiguous in C++03 and later, and taking a pointer offset is therefore well-defined and correct.

const auto last{ std::copy_if(vec.cbegin(), vec.cend(), vec.begin(),
[](const auto x) { return x > 2; }) };
vec.resize(last - vec.cbegin());

Edit: As someone mentioned below, C++ also provides `std::remove_if()`, for a more exact analogue to Ruby `Enumerable#reject`. http://en.cppreference.com/w/cpp/algorithm/remove

const auto last{ std::remove_if(vec.cbegin(), vec.cend(), vec.begin(),
[](const auto x) { return x <= 2; }) };
vec.resize(last - vec.cbegin());
Rule by Nobody – Algorithms update bureaucracy’s strategy for evasion
> to identify things like pornography

You do understand that:

a) nobody has come up with an algorithm that can visually identify pornography? Hell, how can we come up with an algorithm when we have such trouble even legally defining pornography? https://en.wikipedia.org/wiki/I_know_it_when_I_see_it

b) TLS doesn't mask the source/destination IP's, just the content, and as such pornographic sites can still be filtered and banned in school environments without attacking TLS.

... right?
My answer (not mentioned in article): cycle time. So many code-bases with no tests and no useful emulator.

So each "cycle" can be as long as, flash the thing, wait for it to warm up, get the device into the right state, test the thing you wanted to test (which might involve another device etc).
Huh, that's extremely surprising! TIL.
> People like Jon Stewart and Jon Oliver have managed to bridge the divide between news and entertainment

I don't think those are good examples for escapades outside our bubbles, as they are decidedly left-leaning, with a left-leaning viewpoint on the issues they cover, and for mostly a left-leaning audience.
> What you can do is compromise. If the democratic party were...

Unfortunately this is the core of the issue. That first sentence should really read "What the democratic party can do is compromise" for the second sentence to follow. As a voter in the United States you are personally forced to compromise. In order to choose the lesser of two evils you need a developed sense of empathy and morality, and based on the comments in the original article many people seem to be missing this.

Reform of the democratic/republican parties (someone as compromised and mentally unstable as Trump being elected is a serious republican issue) is an entirely different organizational problem that can only be done by party insiders.
I think you're assuming that "automatic differentiation" (AD) is the same thing as "using dual numbers", but AD is a family of methods including dual numbers. The blog post you link to says they're using https://github.com/denizyuret/AutoGrad.jl which uses reverse-mode differentiation not Dual numbers. That means they're performing the same operations (or nearly the same) as standard backpropagation.

Dual numbers are just the wrong approach for neural nets, which have many parameters. The amazing thing about backprop / reverse-mode differentiation is that you get the derivatives wrt all the weights in one reverse sweep through the network.
Sure, so detect that as the problem.

That's not true of rooted Android devices though, most Android devices allow you to enable a developer mode which will allow you to replace the ROM entirely if you like with no need to exploit anything.
His entire spiel about Mexicans being drug dealers and rapists.

And you are clearly not interested in any kind of discussion. You are simply trying to justify to yourself that, despite supporting someone who is clearly an abhorrent person, you are not an abhorrent person. And I'm not buying it.
It may not be so bad because most of Android apps are built on Java which isolates a lot of what OS does. For other native apps, if Google builds a POSIX compliant OS, it should be fairly easy to port/run.
i really struggle if i cant recommend the x1 carbon because i love it so damn much but if you must avoid lenovo the asus zenbook would probably be my next choice, that or an xps13
"untravel mode" wouldn't be an option on the phone.

Once you get home and want to untravel, you plug your phone in to your desktop and sign in to a cloud service that "untravels" your phone, restoring to the state it was in.
Those who don't know George Santayana are condemned to repeat him. FTFY.
I have been, but the current administration's tax proposal looks like it would reduce my tax rate, and in order to make a noticable impact on society as a whole is going to require taxation, people probably aren't suddenly going to get a whole lot more charitable than they have been.

Your statement is the equivalent of the oft-stated "every little bit helps". It really doesn't, because it usually serves as a palliative and stops people short of doing the major work that needs to be done.

I want the decimation of public education to be reversed, I want us to figure out ways to help our fellow citizens who are hurting economically and psychologically. Massive unevenness in wealth accumulation is a huge problem. This is going to take a society-wide effort to fix, not a few NGOs.
www.dartlang.org works
Sophie never had that creepy smile!
A Breitbart social network, maybe, if it has to come to that
And how does it watch it? With the stat() syscall.
That is my argument.
> Just because someone cries and says "they hurt my feelings"

In the context of trans people we're not talking about "hurt feelings". We're talking about murder, sexual violence, severe assault, and increased risk of suicide.
My degree is as unrelated to maths or sciences or computers as is possible but I've been working remotely for many years as a developer, despite not having looked into it until I was out of college for many years. So college really has nothing to do with it at all, in my experience.

College might get you contacts and job prospects, but I've interacted with a lot of developers who do have college degrees but because their training was relatively recently, they didn't get a lot of important knowledge about things like memory management because a huge number of schools only teach GC languages now, so I still have an edge against those with degrees since I made it a point to learn C++ really really well.
You did get bored, didn't you. He detailed the numbers in his post.
There may be notable services missing, but I wouldn't say it is an oversight. It seems the most popular or well-known services are covered and not all of them have referral links. Sure, there is room for improvement, but it seems to me that the creator put this together in good faith.
If you are going to list notes for static sites, definitely consider Google Firebase and Netlify. Both have free and paid options that give you a ton of mileage.
The reason why corporations are doing this is because they are afraid what kind of (malicious) content is coming down to their network and what users are possibly sending out.

Could we fix this by isolating the browser more efficiently from the local workstation environment and thereby removing the need for this kind of security?

What if you would be executing the Internet browser in an environment where you would not need to care so much about the security. Like running the actual browser process in a completely separate environment, maybe located outside your intranet firewall and just streaming the UI via some simple-enough-to-be-secure mechanism to the desktop.
I guess I think of programming in a big company as a team exercise. And thus the hiring pipeline can take advantage of specialization and good-enough economics, as well as teaching people more on-the-job. It's a large burden if you demand everyone on the team know the same first principles (of course there may be disagreement on what those are). Even if personally I want to know as much as I can and get along with others who do too, I'm not really going to hold it against a team member if they produce a poor-complexity algorithm that in review I (or someone else, I think it is good to have at least one person on the team who has algorithm knowledge) notice and can suggest an alternative that's easy to use instead. If they do it again (for the exact same thing) I might raise an eyebrow and remind them of the repeat mistake. If they do it a third time I might write them off as incapable of learning new things. But this pattern applies to other aspects of software too. e.g. Getting people to write testable code can itself be a hassle if they haven't been exposed to that before. Or something as dead simple as getting people to use the rest of the team's coding style guidelines, I've seen interns who still had problems with that near the end of the summer internship, I wouldn't be very happy if it was a senior colleague...