skysight-inc/HackerNews huggingface dataset:
Call it "the kaggle effect" - once someone defines the problem and the metric you'll be graded on and gives you a relatively clean dataset, "solving the problem" is just as simple as importing xgboost and plowing away. But there is often an under-appreciation among people without much job experience how hard it is to get to that point. The OP article touched on it a bit, but really, the most difficult job a data scientist has is defining what problem they're trying to solve and getting buy-in from other business stakeholders. And frankly, no data science masters program or boot camp can teach those skills.
I don't buy that for a minute. There are so many amazing developers out there who could absolutely do this independently.
Physicists Teach AI to Identify Exotic States of Matter
Revisiting the Tech Lead/Manager Role
> the weak link is reduced to my ability to aduit it (combined with everyone else who's auditing it as well and might publish their findings).

And if the hardware itself has microcode that overrides your code?

> but this is ridiculous. Do you really think that the Yubikey folks have backdoored my copy of gcc?

Actually, I think the first and foremest threat would be, "Could someone insert a yubikey into a malicious device that changed its behavior such that it now leaks information and does not provide actual security."

Because those kinds of attacks actually exist. Ultimately, what you're arguing for is the pleasure and moral superiority of being able to do that audit. Not only does that audit not give you many guarantees, but giving you the ability to do that audit opens you up to much more sinister attacks.
Building Code Posters with Elixir
6 Questions You Have to Ask When Building Your Own Security Operations Center
Hey, it worked for Volkswagen...
The security is that it requires physical presence (your finger completing a circuit) to perform authentication. Leaving it plugged in doesn't detract from that.
Tbh, Google Analytics samples at scale and people who are blocking like that aren't affecting the results much as a result. Well, unless they have truly "unique" patterns of using the UI specific to that demographic.
>credible oral testimony.

So the system as it stands is you can be jailed indefinitely because a judge does not believe you actually forgot a password? That doesn't sound ideal.
The Agents Are Coming
I'm going to expand the definition of "daily life application" from things you actually use daily to things you experience daily. These could be engaging too!

For example... what are sunspots? How does the plumbing around your house work? How does a car battery work? How does a microwave oven work?

Another thought. If we are unable to find applications for a technique, should we place such an emphasis on teaching it? I look around and see all the very practical (and interesting!) math and science that is not being taught, e.g. signal processing, just because they are nontraditional. It's a shame to me.
99% of that work involved in self hosting can be avoided with the same $10 paid to SquareSpace or similar hosts - and at least in the case of SS it truly is set-and-forget. About the only thing you don't get is a medium.com URL - which is probably a good thing if you're trying to get your name recognized at all...
...Oh hell, I just thought it was because they had such a big portfolio of endeavors.

Now it just comes across as tacky.
Tariff for 750MW Solar PV Park in India Reaches Record Low 2.97/kWh (US$0.044)
This seems a bit of a 'I have an essay due' question, I don't want to break it down in to a full walkthrough, but if it's any to you, here's roughly what we do without revealing anything:

We have two big sources of logs, proxy logs (user browsing, tens of thousands of users), and firewall/network logs. This is for a network with an average transit of about 15Gbps to the internet during working hours.

Proxy logs appear at an alarming rate from a big network, every page calls 20 other URLs and so on. For this we have a piece of software (agent) on each proxy that aggregates and forwards logs on to a set of central processing servers. These servers do some processing, then hand them on to storage servers (replicated). Recent data is held on disk, older data is stored in an Azure data warehouse.

Firewall logs, you can set them to lots of levels, from only critical errors, all the way to a mind-boggling amount per second. Depends what you want. We send these to a clustered set of rsyslog forwarders, all logs are sent to disk storage (with tape backups) and selected logs are sent to graylog for analysis. You can do all sorts with graylog, from alerting when root logs in to a Linux box or watching for hardware/memory faults, to graphically displaying your firewall attacks using a geo-IP plugin.
Does Nikon design its own chips, or do they source them from an external vendor?
sure. But the workaround (Filing GC under OPT) works only for those who are not Indians or Chinese.

I dont understand why people (who are not Indian or chinese) cannot spare 2 years to get a masters degree and take this step, instead of risking H1b lottery and take the long winded road to work in US.
I think an issue with all of this is that the entire field send unreliable. Until recently a fat tax could have been conceivable. Right now a carb tax seems not unjustified. Since we don't fully understand what's causing it, maybe we should tax non-disease caused obesity? As far as I'm considered nutrition is a hot mess.
I doubt very much that you would quit after getting a 5mm bonus. I've seen some pretty ridiculous Wall St bonuses from the 90's up close.

I think a more typical response would be, "Hmmm. That wasn't so hard, let's see if they do it again next year." And when they don't -- that is typically when you walk.
The central tension in the software process comes from the fact that we must go from an informally identified need that exists in-the-world to a formal model that operates in-the-computer. - Bruce Blum, 'Beyond Programming' (1996)

There are two models of reality that I find to be the most useful ones, especially when writing programs. The first is functions, and the second is sequences of states. - Leslie Lamport

You threaten my startup with patents & debt? I've chosen my models carefully. Perhaps you should have done the same. - @ML_Hipster

... from https://github.com/globalcitizen/taoup
But the anonymous sources are saying that the only problem was that Google was too generous. Clearly we should believe them at face value.
Clearly you can't pay commoners too much. Only upper class people should get upper class money. One has to maintain the social order. God forbid those people who all "quit" use their newly earned capital to start their own enterprise.
> The programs on the site fit the rules defined on it, and the rules include the verification of the results

I'm not sure what you're refuting?

Verifying that the results match is a necessary but insufficient quality for ensuring comparability. If the algorithm could be the same in each language but isn't (e.g. quicksort vs. bogosort), then that's not a valid comparison if your objective is to determine the overhead imposed by the language implementation itself (and if you're not trying to determine language implementation overhead, then what are you measuring?). Likewise if the implementation details could be the same in each language but aren't (e.g. if one uses 64-bit integers and the other uses 32-bit integers).

The computer language benchmarks game was initially conceived to determine a ballpark for how slow interpreted and managed languages are compared to C. Quantifying the overhead of interpreters and runtimes is its raison d'etre, and it shows. When it comes to comparing low-level systems languages that have no runtime to speak of, the best it can do is attempt to quantify the quality of each backend's code generator (it's a missed opportunity that it doesn't include Clang for comparison with GCC).

(And yes, I understand that the benchmarks game contains repeated massive disclaimers that people should not take the performance results as a means of serious comparison. Internet commentators remain undeterred.)

If you're just trying to argue that the methodology used in the OP is poor, then obviously we're in agreement (was there ever any doubt?).
That looks great, thank you for the link. I would love to try one of those devices, I don't have great memories of this kind of unlocking though.

I can't remember the exact name of the product, but I installed it with good faith and it completely locked up my Mac so badly I had to reformat the computer.

So colour me a little reticent to try this, although if the gatekeeper guys are reading this I'll be happy to beta test one for you. You know, purely for accessibility reasons. :-)
> According to Nikon, “with the identification of issues with the integrated circuit for image processing, release of the three cameras was delayed indeterminately.” The company had a team working on addressing those problems, but “it has been decided that sales of the DL series will be canceled due to concerns regarding their profitability considering the increase in development costs, and the drop in the number of expected sales due to the slow-down of the market.”

I'm curious which of these was the larger cause of the shut-down. Did an insurmountable technical issue cause them to cancel the program? Or did they want to cancel the program because they didn't forecast profitability?
You can read the last FAQ answer in the page source:

We love open source and community projects, so we have decided to make TalkJS entirely free for non-commercial purposes.

When you go live, there's a button you can click to let us know you're using TalkJS non-commercially, and you'll be able to go live without paying.

Note: The non-commercial TalkJS license includes no support. If need want the certainty of access to our great customer support, please become a paying customer.
> > So you are putting forth the idea that all forms of personal service require sacrificing dignity?
> Well yes. Following orders is always a sacrifice of dignity, even when we make it a small, subtle one.

Maybe the problem is that both 'following orders' and 'dignity' (and perhaps even 'sacrifice') are ill-defined, but I can name countless examples from my life, as well as from a cursory look at the life of friends of mine, where 'following orders' provided joy and satifsaction and where it didn't affect my (sense of) dignity. Especially in small, subtle cases.
The yubikey is the something you have. You can use the iphone in place of that.
Two problems with this first-principles analysis:

1. The highest paid executives in other industries tend to be at the apex of their careers, and new startups would be a status step down for them.

1. Empirically, executives do switch companies somewhat routinely.

Your last sentence presents a false dichotomy: either we're meant to reject the notion that flight money is a real phenomenon, or we're required to believe engineers shouldn't be compensated above slave levels. There's a huge excluded middle in that argument.
Show HN: Gwe – Python library to get weather from Google search
> I don't understand how anyone can take him seriously in technical fields.

Capital, and connections...

Seems he's totally misunderstanding what intelligence is :
Processing trillions of bits of (high bandwidth) input .. conducting 10 bits of highly efficient and intelligent output (low bandwidth).

I don't think anyone who fundamentally understands intelligence and embodies it, takes any high bandwidth or foolish output seriously.
Is there any data on the number of people using ad blockers? I've personally seen a massive increase in the number of non-techy friends using them. A lot of people for example stream sports (illegally) and those sites are barely functional without a blocker.
You're probably right on, despite the down-votes. This is almost certainly a Submarine Article [1] pushing the tired "engineers are overpayed" narrative. Wonder who's funding whatever PR firm put it out...

1: http://paulgraham.com/submarine.html
But why would you use lisp? I don't get it. No API returns data in a list format.
I'd second that request. I've been considering 'going nomad' for a while and I'm very interested to learn more about it, 'good' or 'bad'.
The site does suck: after registration and login, the "Submit Website" is a link to the login window.
Online advertising is is a collective delusion where ad networks collect more and more personalized metrics about a particular session-device pair, so that they can hoodwink their clients (i.e. people who want to advertise) into paying more for "targeted" ads, while the viewers of those ads are inevitably confronted by one of the following outcomes:

a. they ignore the ad

b. they ignore the ad and think negatively about the product

c. they mentally register the ad and it builds positive brand awareness but don't click through

d. they clickthrough if the offer/proposition was compelling enough anyway

In effect, online advertising is like being paid to be promoted on a dating site: if you're attractive or interesting enough on your own, you probably don't even need it but it may help you get matched with a different user than if you hadn't gotten promoted; and if you're not very compelling you're quite possibly flushing money down the drain while your competitors are eating your lunch. It fools the hopeless and the underdogs, while creeping users out, and ultimately affects the landscape little; it's the ultimate rent-seeking.
Building Creative Teams
RansomFree protection software gets key upgrades
+1 to what you said!

And those on H1b pay max taxes (for that salary bracket).

Most citizens who are sw devs, can work as 1099, drawing similar salary as a W2, but not even pay half the taxes (federal, state, social security and medicare) because most of it can be expensed, and salary they pay themselves will be artificially low.

H1b visa holders dont have that choice of not paying tax.
Trump is pushing NATO countries to increase their spending so the US can decrease its expenditure. Full stop. He's left in-place thousands of forward deployed troops in Baltic states as a deterrent and confidence builder. This is a non-issue.
Edge has much better battery life than other browsers on Windows, much like Safari on Mac. Neither of those are the best browser, but when my choice is between six or ten hours of battery life, it's easy for me to decide.

I dream that one day Webkit / Blink will actually be efficient.
In an alternative universe:

1. the regulatory environment in the US was relaxed

2. the cars were a big hit, and

3. there are articles about how far sighted Google was for letting the research project have these startup like returns.
Almost certainly, you say!

It's hard to think of something Paul Graham wrote that has done more damage to discussions on HN than his piece about submarine PR pieces.
This was called out in the announcement of the company:

We also like that it means alpha-bet (Alpha is investment return above benchmark), which we strive for!

https://googleblog.blogspot.com/2015/08/google-alphabet.html
I'm not advocating for WhatsApp or PGP encrypted email, I'm pointing out that people who make the line in the sand at "decentralized vs centralized" are boiling the problem too far down.
I hope that the global conversation on ecological protection can evolve from climate change to tangible effects, like pollution and ocean acidification, just as climate change evolved from the use of the term global warming.

Ocean acidification in particular ought to be an issue even climate skeptics can acknowledge is a problem. Unlike climate change, which can be difficult to communicate due to its abstract nature (we had heat last summer and snow last winter so what's changing?), you can plainly test acidification with two cups of water - tap and sparkling - and a pair of litmus slips to show the difference. Then expand on how all the carbon in the atmosphere does that to the oceans, and then demonstrate what that does to life in the oceans, from the algae and plankton to the fish people eat.

Overall I think that focusing on precise tangible issues that people can observe for themselves is a better way to communicate the need for ecological protection than to be completely correct in a large and abstract assessment that people might have trouble following.

Only problem is it's hard to sex up the term "ocean acidification." For something like that we'd need an attention-grabbing shorthand, like "melty fishy death water."
Get owned = SSH is hikacked = I don't need your keys and can run any commands on your behalf.

This thing might protect from keyloggers but useless against proper malware that just waits for you to authenticate.
Two way neural implants just seem incredibly unlikely, and even if we did develop them, it would require a great deal of skill to use, you wouldn't be able to just plug in and do stuff with it. Our visual networks are native "neural implants" and babies (who have far more plastic brains than adults) take a while to develop their ability to construct 3d representations of the environment from stereo images.

One way neural implants are more likely, as EEG is greatly limited in resolution due to the weakness of human EM radiation and the barrier imposed by the skull. Basically, it would be an amplifier for the EM radiation emitted from our brains, so computers could better model our neural activity.
A battle rages for the future of the Web
A bit off-topic, but...

"If Mount Everest were flipped upside down into it, there would still be more than 2km of clear water between the mountain’s base and the top of the ocean"

This statement always bugs me, the elevation at Everest's base is already ~14,000ft. Its prominence is not its full elevation. When you try to have someone imagine "flipping it upside down", a person wouldn't typically consider including the surrounding terrain, but simply ignore the fact that it's already at great elevation.
I'd interpret the content of the article as the opposite of the title: "One (the only?) reason staffers didn't quit Google's car project before now? The company paid them so much"

Multiple big players want to get into autonomous cars (and other vehicles -- this is the same space as military contracts for drones) and Google's executives were in total disarray. You'd think they'd lose out but instead they successfully hit some giant milestones by throwing enough cash at the problem.

I mean, if the staffers had been paid poorly, wouldn't they have quit without waiting for that 16x bonus that only comes after meeting the division goals and then waiting four years?
We do: вещественная часть и мнимая часть.
Google seems to have some trouble with execution.

Tesla's 'master plan' is pretty easy to understand externally and gives a clear path/vision forward. How Google plans to actually use their autonomous car tech is unclear from the outside (and I suspect also unclear on the inside).

Tesla's focus on manufacturing and using already sold cars to train their software was a really good plan. Google can't really compete with that even with their fleet of waymo mini cars - it also leaves the big problem of manufacturing cars unsolved (partnership? licensing?).

This seems especially tricky when any car manufacturer that plans to exist in a couple years is already building out their own software divisions with a focus on autonomy.

I'd suspect the engineers see that the management plan isn't going to win so they'd rather jump ship to someone that's doing a better job of it.

This seems to be a recurring trend with Google - get in early with something good, but then let others eventually catch up and beat you.
> I've seen some pretty ridiculous Wall St bonuses from the 90's up close.

That's anecdata. Not everyone is the same. I know friends who would quit in a heartbeat and pursue other passions (music, teaching, non-profit work, etc.) if they got F-you money.
Capable of writing the code, yes I agree there are others out there more than capable. But part of what makes stuxnet and others of its kind limited to Govt. sponsored is the amount of funding required to do the research to write the code. Very few malware developers are going to go purchase a Siemens nuclear refining centrifuge (plus controlling equipment) so they may reverse engineer it and figure out how to break it. Someone had to buy one, then realize if you stop it suddenly enough times it will break.
> So the AI is learning way faster than any human could, it is learning in parallel. We can only drive on car at a time.

Humans can already learn in parallel. It's called The Scientific Method and Teaching.
protonmail is a whole lot easier to use now that you only need 1 password instead of 2
How do you clone a YubiKey? I thought the whole point of having a hardware token in the first place was that it's _not_ easily copied?
> It's time to move past this whole thing and focus on trade and cooperation, not conflict.

War is over laddies and gentlemen !
Will Algorithms Erode Our Decision-Making Skills?
As this article says in the beginning, the car was not owned by the father.
I'm unsure why YC doesn't open up a branch outside the US and offer a vessel to US investors?
This case is about a federal statute that dates back to 1789.
That was more feedback that the site's not working correctly. Since we're talking page source, I guess we might as well tell them the offending line is anchor tag referencing the wrong div `#question6-a` instead of `#question7-a`.
Little of what he taught came from the Theosophical Society, he broke with them relatively early in his life.
12-Foot Replica of the Washington Monument Hidden Under a Manhole Near Original
Cleaning Up Django ORM Connections in Kafka Workers
OH YEAH also Alice in Puzzleland! That might be the very best. Highest possible recommendation.
It's because "data science" doesn't mean anything. People call themselves "data scientists" after they've set up a toy Hadoop cluster between their desktop and their laptop, and the meaning, expectations, and responsibilities associated with the title vary from organization to organization, much like "business analyst".

Some people think that anyone who uses a SQL RDBMS doesn't qualify as a "data scientist" and that the role is limited to people who have experience in "big data".

In general, if you want better applicants for this type of position, your job description should be explicit about the actual activities associated with the job, you should post it where people who know how to do those things hang out, and you should make sure it's apparent that you're willing to compensate well. You'll still get plenty of bad applicants, because every job posting does, but this should help refine it a little bit and clue in some good people that you're worth applying for.

So the answer to your question is basically "Well, what is a 'data scientist'?"
bootstrap = grow a company from own funds and generated revenues, instead of taking external / investor funding.

You seem to be agreeing to give a green card equivalent of rights to an immigrant who is willing to bootstrap own startup and probably invest own money in it?
Sounds like you might have tried this already, but GNOME has had a history of working on accessibility, and I think they're quite open to bugs in case something is broken. How well it works in practice, I don't know, though:

https://wiki.gnome.org/Accessibility

Fedora or Debian is probably the easiest way to get a GNOME desktop these days.
Also as a reminder if you work for a company of a few thousand people: notice how the CEO doesn't care what you think? Now multiply your company population by 5x. Does it really sound like writing heartfelt letters will make a difference?
Here's how to get this (or really any other list) added to uBlock Origin.

* Navigate to the uBlock Dashboard > 3rd Party Filters > Custom.

* Add the line: http://mute.bradconte.com/mute.txt

* Click `Parse` and the `Update`.
If I recall correctly, they use a mix of Sony and in-house designed sensors.