skysight-inc/HackerNews huggingface dataset:
Funny, I don't see the immutable file question, or questions on capabilities, systemd, selinux, etc. Also, there are "big traffic" questions missing, like how to tune a kernel to perform lots of network ops, how to design a system for high-performance and high-availability, network attached storage, firewalls, replication, etc. Basically, how do I build a system that I know can deliver X traffic at Y rate, and scale it?

Then there are the process questions, which always seem missing. How do you prioritize work? How do you balance projects and toil? How do you manage working on the same set of services with multiple team members on multiple platforms? How do you handle incidents? What is your typical postmortem like? What do you do when a customer asks you to do something? When a manager does? How do you manage your automated tasks? Give me an example of implementing auto-healing. Give me two examples of how you have migrated or upgraded a running service. Multiple customers have reported that the production site is down; what do you do?

Then there's more modern stuff which should be standard by now, like talking about using Docker, job schedulers, CI/CD, monitoring, configuration management, inventory management, secret management, deployment, HP/HA, distributed computing, etc. Even using the cloud should be standard now, as virtually every company that isn't using it wants to.
someone linked me this article the other day about how netflix is using notebooks as a development platform https://medium.com/netflix-techblog/notebook-innovation-591e...

i mean i get that theyre nice for doing data stuff and presenting it, but it just seems a bit crazy to use it as some sort of development platform.
It's named for the Bight of Benin, and again, the name was changed to distance it from the French colony it once was under the name "Dahomey".
As someone who seems to be roughly aligned with your positions and who admires your incisive analysis, I nevertheless find that your posts tend to be strident and that they send threads spiraling into flame wars.

I wish that you could find ways to engage which are more in line with the HN guidelines. Many of us with strong opinions, including myself, have had posts flagged and received constructive feedback from dang, just like you under your old identity. I think about those guidelines and dang's feedback a lot when composing posts.
> I personally don't care because I don't use Venmo

By that logic, you shouldn't care about Mozilla because you can just download another browser.

But that's not true. Venmo and Firefox have an impact on the larger world, whether you use them or not. Both should be criticized. But criticizing the messenger does not excuse the behavior of the other.
I have fond memories of this time as well. It is the first time I have seen an article where I am seeing old names like Joshua Davis and Jared Tarbell. Manny Tan and Keith Peters were similarly cool.

I don't get a lot out of the art side, but I have always been fascinated by this particular topic. Where little pieces of code, depending on some inputs, can generate some really fun output.
Ron Wyden is a national treasure. One of a very short list of DC politicians who make any effort whatsoever to understand tech.
They say they're supposed to do this, but the feature was never actually tested and even the manufacturer themselves aren't sure it's gonna work.
Berkshire Hathway Takes Stake in Indias Paytm
> Ceraolo, who says he was not involved in the breach, says he was able to confirm that the hacker accessed T-Mobile via a vulnerable API.

I want some details here. Just the other day we had a blog post lauding fairly open API approaches for client UIs (in GraphQL, but I see similar arguments elsewhere). Lock your shit down, don't give the frontend more than it needs, and if you're in a company with some type of ridiculous team separation where the backend has to treat the frontend as a customer that doesn't work for the company it's just a matter of time.

Not saying this was a frontend API, just saying it's a frequent vector due to the lax auth requirements and "internal" query-like approach they often take.
Thanks Feross for creating webtorrent. The biggest problem I see with this and also ipfs is that the latency is up to 30seconds even for files that are distributes over many clients. Is there any work in progress to reduce the latency?
So it's absurd to suspect Google of doing something Facebook has already admitted to?
Anyone have any good suggestions for what a customer should do when their service provider has been breached?
>From a legal perspective, not certified means the feature doesn’t exist. So it is technically an accurate statement.

I guess almost all of the software developers here have never really built any features then. Imagine that, all that code and the features “don’t exist”. I didn’t realize the law had such ontological power. Not certified means not certified. Not believing you have a legal obligation to get certified is a great reason to avoid that expensive and bureaucratic process.
sounds like this is a process issue! EG, why data scientists and software engineers are both needed, and how they can work together to produce quality code which will produce quality data analysis
Docker is the answer. Hire a separate production engineer to handle docker if your devs are not interested in ops.
What is the dark web? The good and bad of the Internet’s most private corner
Treatment oriented medicine is a problem in and of itself.

There is no treatment for medically diagnosed Celliac disease other than don't eat wheat for the rest of your life; its hard to profit off that in the medical biz, therefore, there being no treatment, mental gymnastics to disprove anything treatable are mandatory across several pediatricians and gastroenterologists and oncologists we talked to for a year or so WRT our son. Finally after ruling out child abuse and cancer, almost out of desperation, they did a quick blood antibody test leading to a stomach cilia biopsy and they're like "sorry its not good news like treatable cancer, its untreatable gluten allergy". Somehow the poor little guy must have given blood for a hundred tests before the antibody test came back with higher levels than the ENT had ever seen in a test result, and the biopsy confirmed it. Remove wheat from his diet and in about a week he was the healthiest kid ever.

The insane part is about one percent of the population is somewhere along the Celiac spectrum of symptoms; my kid somewhat along the extreme edge, most not so bad. But docs will do anything to avoid a simple blood test / biopsy diagnosis because there's no profitable treatment or pill to push.

Somehow, almost accidentally or unintentionally, western medicine in the USA can provide good outcomes, but the average citizen playing the game doesn't understand that its primarily a legal CYA game secondarily a treatment commissioned salesmen game, also a money making racket, and only a distant minor goal is actually helping people live better lives. If people are helped by the medical establishment its almost by accident as a side effect, helping people is definitely not the primary purpose of the establishment.
I find this syntax prohibitively hard to read and write. Is it related to existing languages? Maybe some that I'm not familiar with?
This whole driverless car thing reeks of more vaporware, more public-yet-profitless unicorn companies promising to promise to change the world and aside from surface level consideration of edge case accidents with pedestrians (hasn't one of them already killed or seriously injured a pedestrian??) there isn't much deep talk about less straightforward issues such as (former) members of the trucking industry sabotaging these new fleets or how liability and insurance is REALLY going to work out.

File the promises and the problems under fiction because it appears to be more important to keep the world order, its financial system and these ridiculous media darling fluff piece corporations alive while they bleed money.

And no, im not closed to the idea of successful work being done on automated driving but 30 fps, WTF? too much going on in the larger context of the world, this shit isn't happening in 2020 or 2024 or whatever else many might say.
To me, this is a strong sign of Google manipulating search results.

https://www.google.com/search?q=american+inventors

https://www.google.com/search?q=american+mathematicians

https://www.google.com/search?q=american+scientists

Image results:

https://www.google.com/search?q=european+art+history&tbm=isc...

https://www.google.com/search?q=white+couple&tbm=isch

https://www.google.com/search?q=white+inventor&tbm=isch
Anyone interested in this should read the Atlantic feature about it:

https://www.theatlantic.com/technology/archive/2017/08/insid...
People don't do take-home tests because companies give them in addition to interview loops. I'm saying, just do the at-home test, and cut out the interviews.
The internet exists, is way to big to manually curate, and google is just providing a window into it with algorithmic searches.

There is always talk about how google promotes this or that by having this search return X and how they should adjust it. They always "adjust the algorithm" or ban sites from their search results entirely.

Google's search is better (I've tired and use others..) and thus it wields enormous power. This puts them at odds with governments that always want to control information. I'm sure if they could the whitehouse could make its own "search engine" but people wouldn't trust it.

edit: removed my "good luck with that". The US currently has a poor track record of controlling large corporations because of lobbies etc.
Well, it's quite simple.

Right now the quality of a diagnosis depends heavily on the experience of the doctor. One of the problems is that even an experienced doctor has little experience with rare conditions.

In this age of data-science, we can replace the doctor's diagnosis with a number of standard diagnostic tests (observations), which can be performed by a nurse and/or lab-worker. The diagnosis is then determined based on "correlation" with a data-set, collected over an entire population.

The best possible treatment plan can also be computed based on this diagnosis (which could be more refined than a doctor could possibly make, because it can work with probabilities instead of a single outcome).
That should be good for everyone because CEO's and company executive walkway and no one is held accountable.
VPNs and Privacy: Using Virtual Private Networks May Put Your Data at Risk
2 + 2 equals whatever The President wishes it to equal.
> I can't imagine how anything could fall to pieces the moment someone colours outside the lines.

Try and install an application to a different disk. Or even a different directory. It can't be done in any major distribution because package managers make the assumption that you will never want to place an application anywhere but the same place the rest of the OS is, because they also make the assumption that all applications should be part of the system, because Linux has no concept of separating "system" from "application" in the first place.

I know what your response will be: "normal users don't care about that"[0], which I think illustrates my point rather well.

[0]It's also rather likely you'll go with something like "Windows applications normally don't let you do that either", which is at best a half truth but, more importantly, is a whataboutism.
The claims are justification for the regulations they want to push through. Some countries have laws about what search results can and can't be returned. It's quite doable, and if you don't want it to happen, you probably shouldn't get complacent. Go talk to your representatives and consider getting active in an election campaign.
The current bipartisan issue is that the line is invisible and therefore impossible to regulate. Of course, Google has a trade secrets case for the line being invisible.

The government makes Coke list the ingredients and nutrition facts, but doesn't make them reveal the secret formula. Maybe there's a similar way to regulate Search?
so clearly folks using this library are using it as part of their own geospatial analysis work, but would it make sense to include this as part of something like PostGIS? It seems like it lets you make much finer grained approximations of complex geometries and would be useful for speeding up things like analyzing geometry intersections/containments.
I looked at the chart in the middle and was like, whoa, that one is pretty nice!

It reminded me of: https://www.youtube.com/watch?v=OlLqYBU8qsY
Very much what I had in mind.

Climate skepticism was largely created by media attempting to balance out the point of view of nearly-everybody-including-everybody-who-had-studied-the-topic with that of that-guy-over-there-who-thinks-otherwise.

Showing the other point of view is generally good. Skewing the perspective to show things as balanced isn't.
You're free to develop an RSS reader with those features yourself. RSS is - on paper - an extremely simple protocol, but since many feeds are broken (not wellformed/improperly escaped XML, often incompetently copied from HTML, with spam, etc. etc.), RSS readers must integrate individual feeds almost on a case-by-case basis, with feed-specific fixes and heuristics. And there goes your project budget. Considering RSS isn't exactly growing (because the number of valuable news site isn't neither), the state of RSS is as good or bad as it always has been. I don't know if that is actually a good thing, because when big media (Google) last turned their eye towards it, it monopolized and almost ruined it.
Not certified by the FCC does not mean not tested. If you’re an engineer, I’m sure you’ve tested plenty of things that you didn’t get “certified” by some regulator.

The only reason to go through such expensive regulatory certifications is that you believe you have a legal obligation to.
What Does the Consumer Data Industry Know About You?
I’m glad these concerns are becoming more widespread, since they are somewhat subtle and when we originally shipped RunKit many people didn’t know why we didn’t “just write a js backend for Jupyter”. The reality is that solving these problems are a huge engineering challenge and we spent the entire first year of development at RunKit on unifying the “module” and “REPL” environments. Our litmus test was that notebooks would be logical to work with once they could literally be required by other packages as if they were just modules with no modifications. The solution we came up with was VM-level time traveling: if you modify a previous cell, you should rewind the entire state of the machine (including undoing changes made to the file system, spawned processes, etc) and “pick up from there”. In RunKit, if cell 3 deletes a file, you can still read the file if you modify cell 2, since we snapshot the entire computer, and thus you don’t have to “pretend” you’re modifying cell order like with Jupyter. In this way you really do get the best of both worlds: a notebook never has out of order cells or is displaying its contents in an unintuitive way because if behaves “as if” you had just rerun the entire notebook from the start on every change - but with the feel and speed of iteratively appending cells. Additionally, since this isn’t done at the “language level”, computer-level side effects don’t become “out of sync” with your notebook - “oops I dropped a table in the database” - don’t worry just rerun the cell with corrected contents, it’ll always run with the same state it started with. You can read more about this in a blog post we wrote when we initially released (even though it reads like a direct response to slide 25 of this presentation): https://blog.runkit.com/2015/09/10/time-traveling-in-node-js...
> The main problems are:

Those are problems, but I think you're accidentally digging backwards to find them. If you want to make a living in art, selling to collectors and galleries, it's really not about pragmatic economic concerns like these. It's about having a community of patrons and collectors who can't help but talk about and trade the work at galleries and dinner parties.

As that catches, people will inevitably surface the "good stories" and the reproduction of work will be managed in some way.

That hasn't happened in a way that's been explosive yet. Once a few superstars wow the right people and see their work anchor major gallery collections, there'll be a lot more room for smaller artists.

Personally, I wouldn't overthink the reasons why. Codifying them as "main problems" might just leave you missing opportunity when the winds change.
I didn't know this was a Europe-wide rule, but as a professor in Spain I can attest that the 3 years + 1 year extension rule is now enforced and met. If your time elapses and you haven't completed your thesis, you're out.
The solution is to mandate that Google publicly disclose their algorithms and the various weightings they apply to incentivize behavior and how much of an impact they have. Then everyone can see whether or not their behavior constitutes unfair bias, can test for themselves what's going on.

Google does not need or deserve the ability to keep the way all human knowledge is accessed and found today a trade secret.

Additional notes on this to address the obvious criticisms:

- Google would still have the benefit of it's actual data/crawled content that presumably would not be disclosed and constitutes a significant portion of their business advantages.

- It's unlikely competing search engines would somehow leapfrog Google's technology by having access to their search ranking algorithms. At best copying Google would make them "as good as Google", but you need to be "better than" to get people to switch or offer features and benefits they don't.

- Even if all of Google's data and algorithms were cloned by competitors, everyone would still by and large use Google because Google is the default on almost every platform and browser, and Google has a significant lock-in effect over their platforms.

Which is to say, requiring one of the world's most powerful monopolies to disclose the algorithms by which knowledge is found would have minimal to non-existent impact on their business but have significant benefit to society.
Sounds like an Adjunct position which I hate to break it to you is no where near Professor. You will likely make less than minimum wage, I have seen salaries of $3,000 per class taught, and have essentially no room for advancement.This is a common end point for PhDs that didn't get a Tenure track position and have no other choice.
Touch typing is always a good investment in time though. You'll always be typing something, regardless if its a google search, writing code, playing video games, etc.

I learned to touchtype from playing too much starcraft growing up. If you didn't touch type you were never going to be good, period.

Consequently, playing FPS so much growing up has given me extremely precise mouse movements. I rarely ever misclick things on accident, those quickscopes came in handy.
Or it's extremely basic text matching and "African American Inventors" more closely matches "American Inventors" (as it is an exact substring match) than web pages about "Inventors from the United States", which is probably a more common phrasing (see: https://www.google.com/search?q=Inventors+from+the+United+St...)

One of the biggest problems with Google as I see it, and facebook for that matter, is for the end user there isn't much of a way to introspect _why_ a search result comes from a particular query. In this case, you used that lack of information to confirm your own assumptions and bias.
Identity theft protection doesn't do anything, it isn't even "protection" just notification after the fact and some agent will hold your hand.

Instead how about companies have complete financial liability? That way they'll need insurance, and their premiums will skyrocket if they get breached.
I'll take laws just requiring transparency. I want to know exactly what happened, exactly what was taken, how much, exactly how the passwords were hashed, etc.

> T-Mobile declined to comment. "We don't discuss publicly how we encrypt passwords,"

That is unacceptable, data breach or not.
While I agree with the sentiment, everyone should have basic identify theft protection for free. SSN should not be so insecure or should not be used and the stuff the credit bureaus offer seems like a protection racket.
America’s Student Debt Machine
Literally the first result in that search is a far-right, white nationalist blogger alleging Google is manipulating results for that search.

This would seem to both belie the claim that it is manipulating the results -- by virtue of the fact that wouldn't the first thing they manipulate away be this very criticism -- and seriously taint the chain of events that led you to claim that they are.
I am using GoodNotes for most everything now-a-days and it does indeed rock. I was happy to pay $8 but if it was more money I might have hesitated to pull the trigger because if it did not work well there is no refund policy on the app stores still. No trial version. etc. Perhaps things will get easier for folks to try the higher priced apps for a few days before they pull the trigger to buy.
I'm expensive because I'm experienced, not because of the technology stack. I would expect to get paid the same whether I'm coding in Node or Rails.

Also, I don't think anybody is arguing that Rails can do things other stacks can't do; conversely one can also use React with a Rails backend. But I do absolutely believe that Rails generally provides faster development times, because it has pretty useful abstractions and components work well together out of the box. I can't say the same for Node.

I think your point about devs either being Node or Ruby people is misguided. I did Rails for a lot of years, but have been doing Node for the past 2. It's not because I "made the switch", it's because the job I took was a Node shop. Knowing languages and frameworks is not mutually exclusive.
Great to hear. I swap out your app and xournal regularly as I sort out a suitable workflow replacement for onenote.

I'm curious what sort of things are in the pipeline? Very grateful for the work you've done so far!
> Yup, but why?

Mobile and mobile-first thinking, perhaps. "webdev" is far more js-driven than it was 10-15 years ago. I'm not sure whether that's good or bad, but imo that accounts for much of the difference. 15 years ago I could build entire applications with a minimum of JS, and they were acceptable to clients. That's not really the case any more - there's more demand/need/expectation of js in web projects today.

The need to talk to relational database is, ime, as strong as ever, while the need for supplemental data stores is growing, but is rarely the primary focus for any system already in existence.
I think OPs point is somewhat corroborated by the choices of Google Doodle, both in who they select and who they omit.
I'd assume the greatest search engineers in the world would know how to distinguish people searching between the two phrases.
Python 3 has type annotations and there are static type analyzers for it.
Several of the examples in the article of people without PhDs work at Google Brain so you are literally wrong in this case. They are obviously outliers but either way you aren't right.
>The disagreement is the amount of regulation, and where to draw the line.

It is not clear to me that there is any disagreement on the amount. I know that the conservative claim is that they want less regulation but how do you measure that?

There are a host of things conservative policitians seek to regulate that liberal ones tend not to. There are even huge socialist programs that conservative politicians support more than liberal ones (like the military)