skysight-inc/HackerNews huggingface dataset:
I once wrote a survey of tools within the Jupyter Notebook ecosystem: https://ljvmiranda921.github.io/notebook/2020/03/16/jupyter-... (it’s a three part series and that link is Part 2).

The topic of production notebooks often shows up. I’ve seen tools like papermill and dagster being used for notebook prod, just like in Netflix.

I concluded that using notebooks for prod is always a tech decision, often influence by a tradeoff: risk for premature optimization (writing scripts early on in the project that may only be used once) and underengineering (using non-maintainable and clunky code to support mission-critical workloads): https://ljvmiranda921.github.io/notebook/2020/03/16/jupyter-...
> Please don't use this kind of language.

Please don’t use this kind of “don’t use this kind of language” language. There is no need to be sensitive.
Or you could compare them to the partisans that conducted sabotage against the Wehrmacht in Eastern Europe, for instance. The military would grind to a halt without a functioning supply chain, and it's very difficult to protect all of the links in that chain against an armed and hostile population.

Many more of those links would be physically inside the US than were inside Afghanistan.
ISPC is really awesome, but you're right it is much less known than CUDA/OpenCL. Part of that might just be lack of marketing effort and focus (you don't hear much about it compared to e.g. CUDA) and the team working on it is far smaller than that on CUDA. There has been some wider adoption, like Unreal Engine 4 using it now: https://devmesh.intel.com/projects/intel-ispc-in-unreal-engi... which is super cool, so hopefully we'll see more of that.

As far as support from other languages I did write this wrapper for using ISPC from Rust https://github.com/Twinklebear/ispc-rs (but that's just me again), and there has been work on a WebASM+SIMD backend which is really exciting. Intel does also have an ISPC based texture compressor (https://github.com/GameTechDev/ISPCTextureCompressor) which I think does have some popularity.

However, the domain is pretty specialized, and I think the fraction of people who really care about CPU performance and are willing to port or write part of their code in another language is smaller still. It's also possible that a lot of those who would do so have their own hand written intrinsics wrappers already. Migrating to ISPC would reduce a lot of maintenance effort on such projects, but when they already have momentum in the other direction it can be harder to switch. I think that on the CPU ISPC is easier and better than OpenCL for performance and tight integration with the "host" language, since you can directly share pointers and even call back and forth between the "host" and "kernel".
No, just socialize all risks and privatize all profits.

That’s the New American Way. All upside, no downside.

But only for Wallstreet and big companies that can buy all the best politicians.
I figured someone would say that, the testing tells you if its spreading in asymptomatic or mild cases, but the reason for that is because we want to stop serious cases.

We know how many people are in the hospital. Honestly, that's all that matters, if we have less people in the hospitals relative to our population, then we have less spread. We have less capacity relative to population size, and they're not being overrun. You don't need testing to know if your hospitals and ICU's are overrun.

>This idea that states with smaller populations aren't at risk is a foolish one.

I never said that, I said the risk factors are different and the actions you need to take to prevent spread might be less drastic. I'm arguing against the idea of a one size fits all solution, something that needs to be done to stop the spread in a place like NYC is unnecessarily restrictive and dampening in the local economy in a small town, where people can just wash their hands, avoid going anywhere but work and shopping for necessities, and businesses taking basic precautions like WFH and avoiding direct interaction where possible, and avoiding gatherings of large groups.

I can leave my house, go out in my yard, and walk down my street and possibly not even see anyone else out, much less come within 6 feet of them. I can get in my car and go somewhere else and not have to come in contact with anyone. You can't do that in a city center, people have to stay in their apartments for two weeks, without leaving or wear protective gear when they do leave, because leaving their residence without interacting with people is impossible, you're liable to run into someone in the hallway, stairwell, elevator, sidewalk, bus, or train/subway, all of which are rolling the dice on infection. If you're in the same apartment building, its possible you're breathing the same air, and have the cruise ship effect. Someone in Oklahoma doesn't have those same risk factors, they don't interact with the same number of people going about their daily business, just avoiding travel is enough to keep the whole community isolated. Nothing much is gained by having them restricted to their house at all times, they just need to avoid certain things that would put them in more interaction with others than normal, or traveling outside their region and vice versa.

What is being done now is probably best, you set baseline restrictions for the nation as a whole, and then each regional government increases or adds on to those restrictions based on the needs of their area.
it's probably not possible for armed citizens to actually overthrow the US government without support from the conventional armed forces. but it's not necessary to completely overthrow a government to extract concessions. a credible threat of widespread chaos and violence might tip the scales against a very unpopular policy.
Exactly. And then at the way end, there's a graph with the two scenarios predicting what will happen based on all of the article's analysis:

Scenario 1: Dollar goes up, then down.

Scenario 2: Dollar goes down.

In each Microsoft Paint drawn scenario, there's only a vague implied scale. Scenario 1 going up to ~$130 around 2025, then falling to ~$92 around 2035. Scenario 2 falling to ~$75 by 2035.

So if the dollar goes up, the author is right. If it goes down, the author is right. If it stays the same? ¯\_(ツ)_/¯
Slightly off topic but I once had a question at work on a very niche corporate finance topic. So I logged onto Twitter and tagged Aswath Damodaran in the question and had the world's foremost authority in Corporate Finance respond in like 30 minutes with a detailed answer. Twitter can be amazing for finding specialized expertise if you know where to look.

https://en.wikipedia.org/wiki/Aswath_Damodaran
> I think it much more likely that the regulatory agency would quickly approve the use of the strain on the basis of the epidemiological data gathered in the process of finding it.

Have you had experience with dealing with said regulatory agencies?
6Ghz Wireless Spectrum, Unlicensed Access with US FCC
right, this is an apples to oranges comparison.

you're comparing the feature that RDBs do best to the feature that NoSQL DBs do worst...
Simply because of the e-ink screen
what about open-source Jitsi hosted on own servers? sounds like much more secure and controllable option. i used it just several times for group calls, so cannot say how full the functionality list is but so far rather good alternative to Zoom.
> I’ve not yet seen an explanation of what a monad is that I could understand. Monads are just too abstract for me to grasp, let alone reasoning about.

I had a similar thought about the Option monad when I was learning Scala at the time. My thought at the time was "why are you making it so damn hard for me to get access to underlying value?". At the time I kept trying to "unwrap" the value and continue using it.

Hang in there. An intuitive understanding of monads is necessary to understand how to work with monads like Result fluidly.

For learning monads the best way is to just read tons of different sources and tutorials on them. A lot of them won't make any sense. You might get a tiny hint each time and then it will just click.

Part of the reason monads are hard to understand is because they are typically taught only at the abstract level. You need to see concrete examples first, otherwise it's just a floating abstraction that you can't ground to existing knowledge.

I recommend finding some Javascript tutorials on monads because in the beginning I think a focus on types creates too much noise. Ignoring types will make the intuition stand out more.

You can also get most of the intuition behind the monad pattern by concentrating on just "functor composition".

Imagine:

fnReturningArray().map(doA).map(doB).map(doC)

Then,

fetchPromiseResult.then(doA).then(doB).then(doC)

What do they have in common?

Now you can create "combinators" to make it simpler:

pipe(doA, doB, doC)(fnReturningArray())

The "pipe" function is a generic utility that will work with any type/abstraction that follows the "functor" pattern.

Once you get familiar with the functor / monad intuition you can use and even build you own higher level combinators.

This is a large motivation behind the Result / Either monad. It creates a common pattern that higher order combinators can reuse. In essence, from the constraint of following the functor / monad laws, you get tons of higher order abstractions for free.
2560x1440 at 31" is 95 ppi, in case you wondering.
DeBlasio was telling people on March 2 to go out on the town and watch a movie on Twitter.

Trump is an easy scapegoat for obvious reasons, so politicians and local people use him when not wanting to accept personal responsibility for the consequences of their own actions, or lack there of. If you already take the position that the President can't be relied on and should be out of office, why would you delay taking action yourself to prevent a scenario where you're waiting on hospital ships and the US Army to assist, or acting like you're the only place in the US that needs help, then complaining later that the President didn't do more? It's schizophrenic and hypocritical.
I tried. So. Many. Apps.

Same. I always go back to using the file system:

- it has a hierarchy

- I can use whatever file format I want, mix in images, odt, pdf, md, etc

- I can backup and sync

VSCode is a pretty good editor to manage it all, and I played with the idea of creating an app with the new editor view feature of the last version just for that. Support some metadata, create an automatic encrypted sync server and that's it.

So ironically... An electron app.
This company is a US military contractor so they're effectively part of the government.
Only as urban myth scattered around by the C crowd.

As user from all Borland product until they changed to Inprise, it was definitely not the case. Pascal and Basic compilers provided enough customization points.

When one of them wasn't fast enough versus Assembly, none of them were.

I used to have fun showing C dudes in demoscene parties how to optimize code.

Now, if you are speaking about the dying days of MS-DOS, when everyone was jumping into 32 bit extenders with Watcom C++, then we are already in another chapter of 16 bit compiler history.
In Germany doctors are not allowed to send a person to a specific pharmacy, not even suggesting who might have something in stock. Then again Germany is very regulated when it comes to that.
Great article.

Recalls Gall's Law[1]. "A complex system that works is invariably found to have evolved from a simple system that worked."

Also, TFA invites a question: if handed a big ball of mud, is it riskier to start from scratch and go for something more triumphant, or try to evolve the mud gradually?

I favor the former, but am quite often wrong.

[1] https://en.m.wikiquote.org/wiki/John_Gall
Fed should pay every American, let hedge funds and billionaires ‘get wiped out’
"Guns rights" for minorities in America has rarely ever been about personal protection or what not, it has been about keeping those in power in power and keeping the.

Large swaths of American history of American history are likely being ignored with assertion like "gun ownership could prevent a lynching". Take pre-Civil War laws making gun ownership of African Americas (free and enslaved) illegal, the continuation of those laws under "Black Codes" in both the North and South post Civil War, and the extension of similar acts post Civil Rights Act with laws like California's 1967 Mulford Act.
How about the fact that they have modern radar? :-)
http://archive.is/oWxNu
Well the administration did a lot of things for optics/PR/the "markets" but none of those steps were taken to actually help or protect Americans.

That's really the gut punch for me personally. Trump could have secured his reelection 100% by taking this seriously but instead he was too focuses on the short-term to look even as far as November.
> So reducing a dozen instructions to a single instruction doesn't necessarily mean that the single instruction is going to be faster.

Are you saying dozen scalar instructions can be faster than one vector instruction? That's wrong 100% of time on modern CPUs.
Storybook – a development environment for UI components
So, yesterday post asking about a e-ink screen was a post to get people curious about it so you can click on this story clever
And maybe offering these modern features is so much easier using the electron platform that offering the features based in something else is not worth doing.

There must be a benefit for developers for them to chose electron. And that benefit for developers will have an effect for the users in either more features, quicker rollout or more supported platforms.
>changed the click behavior of the bar to be totally unlike any other program too

I am using Firefox Developer Edition, and I was also stunned at first a while ago. But now as I'm getting used to it, I tend to like it more and more. It was really hard to select just one part of the path (word) before this change, and now I can just double-click those parts to delete them then (useful when you want to cleanup the URL from some mess).

Also here is the description and justification for this change from OP link:

On Linux, the behavior when clicking on the Address Bar and the Search Bar now matches other desktop platforms: a single click selects all without primary selection, a double click selects a word, and a triple click selects all with primary selection
I knew some professors in college that had the DX and that was exactly why they used it. They could download a bunch of newly published papers/references frequently and only have to carry the DX.

You'd see them roaming about the campus reading them. Eventually I think that swapped out for iPads since they could be used for non-paper things.
This is comforting, but I'd rather still be cautious. I wear gloves when I go shopping. I wash my hands frequently anyway, and now I wash them even more. Worst case, I've wasted some time.
I think “disarm” here was used in the sense of reloading ammo vs. making the weapon itself usable or not.
This is going to sound fussy but it's a really important point to understand. This is not the case of a bunch of farmers rebelling against a king, or a duke staging a coup. The people reforming the government is akin to the CEO of a private company firing their mid-level managers. That's the right of the people, and the members of the government serve the people.

The reason why the right to bear arms is important to a free state is because both sides of a negotiation must possess power. Kent State was a tragedy, but it's aftermath happened in a court room with lawyers and journalists. Tienanmen square on the other hand saw a government run over it's people with tanks and then pretend it never happened.

When one side of a power dynamic has no power, the opposite side can do whatever it wants - install a president for life, promote the president to a position without any checks, directly compromise basic human rights for short term political wins, and so on.

A "revolution by force of arms" isn't very likely, but a large well armed group of protestors is a great way to convince a government to show up in court and use words and lawyers instead of tanks.
And how carefully do they select their patients, so that they can maintain their perfect record?
Fulcro Rapid Application Development Tools
I think this is "cheaper" like - its cheaper to to have supply chains for critical medical gear in China.

Makes for a great target for espionage on military tactics and capabilities for one risk.
The problem is that we need a way to say "actually; without exaggeration or inaccuracy" succinctly. Also, to say "I am using an idiom, but non-idiomatically."

"Literally" should be that tool. I understand that a word's meaning is, by definition, what people mean when they say it, but it is frustrating to have this communication tool drift away with nothing to replace it.

As another commenter said, this same thing happened to "very" and "really" in the past. So maybe it's time to let "literally" go and make up a new word for it?
How much of that is due to the C preprocessor though? In theory, you could run the same preprocessor for Rust code (if you figure out some sensible macro shortcuts).
> Good companies understand that people move on, and don't assume that someone is hired in to a role forever. Once you realise that hiring is an expensive process that you will always be doing you then you can optimize it appropriately.

Yes, they understand this, so they simply do not hire people who need to be trained for a year or two to be effective hires.
> neil with data .com

> no data in the article to back up claims

Yet another person who claims that hiring is broken. If this is the case, then show me the company that is not using technical interviews, and demonstrate to me that all these other companies are failing to hiring the best people for the job.

The closest they get to evidence of their claim is that Google didn't hire 1 random guy 4 years ago. Oh, and that Google built Stadia (??? huh ???).

Did I just read an anti-Google blogpost disguised as an anti-interview blogpost? What does Stadia have to do with interviews?
Bull trap.
I read somewhere that someone said (either about physics or CS): "There's 50 times as much going on as I can keep up with, and I only operate at 2% efficiency. So there's this factor of 2500 working against me, and every day I fall seven years further behind."

And that was professionally. That wasn't trying to keep up with the news, and your friends' every social media post.

So cut yourself some slack. Nobody can keep up with everything. You aren't broken, you aren't incompetent, you're just human, and humans have limited bandwidth. I think that's where the answer starts: Stop expecting that you can keep up. Stop thinking that it's reasonable that you can keep up. It's not a reasonable expectation; there's too much for that.

The next step, as others have said, is limiting what you try to keep up with. See, the news outfits make more money if they get you to consume more of their stuff. So does Facebook. There are very smart people trying very hard to make you want to consume their spew, for their benefit, regardless of whether it harms you or not. You have to deliberately defend yourself. Consciously choose how much you're going to take in, and of what. And then fight to maintain that, because they're going to tempt you to make an exception... and another... and a whole bunch more... and then your limits are gone. If and when that happens, recognize that it happened, remember why you put limits on, and go back to the limits.
WordNet and ImageNet in a clone-able SQL database
Hi Hacker News,

I just published a blog post on how to publish open data using Dolt and DoltHub, tools we built. Dolt is git crossed with a SQL database. The blog uses ImageNet and WordNet as an example. In the end, you have your own copy of ImageNet and WordNet is SQL form. Check it out and we'd love to host your data projects!

https://www.dolthub.com/blog/2020-04-10-dolt-dolthub-become-publisher/

If you just want to clone the dataset, you can do that here:

https://www.dolthub.com/repositories/Liquidata/image-net
We (Netflix) do a ton of prototyping/exploration in notebooks like everyone else. We run many ETL pipelines in production as templated notebooks. When something fails, you can just open a notebook to see the input and the output, which is handy.

We don't deploy or execute ML models in production as notebooks. We have many other solutions for that use case. In particular, check out https://metaflow.org
You are leaving out the single most important element of this whole mess: Eurodollars. There are banks outside of the US that take “real” US dollars and multiply them through fractional reserve lending but totally outside of the Federal Reserve System. When the financial crisis of 2008 hit, everyone “discovered” that Eurodollar liabilities were so entangled with real USD liabilities that pulling them apart would be impossible without completely shutting down global trade and finance for an extended period of time. So, the Fed just temporarily gave access to its liquidity for foreign institutions outside of the FRS to keep things running.

Anyways, my point is that Eurodollars can be created, passed around among foreign entities, and destroyed without ever necessarily touching the US flow of funds.
Netflix should offer free TV for kids who watch educational lessons first
If children watch a 1-hour lesson, Netflix should reward them with an hour of free television. This would help low-income kids stay in an educational mode while schools are closed.
And IIRC the Icelandic data doesn't tell us if those people were guaranteed to remain asymptomatic or were merely presymptomatic.
At that point it was a cold.

My wife occasionally works in an emergency room, so the advice she gave me is the same advice that anyone else with the same symptoms would have from a doctor following the CDC's instructions.

She just thought it was a seasonal virus.

Edit: It wasn't until mid March that we (MA residents) suspected it was in the wild. Basically, there was a reported case that came through Logan airport in February, and then when it came out that the incubation period was 2 weeks and many cases just resembled a bad cold, everyone started to suspect that there were a lot of asymptomatic cases in the state that we didn't know about.
> It's easy to be right in hindsight.

I'll follow HN guidelines and I won't assume what you mean by that so I'll just ask. When did "hindsight" start? What date do you feel is a good marker for when it was obvious?
I think a lot of folks are skimming the top of this and missing the really interesting parts.

Their focus doesn’t seem to be providing adversaries against pilots, but adversaries against weapons systems.

He’s essentially selling organic data to train JTACs against.

The goal here isn’t as much great avionics, but great combinations of sensors and sensor jamming.

The military focuses on having a combat ready fleet, while he focuses on a fleet that can provide lowest cost options to provide appropriate training data.

A lot of that fleet is made up of trainers fit with electronics packages and Cessnas similarly Frankensteined. Then the military and manufacturers rent it out vs maintaining their own limited-use fleet.

The hornets are great, not just because they’re sweet jets, but because of the electronics packages and maintainability.

...and then he has a paramilitary nut/Bond villain vibe that keeps the story less dry and probably appeals to the intended audience.
Big balls of mud result from a process that resembles reinforcement learning, in that modifications are made with a goal in mind and with testing to weed out changes that are not satisfactory, but without any correct, detailed theory about how the changes will achieve the goal without breaking anything.