skysight-inc/HackerNews huggingface dataset:
The basic "resumes skewed male so the algorithm did too" explanation appears to be incorrect. But it's found in the original Reuters story and most derived stories, and finding it here implies it's reached the level of urban legend.

Going by the details of the Reuters story and several others, it appears that what actually happened was a training/task mismatch. Amazon wanted an algorithm to do resume discovery, which recruiters would run and get quality predictions as they viewed resumes. But they trained it on resume results, giving it past resumes which had been submitted to Amazon and telling it to seek similar resumes. None of the stories make it clear if there even was negative training data; it looks like the tool was simply told to compute degree-of-similarity to past inputs, and possibly told to prioritize resumes which were ultimately hired.

As a result, the tool was trying to convert a relatively gender-neutral pool (resumes found online) to a skewed one (Amazon applicant resumes), and did so by weighting gendered terms. It also seems to have underweighted technical terms, failing to appreciate them as mandatory or strictly position-specific.

The developers were sufficiently aware of that to catch and correct the known gender biases (e.g. devaluing women's colleges or the literal word "women's"), but were scared there were other uncaught biases. And the results were apparently terrible all around, so the tool was scrapped. Which is pretty much what you'd expect from something trained on exclusively positive, sample-biased examples. The story has been seriously distorted, but the real plan also seems terrible...
Lol! The engine placement on the Maxx so fundamentally alters the physics of the plane, that it’s a totally different beast. Even if it flew the same in common flight scenarios (aka passed all it’s unit and integration tests) it will perform very differently in uncommon situations. It’s the uncommon situations that require pilots anyways, since so much otherwise is automated for safety. There will need to be retraining and hopefully recertification involved. Even then, I think the plane is fundamentally unsafe for passenger flight and cannot be fixed without massive redesign.

As I now reread your comment, I’m no longer convinced you meant it in the contrary way I read it. I agree there’s a thuderstorm coming, and I hope all regulators involved can have the conviction to stand up to the pressures from both sides and rule based on the design merits of the plane (even if they are able to conclude differently from my armchair engineer opinion).
Have we reach a point where there are similar guides for Jupyter notebooks? Or just for the domain of data science / exploratory statistics

Like, conceptually, what should I keep, and how should I organise my notebook(s)?

Most guides are focused on what you can do (Here's how you draw a graph, here's how you load a kernel), I'd rather read about what I should store in my notebooks, and how many I should have.
> How is this different than Amazon literally shipping packages to someone's home address and having their billing information?

If I'm asking a company to ship something to my home address, I've given explicit and active consent to them to have and use that information for that purpose.
Thank you, this was my point but apparently I didn't make it clear.
There has also been a big push on performance and minimising heap allocations in .NET recently, and it's really been paying dividends.

.NET also makes it relatively simple to work with memory on the stack (especially via `stackalloc`), as well as unmanaged memory on the heap. Of course, many developers never have optimisation problems that require these tools, but they are fantastic when you do need them.
AH yes... the 'punish the poor men' argument. In reality, such laws will lead to powerful men able to abscond their paternal responsibilities by having a good lawyer, while poor men remain indebted to their offspring (as they should be of course).
It's even more complicated than that. The Byzantine Empire was conquered by a group of crusaders in the Fourth Crusade in 1204, with several rump states cropping up. The Empire of Nicaea reconquered Constantinople in 1261, so people usually call it the continuation of the Byzantine Empire. By the 1400s, this Byzantine Empire quite literally existed at the whim of the Ottomans, even if they only entered Constantinople itself in 1453. The third rump state of the Byzantine Empire was the Empire of Trebizond, whose last bastion in Theodoro held out against the Ottomans until 1479.

And, by the way, practically none of these countries were so named to their contemporaries. Basically everyone I've mentioned here considered themselves the Roman Empire.
Databricks Open Sources Delta Lake
Scientists Create Speech from Brain Signals
> Lennart needs to

And replace it with what? I genuinely don't know anything that exists right now that could replace it. Linux and ecosystem have a lot of IPC primitives but very few usable systems: I know of dbus and ip.
Most of PySpark is simply telling the JVM what to do, it's not actually running python directly. UDFs are where the real differences are, and they mentioned CLR UDFs serialize the spark Rows 2x faster than Python, but it's not clear if they were using apache arrow enabled pandas UDFs which are 3x-100x faster:

https://databricks.com/blog/2017/10/30/introducing-vectorize...
Microsoft Is Winning the Techlash
'Exhilarating' implant turns thoughts to speech
If "he" really, unambiguously functions as a gender neutral pronouns for persons of unspecified identity, that shouldn't matter, though.
Woman wakes up after 27 years in a coma
I agree 100%. For now, I'll just keep using legacy Checkout, but some day legacy Checkout will stop working. When that day comes, the effort to port to the new Checkout will be approximately the same as the effort to port to PayPal. If there's no pop-up mode by then, I'll probably just switch to PayPal.
I've installed Linux on Sager/Clevo. Unfortunately, can't seem to buy them without Windows pre-installed.

There is System 7 with Linux native laptops.
It's basically a reliable, horizontally scalable object store + a collection of data storage and processing engines.

So amongst the cloud providers, AWS calls a combination of S3 + Glue + Athena (for example) a "data lake", where S3 is the object storage which can store data in various formats, and Glue and Athena are used to transform/process/query the data. See a more detailed article/guide here: https://aws.amazon.com/lake-formation/

If you didn't want to put anything into the cloud and keep all your services on-premise, a local Hadoop cluster could be a data lake, for example using HDFS + Zookeeper + YARN + Hive.

[This is a huge over-smiplification because it's late and I really should be going home :)]
Mark Zuckerberg has a podcast no one asked for
It's not that simple, though. A lot of people - a lot of people - have no idea that during the "Dark Ages", huge swaths of the rest of the world (larger than Western Europe) were going through a Golden Age. It took me rather a while to realize that myself.

And, since WWI was fought in large part over colonial resources and Japan was involved, and since Japan was a major power in WWII (and China was involved as well, if only as Japan's victim), I'm pretty satisfied with "World War" as descriptors.
there was more short selling activity in advance of the articles which is now the reason for the investigations (and for the ban of short selling)
It absolutely is bad for you in the long term. However, given everything else, that might still be their option.

Ie: work 12-16 hours of labor to put food on the table, then study so then get a better job a few years down the road, vs work 12-16 hours a day for the rest of their life just to survive.

This is where UBI would help so people can work in their things besides basic survival.
The only thing that is going to accomplish is severely restricting the number of people who are willing to donate sperm - likely to an extent that couples who are unable to conceive will not have any options available to them
In many cases there are multiple avenues for application, but this paper says the research was specifically funded by the National Institute of Health, which means the PR focus will be toward human health/disease.
It's just what it says - an implementation of Javascript that is proprietary.
Maybe they do :P
Libvirt: The Virtualization API
I absolutely agree. I think we need laws that hold those working in the public sector to extremely high standards, and moreover we need laws that allow private individuals and groups to take action (incl. lawsuits) against corrupt agencies and officials, and have changes in the agency enforced upon it by the courts, and corrupt individuals fired and subject to punishment.

> I'm sure her absence will make it easier for prosecutors

The whole police and prosecution system is need of major reform. Most importantly, eliminate rewards for catching offenders and putting them in jail -- instead: (1) ensure job security, while (2) awarding the lack of crime / low crime rates. At the same time, the agency that crimes are reported to is separate and independent, so that there is no incentive to not record crimes / under-report.
HTML to React Conversion Tool
Don't know where to find numbers, but searching AvHerald could give you some qualitative feel for it. Definitely happens quite a bit (no wonder, given how many flights there are per day).

http://avherald.com/h?search_term=incapacitated&opt=0&dosear...

EDIT to add: fortunately, p^2 is quite small for small p. And apparently there are rules in place to prevent both pilots having the fish for dinner.

https://aviation.stackexchange.com/questions/555/is-it-true-...

http://www.traveller.com.au/why-pilots-dont-eat-the-same-mea...

EDIT 2: "More recently, a 2010 Civil Aviation Authority report suggested that between 30 and 50 pilots, operating flights to or from a UK airport, are incapacitated at the controls every year – many because of food poisoning."

(from the last link above)
Aside from the numerous reasons already given in this thread, I think the rise of the cloud has an impact - it's never been easier to spin up Linux servers (even for Microsoft shops!), and Windows people having their familiar toolset available has surely led to greater uptake of Linux.
And various belts replaced, fluids changed, ignition plugs swapped, starters break, climate compressor (or its clutch) sometimes break... Also turbos, [automatic] transmissions and [manual] clutches are prone to cause trouble. Electric systems might misbehave due to wear and tear on cables. And with 200k+ miles on a modern small car, I would really worry for the engine (here in the EU cars tend to have less cc). Not to mention the hunt for the actual defect. (Source: I am at ~200k miles/326kkm and used to fix a lot myself).
We are in Europe (France) and are using Stripe with SEPA Direct Debit.
Going through the process of defining and planning to build a data lake with my team right now.

A data lake is like you said a collection of data stores, and the industry as a whole hasn't defined it very well past that.

IMHO - A (useful) data lake is a platform that can support any type of data store in any format (be it relational, flat, graph, document, etc) and offer a way to consistently query it. A (useful) data lake does much in the way of managing metadata about those data stores that makes it easy to consume.
We somehow managed to make it work, can’t exactly remember the details but I think at some point it involved us sending them desperate emails (or maybe phone calls, can’t remember exactly) asking them to please change some settings on their side of things so that we would be able to test as close as possible to “live”, it took them at least two or three days if not more to make the change, which created unwanted dead time for us.

To say nothing of the fact that at some point we spent at least two days practically hitting a wall over and over again: we were sending the requests exactly as their not-so-great docs were telling us to do but the response was totally different from what we were expecting. In desperation we somehow managed to contact them (meaning my boss sitting on a phone call with them) to realize that the dev instance they had provided us with still needed some small change on their side of things. Totally non-transparent framework and it all seemed as fickle as a castle made out of sand.

For comparison we had the best experience implementing Stripe, it was like night and day compared to Vantiv. Unfortunately at the end of the day you need to implement what the stakeholders want.
You can see some related but not directly comparable efforts in HuDI see https://eng.uber.com/uber-big-data-platform/

Or
https://iceberg.apache.org/

Which both keep track of data versioning and management of file based datasets on object stores.

Most people today have very ad how approaches to handling data versioning and lineage on Hadoop datasets.
+1 for Nim. I'm dreaming some day to see a RAD where Lazarus generates Nim code with full LCL support; that would be a truly killer dev system for desktop apps. Lazarus is already a wonderful RAD, one can build native apps on a *PI board and run them directly on that target; Nim support would make it even greater.
I view the dark ages as just a big recession following the collapse of Rome. It's not that nothing happened. Often very important things happen during recessions. It's just that there was little macroeconomic growth.
I agree with you completely, I'm not arguing that these studios are behaving ethically. I'm just pointing out that the fact that videogame studios have bad working conditions has been public knowledge for a long time and the engineers who apply for these jobs have to be aware of it. Yet they still decide to get into these jobs even though I'm certain that the vast majority of them could land a more comfortable and probably better paid developer job elsewhere.

I realize that I'm playing the "blame the victim" game and I'm not entirely comfortable with that but in this case it reminds me of that guy who knowingly got in touch with a cannibal to get eaten. If you know what's going to happen and you still on your own free will and without external pressure decide to continue on that path can you really complain that things are exactly how you knew they were going to be?

Are these people coerced in any way to work for these game studios? Were they lied to? Didn't they know that AAA game development is a thankless, soul-crushing task with very tight deadlines and terrible work ethics? Because I remember having almost exactly this conversation with a friend at school more than 15 years ago when he told me he wanted to become a game developer.
Personally speaking, I don't have to reconsider it since there's no way I'd ever allow it in the first place. The very notion strikes me as insane.
How are old revisions efficiently reconstructed from the log?
You're capable of posting unharmonious content on HN with no (visible) consequence, not because you're a foreigner, but because you post the content here.
Why would a criminal leave the coins to sit in the final wallet undisturbed? The article said the wallet only had incoming transactions and never sent any coins anywhere. Surely if you're a criminal organization stealing cryptocurrency you'd want to actually use it.
Brings to mind this article, a history of the rise and fall of Common Lisp at JPL, which was almost selected as the control language for their robotic space missions.

http://www.flownet.com/gat/jpl-lisp.html

And of course, JavaScript having its origins as a more marketable syntactic overhaul of Lisp for in-browser scripting, it's not hard to see how we end up with JS on the JWST for many of the same reasons.

Like others, I tend to idealize space tech from a distance and imagine it using technologies that are across the board better, cooler, more pure than anything that stays on the ground. While the need for extreme reliability does change things a lot, it turns out most of the same forces that guide software selection anywhere else are at play there as well.
> "challenging" doesn't mean difficult. It means doing some research, buying

That's already too much. I can do that, and you can do that. Our jobs are to research things and then implement them. Most people will not or can not do this. Expecting them to is a waste of time.

The way to solve this would be to de-incentivize meat production on the supply side, and encourage food distributors to fortify food with micronutrients that are commonly missing in vegetarian diets (vitamin B12, calcium, etc). Anything short of this is not going to do much except turn people off from being vegetarian.
Donate to ArXiv
I've been neglecting the maintenance of the package "react-stripe-checkout" for a while and though this would be a good time to finally bring it up to date, but it appears the new version of checkout was created with a very different use case in mind. Single page, JS rendered apps don't really fit the model, and should probably use legacy Checkout or Stripe Elements.
Your parent comment was praising that passage and wishing more journalists and others would take that as an example of how to describe about AI.
> Now, that being said, there is one minor question I have, and that is, how would backpropagation apply to this apparently one-way model?

The author mentioned that this is only for inference of neural networks (not training), so this does not support backpropagation.
Ah, my apologies, because when you said "The holy grail of code reloading is to upgrade the code of a HTTP server while it is running and without disturbing any requests being processed." I thought you were referring to the ability of the BEAM VM to also have multiple versions of the same gen_* running, so that old requests can still be running on the original code while the new requests come in on the new code. This is in contrast to the things that came to mind like Python, which technically can replace a function reference live, but there's no such ability to partition who's in the old vs. new space like that, so it's too dangerous to be practically used (or at least not without a lot more supporting code).

BEAM's really got it all on this front.
I've known union workers who love it and I've known union workers who didn't. Both are common enough to be impossible to generalize from beyond opinions being as diverse as people.

Anyone who says "there's no hierarchy" is, without exception, wrong. All they actually mean is "there is no explicit hierarchy". There's always an implicit one. The big difference between the two is generally accountability - explicit hierarchies can have it structured in. Implicit hierarchies get to say "We're all just workers here!" to dodge accountability.

> And I think you'll agree that the trajectory we're currently on is grim. Think it over.

You're right. I do agree. That said, I also grew up in a place where short-sighted unions helped turn a thriving industrial area into a post-industrial wasteland.

Just because one course is grim doesn't mean I want to trade it for any other course.
I'm an European and always pick Paypal over credit card. Credit cards aren't really a thing in Europe. I also much prefer Paypal's direct debit options, where the transaction is immediately visible on my bank account instead of coming in aggregate a month later.
Tidbit: the plural "recordings" implies access to the user's history. That's not supported by the article as far as I can see and would honestly surprise me given the task of transcription/data quality assurance and the current performance of these smart assistants.
From my brief reading of the text of the referenced law [https://capitol.texas.gov/tlodocs/85R/billtext/html/HB00089F...] it would appear that it is aimed solely at 'companies' and not individuals at all. Furthermore it seems to pertain only to contract assignment, not govt. benefits.

Perhaps I'm mistaken, but it does not appear that Texas Law would require this "Anti Boycott" clause on a benefit application.
The Martian Chronicles is more like a concept album, but with short stories instead of songs, than a novel. There are some connections here and there but the vibe is always more important than the details or any broader narrative, as far as linking the stories together.

Fair warning: To the Lighthouse is a (gently!) stream-of-consciousness work of Modernist fiction, and the entire middle act is mostly a description of a vacation home aging for a time, largely absent any people. It's also one of my favorite books, but it's, ah, subtle, I guess. Think a series of impressionist paintings of everyday life, nature, and empty rooms, but in book form.

I hadn't thought about it a lot but on reflection that "satisfying melancholy" effect is one of my most treasured feelings I can get from fiction. There's something childlike about it that really appeals to me—and now that I think about it, a lot of the big children's classic films, especially of 80s, went for this in a big way. Almost everything by Don Bluth. The Neverending Story. That kind of thing. Might be why I make that association.

Just scanned my shelves looking for more. The short stories of Dinesen, a bit? The Call of the Wild, but I think that might just be a "me" thing. It's a lot more common in poetry, where you can read through an anthology for any famous poet and probably encounter it many times, than in fiction. Possibly it's more common in bodies of literature outside of English—I'm thinking especially of Russian and French—where I'm even less well-read than I am in English. I just don't know.
Not sure what that would buy over Object Pascal and the plethora of libraries develop since Turbo Pascal/Apple Pascal days.
Take a look at this:

https://delta.io/
I started using Org mode in emacs. I use it to record the next tasks (Todos), expected results, and actual results. Its damn convinent that I can run code inside org file and say "cat" out the result of an experiment output as JSON by another script into my notebook. I can even embed and run multiple languages using org-babel.

I think I will be coming up with workflows and checkboxes soon for organizing a experiment and easily integrating results of the experiments I am running from disparate software.

I think its very easy to incorporate the stuff in this post, and create a new template in org mode for this. And its so flexible that it will fit all usecases.

Emacs is too awesome.
True, but many people weigh the convenience by the number of uses.

In that case, 0.0001 * 1 million >> 1.0 * 100
My Life Is Way Better Than Yours – By Dog
The phone didn’t die in an area with no coverage in this case - the homr button did. Are you saying that at no point between the time that the home button failed and you took it in to get it serviced/replaced that the hypothetical person couldn’t get internet access?
Technically, it doesn't seem to be pushing boundaries. Just takes advantage of A500's strengths: it's mostly playfields and blitter polygons. But has more coherent style and "story" than usual demos.
TDAmeritrade launches new team dedicated to cryptocurrency retail trading
Oh no! Someone touched someone on a dance floor! Crimes against humanity! Prepare the guillotine, heads most roll!