skysight-inc/HackerNews huggingface dataset:
The problem is Google at all levels publicly misrepresented his arguments. Google replied with a knee jerk reaction publicly.

If anything Google will settle because the proof of misrepresentation is in James's favor.

Sure there are lots of things you could and Google could have argued. But they chose to respond to what had to be either a different paper or their emotions.
There are more highly intelligent men than women, because for men, the distribution is higher, look it up.
Dupe

https://news.ycombinator.com/item?id=16051337 (orig transcript)

https://news.ycombinator.com/item?id=16091105

https://news.ycombinator.com/item?id=16056076

The orig source is https://media.ccc.de/v/34c3-9270-dude_you_broke_the_future which is also discussed on HN, but it doesn't contain a subtitle. The antipope.org site contains the transcript.
Great work!

I haven't messed around with the count-min augmentation for HLLs, but I've had a lot of success in practice.

I've experimented with using HLL sketches for set operations for genome comparisons. The great thing about these operations is that the cost of operations scales with the size of the sketch, not the size of the dataset being sketched. Add SIMD acceleration, and you have an extremely fast, compact, accurate way to perform approximate set operations.

Unfortunately, the naive intersection operation (a sketch consisting of an element-wise 'min' of the counts in both sketches) does not perform well in cardinality estimation.

The recent Ertl paper [0] and associated code [1] puts a lot of effort into more accurate estimation and set operations. In my experiments, I've found that his modified estimation formula is always more accurate than the standard method and remains accurate to much higher cardinalities for a given sketch size.

My SIMD-accelerated, threadsafe HyperLogLog implementation in C++ (with python bindings) using this improved estimation method is available at [2]. Using this structure, I was able to perform over a billion full-genome Jaccard index calculations overnight using `bonsai dist` from [3].

[0]: https://arxiv.org/pdf/1702.01284.pdf

[1]: https://github.com/oertl/hyperloglog-sketch-estimation-paper

[2]: https://github.com/dnbaker/hll

[3]: https://github.com/dnbaker/bonsai
I am actually unsure of her interests.
It's a demerit to him that he accepted their support, but it is also a demerit on the entire rest of society that the only ones who offered him support were the alt-right.
Political Correctness Has Run Amok – On the Right
I do wish the persistent config file enhancement had a significant chance of becoming a reality. https://github.com/BurntSushi/ripgrep/issues/196

I understand alias'es and wrappers fine, but I like having the environment have some way to contribute. It's just my simple preference.

There's also the related #314 which makes even more sense- per project configuration. Sure would be great being able to download a project & have it already setup nicely for ripgrep! https://github.com/BurntSushi/ripgrep/issues/314
Neurology and psychology studies have shown differences in the way men and women think.

For example, when navigating, men tend to use dead reckoning, while women tend to prefer landmarks.

Similar differences may exist with respect to the modes of thinking useful for engineering. With that in mind, consider that our current modal computer architecture and programming paradigms were designed and implemented by men. There may be some intrinsic bias towards man-thought embedded in the entire toolchain.

As a thought experiment, imagine a computing system designed from the ground up by women, with no input whatsoever from existing systems or concepts. A group of females are placed in a time stasis bubble with no outside communication, and emerge from it only after they develop a computing ecosystem of equal capabilities to the existing one.

With this in mind, now give all new students in the pipeline the option to try out both, then choose between the new system and the old for the entire remainder of their career. In this experiment, try to determine whether, after 20 years, the overall balance between sexes is equal, and whether the balance within each system is biased to one sex or the other.

If Babbage and Lovelace had further developed their computational mills, Lady Ada's influence over early programming might have snowballed, such that software development would have been sex-biased towards women from the start. As it is, the ecosystem currently sex-biased towards men was created mostly by men, simply as a matter of feedback. In order to make the existing ecosystem less intrinsically biased in the future, it needs to be shaped by a less-unbalanced group now.

So the natural biological differences are irrelevant. A fair system would have caused those differences to cancel out or complement each other through equal participation. To make the unfair system more fair, you have to force it, against its natural flow toward unfairness.
Social constructivists and progressive supremacists are the only ones angry about what he said -- he exposes their narrative as fraudulently based on moral principles.
Checking my Laptop's network usage, over the last 30 days, Chrome has downloaded 88 GB of data.

To be fair, I stream movies using the Netflix website, 3 movies, so approximately 18GB to video.

The rest? Who knows. Youtube is certainly part of it, though I rarely watch videos full screen so whatever 480p takes up.

Then there are mobile apps like Snapchat which, for heavy users, can eat up an easy 5GB or more per month.

I had the Chrome bandwidth monitor open while researching that number. The 3 or 4 articles I read to figure out the average Snapchat data use ended up themselves using 36MB of data! (and this is with an ad blocker running...)

Figure it took me 3 minutes (not really) to do the research. that is 12MB per minute of data consumption just browsing the internet for references!

My overall point here is that data usage has exploded, and not just for consumption of streaming media.
Does that double life expectancy take into account infant mortality rates? It's not like people living into their 70s was that unheard of back then, it's just that it was easier to die younger.

And yeah, I'm living through it, but it still feels largely like the world I was born into with some additional advances in computing. A huge part of the world is based on incremental improvements on stuff that has existed since the earlier 20th century.
Coincidentally, in looking for Christmas movies for the holidays, I stumbled across "Rare Exports: A Christmas Tale[1]". I won't go into spoilers, but a) it was an unexpectedly smart horror film , and b) seemed to be rooted in actual mythology. Of course, as I knew nothing of the Saami people of Lapland, I started delving into them, their associations with Santa and Christmas, etc., and learned that they've been treated with a great deal of disrespect[2], which actually help to put some parts of the movie in context.

Particularly disturbing to me was this passage in the Wiki:

The genetic makeup of Sami people has been extensively studied for as
long as such research has been in existence. Ethnographic photography
of the Sami began with the invention of the camera in the 19th century.[137]
This continued on into the 1920s and 1930s, when Sami were photographed
naked and anatomically measured by scientists, with the help of the
local police—sometimes at gunpoint—to collect data that would justify
their own racial theories.

[1] - http://www.imdb.com/title/tt1401143/?ref_=fn_al_tt_1

[2] - https://en.wikipedia.org/wiki/Sami_people#Discrimination_aga...
> figure out what extensions are needed to write practical programs in it, at first in an ad-hoc way, then figure out a way to make that extension in a sound, compatible way, then finally form a new clean formal language that accommodates these extensions.

This is not possible, and the history of Haskell, Scala, and to a lesser extent OCaml, is precisely the evidence for it.

> Not my experience. I've found HKT and dependent types extremely useful in practice;

In practice, most uses of HKTs or even term-level HOFs are just bad workarounds for

(0) The lack of a proper hierarchical module system, allowing type components to be shared by fibration.

(1) The lack of properly designed data structure libraries with decoupled concerns. For example, you need traversals and folds to manipulate sets and maps, but you don't need them to manipulate search trees (i.e., trees that allow you to do binary search, rather than ADTs that might use binary search under the covers).

> they give me a simple way to directly encode the business properties I care about verifying.

Do you actually verify them? How exactly do you verify Scala programs in the absence of a formal semantics for Scala?

> Not at all convinced that e.g. Idris-style totality is "unacceptable". What's the problem with it?

“There is no largest class of recognizably terminating programs.”

https://mail.haskell.org/pipermail/haskell-cafe/2003-May/004...

> Certainly my practical Scala experience is that it's good for everything.

One thing that I find useful, due to my current job, is numerical linear algebra without array bounds checks at runtime. Have fun doing this in Scala.
Accept the system -> abuse the system.
I'm not sure they've recognized anything. They go through this consolidate-branch cycle pretty regularly with so many of their products.
> When the majority of people coming to your defense are right wing extremists[0][1] and neo-nazis you are doing something wrong.

When the majority of people are too afraid to come to someone's defense (publicly) because they're afraid that the internet pitchfork mobs will come and destroy their lives too, a large part of society is doing something wrong.

And that large part of society that attempts to do the silencing/shaming/smearing/destroying of the opposition might think they're scoring a victory for their cause (whether or not that cause is worthy is beside the point), but that's not necessarily true, and we saw proof of that in the last US election.
I am terrified about giving smartphones to my kids.

France's new rule (no smartphones in schools - no exceptions) is genius, and I applaud them for that.

What is a supercomputer in your pocket, with access to a significant portion of the sum total of human knowledge, good for, for most people?

Playing fucking candy crush.

We wish that we, humans, were better, but we are not.

So what can we do about it? I have no idea. The economic model already exists for games and facebook, and so on. And people have since the beginning of time been amused by trivial entertainment.

I guess the fact of the matter, or one way of looking at it is, there will always be people who choose trivial entertainment, and there will always be folks who chase knowledge and self improvement. And now, like always, we can do both of those things. But at least now, we can quantify ourselves better, and know more about the benefits and risks. And in that way, maybe more of us will choose to improve ourselves with these amazing tools.
Likely not. I have an old silver shuffle (the tiny USB pen size). Didn't use it much, tried to fire it back up and the battery is toast on it.

Most electronics will have toasted batteries over time. Devices without easily replaceable batteries will have a harder re-surgence, even if they deserve one.
That's not saying that the Word is a function in the programming sense. It's saying that, if you're doing static analysis of a program, there is a mathematical function that models the Word's behavior. In particular, it's doing the 'standard' trick where any computer program can be modeled as a function whose input is the entire computer (and possibly outside resources like the network), and whose output is that computer updated with any state changes that might have occurred.

But that function that describes the word's behavior on the computer isn't the same as the word itself. The word's input is the few words under it on the stack, and its input is something that goes on the stack. The function's input is the entire stack, and its input gets fed into the next function.

You're correct that you could right an implementation that reifies this concept, if you're so inclined. But that's still not the same thing. The 'function' is still on the meta-language level, not the language level where the word is.
The thing is batteries don’t need to have even close to the energy density of gasoline in order to be competitive. As long as cars keep being terrible at actually making use of the energy density of gasoline, batteries won’t need to keep up.

However, energy density is a legitimate complain about batteries, but it’s unreasonable to compare to gasoline.
(and double the price)
You can run a headless Linux distro (although that's not exactly turnkey, I know). If you're already running linux, you can hit something like ctrl+alt+F3 to get a commandline only UI: https://en.wikipedia.org/wiki/Getty_(Unix)

Note for anyone who tries this out - to get back to your main session, try ctrl+alt+F1 or ctrl+alt+F2
Color me not surprised. Institutionally we are casually practicing in discriminatory actions against white men with a rebuttal that 'because you're a white man you have certain privilege' - which conveniently ignores that nobody asks to be born into their body.

It's unfortunate because that is largely not the intention of programs which seek to ensure that women and men of color (I don't include white women because they are largely not 'diverse') have equal opportunity to work and make a living. Instead, these programs have been hijacked by, for lack of a better term, lunatics to push their political agenda instead of genuinely trying to make sure that we find ways to minimize institutional racism and sexism. Have 'white men' abused positions of power to push political agendas? Of course, and we need to call them out on that and drag them out of their offices. But that doesn't excuse other people from performing this same kind of institutional hijacking.

At my organization (Fortune 50) we don't have quotas for women or minorities, but they are definitely metrics that are tracked and optimized for at the highest levels. We attend more women and minority events than others, at least from my vantage point within the organization that performs this work. Largely I don't think we practice discriminatory hiring practices or anything, but the elephant in the room for me is are we hiring under qualified candidates to fill a position that somebody else can do, just because we want to be 'more diverse'? Typically we have to train people once they start the job (which is something I actually advocate for so I don't mind) but if you look at our hiring criteria and who we bring in - they don't line up.

Hopefully we can soon get over this uniquely American mass hysteria about race and just chill the fuck out soon. I'm so sick of it. I couldn't care less about what's between your legs or what color your skin is if you're just a nice person that can do whatever work we're hiring for. Why is that so difficult?
It's really sad that we have people still arguing about the intent of his memo when his actions afterwards make it quite clear what his stance actually was.

And to make sure that people know: He's a liar. Even if you ignore him intentionally misrepresenting his PhD status, he boldly lied about his FIDE chess master status.
I don't give a shit what you believe if your entire platform is built upon "White people are discriminated against and jews are bad".

EDIT - Ah, Trump supporter, that explains it.
Has what worked in the past? Admitting you were wrong and apologizing? Sure it's a good way of resolving conflicts if you were actually wrong. People grow and change throughout life, I don't think that being a knucklehead in the past necessarily means you're a knucklehead now.
Excellent summary.
it is not about who is the greater engineer. it's a fact that women on average prefer to go more to fields other than engeneering.

Some state that this a culture problem and that there is a hidden bias.

Some also state that women might go to other fields because they have a greater capacity at empathy. which is a proven fact. women that go and study those fields won't apply to cs positions they will apply to positions in their fields.

and by the way there was a study that indicated that women get short-listed less in sex-blind hiring

"The trial found assigning a male name to a candidate made them 3.2 per cent less likely to get a job interview."

"Adding a woman's name to a CV made the candidate 2.9 per cent more likely to get a foot in the door."

http://www.abc.net.au/news/2017-06-30/bilnd-recruitment-tria...

this is getting downvoted with no replies if someone has a porblem with what I said, I'm happy to debate.
It is too expensive since there is already a working method developed by Dr Dale Bredesen. In a first trial with 10 patients he cured 9. His method is not a magic pill but is based on doing everything possible to reduce inflammation and optimises 36 parameters.
Two things:

1. Saying that women are "on average" worse programmers is exactly why people are upset with him. He doesn't need to be some kind of insane absolutist in order for what he said to be very problematic.

2. Even if there are statistically significant sex differences with regard to programming ability and inclination, there are also historical and sociological factors that are working against women in tech. Damore's memo was explicitly a negative reaction against some of the programs designed to counteract these systemic issues. As such, even if he were 100% right about the sexual dimorphism (which he isn't, see my other post in this thread), using that as an argument against trying to solve the sociological problems is not only logically unsound, but exhibits bad faith and bad motivations.
The easiest way: first, install rust and cargo, either through your distribution, or thorough rustup if your distribution doesn't have it yet. Then run "cargo install -f ripgrep". It'll download the source code, build, and install to ~/.cargo/bin, which rustup adds to $PATH for you by default.

Edit: the "-f" in the "cargo install" command is for updating; without the -f, it refuses to install over an already installed version. The first time you install, you can omit the -f.
> I am glad that his life is ruined

There’s nothing toxic about that!

As for whether or not he knew what he was doing...he may have written this thing, but he did so in an area that was designated for that sort of thing. He wasn’t the one that started emailing it to the entire company. So it’s fair to say he thought he was just having a discussion in the topic with whatever this skeptic group at Google was, and other people decided to turn it into a national political issue to get him fired for it.
The fact you'd like a gay liberal as right-wing is disconcerting but I agree, and independently, came to the same conclusion that is is strange how many shows he popped up on so fast.
No, there is a longer story ... which I'll go ahead and tell since it's a perfect example of correlation vs. causation.

I remember to take my fish oil more regularly when I'm taking a prescribed medicine. At one point I switched brands, but also hadn't been taking it regularly.

I started a new prescription and had stomach discomfort. I attributed it to the new med. So I stopped taking the new med, and it got better--- but that also meant I wasn't taking the fish oil regularly.

Eventually I got regular about taking the fish oil again without the prescription med and went ... wait! I'm having that symptom that prescription made gave me!

Correlation is not causation!
Or maybe the "left-wing" like tech crunch just flat out lie about him repeatedly. I don't appreciate any the right wing youtubers you cite, but judging by the quality of this article, I'm glad he had other opportunities to speak. In this instance I do think the left wing is stifling expression and I can't abide by that, if you think I'm exaggerating, read the memo he didn't publish but request internal criticism of, and he was fired for it by google.
Why is it that one side gets to make claims accepted blindly as fact unquestionably (unequal representation of women is solely because of sexism) and the other side must be objective / scientific?
Sorry, I was only responding to the immediate comment about apples and bananas.
He got crucified because he didn't make anybody laugh -- now he will be paraded around as a poster boy for the alt-right or w/e. Aren't autistic traits highly prelevant in programmers? Isn't it also true that those traits will show up much more often in men compared to women -- a token factoid curtesy of wikipedia. Also anecdotally, how many male devs do I know that started hacking at 13 -- a lot. How many women? Personally none, but I know colah from Google Brain is one example, and a rather extreme data point too -- at the extreme end of the scale it's irrelevant anyways, a successful female comp sci prof or a female researcher will be picked. Unless there is some extremely good reason like Google drained all the capable men already out of the ecosystem there doesn't seem to be rational reason to explicitly optimize their hiring pipeline for the wrong demographic -- maybe they don't optimize it like that, but a lot of people have the perception that they do which will get you the same result in the end.

Update: one moment this gets up voted and the next moment it gets down voted and this repeats, is anybody willing to actually argue? Call my bs, I have thick skin.
> most electricity still comes from coal

Highly dependent on location. At the end of 2016, CA was is less than 5% usage and 0.2% production of coal powered electricity. Many other places are following as well.
This is a minor aside, but I don't think Joe is a conservative. I think that he said during the midnight election comedy stream that had he not promised to vote for Gary Johnson when he came on the show, that he would've had to pull the lever for Hillary. He doesn't like social justice stuff, but other than that, he's kind of a big hippy.
The first sentence doesn't mention engineering.

How many people with top engineering skills do you think flip patties at McDonalds? Probably not many. Does that mean they're worse at flipping patties? No, it means they want to work elsewhere.
Hundreds arrested as ‘Sexy girl’ bots invade Chinese dating apps
Never knew joe organ was right wing. I've been listening to his podcasts which seem pretty good.
Locally developing K8S services without waiting for a deploy
So you're saying it's impossible to be analytically intelligent but politically inept?
You may enjoy Dr Rhonda Patrick's podcast as well.

https://www.youtube.com/user/FoundMyFitness/
Companies can simply have a straight-edged policy of no politics -- from religion to economics, it's all off-topic and out-of-bounds.
> proposing that women are on average less biologically capable of programming is exactly what he's saying.

No, he's saying that they also might be less interested, for biological reasons. I recommend actually reading the memo (https://assets.documentcloud.org/documents/3914586/Googles-I...): "Women generally also have a stronger interest in people rather than things, relative to men."
>The solution is to stop allowance of condo conversions or TIC (Tenancy In Common) conversions,” she said.

You can always trust them to keep digging.
> ...these support extended Latin, Greek, Cyrillic and Hebrew

I'd love to read about who and why chose this wonderfully useless list of languages.