skysight-inc/HackerNews huggingface dataset:
Author here.

About a month ago, I posted about using SIMD instructions to make aggregation calculations faster. I am very thankful for the feedback so far, this post is the result of the comments we received last time.

Many comments suggested that we implement compensated summation (aka Kahan) as the naive method could produce inaccurate and unreliable results. This is why we spent some time integrating kahan and Neumaier summation algorithms. This post summarises a few things we learned along this journey.

We thought Kahan would badly affect the performance since it uses 4x as many operations as the naive approach. However, some comments also suggested we could use prefetch and co-routines to pull the data from RAM to cache in parallel with other CPU instructions. We got phenomenal results thanks to these suggestions, with Kahan sums nearly as fast as the naive approach.

A lot of you also asked if we could compare this with Clickhouse. As they implement Kahan summation, we ran a quick comparison. Here's what we got for summing 1bn doubles with nulls with Kahan algo. The details of how this was done are in the post.

QuestDB: 68ms Clickhouse: 139ms

Thanks for all the feedback so far and keep it going so we can continue to improve.
Vlad
> The food pyramid we all know and love is a product of over two centuries of industrial agriculture.

And fittingly, was provided to us by the Department of Agriculture, not the Department of Health as one might expect.
Would the same happen if Theil owned Twitter, and fact checked, etc. Joe Biden? IMO we would see the opposite, and liberal politicians calling for Twitter to be taken down. One person's soap box is another's tabloid.
The post discusses the optimization of bin2c (https://github.com/adobe/bin2c/) – a tool to embed binary files in C or C++ applications that reduces compilation times up to thirty times!
130F for 15min might not be fatal ... better bet: How many suspects get baked silly before a dog gets cooked and the patch gets reverted?

Seriously tho: cool hack. use of resources at hand for immediate unanticipated need.
> Is it a known fact that AT&T is in bed with the NSA, or just a coincidence

It's complicated.

Telcos that operate in the US are required to follow US laws and court orders and there are laws and orders that require them to submit data to the gov.

But they also don't seem to be trying to fight it: https://www.wired.com/2013/09/telcos-metada-orders/

I'd imagine if they fought it, a new law would magically appear in the books so it's hard to tell if they are being practical by not pursuing legal action that is bound to be overruled or just plain evil (the truth probably lies in the middle)
You point is that this is simple, yet Microsoft with Thousands of engineers working over the span of decades never internally developed this idea or framework except after picking the brain of this particular person and doing a copy of that particular competing project.

Paintings are just paint on a canvas, and all code is just clicks on a keyboard. That doesn’t make it any less immoral to blatantly copy without recognition.

It’s perfectly fine to carry out a fork, the irony here is that Microsoft likely tried you play this angle of “we’re just competing, not copying you” because they thought carrying out a fork with attribution would blow up in their face, which this now has.
I am not sure why you mentioned passwords. Collision attacks do not affect the use of hash functions for password hashing.
Just pair them with cookie notices for extra effectiveness!
In regards to search interest, I have a feeling that specific distributions (specifically "Ubuntu") have replaced the use of "Linux" in Google searches.
So, the people indiscriminately mass-spraying a dangerous chemical that they don't even understand into the environment? I'm not sure I'd go as far as to call that terrorism, but I see why other people would. They do seem to be convinced that the ends justify the means, and care little for collateral damage.
"Common side effects may include vomiting, headache, changes in vision, and muscle weakness. Severe side effects may include allergic reactions, vision problems, and heart problems."

Sure, these side effects may be uncommon, but they're a hell of a lot more common than they are if you don't take hydroxychloroquine.

Incidentally, it's an open secret that a lot of the popular NSAIDs wouldn't be OTC if they were discovered today. Specifically because NSAIDs aren't just "safe", over the counter dosages are quite low--low enough that they're ineffective in many cases, which is why the same NSAIDs are prescribed at orders of magnitude higher doses.

There's historical precedent for "safe" drugs being problematic during a pandemic: aspirin poisoning was a significant cause of death during the 1918 Spanish flu epidemic.
Are you saying that open criminality is better than hiding crimes?
Can you distract people by asking this?
Got to keep this discussion in context. Google has no need of hotshot contract programmers. That company already has 50000+ crackerjack programmers and they decline to hire 99% of the candidates who want to join them. In the context of this article, the contractors are people who would not be qualified for full-time engineering jobs at that company. They are performing peripheral business functions or grinding on manual tasks like content moderation.
That's good to know, I had been trying to figure that out but the doc pages I landed on didn't really make it clear when I was looking at it.
Right up there with emails from software companies with “our response to Covid-19.”

You are a software company. Unless the server has the virus, I really don’t care.
Exactly because they have effects that sound different and are instances of the same general principle.

Edit: The idea is not to stop there. You also have the minor 7th chord being dual to the major 7th chord (with the octave added implicitly). Those two chords are often used together in jazz music. In this case the interval you use to get the upper note is a 4th. And depending on which interval you are focusing on, and what kind of scale you use (if not chromatic) this simple concept can get much more interesting.

I agree that playing for example C E G and then C Eb G sounds like a "change", but I don't think the theory gives you complementary chords in sequence. They connect ideas with each other. In that sense it makes sense for a major chord to be dual to a minor chord.
>Maybe I missed something, but the boot partition can and should be encrypted as well (depending on the threat level I suppose).

It should be authenticated. You can sorta get there with encrypting boot and keep a boot loader off the main computer, if you don't have secure boot. But the better option is to always setup secure boot and sign all entires.

Using a unified kernel image you would end up protecting the initramfs, microcode and the kernel with secure boot.

https://wiki.archlinux.org/index.php/Systemd-boot#Preparing_...
This is a particularly entertaining article.

On one hand, capitalistic systems are clearly optimizing for peak efficiency during global instability which is reassuring in some minor or maybe not so minor way.

On the other, just be nice and give your employees some extra official time off because they're obviously not working as much. Life is slowly returning to normal, but it's still wacked out and stressful - just be nice. Giving kindness when it's needed most pays long-term dividends.
It matters here because he is using ln, and we don't know if we should stop at the first right parenthesis or the second.

The word you are looking for is associative.
Just as a curiosity, humans kill hundreds of trillions of insects annually.

[1] https://www.quora.com/How-many-insects-die-from-people-stepp...
> Comedians are not the fucking president.

She later clarified it wasn't a joke.
What's the benefit of this over class syntax? If we had decorators in the language already we could make field reactive:

class Component extends React.Component {
@state show;

render() {
return
<div>
<button onClick={() => this.show = !this.show}>Show Menu</button>
// Mounted with show = true and unomunted with show = false
{this.show && <MenuDropdown />}
</div>
}
}

Hiding the underlying stateful objects that back React components seems like it causes more confusion and complicated APIs than it's worth. Likewise closures returning closures and state defined with function calls seems like re-inventing classes.

Just make the component itself stateful and the lifecycle explicit and it's all so much simpler. Then attack the problem of composing JS classes from pieces with tools available to all JS classes, not just the framework at hand.
The New York Times appears to me and many others misguided on the issue of race.

The 1776 Wikipedia page does not appear to be slated for deletion, I'm not sure what you're talking about there.
Property damage is absolutely a violation of people's rights, which is why property was added to the constitution. Outrage does not negate a business owners rights.
Cloud computing makes this true for everybody else too now, at least within a practical range. Now I can easily afford a multi-million dollar distributed compute facility... for a few hours, rented from Amazon.

I'd be surprised if the NSA has a clear purpose for bulk colliding SHA-1. It's a pretty niche thing to want to do even compared to say, "cracking" DES. For MD5 we know such government agencies made some collisions to exploit various technologies that didn't stop trusting MD5 in a timely fashion, but it wasn't something they did a lot just one collision here or there as necessary. e.g. https://en.wikipedia.org/wiki/Flame_(malware)
> I've discussed some of this stuff with him: in his eyes, Obama did stuff he shouldn't have, so Trump can do stuff he shouldn't.

This is a terrible line of thinking. I'm no Trump fan, but there's a ton of things neither Trump nor Obama should have done as president, and excusing one with the actions of another doesn't make a bad act good.
World's Oldest Companies
I don’t believe the Democratic Party has ever advocated that states should have no rights, so I don’t see how your argument makes any sense. Of course in a specific instance they could advocate for states rights.

It is also perfectly fair on the Republican side.
https://www.nakedcapitalism.com/

For news and daily events 2x a day
Right, I understand we are parallelizing the addition operations and the performance gain is due to adding chunks of the numbers in parallel.

What I am saying is the total number of carry operations is conserved, even though they are delayed.
Publishing rights for a lot of the classic MicroProse games seem to currently be held by Retroism: https://retroism.com/

This includes the original MicroProse Mighty 8th (https://retroism.com/b-17-flying-fortress-the-mighty-8th/), along with the Silent Service games, F-117A and F-19, the original Sid Meier's Colonization and a bunch of others. Though there are some notable MicroProse titles missing from their catalog: M1 Tank Platoon, the original Gunship and Gunship 2000, and F-15 Strike Eagle III all jump out at me.
The anti-fat push in the last few decades was the result of the sugar lobby actively pushing pseudoscience to argue that fats were responsible for the rising rates of heart disease rather than sugar[1]. This is somewhat reminiscent of the "science" funded by the tobacco lobby.

Ironically, margarine was arguably worse for your health than butter because it contained transfats (a side effect of the hydrogenation process on oil) which are now known to definitely cause heart disease[2]. In fact the link is so clear that a 2006 review flatly stated that "on a per-calorie basis, trans fats appear to increase the risk of [coronary heart disease] more than any other micronutrient"[3].

[1]: https://www.npr.org/sections/thetwo-way/2016/09/13/493739074...
[2]: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3955571/
[3]: https://www.nejm.org/doi/full/10.1056/NEJMra054035
Not me, I like both modes. Often I will have one text editor in dark mode and another in light mode.
I will definitely take this into account sir :)
Funny that the first post sticks out from the rest (a digital project vs. the physical ones). Notably it's more 3x3 a lot of the time. I wonder if the creator also felt like they had to make use of all the 3 pixels of horizontal space for some of these characters. The lowercase "l" is what I'd be using for a "1", with my lowercase "l" being 2 pixels wide, for instance.
Yes, the desktop client does not support it. If I want / need E2E I use my phone.
The positions in question here are basically lower-tier quasi-employees, who are contracted through an employment agency because Google doesn't want the liability of employing them directly. That liability is both legal and reputational, the latter because cutting contractors lets Google cut costs without worrying their FTEs. These contractors work full time for a single client (Google). They expect/hope to do so indefinitely, at least for a year or so, and in normal times they do.

I believe that UK-style contractors are closer to what I'd probably call a "consultant", specialists who get a much higher hourly rate than an FTE would but aren't sad or surprised when a contract ends. Those do exist in the USA, but that's quite different from the "contractors" here.
I really don't understand this argument of "they arrested a latino man, and white coworkers of the black man (last), so it can't have been racially motivated"
>Cannot be the right call.

To be clear, when I referred to making the "right call" I was referring to the choice of inaction from police and national guard units last night/this morning during ongoing protests. I think ultimately, this will lead to less damage.
You can kind of do this with the mini-media-player and Spotify card. I guess I need to do a write up on this. It doesn't work the greatest unless you have audio groups setup. You could define a scene with the speakers and playlist you want to play as well.
Safe enough, but why not use a modern hash function instead?
Hopefully they’ll just kick him and his acolytes off the platform. I’ve not met people so drunk on hero worship that they forgo facts and reason as I have when speaking with my trump supporting friends and family. And now he’s trying to sway elections by using misinformation? Openly using the pulpit of the highest office to spread patently false rumors? His fear mongering is harmful and has been violating Twitter’s terms for years but hey I guess it was good for business until recently... still good for them.
As a team lead of the Cadence/Temporal it is really amazing to hear such a feedback. Thank you!

BTW. You can AMA about the technology here.
Thank you for the suggestion, I love the idea of slower yet deeper news.
Your comment that I was replying to did not say "less than human." You said "less human."

Being treated as "extra disposable and second class" is being treated as less human than a FTE. It's up in the air whether that also means they were being treated as "less than human."
This is true, I agree. It was an observation that the people rioting and looting are choosing to put their lives into their own hands.
Yes, that is true. If you allow negative ingredients you can indeed reach all points in the characteristic state-space of baking, even when limited to picking from a huge set of proprietary Bisquicks. Which is a hopeful thought. I think.
I appreciate it. I'm honestly surprised its initial reception has been so unpopular, but I suspect people think I'm somehow advocating for censorship... I'm not at all, and think that's obvious, but c'est la vie.
I did the same, I just didn't feel like going back and rewriting all the templates.

Whoopse! forgot the link earlier https://github.com/jimktrains/bam I wish I had included an example in there though :(
Really like the look of the app although I can't use it since it's iOS only.

Actually, my wife and I need something like this - we work together, and it's hard to coordinate around periods where I am in programming flow.

If you are the developer of the app, congratulations on your launch! :)
Sorry. When I cut/paste the subtitle of the article on submission, I thought I grabbed the entire subtext. Not sure how that happened, but I've edited the title.
I have to agree. I still haven’t used hooks yet and I’m sure I’ll get used to them when I do, but by comparison to this article Svelte is a breath of fresh air. It’s simple, it works. A lot of people object to it because it’s very different to React, but judging by the diagrams in the mental models here I don’t think that’s any bad thing.

An aside, and I know complaints about hooks are very boring now, but I remember when React first arrived on the scene. The API was a delight. shouldComponentUpdate, willReceiveProps, etc. Everything was so clear from the first second you picked it up. Now? I’m less sure.
We value your privacy. Like, it's valuable. We sell it for money. We're going to nag you until you click this button so we can't get in trouble for profiting off the data you give us.

Good legislation is important to let us penalize bad actors—does any one know of any accounts of some bad actors getting stopped by the GDPR?

What do you guys think: are there laws that should be in place to incentivize privacy-preserving tools?
> A curated list of awesome pipeline toolkits

Is this "curated"? It seems like an exhaustive "dump" of toolkits.
Now the comment makes sense, appreciate it.
PSA that there was a sort of "email 2.0" spec called "Internet Mail 2000" (which gives you an idea of how long ago this was, heh) by djb, that would have partly eliminated all this crap. The idea is that you can pay the cost of read receipts (which are kind of a superset of what you are concerned about) to structurally disadvantage spamming so much (by forcing it to tether itself to DNS) that it ceases to be a viable marketing model; spam that is big enough to generate revenue is also either big enough to be caught or spread out enough among new domain registrations that the cost easily swallows the revenue. The struggle is that nobody likes read receipts, so one is stuck trying to define some sort of "halfway between" system to try and invalidate the read receipts, "sometimes you have to store the message until the person wants to read it, but sometimes Gmail will download it before the person reads it, so this signal is unreliable for whether it was actually read."
Right, am not saying that this isn't faster, I am saying you aren't reducing to total number of carries.
Because violence is one of the fundamental political and sociological forces in the world, and preventing people from talking about it in the abstract--as distinguished from targeted threats of violence to specific people--is completely off the reservation. As a Bangladeshi, I have a country because people like my uncle went to war and killed a bunch of Pakistanis. I bet Polish people are glad that Americans gunned down millions of Germans in the 1940s. Steven Spielberg's "Munich" was an amazing account of Operation Wrath of God--glorifying the assassination of terrorists that killed 11 members of Israel's 1972 Olympic team. Violence is often a proper subject of glorification.

In practice, I strongly suspect the Twitter isn't actually applying the policy as written. Instead, they're applying the policy selectively, based on ideological biases.
handshake failure is happening with certificates, I will look into the issue tomorrow, and we should be good :) thanks for trying.
Let's compare that to "when the looting starts the shooting begins".

Which is an observation, and which is a directive? I think that is the key question that Twitter is dodging. They want to editorialize with their opinion as to which is which, but not for everyone.
Just wanted to say how cool this was. It's been awhile since I've done any C/C++ programming but the pointer syntax and work really takes me back!
This is not a preimage attack.
Scaling Up Anime with Machine Learning and Smart Real Time Algorithms
Don't kill innocent people of any color. Punish police who do. Everyone can agree on that.

"Looting is a consequence" is a poor excuse, looting/arson is not the correct way to express anger, you harm people who have nothing do with the problem or solution. Stop excusing their behavior.
Do you have any examples of liberal politicians calling for social media platforms to be taken down for fact checking or enforcing their terms of service? Simply saying "in my opinion they'd do the same thing" is not convincing.
I'd call it a watermark too; "checkpoint" can mean an intermediate point in a multi-step database transaction.
The disturbing thing is compared to some of the alternatives which can stop breathing in some people that is safer.
ln(5) * 10 / 2 ~= 8.047

ln(5 * 10 / 2) ~= 3.219

So it does matter.
There is no objective "ethically correct" anything.

You'll say one thing is "ethically correct", and someone else will say the exact opposite thing is "ethically correct".

Neither of you is right, and neither of you is wrong.
I've always called them offsets.
Using MySQL with Deno
Some next-gen VR HMDs have started to integrate TrackIR technology.

The only major point where TrackIR shines is price. Other than that it doesn't compare well to VR. A flat screen, no matter how interactive, can't compare to a VR HMD for all encompassing immersion. TrackIR on its own is also limited entertainment wise. Its most common use case is for sims, while VR is more versatile.
The title of the new game is just The Mighty Eighth, no specific bomber mentioned. The real-world "Mighty Eighth," the Eighth Air Force (https://en.wikipedia.org/wiki/Eighth_Air_Force), operated both B-17s and B-24s.
Why K2? is there any relation between D3 and K2, or is that just something that you're taking?

Also, what dosage of D3 and K2 are you using for your kids?
I updated it and apologized for the error.
In other news, in an unfortunate training accident a low yield nuclear device was dropped on twitter HQ
Gab has been the theoretical right-wing Twitter for years. It wallows in mediocrity.

Trump and his cult are on twitter to try to bask in the legitimacy. If they're on their own, the raw charade of how childish and imbecilic their noise is becomes too obvious.

It's also a bit hilarious given that Gab, created because of crybabies like Trump and Scott Adams, has hilariously restrictive policies, just as The_Donald is one of the most snowflake-moderated subs on Reddit. The right really can't stand each other.
Why T.S. Eliot still matters
This whole blog post should just be added as an appendix to the Rustonomicon, in order to provide official documentation for the RUSTC_BOOTSTRAP=1 flag.
They are. Or do you want them dragged through the streets and hanged immediately?
>A plain reading of the quote does not direct anyone, to do, anything.

Ah yes, and his followers are widely known for their highly nuanced and level-headed understanding of things he says (and politics in general) /s.

>The questions are this: Who is right? Who decides that?

On whether egregiously advocating violence is ok? Really?
There but for the grace of Linus goes my compiler.
> You can find most these items for normal prices on amazon too so this seems a bit like making a story where there may not be one.

My understanding is that there are generally 2 reasons for "outrageous" prices (in normal times).

1. Some vendors specialize in being the seller of last resort. They price their products high and wait out the market until they're the only game in town. This definitely happens with books, although I'd hope that with the advent of ebooks, this will be less viable.

2. Algorithmic pricing gone wrong. Sometimes multiple companies will set their prices on each other's current prices, resulting in gradual price drift.
They say there are no stupid questions, so here is mine:

If there are Billions of parameters in the SOTA models, how do we argue that they are not over fitting?
UK-Based Digital Bank Revolut to Lay Off 60 Workers, Due to Covid-19