skysight-inc/HackerNews huggingface dataset:
In this case it could use the Linux crypto API, which already has ZSTD support and provides compress/decompress functions. But that is exported as GPLv2 so ZFS needs to do its own thing. And idk if the API is sufficient w.r.t. to e.g. workspace management/reuse.

W.r.t. to ZSTD: The usual thing is to provide a zlib compatible API, which ZSTD does ( https://github.com/facebook/zstd/tree/dev/zlibWrapper ). But the ZSTD zlib compatibility layer causes lower performance, so it is better to use it directly. Maybe all future compression algorithms can provide a ZSTD compatible API, so we have to do less work in the future?
I am curious, given the international nature of Facebook which makes it hard to rely on country authorities to settle content moderation disputes: what would be a better alternative? (Disclaimer: I work at FB)
Sorry, I'm using the modern meaning of green threads [0], which is simply threads scheduled in userspace.

The first green threads implementation, which was of course Java 1.0, was certainly M:1 - my memory is that we didn't even have pthreads in linux at the time - but the term today doesn't specifically mean a M:1 mapping.

On the other hand, of course JVM1.0 invented "green threads" which was M:1. So yeah this is confusing and I made it more confusing. Sorry. :)

So the point I was trying to make is that Java originally scheduled threads in userspace, then delegated scheduling to the OS, and has now taken it back. In hindsight it seems that delegating this key function to the OS has caused a lot of pain, and I'm interested in the drivers for using OS threads instead of just making the original green thread implementation better.

To be even clearer, I see this a lot in software. We delegate some key function of a product (like database access) to some inefficient and complex machinery (like an ORM) and then spend years working around the problems that decision caused. I've done this myself. I'd like to understand how to stop doing it.

[0] https://en.wikipedia.org/wiki/Green_threads
Wow, this is beautiful! Thanks for sharing.

Btw I love that Ruby methods return a value, so method chaining works so good. That‘s something I appreciate in Mathematica‘s postfix notation (for instance `x // Sin`), and also what I love in R‘s pipe operator, Unix‘s pipe. So many other languages like Elixir offer it. Unfortunately this does not work out-of-the box in my beloved Python.
Entropy and the NetBSD Kernel
So the court orders you to close your operations and on top of that you have to pay for it? liberte egalite fraternite much.
Groped, Scared, Disgusted: Stories of Dealing with Chikan in Japan
With the wealth of knowledge available, and the slow improvement of online learning, I hope we stop treating college as the place to discover things and improve our knowledge. It’s sometimes an okay way to do it, but is generally one of the least efficient ways in the modern world.

With a basic foundation in a topic, Wikipedia and open journals are much more valuable learning places than a lecture hall or study group. Those basic foundations should be built much earlier in primary education.
Ah, yeah that adds information (not in the article) to this case. But note that I have downvotes on my comment. I'm not surprised. I think I'm being respectful here, but people take as a personal attack when the choice to have biological children is in any way questioned.

So this woman did not have that information available to her at the time. Like I said I know people that did.
Hackers-: Give Us $42m or Show Your 'Dirty Laundry' on Trump
Particular.net release their Dist. Systems course free, it's normally expensive
LMAX also spent a ton of time doing non-standard things with data structures to optimize cache and prevent heap allocation: https://martinfowler.com/articles/lmax.html

Unnecessary allocations will be your bottle neck at some point when shutting data around.
I'm from Moscow and I have relatives in Crimea. I've visited them in 90s and then in 2000s. Most of Crimea citizens are 'soviet' pro-russian people. They are happy to get russian pension and all that infrastructure porjects money cause Russia is a really rich country compared to Ukraine.
Have a Good Trip is a gateway drug to de-stigmatizing psychedelics
Both are problems. Our brains have a tremendous amount of compute and use complex, nuanced, adaptive strategies.

The clearest example is how much energy we spend modelling other humans' thought processes. We spend so much because a simple permutation of tit-for-tat isn't sufficient - it will lose. It's an arms race to use complex strategies, an outcome which is specifically precluded in the model. I'd argue the fact observable reality is so divergent from the model means we should be skeptical of the applicability of the model.
No, you'd have to be earning an enormous amount to pay 50% tax in the UK. If you earn e.g. £150k, you get to keep £90k. Only £7000 of the money withheld is NI, so NI doesn't make that huge of a difference. Council tax isn't going to cost you £15,000 a year [1], so you're pretty clearly keeping more than 50%.

[1] If you're paying £15,000 a year in council tax, you must have some kind of gigantic property whose maintenance costs would dwarf that figure anyway.
Thanks for pointing to that gem (got bored after the 2nd paragraph or so...)! I hope whoever will do the inevitable remake in 2032 will read it, too :)
Liberty, equality and fraternity yes. For humans, for their safety. Who the fuck cares about Amazon's margins?
I don't like blogs. People should have websites not ordered by publication date. I want to see the personal website brought back.
> “We've known this person so long we know he'll do a proper job."

> The delivery schedule also has built-in buffers. If a delivery is due at 13:00, the dabbawala will aim for around 12:00 [...] For every 15 to 20 dabbawalas there is also always someone on stand-by in case one of them gets delayed.

> At 12:45 a dabbawala races around the corner on a bike and rushes shouting into an office building. [...] The dabbawala was late by his own standards but the customer was probably never aware of the hiccup, he says.

> A dabbawalas’ commitment to the job is partly because it pays well – roughly 12,000 rupees (£140) a month, a good salary in India for what is essentially unskilled labour. The fame of the dabbawalas also gives the job a certain prestige.

> And as a cooperative all dabbawalas are equal partners with supervisors called mukadams who are elected.

It seems like there's no major secret here. The key to achieving such things is... surprise surprise... treating your workers fairly and paying them well so they actually give a shit about their job, and feel appreciated and proud of what they do. The same would actually translate to many other industries.

The food delivery startups could achieve the same if they paid their delivery drivers fairly (at the moment most don't even make minimum wage - compared to the dabbawalas’ "good salary") instead of pissing away their money into marketing/advertising or into someone's pocket, whether greedy investors or "engineers" to build a blockchain-based, Kubernetes-powered microservices playground.
To earn more, you have to become more. Increase your value and your service. Come in early and stay late. Never say no to an assignment. Don’t go to your boss with a problem unless you also have a suggested solution. Be pleasant to everyone and make connections with people inside and outside your office. When it comes time for your review, ask for the amount of raise you are worth and have a list of your accomplishments (and maybe their monetary benefit to the company to back it up). If that doesn’t get you the raise you deserve, start looking for a new job.
i totally agree with what you're saying but you should also know that redact doesnt fit in your sentence
I’m not saying this to be pedantic. And I’m not denying that there is some social expectations when living in society.

If you say that there is no obligations, but also that you should follow some social expectations, then you’re contradicting yourself. It’s just a nicer way to say that people should behave according to what you consider to be acceptable.

Btw, which society rules do you mean? Because you have a lot of differences in different places regarding politeness and other social obligations.
Around the same time they covered the wood floor with carpet and linoleum.
Bryan Caplan's 'Why I Am Not An Austrian Economist' is a pretty definitive take on the weaknesses of the school's main arguments (from someone based at the only faculty to seriously focus on Austrian Economics who is broadly sympathetic to the school politically and sceptical of much of mainstream economics).
http://econfaculty.gmu.edu/bcaplan/whyaust.htm

What happened in 1971 was that the remnant gold standard system embodied in Bretton Woods proved to be entirely inadequate to changing economic circumstances. Despite the Gold Standard's almost religious significance to certain economists of Austrian stripes, many of the other economic changes over the last half century were driven far more by abandonment of policies Austrian economists generally hate [large scale public investment projects, collective bargaining] and embrace of policies they love [deregulation, flattening of the tax system]. There's a reason that the incomes of the "1%" actually start growing rapidly again in the 1980s and not the 1970s, for example.

As for why the current set of broken companies should be bailed out, it's quite difficult to argue either ethically that businesses ought to bear the financial responsibility for being ordered to stop trading for health reasons, or in terms of economic substainability that the public will be better off starting everything from scratch if and when anyone feels like starting things like air transport again.
Common mistakes using Kubernetes
Interesting idea. Just looking at the landing page, I feel like you're describing a solution without making people feel the pain of the problem.

Why would a company pay you for this? What's in it for them? Once you get good at explaining that you can show how GreenWise is the solution to the problem.
You are largely correct about the "reversion" to userspace threading, but the decisions (some of them were forced moves) weren't because of fashions but very different circumstances. You could point out that it is interesting that different circumstances have led to userspace threads.

I don't know all the reasons behind abandoning green threads, but some are mentioned here: https://docs.oracle.com/cd/E19455-01/806-3461/6jck06gqe/inde... namely, no multi-core and bad FFI ("interoperate with existing MT applications"). Plus, a little later, the transition to HotSpot left little desire to reimplement userspace threading. There was no pressing need, there was other, higher-priority work needed, and FFI was still an impediment. In other words, making green threads better was neither an important requirement nor a reasonable possibility back then.

Why have we "gone back"? 1. the scale of concurrency required today is higher and resulted in the scaffolding I mention in the article, 2. FFI is no longer an impediment as Java code rarely relies on native code these days.

Nevertheless, Project Loom doesn't switch from kernel to userspace threads, but rather lets you choose which implementation you want for each thread.
Go’s mission statement isn’t to be faster than Java or to replace java. Its to (1) compile faster (2) compile into single binaries with no dynamic links (3) natively support concurrency and parallelism with M:N routines:threads.

Go will never replace Java for Android because (1) it doesn’t use a VM, so it would need to compile for every arch that android runs on (2) it would require a bug-compatible port of Android. Because Kotlin runs on the JVM and can run on top of Java codebases, it doesn’t have to leap over these hurdles.

There are other reasons you can come up with I’m sure, but those are the biggest that stick out to me. Notably it has nothing to do with “which language is better”.

They optimize for different use cases, and that’s OK. That being said, if you were writing Android from scratch and were only targeting ARM (an equally silly comparison meant to highlight the differences in the languages), you’d be hard pressed to justify Java over Go.
And the privacy policy page returns 404.
> this exact mistake

https://kafka-summit.org/sessions/source-truth-new-york-time...

Both your comment and the GP are using examples of failed startups as basis of your criticism. One mentions "50 engineers" and I'd bet not a single one had an "engineer" bone or training in their body. So I read that as 50 blog-driven programmers fail to execute a sophisticated system design they read about on some blog. Surprise?

Using Kafka as the distributed log of a deconstructed database is technically an order of magnitude more demanding than wiring MVC widgets, or using the latest paint by numbers framework, etc., because that is in fact developing a custom distributed database.

Technical leadership and experience are forgotten things but they do matter. Let's not blame the stack.
https://github.com/EnterpriseQualityCoding/FizzBuzzEnterpris...

FizzBuzz Enterprise Edition is a no-nonsense implementation of FizzBuzz made by serious businessmen for serious business purposes.
CoopCycle: Democratically governed federation for bike delivery
If you read my comment, I said "building the product".
I have recently analyzed Kafka as a message bus solution for our team. My take is that Kafka is a very mature and robust message system with clearly defined complexity and thus when used correctly, very dependable. The recent versions even have online rebalancing (but don't tell that to the Pulsar people). However "Kafka Streams" just make me shiver - I don't understand why someone would masquerade a project directly competing with other processing frameworks (e.g. Apache Flink or Spark) as being part of Kafka itself, when apart from utilizing Kafka's Producer and Consumer interfaces it really has nothing else in common with it. Streams is a giant, immature, complexity-hiding mess which as a responsible systems designer you have to run away from really, really fast.
I’m curious, what makes Kafka to be picked in the first place. Perhaps a vast majority of developers are growing up using Kafka for everything for their learning projects as it makes it convenient for rapid development?
Maybe they learn about it through blogs, video tutorials and so on, at the cost of other technologies?

For instance, my nephew was heaping praises on Firebase and would use it for all his projects. It took me a while to understand that the convenience of using it masked some of the issues that would only get exposed at scale.

For whatever reason a vast number of developers are entering the workforce believing in Kafka’s capability to solve all problems. And going against that majority will be very tiring and even costly.
Russian rapper who loved dollars arrested by FBI
Facebook needs to be regulated. They dont allow dissent or opinions that oppose their own. While controlling the vast majority of social media.
Free until may 15th, you posted this on may 17th.
As a holder of S&P 500, it won't look big. As a majority stakeholder in a company that is on the border, it will.
lz4 is performing pretty well. Better than most zstd-fast settings. It will not be obsolete after adding ZSTD and most likely stay the go-to algorithm if you are unsure what to choose.
Phil's a great aviation writer.

Beyond what he wrote, the regionals were created to union-bust, but the 1,500 hour rule has already closed most of them, giving captains even more power. :)
Can someone be so kind to explain how is the market worth of a company calculated? Is it based on (1) the number of users (2) how much capital gets invested in it with purchase of shares? ..?

I just find it hard to grasp the idea that an app can "be worth" more than 7 largest airlines combined; because I do not clearly understand how the worth is being calculated.
Once you start talking hundreds-to-thousands requests/second, 500ms is an incredibly long time and you're well past simple tweaks to GC. Tuning GC to a high degree is non-deterministic black magic, which is not what you're looking for at that point.

Simple tweaks can go a long way for a lot of developers, but GC performance has been a problem at the last 3 organizations I've been at - and I'm not in the valley or at a FAANG - so it isn't exactly an uncommon scenario for developers.
This seems kind of lightweight. There should surely be a web implementation that uses Docker, k8s, React, Typescript, Node, MongoDB, AWS, and GitHub, and still only works correctly in a specific version of IE8.
I did read the paper. It's vague, badly written and its main claim is not
supported by significant evidence, either theoretical or empirical.

First of all- what is the main claim of the paper? It's difficult to tell
because it's not stated clearly at any point. There are a number of sentences
in the paper that seem to be trying to claim something, but the author seems
to be unclear himself what that something ought to be.

For example, this sentence, in the abstract, seems to make a strong claim:

This article demonstrates that a natural language can serve as an artificial
language also, and that much work in AI has been reinventing a wheel
millenia old.

If this is indeed the paper's main claim, then it is not supported by the rest
of the paper. The paper starts with a description of one kind of semantic net
(similar, but not identical to, a semantic net scheme proposed by Rumelhart
and Norman as a model of human memory). It then describes a scheme for the
formal semantic analysis of Sanskrit first proposed by Panini and his
disciples in the first millenium B.C. The article then goes on to show a few
cases where the Paninian semantic analysis of Sanskrit and English sentences
coincides with the semantic analysis by the semantic net scheme chosen by the
author (i.e. they yield the same triplets). The author finds multiple
commonalities between the two kinds of analysis and concludes that they are
equivalent. The paper concludes with some musings about the accomplishments of
Indian linguists of Panini's line that he likens to "computer scientists
without the hardware". An interesting thought, to be sure.

However, a demonstration that a semantic analysis of a scant few sentences in
two natural languages by two different methods (semantic nets and Paninian
grammar) has similar results can not be accepted as proof that the two methods
are equivalent, which really seems as what the author is trying to claim. At
best it's evidence that there is an equivalence, but since this evidence
consists of just a few sentences, it is really weak evidence. There is
probably an infinite number of sentences that it is possible to construct in
English and in Sanskrit- and a possibly infinite number of semantic parses
based on the author's own chosen semantic net scheme, of each of those
sentences. There's nothing to say that if we kept analysing English and
Sanskrit sentences in the way the author shows, we would keep getting the same
results he obtained.

So to recap, the paper has a very vague main claim that is very loosely
supported empirically by some examples that we have no way to know are
representative. Like I say in another comment, I really can't understand how
this passed peer review in AAAI. There is no chance that this would ever be
published in AAAI today.
It's not likely your product will have enough financial success to afford the huge amount of engineering effort facebook has put into improving their platform. If your system falls apart before you are making enough off of it to fix it you're going to just run out of runway.
"Toxic business model" - oh yeah?

Like the same one that pays the bills for theguardian.com?

(I just disabled my ad-block and saw scammy+nasty "feet" ads of some sort, pretty sure those would not be allowed on FB.com)

(edit: fixed The Guardian link)
> start looking for a new job

But that's part of the problem, I have started looking and I can't find anything better in the french market (besides having to move to Paris). It seems that every company I go to looks at a grid of diplomas and experience and gives me very similar numbers.
The module system in Node.js (not ES6 modules) makes it super easy to use modules because a module is bound to a variable and you can require the module from anywhere and it will be scoped to the function. It's like if all code in the global JavaScript collective is available in global scope.
I've maintained a blog regularly for two decades without worrying about promotion, or whether anyone would read it. I knew that some of my friends and students would read it, but that was about it.

I still treat it as a way for me to gather my personal/professional thoughts or provide a summary of a topic or technology that others may find useful. And no, I don't give a rat's ass whether it's politically correct.

But over the past 2 decades, I've received hundreds of emails from people who came across it from all around the world. And some of my blogs have even been posted here on Hacker News. It's http://jasoneckert.net (which forwards to a longer URL that is secured) in case you are interested.
It might sound kind of trite, but it has less to do with the replication algorithm and more to do with the fact that Zookeeper’s source is quite complicated vs, say etcd, so there are more opportunities for subtle bugs to appear. I encourage you to look at the bug section of the change log for zookeeper, and also the feature list of ZK vs etcd.

Also, etcd powers many critical open source projects, so there are many institutional eyes that actively contribute to its improvement. IME if we ever encountered an issue at work with ZK, we found it impossible to trace it down to a bug that we could fix and upstream. Etcd’s been easier in this regard.
Tink – Cryptographic APIs that are secure, easy to use correctly
Who has read through all the code of their direct dependencies, let alone transitive ones?
Screenshot evidence https://ibb.co/VV0TmyY
You might be correct - it may be only my ignorant experience interacting with Apache Big Data technologies of present day and wondering what the hell they are doing under the hood to take them so long to process simple stuff in bulk.

Perhaps open source engineers are not "paid" enough to spend countless hours carefully optimizing their programs on JVM. Properly paid engineers working on proprietary technology can surely bend and twist JVM and make it perform. It might be possible, but costly due to complexity and unpredictable nature of it.

It reminds me of world of SQL where you have to run your query with many small modifications and hope that the optimizer will generate a sensible query plan while the query is still readable. That's the cost of building on top unpredictable systems. You wonder why you can't simply get access to the lower level - physical plans - and program on that level directly, since you know what your desired outcome on that level is anyway.

I still wonder why new projects for performant data processing are not written for example in Rust since for this task it has all the upsides and none of the downsides of JVM.