skysight-inc/HackerNews huggingface dataset:
Each word in this design is a little bloom filter. It has number of bits (m)=64; number of hashes (k)=5; and going for 1% false positive rate, which per formula (with n being number of items in the filter) in [1] is:

fpr = (1 - e ^ -(k * n)/m ) ^ k

OP solved for 1% and got n =~ 4.

There is exactly 1 hash function (to compute the 64 bit key). 5 bits are pseudo-randomly selected (giving us k=5) and written to an array element indexed off of the 64 bit key itself.

So sizing this [naively] is a matter of taking your n (say 4 million items) and dividing by 4 and getting a 1 million array of words.

What is not discussed in detail is block selection. Given the segmented nature of the array based data structure, distributing exactly 4 items per word is impossible for an on-line filter (as that requires perfect hashing). So, the actual 'load' capacity of this filter is, in array form, a fraction of 4 x array-len. Precisely, given an array of size S words, with capacity of Sx4, well before we reach Sx4, our keys will resolve to array elements, the little micro filters, that already have 4 registrations. Inserting the full allocated capacity (Sx4) will certainly result in a significant number of words having n greater than 4, which reduces the false positive rate. At 5 items we have fpr at 3.5%, and at 6 fpr is 7.3%. Equally, some array elements (words) will have less than 4 elements, getting exceptional fprs. For example, at 2 entries, fpr is 0.0063%! If we load the full capacity, we can no longer make statements about "1%" false positive rates, as OP does, it should be noted.

So, you either have to keep track of elements assigned to words (3 bits / word to count 0..4), or you compute a probable value to minimize overloaded array elements, keeping max writes to a word to 4 items. My guess would be ~70%ish utilization range of allocated memory. In this case, we get our desired 1% (max) but get bonuses of fortunate keys that land in underloaded words and get super high assurances at the cost of eating a bit of space inefficiency. /g

So this is the classic ball into bins question [2]. For hashes, the surprising but powerful 2 choice approach gets us high 90%s load factors. I'd recommend that. Yes, we'll x2 hashing and cache-line costs, but loading factor will be in high 90s range. Here OP should examine two candidate words, and pick the one with least items. [On look ups, we have 2 filters (words), one of which asserts it doesn't have it, and another that is 99% sure it does. Or both disclaim having it.]

[1]: https://en.wikipedia.org/wiki/Bloom_filter#Probability_of_fa...

[2]: https://en.wikipedia.org/wiki/Balls_into_bins_problem

p.s. to OP: you could also return the fpr if you keep track of items per word so the call site has insight into the assurances. That would be useful for a probabilistic data structure.
> But if I write code in Haskell I can only call it from Haskell (which wasn't something I mentioned in my original comment, but is important).

Right, that's a downside. I believe there is a way in which you can call Haskell code from C, but I've never seen anyone use it myself.

> I think there's an underlying tension between generality and clarity.

You're on to something here. C++ has the same problem, where the syntax itself is context dependent: `a * b;` could be a multiplication if `a` is a variable, or a variable definition if `a` is a type. Also template meta-programming, and overloading and {con,des}tructors in general. (Of course, Haskell has the overloading thing even more -- though the containment of IO helps matters quite a bit in my opinion.) Golang explicitly chose to go the clarity way, and it got them some love and plenty of flak.

Maybe one should just conclude from this that Haskell is not a great language for corporate environments. On the other hand, I think it's great for small-team development due to its expressivity and generality. But these two claims do not contradict each other: not every language is good for every purpose.
Check out this thread:

https://news.ycombinator.com/item?id=27903630

It's impressive what some people can achieve under restraints.

Following the recommendation I started to use Pydroid (on Adroid) from the Playstore and even without an external keyboard it's great for little scripts (or exercises) on the go.
That is very true. I’m just wondering how this even became an article. It’s a government statement with zero citations or elaboration.
Personally I can't get myself worked up over this, mainly because I don't think it would make a difference if these people didn't do what they did.

Would our lives be any different if the king of Jordan had paid his taxes? Would the UK be better off if Blair hadn't found a way of saving a couple hundred grand off his latest real estate purchase? Etc

Also I have no shame in admitting I'd do exactly the same if I had that kind of money.
I sorely miss some kind of functional streams api in Go when switching between Go and Java. for-loops make the equivalent code absolutely awe full, plus it’s not automatically parallelizable by replacing .stream() with .parallelStream(). IIRC, some Go luminary decided map, apply filter etc. we’re no good, so I hold little hope of something like Java streams API in the future.

Maybe someone can recommend a third party library.
This implies there Russian Conspiracy members are actually caring about their domestic cybercrime which is clearly not true.
Not to be a Debbie Downer, but functional Scramjet technology does very little for humanity outside of defense. As is the case with most of what DARPA funds, no? If that wasn't the case, then the market itself would be chasing the technology. Like, what would this be useful for?

I guess I'm just fundamentally questioning what you mean when you say 'human progress'. I assume you mean it more in terms of improvement as opposed to preservation, but given the fact that life itself is a struggle against entropy on all levels, preservation is a very important foundation on which to build.
They are trying to reduce carbon emissions, not to be progressive or regressive. It looks like a measure for improving climate, not income redistribution.
Right, or the way that gravity works. We know that it works and that's good enough for the day to day. Even good enough to plan.
They are all roughly spherical, so they could be cooking stones. Heated in a fire, they can be then rolled into a pit which contains the food and water, allowing the food to be boiled slowly without burning.

https://www.thoughtco.com/stone-boiling-ancient-cooking-meth...
Well, it's pretty normal to assume some basic knowledge when you dealing with some specific topic (as type theory), normally people who know dependent types also knows functional programming, GHC, coq, Agda..., the point is if you're this person so you might be able to rewrite PomPom very fast, even if you do not have implemented a dependent type checker before. . And yes, the time you spent working with some project shouldn't matter so much, but a lot of people do not have enough time/motivation to work on a toy project for 4 months straight, bringing a choice of working on some project of only a week can improve the experience of language implementers.
If the MAC and construction is solid, then wrong decompression is achievable, both theoretically, practically and by design, in many different ways except the one you mention - the rare collision.

There likely won't be enough computation, ever, to trigger an accidental collision, even if was a galactic bitcoin equivalent.

I'd only be worried about deliberate collisions, if the construction isn't sufficiently hard.
Afaik there's Trinity, which is basically a continuation of KDE 3. You could see if that works for you maybe.
Show HN: Charter – Generate a Chart from CSV
It doesn't matter. All that you need to focus on is building a product that users want.

For (almost) every language that exists, there's at least one startup using it that succeeded.

The argument of speed is not realistic. Time matters, that's true, but not to *that* extent.

Maybe the only factor that matters is how familiar you are with language (so that you can easily build your prototype/MVP) and how popular the language is so that you can easily recruit when the time comes.
Right. What is meant here by "Robotic process automation" here is screen scraping in difficult cases.

I used to have to do that. Around 1999 I had a nightmare written in Perl which could scrape human-readable financial statements in text or HTML filed with the SEC to extract a few basic numbers. All financial statements have roughly the same data, but they're all formatted differently. I used to have a database with a sizable list of euphemisms for "net loss".
For a while, the SEC made companies submit that information in XML, which they did badly. Then the SEC removed that requirement. Then they re-instated it with a better system, which is where everybody gets that data now. It took about 15 years before everybody was on board with this.
Nimbo.sh – Machine Learning on AWS with a single command
But there is no other query, except if you count each and every traversal originating from each record. The top-level query can traverse edges to reach other vertices, so first it gets a result set, then for each result, fields across relations, etc.

In traditional join sense, a RDBMS first gets two or more result sets, then filters and matches one, both or neither to appropriate rows in the other one. It is a different concept entirely.

Suffice to say, one of these is conceptually easier to parallelize and distribute.
The problem of staying in academia is getting a tenured position ...
Don't care. No one is banning supersonic travel, just supersonic travel over land. If it can't be made to work economically over the long oceanic routes then it is a dumb idea that deserves to die. Again. If it works over water then it can stay there.
I really really wouldn’t take France as an example of how to deal with corrupt politicians. There’s an astounding complacency around corruption here, a politician in the US or UK wouldn’t have been able to get away with 1% of what Chirac or Juppé or Sarkozy got up to in the 80s-90s
I wonder how viable it was to write it by hand and still be able to use the editor to modify the simpler parts of the file.

"Not being able to mix and match" has always been where I've got stuck (from both directions before now) with other environments.
And said billionaire, who ran on a anti-corruption platform, concealed assets that are were required by law to be disclosed. That's a crime.
The paper disputes the idea that people’s expectations for future inflation matter much for the level of inflation experienced today.

What I have been reading lately gives me the impression that different patterns of capital allocation have changed inflation dynamics.

There's excess demand for older-generation used by the auto industry. In text book economics, that would lead to higher prices and then more factories and the meeting of that demand at a higher level.

But what happens is chip makers, the only ones apparently capable of making even older generation chip factories, won't allocate capital for such factories because they view as on their way regardless of demand.

So essentially, with huge capital allocations, companies won't chase short-term demand surges because they don't want to be left with future excess capacity (which is more costly than any immediate payoff). Look at Nvidia actively fighting the demand of crypto miners for their products. This seems to be a barrier to any inflationary spiral (increased demand leads to shortfalls, not higher prices and production. Maybe prices too but increases not propagating).

So, it's not that the economy is incomprehensible but it's structure changes and so it's structure can't be captured by pure economic theory.
Children laying cowboys and "indians" is to trivialize and to mock ?!
Without saying this is only good or this is only bad, I honestly think we have reached a level of general wealth, e.g. enough to eat for everyone and enough to endlessly distract everyone (TV, social media, games, etc.), that most people won't really get worked up by such things anymore.
Socialism is evil, but not as evil as killing tens of millions of humans.
We've known it's exclusively airborne since April 2020? What does more airborne mean?
Third time’s a charm? Or nothing is going to happen again?
Its hard to take someone seriously when the most specific accusation in your article is that they have "bad vibes."
Strange the SYCL is never mentioned. It seems to meet the targets goals better by using C++ lambdas, ...
https://www.khronos.org/registry/SYCL/specs/sycl-2020/html/s...
People kind of are rioting, though. The election of Donald Trump (and the rise of populist parties across Europe); the January 6th capitol riot; the Black Lives Matter movement - whatever you think of these things, they're all connected at some level to a deep-seated feeling of social injustice. Perhaps we're only at the start.
Well of course, and every other analysis text.
The problem with always thinking there are easy solutions is that you never solve anything.

OK, we release all the drug traffickers who are only guilty of that and no other crimes. Congratulations, you've reduced the jail population by 5%. Oh wait, an even bigger group of people now fill the prisons, but for theft. Oops. But if we free all those millions of imprisoned sex workers, that will solve the problem, right? Lol.

Now that you've done all the performative ineffectual stuff, you still have the expensive prisons to worry about and no fix. So what do you - change the subject and move on to provide a facile solution for some other problem? I thought so.
FWIW, there's very little practical reason to normalize your DB beyond the third normal form (or technically the Boyce-Codd normal form, which your DB will probably already meet if it's in 3NF)
Personally I think Democracy could be nice. I think there are systems of governance that can allow everyone to have agency on their life without necessarily having to be rich enough to passport-shop.

Calling our democratic Republics simply "Democracy" is another cool helplessness-inducing newspeak trick. That language implicitly positions the system on the extreme-end of citizen-agency, so logically everything else must be more authoritarian.

In fact, assuming you live in one of these so-called "Democracies", think about how much your country's laws and policies impact you, and then think how much effort and input you provide to deciding those laws and policies. The ratio is most likely ridiculous.

We always say "direct democracy doesn't work because people don't care about every issue", but there's an universe of possibilities between Democratic Republic ("chose between red and blue every five years") and simplistic direct democracy ("country-wide majority vote on every government decision").
Found out about this from mjacques' comment [0] on the SpotML post and figured it was worth submitting just on its own!

[0] https://news.ycombinator.com/item?id=28739364
Reason #1: Relational DBs got a simple query language, which boosted their popularity in 1980s. MS Access made it a funny game, and you could get it going in under an hour.

I had experience with Wikidata, and it was way harder. The logic of the language is impossible to figure out by reading the examples. (My request was simple like "get region X, find all nested entities and their population".) I'm not familiar with other query languages to Graph DBs, but if this is state of the art, I'd avoid it.

Reason #2: Graphs are not easier to reason about. When you have all properties as optional, and every connection (edge) gets a set of properties too, things become much harder.

"John is Frank's father" in that database would be a very complex structure: entity A which is John with properties such as "belonging to a class of" humanity (which is another entity), human own first name, last name, and finally a "child" property, linking to Frank, who's got same set of attributes.

That's hard to put in your head. With relational DB for this example, you have to imagine just a 4*2 table (3 if we count the header).

I think these 2 factors make development with graph DBs much harder, and developers resort to them only when absolutely necessary, and keeping only a single type of relations in graph (like road graph, or parent-child relationship).
That was a non-binding memo. If Ukraine wanted protection then they should have insisted on a mutual defense and non-aggression treaty.
Yeah, most likely.
IMO not practical and not needed, just add an import duty from countries without carbon tax to price in the externalities. And the market will figure it out.

The duty can be a flat rate or an average emissions per economic output for the country.
Does anyone know the tool to use used to generate the site?

e.g. Is it using plugin for a static site generator?
It's routine in some major countries, like China.
I'm all in regarding this but I see a big issue regarding corruption and nepotism.

For instance, it does not say that in TFA, but it is implied that some sort of fund would have to be created to manage and distribute all that new money. Let's consider that, as a natural consequence, a big part of that money goes to buying carbon credits/offsets; that's a billion euro bill that is going to make "the right person" very rich, very fast.

And before one says something like "but we are not like that", just remember Austria just came out of a huge political crisis a few years ago. Imagine what would happen to this money in other least developed countries.

A possible solution would be to keep things as democratic and transparent as they could possibly be.
Well it's widely known that Dr. Evil outsourced his sharks with laser beams to IBM, that makes sense to me.
For the purposes of actual “research” pin citation is critical - you can’t just take somebody else’s ideas or words without attribution. If the AI is pulling in ideas and text from other places that needs to be traceable. Does this provide citation management for where the original content is coming from?
I don't think that's so unlikely: on my blog ~30% of visitors come from searches
Yeah, I think it’s about time to stop using that phrase, “low on the totem pole”. Remarkably ignorant and insensitive. You already even used the word “hierarchical”… we get it.
One thing I don't really understand about Atmos is, if you're listening through a stereo source (e.g headphones) everything has to be downmixed to two physical speakers. You can do fancy phase change psychoacoustics stuff but it's still coming out of those two speakers. You're taking a model with effectively unlimited sound sources and rendering it down to a stereo signal like any other non-Atmos source.

So is there really a difference compared to a differently-mixed stereo track (other than sucking down a ton of Apple/Dolby marketing hype)? if an artist really wanted their music to sound 3D over stereo speakers, they can already do that during the rendering process.
I read a lengthy account of US Corporate history in graduate school (whose exact title eludes me at the moment). My impression is that in the US, there was a desire to tie transportation to broader physical markets, and include decreasing costs by owning the warehouse and distribution infrastructure. On the marketing end, a common brand name for a family of products was also owned by the corporation. An important early US example is the National Biscuit Company NABISCO. There were no US national food companies, as each market had the combination of brands, storage and distribution for the food product. The corporation held assets large enough to tie market regions together. It was not a small feat and was very much the Big Markets Tech of the time. Sears and Roebuck from Chicago form a different model, with non-perishable goods.

For international finance, early 20th century oil played a special role, not adequately described here.

As far as the parent comment about corporations "killing people" .. this is true but naive.. since the Romans and before, brutality was the norm, not the exception. Every educated person and most others knew about extreme forms of collective abuse, it had happened again and again. The very formation of civilization, including merchant and trade functions, was generally meant to be an improvement on past forms. Rarely, but with serious circumstance, some merchant company would rape and murder their way to fortune for a while. But karma is a bitch as they say, and those things did change. The tame history I cite above, was specifically aimed at making a better economic engine, for profit by ownership, which upon consideration was the chosen path.
> Who is gonna pay?

The people who think climate change is important enough to not allow more coal, gas and oil to be burned.

If people can do so more cheaply through other means they should naturally do that first, through the common results of closing nuclear plants has always been an increase use of gas, oil and/or coal.
I definitely don't think anyone should be criticised for choosing Spotify.

Especially if they are using cheaper headphones which don't benefit from the lossless audio on Apple Music.
Show HN: WebAssembly/Pyodide based data wrangling tool I made in my free time
Live is often worse than a sound-board recording of the same show. Too many concerts have audio “engineers” who think the job consists of cranking a knob up to 11 – I basically stopped going to big shows in San Diego when I realized that the popular venues were totally okay with letting the speakers distort horribly all night. Unless the band had better standards it just wasn’t worth it.
People probably don’t like the black bars. Or at least the people in charge think so.
Let's see ESPN get a reservation at Dorsia now!
>As you mentioned, TSLA's last public offering was in 2020.

>Stock based comp is a standard cost of business in most large tech companies

The public offerings come at intervals, but the total raised seems to be pretty steady. It all contributes to keeping the business running. Money is fungible. "Everybody does it" is not an argument for anything.

Your opinion could be perfectly correct, in terms of predicting the future, and I am not an expert on Tesla. But your comment doesn't convey to be even the tiniest hint of why you hold your opinion.
Paywalled, unfortunately. A quick scan of news sites reveals they sent 38 planes into the aircraft identification zone.
That's missing the point. Economics is treated more like thermodynamics. In thermo you have lumped parameter models (parameters like temperature and enthalpy) that are actually correct even though they dont take tiny details into account.

IMHO the problem with economics is that their simple models are not over a closed system. A supply and demand curve is fine for a specific product, but it fails if you try to use it at the macro level where other factors come into play.

I'd love to work on better models for the fed, with the data and experts they have.
To get free apology (and probably some more material compensation as well).
Well, you could have calibrated things a bit differently. E.g., domestic heating isn't nice to have in Austria, but a necessity. Also, it's not a major contributing factor, it's just easily accessible by legislative action. On the other hand, if you're not building or renovation, and, if you're poor, the kind of heating you find to have, is kind of fate. Those refundings won't buy you a new heating system for your house. So, well, you could have started with more of a focus on the major, industrial contributors and refocus, when this has yielded as much as could be expected. In the meantime, focus on funding thermal home insolation, as is actually proposed in the program. (There has been done quite some in this direction, already.)

(Disclaimer, I'm Austrian.)
dcompute!
Most people aren't qualified to be fed chairman. The ones that are, probably made a lot of money in the finance industry.

If they didn't make a lot of money, they probably never rose to positions that gave them the experience they need to do the job?