skysight-inc/HackerNews huggingface dataset:
This is pretty interesting, because the effects of migrating from lz4 to zstd were:
- Total storage usage reduced by ~21% (for our dataset, this is on the order of petabytes)

- Average write operation duration decreased by 50% on our fullest machines

- No observable query performance effects

It seems like the better compression ratio and resulting reduced IO more than makes up for increased CPU compared to lz4. I wish they had mentioned the actual effect on CPU.

Compare to the recent thread "The LZ4 introduced in PostgreSQL 14 provides faster compression" [0] where the loudest voices were saying that zstd would not work due to increased CPU. This is a different layer (filesystem compression vs db comrpession), but this article represents an interesting data point in the conversation.

[0]: https://news.ycombinator.com/item?id=29147656
True, that. You can make good money as a dev in finance here in London. Not as much as in the US, but better than most of Europe.
> Also: why are Republicans proposing big new regulation that would apply to every US business, impose additional bookkeeping & accounting work for every business, and then not improve consumer privacy protection?

Two potential reasons.

One: They believe federal privacy regulations are inevitable, and want to take the opportunity to shape it as much as they can. Two years ago there were competing Republican & Democrat proposals for privacy legislation; the meats were pretty similar to each other, and GDPR, and CCPA. The differences were some subtle details around the edges that are likely to end up being HUGELY impactful.

For example, the democrat proposal included a Right of Private Action while the republican proposal did not. You can blah blah blah all goddamn day about what counts as private and what doesn't. But at the end of the day, the thing that matters most is "what happens when a company breaks the law?" Being able to sue them yourself is a very large difference from requiring all enforcement run through the Attorney General or an executive branch whose funding can be rescinded.

Two, but related to the first: There are currently multiple states that have local privacy regulations. The number is likely to increase. Companies would prefer to deal with one set of laws rather than fifty even if the one set of laws is more difficult that any of the fifty laws it replaces.

On a related note, the other serious difference between democrat and republican proposals was called "pre-emption." The republic proposal would have removed the ability for states to pass stricter privacy laws at home.
It's probably faster to buy data on members of Congress. I assume that's where things likt the Video Privacy Protection Act came from.
I don't think there are "ignore this law" style exemptions, but my understanding was that some policies were looser if you're small.

Not in EU, not a lawyer, so i could be wrong.
Credit score can affect employment, I.E. you can't get hired because you are too poor.
> The rise of the throwaway product is a rather recent phenomenon. Our grandparents repaired everything. It's the only sustainable approach.

How do you change that, though? Our grandparents repaired things because they were expensive. In the 50s, a washer & dryer cost $500. In today's money that would be over $5000. And income has gone up even more. Purely in economic terms it has become considerably less appealing to fix a broken appliance.
> This one literally changes just one setting and you get the same results if you do it manually

I just checked and this isn't actually true though, it looks like it also installs a service worker that runs some code in background.js. It sucks I needed to look at the extension's contents to verify that and backs up why I wouldn't want to install it in the first place.

My proposal seems win-win, you can even push the extension hard in the search page if it's not installed due to your concern, provided you allow it to be easily and permanently dismissed.
I don't really even mind pinterest being there but they shouldn't have more than 1 picture per say every 20 or 30 pictures.
hey you copied this comment!!

that's mean >:(
I am entertained by how the HN crowd goes Marxist when it comes to private data.

(Please think twice before replying based on lazy presumptions of what Marxism is.)
I mean... you can put anything you want on the internet. I looked up their "methodology" and it's sort of just whatever they think a source/article is. Not really rigorous.

And anyways, they put the WashPo right of NYT? That hasn't been true since ol Jeff B took over.
It is an upgrade, but don't mistake ZFS 2.x as making zstandard mandatory. The default for compression=on is still lz4.
There’s two directions to it. I’ve read crowing articles via HN about how it opens the US up to hiring from the world, it also opens up the world to hiring from the rest of the world and from the US.

It’s not just “outsourcing” that’s gone remote, it’s key players and teams. That’s a big difference from earlier waves.

The ability to pay and live appropriately will be the chief determinator. US companies might pay better on average, but we may start seeing larger and brighter sparks elsewhere in the world.
That is correct. Usually it is better to wait and see if the results are corroborated by different research teams, preferably in different countries.
People underestimate the overhead and difficulties that make companies reluctant to hire in different countries.

Companies don't even really want to deal with different employment regulations and tax policies across different US states.
hey you copied this comment!!
that's mean >:(
Maybe for you it is. But for many, adherence to religion isn't a free choice (or if it is, it requires overcoming a lifetime of indoctrination).
I get so frustrated nowadays looking for origami instructions; everything seems to be a video when all I want are the diagrams that used to get posted.
> Well, even for the section "names" it just forgets to say if imported and non-imported names all share the same encoding and which should it be - just a nitpick, but with less than 5 seconds

https://www.python.org/dev/peps/pep-0263/

Names aren't unique.

> Do you know that there are some behavioral limitations of dict that arise from a specific optimization in the implementation in C of dictionary iterators?

I'm rather curious what you're referring to here, do you mean dict-ordering, or something else?
> Members of terrorist group will be imprisoned for their terrorist acts, drone stricken

What about terrorist recruiters? People in the US who try to garner support of others but don't actually do the terrorism.
Flex can be in the eyes of the beeholder.

If someone flexing to prop up themselves with BS, meets such a person they will be stung with the existential dread of 10,000 flexes!
Language and cultural barriers are not a problem if you hire people to directly work in the team.

They are not problem if you do hiring directly and select right people.

Biggest problem is that companies want to hire bunch of worm bodies and dump trash tasks on them.

Managers expect that they will be able to throw vague requirements and bunch of people who are not part of their company will figure out what to do. What is especially funny that bad things happen even with people inside companies when manager tries to just throw vague requirements at dev team.

It is also problem with big "software houses" where you hire bunch of people - nowadays people have good internet at homes are much more conscious and one can hire specialists directly from other country and skip BS providers.
>You might think this is trivial -- but SERIAL creates an "owned" (by a certain user) sequence behind the scenes, and so you run into massive headaches if you try to move things around.

Maybe it is because I'm too old, but making id grow by sequence is the way how things 'ought' to be done in the old skool db admin ways. Sequences are great, it allows the db to to maintain two or more sets of incremental ids, comes in very handy when you keeping track of certain invoices that needs to have a certain incremental numbers. By exposing that in the CREATE statement of the table brings transparency, instead of some magical blackbox IDENTITY.
However, it is totally understandable from a developer's perspective that getting to know the sequences is just unneeded headache. ;-)
the subpoena system, for all its failings, is that public constraint. if it can be circumvented, that constraint effectively no longer exists.
> distract people from realities of the world

And that's exactly what people want. Escape. Just like with games, movies, sports, arts, etc.
In my last job I used to work with a major vendor (in industrial manufacturing) who provided a Cloud+Edge Integration solution for factories. The Edge portion was a Industrial PC with a software layer that basically allowed you to deploy stuff developed in the "Cloud" to the Edge PC.

One of the OOTB things on the Edge stack was a customized version Node-Red. It was one of the most popular components for customers and used a lot in factories.

Yes, it's true that you don't want to use it as the thing that connects your industrial controller/PLC to a Python script (running in a container on the Edge PC) that decides if a machine should be turned off for safety reasons.

But there are a lot of use cases if you think about it as a low/no-code development environment for streaming data. It provides a way to automate a lot of boring manual processes around data. Being able to use Javascript code snippets also means a lot of developers have an easy way to deploy small blocks of codes. It's easier to learn JavaScript than trying to figure out something with a PLC or a SCADA system.

The dashboarding was also pretty nice - especially compared to the Dashboards you'd see on a machine HMI (basically a touchscreen that controls a machine).

It wasn't perfect of course. If your sensor data is streaming at 1Khz you'd need to use something else. But the data from a lot of factories is a lot more mundane than that. And a lot of fancy factories have mundane things they need done simply and quickly.
This was super informative – I especially like that you showed your thinking through a step by step process, instead of just "here's the best thing to do". That makes it possible to apply this same lesson to other areas as well.
Pokemon Go Creator Builds on Kubernetes for Developers
When I was a child I was in an "Odyssey of the Mind" group and in one competition we had to solve some problem and the plan my team came up with had a few steps, one of which was "Build a robot". We were all children and none of us had even the slightest idea of how to build a robot or any relevant technical experience or ability. But somehow, we never realized this deficit and came up with our plan and tried to execute it.

It wasn't until we had destructively disassembled a power tool that one of us had access to, on the theory that we could use whatever motor was inside of that tool to drive our robot, that we realized we had no idea what we were doing nor any conception of how to build a robot. I had a feeling of amazement that sticks with me today that we were able to articulate our plan to solve the problem, which depended on our robot helping us with some sub-task, but were completely unaware of the fact that the robot was far beyond our ability to construct. Our plan was like something that might have worked in a cartoon but not in reality.

That feeling comes back to me as a kind of "Build a robot" moment in cases like this. "In our virtual reality metaverse people will be able to attend concerts with one another and save the tickets as NFTs!" Okay, but what you have is a screen that you can strap to your face and is nothing like a virtual reality metaverse and you have no idea how to get there.

Another way of thinking about it is taking the hardest part of the problem and hand waving it away to solve the easier parts and then forgetting that there is a big blank spot in your plan. It's easy and fun to think about all the stuff you can do in a compelling virtual reality metaverse, but you don't have one and aren't likely to get one any time too soon.
As a developer working in Europe, I would love to work for an American company and make 30 to 50% more. But, it's difficult:

- I don't really want to adapt myself to their timezone. Perhaps 1 or 2 or hours of shift from my tz, but not more

- I don't want to work as a contractor. I want to be an employee

- I want at least 28 business days of vacation per year

- I do 9 to 5. No more, no less. I'm not in my 20s anymore

Because of the reasons above I don't even care looking for remote positions in American companies (which are scarce already).
> In the US, fines are mostly meaningless if you are poor as debtor prisons are (rightfully) illegal.

You're overwhelmingly correct, however someone is going to shortly reply to your comment with a link to a story about how someone somewhere got jailed over a debt and how debtor prisons are making a comeback. It's extraordinarily rare in the US.
Year 0, you have $X dollars in your bank account with $Y purchasing power.

Year 1, you have $X dollars with $Y - 1 purchasing power.

Etc.

$Y > $Y - 1

Inflation is an anti-feature.

> What can it do for me?

It really sounds like you’ve never held Bitcoin. HN can change that for you really quickly if you’re open to it.

Currencies compete, and ones with inflation which punish holding the currency over the long term are fundamentally less user-friendly.
>No company should ever spend more mitigating a risk than the potential cost they could incur from the risk.

basically you summed up the opening scene from the FightClub. The human life cost H millions, so until it is going to kill N such that N * H >= cost of the fix ...
time zones are probably the biggest issue i see coming up.

as someone in PST/PDT with a sleep disorder, its pretty easy to work with east coast people. i've had a boss in the UK before and it worked because he was okay with ending his day with a 6pm meeting his time. but working with people on india time is going to be a mess one way or the other.
It's Hacker News, not Normie news.

And judging from the question, you don't seem high on Emotional Intelligence yourself :)
The workflow with Cython is that it produces native python modules (e.g. .so shared objects / .dll dynamic link libraries) that the python interpreter can import.

So if you change some of your Cython code, for it to be used at runtime you need to invoke the Cython build tools to rebuild the new version of your python native module.

I usually use Cython for a small core of compute heavy operations, and leave the rest of the project as pure python. That way I only need to rebuild Cython code if I change something inside that small core.

> Is it 1-to-1 with standard Python?

Not for the best speedups, no.

E.g. you might be able to get a modest speedup, say 50%, taking a pure python file, renaming it to *.pyx, and getting Cython to compile it. But that's not why I use Cython. I use it when I have compute-heavy code that I want to run at native speed (think matrix-vector product type stuff), by carefully rewriting in Cython, thinking carefully about memory allocation, data structures (prefer C arrays!) and performance, it is fairly achievable to get a 500x speedup.

Cython relies on you writing specialised Cython code that is quite close to C code -- strongly typed Cython variables work like statically typed C variables, not dynamically typed Python names. You end up with Cython code that cannot be executed as if it were normal Python code by a python interpreter.

But, Python code can usually not be executed very efficiently, whereas Cython can translate small loops of strongly-typed numeric code into small loops of strongly-typed C code, which can often compile to very small loops of native CPU instructions, which then run blazing fast.

Under the hood, Cython works by translating the not-quite-python code into C code that uses the python interpreter's C extension API. Then it compiles the C code into a python native module using a C compiler.
The definition: mRNA does not stimulate the immune system directly. That's what's new about it. Did you know that? It tricks the cells of the body to create protein that then get hopefully a reaction from the immune sys. They typically also add some other stuff that helps to elicit this reaction (usually stuff that in large quantities is harmful to humans).

> Definitions made prior to the pandemic would already fit the mRNA vaccines, therefore the claim that the definition was stretched for marketing/persuasion reasons don't really hold water.

You you say mRNA treatment is not new? I think this is the first rollout of such medicine on humans.

> "Approval pending" / "Citation needed? "

Ok, I misquoted this. Here what I did mean:

https://en.wikipedia.org/wiki/History_of_COVID-19_vaccine_de...

See the PhaseIII trails were allowed to be skipped with the EUA.

The process by which the treatment is now pushed to kids is even more botched.

I believe we are exposing the younger (say <60) to risks bigger than the c19 poses itself. Yes we're dealing with an overly stressed healthcare system, but that's a different matter. The jab should be worth it for the person him/her self, and that should be made clear to that person, if they dont believe it they will not take it and that's their choice.

Im okay with tax being used to give people that want the free jabs. Im not okay with persuding people to to take it with anythign other than data.
Westinghouse. RCA. Magnavox. Once they were great American companies. They're now just shells that do licensing of the name.
Imagine the government wanted to know who "deepthroat" was during Watergate: just buy the location data of the journalists and anyone nearby.
Some databases don't give you a choice, and your table data is actually stored in a clustered index sorted by primary key. This means random inserts when using a UUID (without embedded time), and more page splitting.
Oh shit! That's bad.
That picture seems to have gotten through all the SafeSearch:strict filters.

Sadly, the image search app comes from Bing, so every other non-Google search engine has the same problem with that same single image, e.g.

https://duckduckgo.com/?q=asd&t=h_&iax=images&ia=images

https://www.bing.com/images/search?q=asd&form=HDRSC2&first=1...

Even in the SafeSearch:strict mode.

I will report it them and I hope they'll fix it soon.
Because we need to understand the purpose of the data collection and what bad things might happen because of it.

If Treasury is using this data to catch people who violate economic sanctions, ok. If the IRS is using this data to catch people who cheat on their taxes, ok. I don't love either of those things, but they are using the data only to do things that have been defined as their job to do for a long time now.

There doesn't seem to be any evidence that any of this data is going to be used to penalize people financially/economically for "social infractions", or to penalize people in unrelated ways (like, you missed payments on your credit card so you aren't allowed to ride on a train). If there was, then sure, that's cause for worry.
Hi Richard, how does your organization achieve carbon neutrality? What metrics are available, or how do you know it's accurate?

As a software engineer, this has never been a requirement of me, but I want to start conscientiously working for a company that prioritizes it. I have toyed with the idea of Raspberry Pis, Starlink, and solar panels to host a carbon-neutral Kubernetes cluster.

(P.S. I submitted an application, but regardless will be interested to follow You.com for the upcoming years)
When it comes to attributing a symptom you're feeling to a cause, the number of correct-negatives in COVID testing indicates a lot of noise (not covid) vs signal (true covid symptom). With placebo effects it's the same problem.

So I mean that when 'active placebos' are used, rather than ones that have no side effect (like dry mouth), the effects are larger. So in basic terms, the more noise there is in the system, the more signal error there is. The main point is about the reason they do blind control studies. People are not very good at correct attribution.
I strongly agree. I think this has been the case for all versions of the public education system in living memory, and the main ways this has changed over the last few decades are twofold:

-More oversight and efficiency in this process is breaking down the unofficial means through which anyone got anything else out of it (e.g. real mentorship from educators who care that is not encouraged so much as tolerated by education policy, opportunities to engage with new ideas in a meaningful way, good reading recommendations, an incidental avenue into a social life)

-The structure and function of public education is increasingly infecting university curricula, structure, and priorities

I think this likely has the effect in broader society of creating less fluid competency and more blank-faced compliance, and this disproportionately affects people in key leadership roles as schooling becomes more of a selection pressure on people's career paths
As far as I see, this test case is a pass.
Sorry, grammar pet peeve of mine: "could have" not "could of" :) cheers!
I agree that it's all stupid. There is a select group of idiots that want to spend a crazy amount of money on meaningless collectibles.

Thats's why I understand both baseball cards and NFT's. :D
A new company? Two words: capital intensity.

Production of industrial machinery like farm equipment requires massive factory infrastructure with significant supply chains. Getting the capital together for that is hard enough, but then the new company would be competing against the established John Deere, with the added (perceived, if nothing else) handicap of lenient repair rules.

An existing competitor to John Deere? I suspect it is for the same reason that sedans are essentially indistinguishable, style-wise: operating in the same environment (aerodynamics, interior volume and shape, etc. on one hand, the legal and cultural background on the other), they have all struck on the same optimizations, which include repair restrictions.

Now, if one does decide to try the alternative, and makes significantly more profit, you'll see a fairly rapid state change as most of them switch.
> Things cannot simply be bad/user hostile/privacy invading, etc.

In this case, the algorithm is actually bad for all ethnicities [0]. It's just that it's extremely bad for black students (fails half the time) and just regular bad for everyone else (fails a quarter of the time).

[0] https://www.theverge.com/2021/4/8/22374386/proctorio-racial-...
Visit “WTF Happened in 1971” [1]. That argument doesn’t hold water for middle and lower class persons.

[1]: https://wtfhappenedin1971.com/
They can do whatever they want. You accuse others of being patronizing but your sense of entitlement is polarizing. It would do you well to realize that the US pays a lot for software engineering as a result of the same societal structure, policies, and priorities that cause the problems Europeans love picking on (e.g. healthcare, paid time off, parental leave, etc).
I'll report it to the Bing image search team.
I kind of agree with the article, but on the other hand, I don't think I would I have ever donated without their aggressive campaign... Or I maybe would have once and then forgot about it. When I receive their email I'm like, "oh yeah! I should donate, totally forgot in a long time."
Like literally, the amount of instances where the government is weighing life/death is very small, even smaller at the federal level (most death penalty cases are against state laws). If you're meaning in the 'government programs can greatly affect my quality of life', then private companies can totally do that too - through targeted advertising.