MurphyA/hacker-news huggingface dataset:
by jillesvangurp | 2025-07-21 11:27:52+00:00
Filter and aggregate after you log your metrics, traces, log messages, etc.; not before.

You can worry about data retention, rollups, and other strategies for limiting data storage separately from the systems that emit the data.

At least with the right data stores. I kind of like what opensearch and elasticsearch do for this. In Elasticsearch you have a data stream. You configure it to roll over based on time or data size. Once rolled over, indices are read only; new data appends to the current one. You then can define life cycle policies to decide what to do with the old ones and e.g. move them to cold storage, transform them with rollups, and eventually delete them.

With application logging, you typically assign different log levels. Trace and debug are typically disabled in production (or should be). Info can be quite noisy. Warn tends to be repetitive (because developers tend to ignore warnings and will never fix them). Errors should be rare.

I have my system configured to start emailing me if errors get logged. An error means something is broken and needs to be fixed. Zero tolerance on errors. When an error happens, all the other log information provides me context. So there's value in retaining that. But only for a few days at best. Long enough to survive a weekend or things like Christmas. But after that it's just noise. I have a hard cut at about two weeks. Some places you need to store stuff longer for ass coverage reasons.

Data retention comes at a price of course. I've seen companies log ginormous amounts of data and ignoring all their errors. 30GB per day. Absolutely appalling. Me: it looks like your database layer is erroring non stop (constraint violations and worse); you might want to do something about that. Them, ah no that's just normal we just ignore it (php shop, incompetence was the norm). Me: so how do you know when something breaks?! Them: ......?!

My well paid consulting gig was beating some sense into this operation as one of the managers noticed they were spending hundreds of thousands per year on this nonsense. My fee was a rounding error on that. Easiest job ever. But kind of cringe worthy once I started looking into what they were actually doing and why. Mostly it's just, "yeah some guy set that up once and then we never looked at it and he left. What are you going to do?!". There was a lot of that with this company. Just absolutely nobody that even cared about the waste of resources or getting any meaningful feedback from their logging. If that's your team, you need to do something about it. That's your job and your not doing it well. If you need an external consultant to tell you, you might want to reflect on the notion of majorly shaking things up a bit.
by burning_hamster | 2025-07-21 11:29:29+00:00
I disagree.

> I think it would be better to describe this as an ‘organelle’ transplant as it would be easier for people to understand and discuss.

Unlike previous attempts, the donor mitochondria are not transferred into the mother egg. Instead the donor cell is denucleated, and the nucleus from a mother's egg is transferred into the denucleated donor cell. Consequently, there is a wide variety of donor specific material, which may influence the early stages of development and only "wash out" after a number of cell divisions.

> But calling it a 3 person baby is unhelpful and misleading as IMO mitochondria DNA is of a different category to chromosomal DNA.

How so? Arguably, mitochondrial genes are much more essential than most nuclear genes.

1. Mutations in any mitochondrial gene often have dire consequences, whereas variants in nuclear genes are much more frequent.

2. Mitochondrial DNA is the most expressed in pretty much any cell by a huge margin. Mitochondria express 13 (IIRC) protein coding genes and two dozen other RNAs. Those 30 odd genes often make up 1-5 % of a cell's whole transcriptome. Only genes coding for ribosomal RNA are more strongly expressed.
by simonw | 2025-07-21 11:30:16+00:00
I actually found the citations on the last page: https://appetals.com/promptguide/references/

If it's not AI generated there's something very weird about your writing style.

This page in particular comes across as straight up LLM hallucination: https://appetals.com/promptguide/resources-and-tools-for-pro... - it lists "Prompt Engineering Discord" and "LinkedIn Prompt Engineering Groups" without providing links to anything, then lists "Legal Prompts Library" and "Marketing Prompts Collection" and "Developer Prompts Repository" under "Industry-Specific Collections", each with three bullet points and again without linking to anything.
by casperb | 2025-07-21 11:30:21+00:00
This reminds me of the story where Barclays had to buy bad assets from the Lehman bankruptcy because they only hid the rows of assets they did not want, but the receiver saw all the rows due to a mistake somewhere. The kind of 2% fault rate in Excel that could tank a big bank.

https://www.computerworld.com/article/1561181/excel-error-le...
by gausswho | 2025-07-21 11:30:51+00:00
"The path Bluesky has chosen is Kids Web Services (KWS), a system controlled by Epic Games. Yes, that Epic Games. To verify yourself as an adult to Bluesky UK, you'll have to register with KWS... You have to give permission for an enormous amount of your personal data, including payment card details, phone number, address, face scan, national ID numbers and documents, access to your device details, when, where, and for how often you do things online, and on and on."

I only have so many faces I can palm.

Of all companies, we're handing the management of this over to the company that operates Fortnite and is substantially owned by China-based media mogul Tencent.

We're going to fracture the web into pieces, aren't we?
by whywhywhywhy | 2025-07-21 11:31:09+00:00
Imgur also rugpulled in the end, think it was adult content at first but didn't they recently delete a ton of old content and content not tied to accounts.

Ultimately you can never trust the parasite image upload service because eventually they'll try and supplant you like how imgur is now a reddit-like/ifunny-like type site instead of just a "dumb" image host.
by detaro | 2025-07-21 11:31:33+00:00
You need the owners permission. In the specific case of a building where different people own different apartments, that's the owners assembly for the outside. That's not the same as it being forbidden by regulations, and not particularly specific to European countries. Fairly sure if you own a condo in the US they'll also have their own rules about what you are allowed to do to parts of the building outside your unit and a voting process for exceptions and changing it.

And obviously ownership law like that has nothing to do with "greenwashing propaganda".

Some areas can have local restrictions facade design, but that's neither universal nor something that can't be mitigated.
by bubblyworld | 2025-07-21 11:32:12+00:00
Not quite - the nanometres on the y-axis are "deltas" of your spectral variable. The density allows you to answer questions like "how much power am I getting per square metre in a range [A, B] of wavelengths". You would integrate your density between A and B to obtain the value.

For example, pick some small value "k" close to 0 in units of nm. Then in your example, the amount of irradiation contributed by the small window [1000-k, 1000+k] nm of wavelengths is roughly equal to k*3.5e18 photons per square metre per second (you can check that the units work out). The smaller k is, the more accurate the approximation. If you want to get an answer for a larger interval you can break it up into lots of k-sized pieces and sum the results up. Recall from calculus that this is exactly what integration is (yes, I know the truth is a little more complicated in general measure theory).

Does that help? It's a bit like a continuous probability distribution, in the sense that to get an actual probability out of it you have to integrate. Formally a mathematician would say that a density corresponds to a "measure" over the space of all possible values of your spectral values.
by teleforce | 2025-07-21 11:32:19+00:00
The author is Christine de Pizan, an Italian-born (Venice) French court writer [1].

Fun facts, Christine married at the age of 15, now will be considered by both Italian and French law as an illegal underage marriage. The marriage was, by all accounts, a happy one [2].

She had 3 children from the marriage to Etienne du Castel, (a royal secretary) for about ten years, remained widow after her husband's death.

Christine was Catholic and is often presented as one of the first feminists in history.

[1] Christine de Pizan:

https://en.wikipedia.org/wiki/Christine_de_Pizan

[2] Biography of Christine de Pizan, Medieval Writer and Thinker:

https://www.thoughtco.com/christine-de-pizan-biography-41721...
by hnbad | 2025-07-21 11:32:29+00:00
> Most software developers I have met have this kind of disdain for their users familiarity and ability and act like they are above that.

This is absolutely true.

For what it's worth, "so-and-so department, room 123" is only a helpful mental model for navigation if you have additional knowledge not present in that description: that the department is probably contained entirely in one specific building, where that building is, that the rooms are likely numbered sequentially following a pattern that also indicates the floor they're in, etc. By itself this is an address whereas "red building, third floor, left then left" is a turn-by-turn route.

In terms of UIs, the latter is more like "left-hand side of the menu bar, 'Edit' menu I think, half-way down the screen, something like 'Modify' or 'Change' or 'Transform' or something, then third item in the list, something like 'Skew' or 'Bend' or something" compared to the first just being "Transform -> Skew". The former is fuzzier and the exact labels don't really matter because you'll know them when you see them. The latter is extremely precise but tells you nothing about how to actually find what you're looking for (is it in the 'Edit' menu? is it in a right-click context menu? etc). It's only really useful by itself if you have a command palette.
by kingkongjaffa | 2025-07-21 11:32:43+00:00
Switching to the lite version of the extension has been as easy as 'set and forget', for me.

I'm sure there are some differences somewhere but it seems to be working well.

I'm glad it's still an extension by Raymond Hill (gorhill), since I trust that guy more than any corporation.

He's been on everyone's browser extension list for ~a decade (?).
by bearjaws | 2025-07-21 11:33:25+00:00
Doing a project to migrate from one LMS to another, I put ChatGPT in the middle to fix various mistakes in the content, add alt text for images, transcribe audio, etc.

When importing the content back into Moodle, I come to find that one of the transcripts is 30k+ characters, and errored out on import.

For whatever reason, it got stuck in a loop that started like this:

"And since the dawn of time, wow time, its so important, time is so important. What is time, time is so important, theres not enough time, time is so important time"... repeat "time is so important" until token limit.

This really gave me a bit of existential dread.
by LeafItAlone | 2025-07-21 11:33:53+00:00
Sure.

I think it’s odd for you to criticize someone’s reasons when you apparently just reject their underlying premise to begin with (which is, effectively, my experience with a particular open source tool isn’t the best for me and the one I found that does isn’t open source).

Frankly, the idea of having 4 different ways of editing code, as you’ve described above, just seems like a nightmare to me. I like to have one tool that does it all and learn to use that tool well. The Jetbrains tooling allows me to do this with little of my time spent configuring it.

If what you are using works well for you, then I think we should all be happy here.
by mandmandam | 2025-07-21 11:34:14+00:00
> we are in a place with an order of magnitude less trouble building a business.

What is this claim based on?

Is there 10x as much stress among French business owners? Are entrepreneurs working 10x as hard in China? Are there 10x fewer businesses in England?

And, stepping back a bit: To the extent that running a business is easier in America, how much of that is because the US exploits and bullies the rest of the world?

How much is because it's a huge country with vast resources (that were stolen from its murdered inhabitants)?

How much is because the lack of regulations allows for rampant externalization of costs?

How much is because businesses are more 'free' to exploit their own workers?

How much is because most of the mechanisms for basic accountability are broken?

These aren't "gotcha" questions. They're fundamentally important to our future, because none of that is sustainable.
by nxobject | 2025-07-21 11:34:28+00:00
Where did the 6 application/year number come from? The justification seems a little fast-and-loose:

> According to the new notice, the number of PIs who submit more than six applications per year is “relatively low.”

I imagine that, given funding cuts, PIs are going to try to work harder to find funding opportunities (i.e. more proposals submitted) for insurance.
by AndyMcConachie | 2025-07-21 11:34:33+00:00
This is everywhere in the EU. The Dutch government put out an RFP for MS Outlook licenses. RFPs are supposed to be vendor neutral, so I don't understand how an RFP for something that only a single company sells can be vendor neutral.

They outsource all their email, but they don't put out RFPs for "email". MS is burrowed so deep into EU governments good luck getting them out.
by marcusb | 2025-07-21 11:34:50+00:00
The drive enters the cycle again. I use the drives until they show signs of failure (SMART monitoring/testing), or until I need to upgrade for capacity reasons.

I'm using "recertified" (really, used) drives that I've written about here: https://marcusb.org/posts/2024/03/used-hard-drives-from-tech.... They are inexpensive and, so far, have been very reliable. (And, yes, I've done restores from the backup sets.)
by aristofun | 2025-07-21 11:34:52+00:00
The sole purpuse of a “set of instructions” is to serve end users, to fulfill some business function. Without it it is useless bunch of symbols.

The set contain bugs itself that are getting revealed over time. But more importantly end users and businesses function evolve and change and if people have no choice but to adapt to such a “hammer” - it’s a piece of crap, not a software.
by calrain | 2025-07-21 11:34:59+00:00
Logging is an exercise in solving problems of future you.

We don't log just to have records of everything, we log to solve future questions.

I'm working on a system that generates huge numbers of log entries and have settled on a short term solution to over log everything.

Once a log entry has persisted, I'm using it as a 'Bronze Layer' in a typical Medallion Model and will then filter that log data up into Silver and Gold layers so I can have billing, reporting, dashboard metrics being lifted out of the verbose logs.

Not sure what I'll do with the verbose Bronze Layer logs maybe cold store them somewhere, but it's interesting to experiment with progressive aggregation of logs to hopefully purge and dispose of the raw log data as fast as we can extract value.
by libertine | 2025-07-21 11:35:35+00:00
This might be a controversial take, but here it goes: the vast majority of Chinese brands are really bad at marketing to Western audiences.

There are a few good ones, but they had to do what was necessary. For example, to increase the appeal of electric vehicles - they hired German industrial designers from European automakers.

The few ones that come to mind are Huawei, DJI, and arguably Xiaomi. Then, of course, you have niche companies with great products that market mainly through influencers, such as Bambulab. There are also plenty of niche products from Chinese brands with high quality.

But the vast majority are sloppy, lack "good taste" (which is subjective to culture), compete mainly on price, and from my understanding, they haven't developed their own identity - or at least popularized it in Western countries.

For example, Japanese companies' marketing, and even the marketing in Japan, has an appeal to Western audiences because of cultural exchanges (from products to media for many decades). It's unique and original to them, and Western audiences cherish it.
by jjani | 2025-07-21 11:36:00+00:00
I did spend more than a decade living in a European country famous for its cheese - your nearby supermarket will have some cheese from there :) Was talking about it in that light; Korea is a completely different story.

What you're saying could be true for the US, but in Europe people tend to put 1-2 slices of cheese on their bread, or grate it over something. Even if had as part of a platter with crackers, like with brie, it's nowhere near that much. For cacio e pepe, where the whole sauce is cheese, you only use maybe ~25g per person. This [1] is what 200g of pecorino romano looks like. Good luck eating all of that in one sitting - or don't, as you'll 100% regret it!

> I'd devour the whole bag of cheese sticks if I could.

If we take all cheese sticks that have been sold across the world in the last 24h, I'd be surprised if more than half their total weight was actual cheese.

[1] https://gastronomica.co.uk/wp-content/uploads/2021/05/Pec.-R...
by bayindirh | 2025-07-21 11:36:08+00:00
After being bullied about a couple of questions which were not already answered in Stack Overflow, I stopped participating StackExchange completely.

The point system which meant to motivate people to contribute became the bar itself. Lower score meant you were not taken seriously or considered a noob who stopped using pacifiers and started using computers 30 minutes ago.

So, I returned to what I did best. Digging documentation and taking my notes. They can pat themselves on the back for keeping the purity and spirit of the network.
by ben_w | 2025-07-21 11:37:20+00:00
All true, but also three of the four currently-ongoing genocides are by three of the countries I listed: https://en.wikipedia.org/wiki/List_of_genocides

> I would challenge people to come up with something more criminalized than genocide.

IDK about "more", but murder and tax evasion seem like they'd be high on the list for a state to continue functioning no matter what is actually written as an explicit law?
by LeafItAlone | 2025-07-21 11:39:00+00:00
And not having sensors results in not knowing where the trains might be on your track _forever_.

I’m not entirely sure what you are trying to argue. Your original comment said you can’t know where trains are on underground subways because GPS doesn’t work underground, but that’s not the technology they use anyways, so it doesn’t make sense to reference it. The you seemed to argue that what might currently be in place is insufficient, but that wasn’t what this thread was talking about.
by pomponchik | 2025-07-21 11:39:48+00:00
Many old Python libraries got their mirrored async reflections after the popularization of asynchrony. As a result, the entire Python ecosystem was duplicated. Superfunctions are the first solution to this problem, which allows you to partially eliminate code duplication by giving the client the opportunity to choose (similar to how it is done in Zig) whether to use the regular or asynchronous version of the function.
by Mashimo | 2025-07-21 11:41:04+00:00
Seems like you can get it in 120 fps 2D, from Wikipedia:

> To accommodate the film's wide release, various additional versions of the film were created.[3] They include 120 fps in 2D and 60 fps in 3D as well as today's current standard of 24 fps. The film also received a Dolby Cinema release, with two high dynamic range versions that can accommodate 2D and 3D, with up to 120 fps in 2K resolution.

https://en.wikipedia.org/wiki/Billy_Lynn%27s_Long_Halftime_W...
by hnbad | 2025-07-21 11:41:15+00:00
Is that how you think about fixing software bugs too? "You're saying the existing code is broken so we should fix it by writing more code?"

EDIT: Regulations are simply laws. Laws structure legal (this includes financial) interactions. The idea that you can always fix problems just by removing regulations is no less absurd than the idea that you can always fix problems just by removing code. "Good" isn't defined by having less or more, it's defined by what you have being good or bad at doing what it's meant to do. Parent is wording their question in such a way that it can only be interpreted to mock the idea of fixing a bad law by passing a new law (whether that involves replacing the existing law or not is irrelevant).
by MisterTea | 2025-07-21 11:41:34+00:00
This sums it up nicely:

"Hexanitro? Say what? I'd call for all the chemists who've ever worked with a hexanitro compound to raise their hands, but that might be assuming too much about the limb-to-chemist ratio."

https://www.science.org/content/blog-post/things-i-won-t-wor...
by stefanha | 2025-07-21 11:41:35+00:00
It looks plausible: XFS's xfs_dio_write_end_io() updates the on-disk file size. Do you have a link to documentation that confirms this is true for Linux or POSIX filesystems?

Edit: POSIX 1003.1-2017 defines fdatasync(2) behavior in 3.384 Synchronized I/O Data Integrity Completion, where it says "For write, when the operation has been completed or diagnosed if unsuccessful. The write is complete only when the data specified in the write request is successfully transferred and all file system information required to retrieve the data is successfully transferred".

So I think POSIX does guarantee that a write at the end of the file with O_DSYNC/followed by fdatasync(2) (and therefore, Linux RWF_DSYNC) is sufficient. Thank you for pointing out that RWF_DSYNC is sufficient for appends, vlovich123!
by rtsil | 2025-07-21 11:42:54+00:00
And malnutrition isn't only about lack of food, it's also about mediocre quality of food:

> Similarly, new estimates of adult obesity show a steady increase over the last decade, from 12.1 percent (2012) to 15.8 percent (2022). Projections indicate that by 2030, the world will have more than 1.2 billion obese adults. The double burden of malnutrition – the co-existence of undernutrition together with overweight and obesity – has also surged globally across all age groups.

Obesity will soon, if not already, become a major public health disaster in poor countries.
by incomingpain | 2025-07-21 11:43:10+00:00
Lets start with: Does Europe need to break free?

Absolutely they do. For oh so many reasons.

Can they? Well obviously everything is possible. What's more likely is winning the lottery while being abducted by aliens during a dentist appointment in Antarctica.

But it's also more likely than being struck by lightning while being bitten by a shark in the desert during a snowstorm.

So at least its possible?
by ot | 2025-07-21 11:43:17+00:00
There is an additional benefit to throttling by time, it is a lot easier to do it efficiently in multithreaded environments.

If you log by count, you need a global counter for that event (you could do thread-local, but then your logging volume would depend on the number of threads). If the code path is hot (which may be the case if you want to throttle your logs) multiple threads will contend on the increment, and that can be very expensive.

If you log by time, you just need a load and a clock read (on Linux, `CLOCK_MONOTONIC_COARSE` is a handful of ns and the resolution is enough for this purpose), and only need synchronization (a compare-and-swap) when the timer expires, so threads virtually never interfere with each other.