MurphyA/hacker-news huggingface dataset:
by hliyan | 2025-04-18 12:02:13+00:00
This reminds me of one of the most interesting bugs I've faced: I was responsible for developing the component that provided away market data to the core trading system of a major US exchange (which allows the trading system to determine whether an order should be matched in-house or routed to another exchange with a better price).

Throughputs were in the multiple tens of thousands of transactions per second and latencies were in single digit milliseconds (in later years these would drop to double digit microseconds, but that's a different story). Components were written in C++, running on Linux. The machine that ran my component and the trading engine were neighbors in a LAN.

We put my component through a full battery of performance tests, and for a while, we seem to be meeting the numbers. Then one day, with absolutely zero code changes from my end or the trading engine's end, the the latency numbers collapsed. We checked the hardware configs and the rate at which the latest test was run. Both identical.

It took, I think, several days to solve the mystery: in the latest test run, we had added one extra away market to a list of 7 or 8 markets for which my component provided market data to the trading system. We had added markets before without an issue. It's a negligible change to the market data message size, because it only adds a few bytes: market ID, best bid price & quantity, best offer price & quantity. In no way should such a small change result in a disproportionate collapse in the latency numbers. It took a while for us to realize that before the addition of these few bytes, our market data message (a binary packed format), neatly fit into a single ethernet frame. Those extra few bytes pushed it over the 1600 (or 1500?) mark and caused all market data message frames (which were the bulk of messages on the system, next to orders), to fragment. The frame fragmentation and reassembly overhead was enough to clog up the pipes at the rates we were pumping data.

In the short run, I think we managed to do some tweaks and get the message back under 1600 bytes (by omitting markets that did not have a current bid/offer, rather than sending NULLs). I can't recall what we did in the long run.
by dijksterhuis | 2025-04-18 12:02:32+00:00
> Always remember that the world was fine with 2bn people just 100 years ago.

we’ve gone from ~2 billion to ~8 billion in 100 years.

compared to the (highly estimated) figures from before 100 years ago — that’s a massive increase.

the graph is basically a line going straight up compared to the rest of (highly estimated) population data for the last 10k years. and growth is continuing.

https://ourworldindata.org/grapher/population

> Maybe the world in 2050 will be so different that the issue has resolved itself

“maybe a miracle might happen” — is just kicking the can down the road in my book.

we are out of balance with our surrounding environment. there will be a readjustment — whether we choose to make that readjustment ourselves (take responsibility for the problem), or let the readjustment happen (the problem really becomes a problem), is up to us as a species.

> Some problems need tackling at the right time.

some problems take a really long time and a lot of effort to work on so maybe starting to work on them early and proactively might be a good idea. like climate change.

> We don't need to get too crazy about declining populations when we are facing more urgent issues.

speaking of climate change, global overpopulation kinda has an impact on it! more people -> use more resources -> screwing up the planet faster
by rc00 | 2025-04-18 12:04:17+00:00
I can see the appeal if there is a need for stronger metaprogramming. Not that Zig is terrible in this area, it is just that Jon's language is much more powerful in that area at this stage.

That being said, I do see an issue with globally scoped imports. It would be nice to know if imports can be locally scoped into a namespace or struct.

In all, whether it's compete or coexist (I don't believe the compiler for Jon's language can handle other languages so you might use Zig to compile any C or C++ or Zig), it will be nice to see another programming language garner some attention and hopefully quell the hype of others.
by Applejinx | 2025-04-18 12:04:51+00:00
Bear in mind that a lot of people took pains to not look at their candidate too closely, to the point where a (slim) voting majority wasn't showing up to rallies etc. during the campaign. One might see this as signs of their being fake, but it could also be suggestive that they didn't want to come out and see where their guy was really at. They voted for the IDEA of him and what they figured he represented, and were indulged in those beliefs as hard as possible.

So this 'approval' is sort of phantom approval. It's approval of a fantasy man who doesn't track too closely with the reality of what's actually happening.

The point where people pay heavily for their erroneous beliefs, for instance by losing their retirements and savings, is a point where people re-evaluate.
by richbell | 2025-04-18 12:05:29+00:00
> in light of the DOGE findings regarding 150+ year olds collecting social security...

The claims made by DOGE were highly misleading (i.e., lack of death date does not mean a 150 year old is receiving money).

Moreover, it wasn't a novel discovery. It had already been identified and published in a 2023 audit: https://oig.ssa.gov/assets/uploads/a-06-21-51022.pdf
by aqme28 | 2025-04-18 12:05:56+00:00
There are two gases that need to be exchanged when you breathe. You need to get rid of CO2 and you need to get O2. When you hyperventilate, you purge CO2, but don't really change your O2 content.

This matters only because CO2 is what triggers your desire to breathe, but O2 is what causes you to actually pass out or not. So what happens is that you might pass out before you realize you need to come up for air.
by somenameforme | 2025-04-18 12:06:09+00:00
I think you have to distinguish between militant groups filled with highly motivated ideological volunteers and state militaries which are often primarily filled with people from poor families who have graduated high school and then don't know what to do with their lives. In war time it's an even uglier picture where you may have armies filled with people who were literally dragged kicking and screaming off the streets and then beat into obedience or death.
by larusso | 2025-04-18 12:06:13+00:00
Yes. You‘re correct. When I wrote written I meant put together. Because the process was more to put a compilation together. I‘m not Christian and also atheist so please forgive any wording that my sound like a debunk the whole process. For me the scientific truth is not given that this person as stated in these gospels ever existed. But I‘m very interested in und history and the history of religions. I visited many churches because of the combination of power, rituals and believe. Even though the first is graspable for me.
by raffael_de | 2025-04-18 12:06:31+00:00
> - no translation feature ("gründonnerstag englisch") gives me links to leo.org (which was a cool site in the 00s) and to other sites, but Google gives me a translation box with the result

How about a custom Bang for dict.cc?

Bang shortcut could be "dcc" with URL: https://www.dict.cc/?s=%s.

Then you can translate using "!dcc gründonnerstag".
by everdrive | 2025-04-18 12:06:58+00:00
My impression is that the first Trump presidency left everyone at a loss. If you react with outrage, you're labeled in some negative way. This is really an extension of online trolling, where any emotional reaction proves that you "lost." Everyone has a chance to speak up now, but this actually diminishes the power of everyone's voice. You're one drop in a few billion or a few hundred million now. And to the extent that you do speak up, it's fully partisan; the complaints of "the other side" are never heard nor granted legitimacy.

I imagine there are people who would call this cynical and defeatist, but I think often people speaking up is purely counter-productive these days. So many attempts to speak up are just yet another partisan volley which can be written off on partisan grounds alone. Worse, given the way that social media works, the worst and most extreme voices from your faction will be the ones which get the most attention. They will paint your entire faction, and from a public opinion perspective, people will view your side as being far more extreme than it might actually be.

I think people have a model in their head of the civil rights movement, and they think that protest alone will be successful just like it once was. It's not clear to me that protest, in and of itself, actually does much these days. Trump seems to enjoy seeing his ideological opponents outraged, and his supporters are either cowed towards him, if not far more vindictive than the man himself. Maybe it's just because I keep seeing the mindless noise from the internet, but real push-back here requires a centralized and most importantly, a focused movement. One that doesn't just incorporate the most extreme policy positions from its wings, and understands how to build a broad coalition. It's something people have forgotten how to do. It might be trite to blame social media, but no one seems to understand how to build a broad coalition in the way that Dr. King did during the civil rights movement. Movements these days tend to exclude, rather than include, and tend to be led by radicals and extremists, which defeat the cause they claim to fight for.
by snozolli | 2025-04-18 12:07:22+00:00
implicitly lumps Trump himself in as a "malicious actor".

Trump is a malicious actor. He literally tried to overthrow democracy on January 6!

Maybe not something I would want said or repeated by my administration either, disregarding the veracity.

Congratulations on empathizing with an authoritarian.

in light of the DOGE findings regarding 150+ year olds collecting social security

Stop being so gullible.

https://www.wired.com/story/elon-musk-doge-social-security-1...

Musk could also have simply looked up the SSA’s own website, which explains that since September 2015 the agency has automatically stopped benefit payments when anyone reaches the age of 115.
by theGeatZhopa | 2025-04-18 12:07:37+00:00
So super stupid to think one is going to be able to talk to Russia and convince them giving up a thing, they started by themselves. If they're progressing, constantly acquire land mass, despite sanctions, less earnings and all the backlash put on Russia by the whole world - we're not talking about the humans died for this on both sides.

So how is it called if you play poker with someone who's got nothing to lose and still has big enough pockets. That's a big gamble.

There's no deal, if the other don't want to. Putin doesn't want. We need more pressure.
by jjtheblunt | 2025-04-18 12:07:38+00:00
> But what is more horrifying for me is that apparently this administration remains representative of a large section of the US population - with seemingly unshakeable approval by between 40% and 50% of the US adult population according to polls.

It’s possible that percentage counts dissatisfaction with the previous administration more than approval for the current one. That is, it might just count people wanting any change.
by cyrnel | 2025-04-18 12:08:48+00:00
I think this article describes the issue well:

https://crankysec.com/blog/community/

> All the cybersecurity companies saying "We don't have anything to say about this situation." is just them being true to their main in-group: for-profit companies that don't want to upset a big current or potential buyer. They are, first and foremost, part of that "community", and they happen to be involved in cybersecurity. Solidarity is happening there, just not to the people in cybersecurity.

This sucks and we should change it for sure. So many other industries have successfully become professionalized, unionized, and kicked the grifters to the curb. But it feels more and more like the cybersecurity grifters are the ones holding the reins.
by apwell23 | 2025-04-18 12:09:57+00:00
you are assuming that people who have them are making conscious choice to have them. I live in india and everyone here has them by default, there is no flowchart with a diamond. its just something ppl do, like going to the bathroom.

in the west answer is that there are more forms of entertainment and fulfillment available now and there is actually a flowchart with diamond in it.
by bayindirh | 2025-04-18 12:11:03+00:00
No, thank you. E-Mail is designed to be an analog to, well, analog mail. I expect to open the same e-mail 5 years later and see it intact, in meaning sense.

For interactivity, we have web pages, and they seem to work fine.

This doesn't compare with Discord, because Discord is meant to be a "chat" platform for ephemeral issues to begin with (yet it's abused as a permanent platform), and AMP for e-mail is abusing a platform designed for permanence for temporary communications.

That's a bad idea(TM).
by credit_guy | 2025-04-18 12:12:59+00:00
Maybe except China? They've built 37 reactors in the last 10 years (with a total capacity of 20 GW) and have 30 more under construction with a total capacity of 31 GW [1]. It is possible this is all subsidized construction, like lots of things in China. How could you tell? Still, there's also a fairly good chance they found a way to make them economical, just like they build roads and bridges and buildings and railways at a much lower cost point than the West.

[1] https://world-nuclear.org/information-library/country-profil...
by dangravell | 2025-04-18 12:13:23+00:00
(Disclaimer: this relates to the commercial project I run, but it is directly answering the parent)

It's not self hosted, more a middle-ground between rented Spotify and self hosted data sovereignty, but this is what we do at https://asti.ga . You store your music in some Internet-accessible storage, such as any S3 compatible endpoint, and Astiga connects and streams your library (and provides offline etc etc). AMA.
by specialp | 2025-04-18 12:13:33+00:00
You see this in other areas too like academia being afraid they will get the ire of the administration and lose money. For a lot of firms they don't want to suddenly get their government contracts dropped by speaking out. This is how things slowly become more authoritarian, and freedom of speech dies. This is also why the gradual expansion of executive power was not good.

If the threat of financial loss stops people from criticizing actions, imagine what it would be like if you would be investigated and jailed on sham charges like in some other countries.
by JackC | 2025-04-18 12:13:35+00:00
> I work for an org with close ties to arXiv, and just like us they are getting a lot more demand due to AI crawling

Funny, I also work on academic sites (much smaller than arXiv) and we're looking at moving from AWS to bare metal for the same reason. The $90/TB AWS bandwidth exit tariff can be a budget killer if people write custom scripts to download all your stuff; better to slow down than 10x the monthly budget.

(I never thought about it this way, but Amazon charges less to same-day deliver a 1TB SSD drive for you to keep than it does to download a TB from AWS.)
by sheepdestroyer | 2025-04-18 12:13:35+00:00
Objective reality, it exists.

Telling your audience obviously false / anti-factual lies, without any regard for fact checking, is not just "biased reporting". And it is inherently wrong, malevolent, evil.

Anyway, I'm amazed each time I hear right wingers who did not get the joke seemingly complaining about how Reality has a left leaning political bias...
by casenmgreen | 2025-04-18 12:14:15+00:00
Just read of this on BSky.

Has some of the protected disclosure document from the whistleblower.

https://bsky.app/profile/mattjay.com/post/3ln2dgoksce2e

Looks like Elon's staff went in and made a copy of everything - which in this case NLRB, so sensitive stuff, but any state department going to have a ton of sensitive stuff - and sent it who knows where; this after disabling all logging and a ton of security, presumably to try to cover their tracks.

This is bad. These guys are looking like bad actors, with State-level authorization for access to everything.

Also looks like they're kids and don't have the hang of security, and the professional Russian State run APTs have hacked them.
by vitaly-pavlenko | 2025-04-18 12:14:52+00:00
my favorite paper on analyzing chord progressions so far is this seemingly niche comparative study of five metal genres: https://pure.hud.ac.uk/ws/portalfiles/portal/58172029/Boddin...

it shows which chords exactly set black metal, power metal, metalcore, death metal and progressive metal apart

(i also try to do my own narrative on chords, but so far there's nothing to write home about: https://rawl.rocks/)
by orochimaaru | 2025-04-18 12:15:29+00:00
Hiring and payroll can be a complete nightmare especially with publicly funded organizations and initiatives like arxiv.

Also plenty of North Korean bad actors masquerading as US remote workers. I’m betting as European remote workers too. I like remote work but shit like that is why we can’t have good things.

https://www.yahoo.com/news/thousands-north-korean-workers-in...
by fzzzy | 2025-04-18 12:15:30+00:00
OpenAI's Codex CLI uses it on macOS. It's in typescript but maybe I'll take a look at what they do and port it to python.

[edit] looks really simple, except I'll have to look into how their raw-exec takes care of writeableRoots: https://github.com/openai/codex/blob/0d6a98f9afa8697e57b9bae...

[edit2] lol raw-exec doesn't do anything at all with writeableRoots, it's handled in the fullPolicy (from scopedWritePolicy)
by yousif_123123 | 2025-04-18 12:15:46+00:00
I have noticed Gemini not accepting an instruction to "leave all other code the same but just modify this part" on a code that included use of an alpha API with a different interface than what Gemini knows is the correct current API. No matter how I promoted 2.5 pro, I couldn't get it to respect my use of the alpha API, it would just think I must be wrong.

So I think patterns from the training data are still overriding some actual logic/intelligence in the model. Or the Google assistant fine-tuning is messing it up.
by stevekemp | 2025-04-18 12:17:03+00:00
Thanks! One of my biggest frustrations with the retro-scene is having to deal with old compression-formats, and disk-archives, so that was very much a design choice.

Many of the recent/modern emulation projects work the same way. In addition to RunCPM there's also the excellent rust-based iz-cpm project which I enjoyed studying at times.
by kragen | 2025-04-18 12:18:06+00:00
I agree about WordStar and TP. You can kind of justify all of CP/M's problems by reference to the limits of the machines it had to run on (for example, they often had no real-time clocks), but I still think you could do better in many ways. For example:

- The command processor didn't have to be so limited, as amply demonstrated by ZCPR, or so hard to use, as demonstrated by the p-System.

- Record-oriented file access was probably a mistake. The 128-byte record size meant that you still had to use 2-byte record numbers to get files of over 32K, and that writing a single record required wastefully reading a whole 512-byte sector in order to not lose the other three records in the sector. Byte-based file access would have been far better for the usual case, even at the expense of needing 24-bit seek offsets for very large files (over 64K). This would have to be built on sector-based access, but the intermediate layer of record-based access is purely dead weight for most applications. Sector-based access (or access in larger blocks as in Forth) would allow you to use 1-byte sector numbers until the advent of double-density disks.

- Using different BIOS calls to write to the terminal, the printer, and the paper tape punch was obviously a mistake, and one that made it very difficult to extend the set of available devices. I believe HDOS did a better job here. Moreover, if you adopted byte-based file access, you could use a single BDOS call to write to a file, the terminal, the printer, or the punch, and analogously for reading. This also would have made it easier to support multiple terminals.

- The user interface of ED was stuck in the teletype era. But almost nobody ran CP/M on a teletype, because teletypes cost more than CP/M crates. Before long most CP/M machines had a monitor built in, like the Kaypro, Osborne, and H-89. Even BASIC-80's unusably bad line editor gave you a live display of the line you were editing, and WordStar demonstrated that it was possible to do much better on the same hardware.

- The "user" facility in its filesystem was useless.

So, I'm not a huge fan of CP/M. I think virtually all of its major design decisions were mistakes, except for the BIOS/BDOS split, though not such serious mistakes as to make it completely unusable. I'm interested to hear why you disagree so strongly.
by eigenschwarz | 2025-04-18 12:18:43+00:00
In a medical setting, where I am more familiar with it, tetany is never good. Personally it is also wildly uncomfortable. Perhaps it's fine and somehow pushing through it is part of the "experience", but if I want an altered consciousness I'll stick to a psilocybin-based retreat every 5-10 years and my meditation practice in between :D.
by graemep | 2025-04-18 12:19:29+00:00
I am not advocating tearing everything down, as that will make things worse, especially if done violently.

> That leaves no room for democratic participation

I think there is very limited room for democratic participation and it has become far to difficult to change anything. If I vote and I do not care which of the parties that have a chance of winning wins because their policies are so similar it does not matter, where is my democratic participation? Even if the parties are different and I do not like the policies of either, what is the value of my vote?

I think things will improve in the long term when there is sufficient pushback, but it will take a long time.
by Robertste123 | 2025-04-18 12:20:10+00:00
The Amazon clone is expanding in 2025, and its unparalleled potential is enough to entice an entrepreneur to venture into it. However, a top-notch platform is essential if you want to profit greatly from it.

Skype: trioangle | Mail ID: sales@trioangle.com | Whatsapp: +91 6379630152
by jrmg | 2025-04-18 12:20:13+00:00
When I moved internationally, I found out about the ‘M-Bag’ service. The post office gives you real mail sacks (hefty, expensive seeming things!), which you can directly fill with books and printer matter (and nothing else!). They’re then tagged after sealing the drawstring, and shipped internationally!

I’m sure the USPS wants those sacks back, but the post office in the UK, where I had them sent, was just perplexed by them and told me to keep them.

https://faq.usps.com/s/article/What-is-M-bag-Service
by bluenose69 | 2025-04-18 12:23:02+00:00
LaTeX is still very much in favour in my field of geophysical research. I believe that the same is true across most fields that rely on mathematical notation to explain things in written form. I've never found it difficult to write in a non-WSIWYG system ... indeed, it is really quite convenient.

Years ago I had a student in my class who was unable to make out written material, but had a machine that read text aloud. My class notes (some 300+ pages) are chock full of mathematics. I went to the student's house to see how that reading machine worked. Provided with LaTeX input, it said a lot of things like "backslash alpha" and "begin open brace equation close brace" stuff. I wrote a quick perl script to change it, so it said "alpha" and "begin equation". Presto -- it was exactly what the student needed. This was, as I say, many years ago. Maybe now there is software that can handle MSword files, etc., but that definitely did not exist at the time. The result? The student was able to take the class, and did very well in it.