MurphyA/hacker-news huggingface dataset:
by corimaith | 2025-04-15 12:13:21+00:00
The methods that institutional investors have, like market making or delta one strategies, aren't available because of the rules, it's because individual investors literally don't have the scale, flow and networks to do it.

Second of all, at the end of the day it's other people money's they're using, and are entrusted to manage. You can't demand people to just lend money to anyone, any sort of free market of loans will quickly coalesce into a few capital allocators.
by thrance | 2025-04-15 12:13:44+00:00
What? Have you really read the Nature article? You're talking absolute nonsense here. No one is out to redefine mathematics, fuck!

You want real politicization of science? Check out the GOP's pomicies. They're the one cutting funding to organization that won't bow to their ideological lines. They're the ones barring access to foreign scientists for having criticized the dear leader online. They're the ones appointing political commissars to overview what's fine or not to work on in labs.

75% of scientists that ever published in Nature are now considering leaving the US [1] from fear of the administration. Is that not a concern to you?

[1] https://www.nature.com/articles/d41586-025-00938-y
by miros_love | 2025-04-15 12:14:47+00:00
>European versions of ARC

But this is an image-like benchmark. Has anyone looked at the article about the EU-ARC, what is the difference? Why can't you measure it on a regular one?

I glanced through it, didn't find it right away, but judging by their tokenizer, they are learning from scratch. In general, I don't like this approach for the task at hand. For large languages, there are already good models that they don't want to compare with. And for low-resource languages, it is very important to take more languages from this language group, which are not necessarily part of the EU
by arghwhat | 2025-04-15 12:15:08+00:00
> I personally feel bad for the environment

1 item per day is certainly not efficient, but nowadays temu and aliexpress batch things over a small period so that shouldn't really happen...

> and all the people on the losing side of cheap low quality junk production

Remember that taking away bad jobs does not save anyone, quite the contrary. People go from having shit jobs to no jobs, or even worse jobs with lower-profile companies.

Helping them requires creating vast numbers of better paying jobs with better working condition in their country, which require redirecting vast amounts of money to those countries. E.g., by buying even more stuff from those regions, but from manufacturers paying better wages (and selling goods more expensively), so they end up having to massively expand and hire more.
by roelschroeven | 2025-04-15 12:15:21+00:00
I tried with a simple database, and it just shows me a blank screen. The console in developer tools shows an exception (both in Firefox and Chromium):

index-CGfYebmt.js:85 Uncaught RangeError: Offset is outside the bounds of the DataView at DataView.prototype.getUint32 (<anonymous>) at R0 (index-CGfYebmt.js:85:4683) at X0 (index-CGfYebmt.js:85:7966) at index-CGfYebmt.js:85:8157 at Array.map (<anonymous>) at Q0 (index-CGfYebmt.js:85:8150) at index-CGfYebmt.js:85:8240 at Object.useMemo (index-CGfYebmt.js:48:46087) at My.$.useMemo (index-CGfYebmt.js:17:7276) at V0 (index-CGfYebmt.js:85:8228) R0 @ index-CGfYebmt.js:85 X0 @ index-CGfYebmt.js:85 (anonymous) @ index-CGfYebmt.js:85 Q0 @ index-CGfYebmt.js:85 (anonymous) @ index-CGfYebmt.js:85 useMemo @ index-CGfYebmt.js:48 My.$.useMemo @ index-CGfYebmt.js:17 V0 @ index-CGfYebmt.js:85 tc @ index-CGfYebmt.js:48 bc @ index-CGfYebmt.js:48 lo @ index-CGfYebmt.js:48 No @ index-CGfYebmt.js:48 wm @ index-CGfYebmt.js:48 Xc @ index-CGfYebmt.js:48 Ao @ index-CGfYebmt.js:48 Qo @ index-CGfYebmt.js:48 me @ index-CGfYebmt.js:25
by firesteelrain | 2025-04-15 12:15:26+00:00
“ Khalil is not a citizen, and as such his permanent residency is based upon continuously meeting the government's definition of possessing "good moral character"

https://www.reddit.com/r/changemyview/comments/1j9ata1/comme...

Another

https://europeanconservative.com/articles/news-corner/us-jud...

“ That form asks: “Have you ever, or do you intend, to provide financial assistance or other support to terrorists or terrorist organizations?” As the Pittsburgh Jewish Chronicle reminds, less than a year after arriving at Columbia on a student visa, Khalil was leading American undergraduates in actions in support of Hamas after the October 7 massacres. Khalil was involved in illegal occupations of buildings, served as the negotiator on behalf of the occupying students with the university, pressuring the administration to accommodate student demands based on their illegal activity, and helped organize an illegal encampment on the campus that denied access to “Zionist” students. ”
by jsenn | 2025-04-15 12:15:42+00:00
yeah, the linked paper [1] has more detail--basically they seem to start with a seed set of "class labels" and subcategories (e.g. "restaurant review" + "steak house"). They ask an LLM to generate lots of random texts incorporating those labels. They make a differentially private histogram of embedding similarities from those texts with the private data, then use that histogram to resample the texts, which become the seeds for the next iteration, sort of like a Particle Filter.

I'm still unclear on how you create that initial set of class labels used to generate the random seed texts, and how sensitive the method is to that initial corpus.

[1] https://arxiv.org/abs/2403.01749
by KronisLV | 2025-04-15 12:16:13+00:00
I also quite liked the EuroLLM project: https://huggingface.co/blog/eurollm-team/eurollm-9b

Was pretty good with Latvian (better than other models this size as well as variants of Llama or Qwen that I could run) and I assume probably with other EU languages as well.
by constantcrying | 2025-04-15 12:16:17+00:00
Yes, I am very intelligent for figuring out that products, made under near slavery conditions with the sole goal of making them as cheaply as possible by companies who have exactly zero reputation and whose customers have no way to retaliate are in fact bad. This was an extremely complex deduction on my part and in no way totally obvious.

Also, things that are very bad for the environment should be banned. Not by me, but by the government.
by dmd | 2025-04-15 12:16:29+00:00
I feel like this is an underrated superpower. I don't have it - my digit span[0] is about 3, well below normal, so I've always felt that while I'm pretty smart (and managed to get a scientific PhD at an Ivy, so my brain's doing /something/ right), I've always felt like I'm driving a Ferrari but the windows are all blacked out and I'm looking through a tiny hole.

[0] https://en.wikipedia.org/wiki/Memory_span
by lesuorac | 2025-04-15 12:16:49+00:00
But hindsight of HN is different from hindsight of FaceBook.

FaceBook was literally collecting data on what apps people were using on their phones and empirically saw the rise of Instagram. Of course the rise of Instagram didn't need to continue but that's why you buy all the realistic competitors so even if most of them fail you have a moat of dead companies.
by Tainnor | 2025-04-15 12:17:17+00:00
* Take a complicated tree structure representing a document management system and transform it into some different tree structure, e.g. by filtering out elements or fields due to missing permissions, or by rewriting it in the way that the elasticsearch index expects it, or a bunch of other reasons.

* Generate a TOC of an HTML document by parsing all the header elements. More generally, anything that's related to parsing (something which I've had to do several times).

* Run a complex (> 50 LOC) validation on some user input.

* Generate a word document or PDF. Conversely, parse a word document or PDF.

* Financial computations, such as calculating totals of an order made up of multiple line items with discounts, taxes, additional charges, etc.

(I'm purposely leaving out more non-standard applications, such as pre-LLM chatbots, or an entire mathematical problem solver that doesn't even use a database, but just so you know, they exist too.)

There's also the much more immediate counterpoint that it's of course possible to write web applications in Haskell (or OCaml, Scala, ...), otherwise all these frameworks wouldn't exist.
by lsaferite | 2025-04-15 12:17:46+00:00
Is there an API endpoint at OpenAI that gives the information on this page as structured data?

https://platform.openai.com/docs/models/gpt-4.1

As far as I can tell there's no way to discover the details of a model via the API right now.

Given the announced adoption of MCP and MCP's ability to perform model selection for Sampling based on a ranking for speed and intelligence, it would be great to have a model discovery endpoint that came with all the details on that page.
by grey-area | 2025-04-15 12:18:32+00:00
Interesting dynamic here with echoes of the .com bubble where there is a huge web of industries all dependent on the current setup continuing and money being available for consumer spending and ads - when that dries up it will impact not just those selling goods imported from China, but everyone in the US.

Disrupting US trade quickly with massive global tariffs will cause all sorts of secondary effects like a massive downturn in ad spending - directly affecting companies like Meta and Google who look insulated right now because they don't sell physical products.

Not a great time to be dependent on ad revenue.
by tannhaeuser | 2025-04-15 12:19:15+00:00
I mean, Mistral AI is a Paris-based company, and theirs was considered on par or better than other open weight models such as llama3.1 and qwen2.5, and mistral-24b is currently beating oh-so-great gemma3-27b depending on tasks.

Also, Stable Diffusion was originally (and still is I believe) developed in Munich.

It's true though that raising capital and finding investors works wayyy better in the US (kindof needless to say on HN) and so was getting top talent - at least in the past. Don't get me started on energy prices ;) but I don't believe those contribute significantly in the end anyway.
by TheAceOfHearts | 2025-04-15 12:19:36+00:00
There's a KnowYourMeme [0] post with additional details and context. Most interesting to me is finding out that there' s a word filer / transformer, so SMH becomes BAKA and TBH becomes DESU, as two examples.

[0] https://knowyourmeme.com/memes/events/april-2025-4chan-hack
by xtiansimon | 2025-04-15 12:19:37+00:00
Hyperbolic. I imagine if a blind person is convinced by an unfamiliar/altered crosswalk voice to “walk into traffic”, they need a personal caregiver to navigate outdoors. Blind persons are “blind”, not stupid.

But I take your point, there is a line, and we expect infrastructure and trusted resources to be inviolate. And yet these norms are falling all around the edges of society.

The Bay Area has a long history of activist artist hacking society. Billboard Liberation Front, for example. The Bay Area is not just filled with tech Bros.
by martinald | 2025-04-15 12:19:38+00:00
The real reason is that bandwidth is dirt cheap, if you know what are you are doing at scale.

For 'hobbyists' there is a lot of complexity with setting up your own streaming infrastructure compared to just using YouTube or Twitch.

Then for media companies who want to own it, they can just buy their own infra and networking which is outrageously cheap. HE.net advertises 40gbit/sec of transit for $2200/month. I'm oversimplifying this somewhat, you do have issues with cheap transit and probably need backups especially for certain regions. But there isn't much of a middleground between hobbyists and big media cos.

For piracy (live sports streams), I've read about https://en.wikipedia.org/wiki/Ace_Stream being used for this exact purposes FWIW. This was a while back but I know it had a lot of traction at one point.
by DaiPlusPlus | 2025-04-15 12:19:46+00:00
> This was just a test, and it was successful

It's too soon to say it's "successful": SCOTUS was 9-0 against and that was still only a few days ago, so far from being a success it's now turning into a constitutional crisis... assuming the administration doesn't fold, or flip-flop, or some combination of the two - which we've already seen plenty of[1].

----------

[1] the seemingly arbitrary and capricious tariff changes announced almost every day ever since the-day-after-April-fools-day.
by NhanH | 2025-04-15 12:19:51+00:00
The celebration now mainly focuses on “unification”, with some slight flavor of “independence/ liberation of the South”. The US is not even mentioned. So the idea is that we celebrate the finality of having a unified and independent country after a very long period of not being so.

The message is very deliberate and has been gradually more focused on the “unification” aspect since at least 2014-2015.
by rwmj | 2025-04-15 12:20:22+00:00
I'm not sure about that. In these fields there are plenty of places where you need to ingest or process masses of data (eg. from a sensor in a medical device), and you're only going to sell 5 of these machines a month for 100K each, so $3000+ bill of materials for an FPGA to solve the problem makes sense.

The problem (for Intel) is that you don't sell billions of dollars of FPGAs into a mass market this way.
by hummusisdata | 2025-04-15 12:20:31+00:00
This is my recent article exploring how data quality will become the primary differentiator between organizations that thrive and those that struggle in the era of AI agents. I discuss why companies with the cleanest, most reliable data will win - not necessarily those with the most advanced AI models. The article includes:

Real-world examples of AI failures (like the $1 Chevy Tahoe incident) Assessment of how data governance must evolve Practical checklist for organizations to evaluate their AI readiness Analysis of changing roles for data professionals

I'd appreciate your thoughts and experiences with these challenges.
by potato3732842 | 2025-04-15 12:20:45+00:00
>If you’re a consumer, I’m not sure why you’re not singing praises of this arrangement. If someone in China can sell me exactly the same stuff for 1/4 the price you’re charging, shipping included,

Because those low shipping prices are being subsidized by taxes and the rates other shippers pay which make their way back to him because he shares an economy with them.

Just because the specific source of the subsidy is complex and can't be accounted for by the consumer doesn't mean it's not paid.
by sam_goody | 2025-04-15 12:20:51+00:00
Off topic, but _why_ is it good that the gov gives hundreds of billions of dollars [if you include grants] to higher ed.

I work in a startup where none of the programmers have been to college, and they seem to get along just fine.

I volunteer in a youth group that teaches "soft" sciences, and I am sure that groups like ours do a better job at that with a lot less funding.

Trade schools cater to the lower income, are much more effective dollar for dollar, and get a lot less federal funds. If that money were to be poured into trade schools instead of universities, it would help create a better middle class.

Why should Harvard be so entitled?

EDIT: IMO, The reason youth go to college is to have fun. The real reason the parents are willing to pay, is because their children will forge connections with other wealthy families that is worth the money. It may be good for the wealthy that the money stays in their circle, but IMO this is not something the Gov should subsidize.
by guappa | 2025-04-15 12:21:08+00:00
I had a CTO that would insist he had to pick every single dependency himself personally. And he mostly decided depending on how much he liked the CSS on the website.

That's how we got to use a payment provider that had absolutely no documentation and was located on the other side of the world, so queries to their support team would take 24h.

We never managed to actually get any money via that provider.
by RHSeeger | 2025-04-15 12:21:19+00:00
> Then it is a poorly written contract, and the party that agreed to it was tricked or poorly advised.

Well, yes? I mean, we're talking about a situation where one of the parties involved in the contract isn't acting in good faith. And people frequently can't understand contracts. Is there anything surprising about the fact that someone was misled or "tricked" in such a situation?
by acdha | 2025-04-15 12:21:38+00:00
This part is really damning: a real efficiency audit might need a lot of access to look for signs of hidden activity, but they’d never need to hide traces of what they did:

> Meanwhile, according to the disclosure and records of internal communications, members of the DOGE team asked that their activities not be logged on the system and then appeared to try to cover their tracks behind them, turning off monitoring tools and manually deleting records of their access — evasive behavior that several cybersecurity experts interviewed by NPR compared to what criminal or state-sponsored hackers might do.

The subsequent message about Russian activity could be a coincidence–Internet background noise-but given how these are not very technically skilled and are moving very fast in systems they don’t understand, I’d be completely unsurprised to learn that they unintentionally left something exposed or that one of them has been compromised.
by imgabe | 2025-04-15 12:22:26+00:00
Sure, it’s not infallible, but having other experts in the field read and judge a candidate’s work is at least an honest attempt at assessing merit.

Whereas going by who can write the most enthusiastic essay about diversity, as judged by the blue-haired gender studies major in the diversity center, is a system that will only select for rabid ideologues and disingenuous bullshitters.
by dkislyuk | 2025-04-15 12:22:27+00:00
This is a great characterization of self-information. I would add that the `log` term doesn't just conveniently appear to satisfy the additivity axiom, but instead is the exact historical reason why it was invented in the first place. As in, the log function was specifically defined to find a family of functions that satisfied f(xy) = f(x) + f(y).

So, self-information is uniquely defined by (1) assuming that information is a function transform of probability, (2) that no information is transmitted for an event that certainly happens (i.e. f(1) = 0), and (3) independent information is additive. h(x) = -log p(x) is the only set of functions that satisfies all of these properties.
by kergonath | 2025-04-15 12:22:59+00:00
I don’t buy things online too often (about once a month, I would say), but regularly I buy on AliExpress things that I cannot find elsewhere at a decent price or at all (mostly electronics and specialised hobbyist stuff). On the other hand, yes, Temi is cheap garbage, and so is much of AliExpress. And Amazon as well, to be honest. Real life leaves room for a lot of nuance.
by ltbarcly3 | 2025-04-15 12:24:03+00:00
No, it's mostly a cancer survivors support group. Every third post was about cancer, what is causing it, and frank expressions of helplessness in the face of it.

About half the posts were pornography, racist rants, or memes making fun of someone, often for being mentally handicapped.

Five percent was accusing the moderators of sleeping on the job.

Edit: I love that people are down-voting this, it really shows how much people like to have an opinion even while they can't recognize even the most obvious things that requires any information about the subject.
by EvgeniyZh | 2025-04-15 12:24:43+00:00
It sounds plausible that Mahdawi is the second person on Khalil's case memo [1]. If that's the case, the claim is that "alien whose presence or activities in the United States the Secretary of State has reasonable ground to believe would have potentially serious adverse foreign policy consequences for the United States" is deportable.

[1] https://www.documentcloud.org/documents/25894225-dhs-documen...
by ben_w | 2025-04-15 12:25:07+00:00
Hmm…

So that's cool, but now I'm thinking: the distant galaxies are redshifted and time-dilated in equal proportion, and also more densly packed because the universe was smaller in the past, so I expect the actual rate of supernovas to be significantly smaller than simply multiplying 1/century/galaxy by 1e11 galaxies.

Edit: also I don't know if rate of supernovas changes over history thanks to different steller environments giving the population-1/2/3 generations of stars…
by lilwobbles | 2025-04-15 12:25:33+00:00
I don't get this argument. All the cheap, toxic, unsafe, non-lasting crap will still exist, it's just going to be sold on Amazon with 1-day shipping. Consumers want these products and the market just fills the demand. The deregulation that will take place under this administration will lead to even more, toxic, unsafe crap flooding the market, except it'll just be manufactured in the U.S.
by pfdietz | 2025-04-15 12:25:58+00:00
IEEE Spectrum had their usual interesting in-depth look at this a few years ago, for military fiber lasers.

https://spectrum.ieee.org/fiber-lasers-mean-ray-guns-are-com...

The technique appears to involve multiple lasers of slightly different wavelength; this allows the beams to be combined and to not interfere with each other.
by jajko | 2025-04-15 12:26:10+00:00
Sometimes, one stands up to the bully even if its not the most convenient thing to do, something about morals and culture. Bully thinks this is some arab market with standalone greedy participants just like himself, while the game is anything but that.

Bipolar bully on top just generates random chaos, the best course is to cut oneself off as much as possible as quickly as possible, which is clearly happening behind the curtains
by jqpabc123 | 2025-04-15 12:26:45+00:00
it's hard work trying to get information on how bad these devices could spy on you

The orange flag is when setup requests my wifi password.

But the big red flag for me is when configuration fails without unfettered WAN access. In this case, the product goes back in the box. If you allow this, you allow anything. Someone else effectively owns the device.

An easy test for this --- simply unplug your network from the WAN modem and see what happens.
by jmyeet | 2025-04-15 12:27:23+00:00
4chan will be studied for years for its role in alt-right radicalization as well as being a baroemeter for young male discontent.

For example, QAnon started on 4chan (I believe as a joke?) [1]. Nowadays a lot of 4chan users and traffic have since migrated to Twitter for pretty obvious reasons. Pseudo-intellectual racism has a lot of roots in 4chan (eg the popularity of Julius Evola [2]) that's deeply tied to "trad" content, Andrew Tate fandom, the manosphere and "self-improvement" [3].

Things like the Bored Ape Yacht Club originated on 4chan and it's full of racist memes [4]. A lot of racist and antisemitic memes originated on 4chan.

Worst of all, it seems like Elon Musk is motivated by a deep desire to be liked by 4chan [5].

So the point is that 4chan users (and admins) have a lot of real-world influence and that's kinda scary. It also makes them a target for this kind of hack. I suspect a lot of people will be exposed by this and in more than a few cases, you'll find ties to the current administration.

[1]: https://www.nbcnews.com/tech/tech-news/how-three-conspiracy-...

[2]: https://jacobin.com/2022/12/fascism-far-right-evola-bannon-b...

[3]: https://www.nature.com/articles/s41599-021-00732-x

[4]: https://www.youtube.com/watch?v=XpH3O6mnZvw

[5]: https://www.aljazeera.com/opinions/2025/4/6/how-musk-ushered...
by sznio | 2025-04-15 12:27:30+00:00
the mechanics are old

there's no other online community i know of that still allows fully anonymous posting

the culture changed, but the "environment" causing the culture there to be the way it is still same as the original.

the bump/delete mechanics work well to promote the most controversial, most engaging content, without any advanced statistics or ML.

despite being a shitty place, i don't feel advertised to, spied or in any way abused _by the software itself_ while browsing it