MurphyA/hacker-news huggingface dataset:
by aatd86 | 2025-05-21 20:21:55+00:00
I don't think that it is sound to incorporate a DSL that imitates html only approximately into a language. That should remain an external library at best.

And that's irrespectively of my view on jsx, the latter which I find non ergonomic and confusing. That many people are being force fed it to the point of familiarity does not mean that it is the best DX.

we went from (html + js> to html in js and js in html. Quite very confusing to me. Knotty (naughty) complexity pun intended.

It's more akin to stockolm syndrom to not improve on the statu quo at this point.
by ergocoder | 2025-05-21 20:22:05+00:00
Yeah of course we cannot short a non-public company.

If we could, then forget OpenAI. I would short every private company and end up richer than Elon Musk because 99% of the private companies fail.

“Wanting to short a private company” is such a weird comeback. Like yeah private companies most likely fail. Everyone knows.
by mrguyorama | 2025-05-21 20:22:25+00:00
Saying this in a programmers forum is pretty rich.

If you've ever written code that wasn't clear and obvious and necessary to the dumbest script kiddie, it's bad code, right? I'm sure you love those PR bots that sass you for "function getting long" right? They are never wrong, right?

Why do we continue to insist, as the world gets ever more complicated, that non-experts not understanding expert things is a problem with the experts?

Most adults don't understand relativity, so it can't possibly be correct.
by Lerc | 2025-05-21 20:22:38+00:00
>So I don't think your tinystories example qualifies for the PRH, since it's not enough data and it's not representative of the whole Internet. And RNA data is (I would guess) something very different altogether.

My thought there was that you'd be comparing tinystories to a model that trained on the entire internet. The RNA related information would be a subset of the second representation that has no comparable encoding in the tinystories space. Can you detect that? If both models have to be of sufficient scale to work the question becomes "what is the scale, is it sliding or a threshold? "

>> Assuming that is true. If you can detect when you are trying to put a square peg into a round hole, does this mean you have the ability to remove square holes from a system?

>Not sure I follow this part.

Perhaps the metaphor doesn't work so well. If you can detect if something is encodable in one embedding model but not another. Can you then leverage that detection ability in order to modify an embedding model so that it cannot represent an idea.
by amatecha | 2025-05-21 20:22:41+00:00
A couple years ago was "the year of" open source OSes for me. I only have one remaining machine running Windows, and it just sits there doing nothing because I don't actually use it anymore. Same with my one remaining Apple machine. Well, I mean I have a couple retro machines that aren't in everyday use of course. Everything else is running Linux or BSD.
by falcor84 | 2025-05-21 20:22:53+00:00
I love this, and as for AI-assisted cheating, I would make it such that the student can use any tool whatsoever under the sun, but then needs to do a live in-person presentation on it followed by 10 minutes of Q&A. Some are better bullshitters than others, but you'll still see a very clear difference between those who actually worked and those who had the work done for them.
by fullstackchris | 2025-05-21 20:23:11+00:00
from my experience its about the speed of a very competant human - one of my favorite custom tools ive written is just access to a series of bash commands - havent tested with others but claude very quickly browses through files, reads them, and so on to do whatever it was you prompted. But even then it is all contextual - for example, I had to remove 'find' because as one would expect, running 'find' against a huge directory set is very slow!
by anonymars | 2025-05-21 20:23:26+00:00
Multiple things can be true at the same time:

- on average there is a pay gap

- not all of it is an apples-to-apples comparison of job/experience/hours

- not all of it results from discrimination

Put another way: is all of that pay gap due to "sexism"/"discrimination"? If not, then simply removing discrimination won't necessarily result in equality. What else might be at play, and what does that mean for public policy?

As an example, this study (https://scholar.harvard.edu/files/bolotnyy/files/be_genderga...):

> Mechanically, the earnings gap can be explained in our setting by the fact that men take 48% fewer unpaid hours off and work 83% more overtime hours per year than women. The reason for these differences is not that men and women face different choice sets in this job. Rather, it is that women have greater demand for workplace flexibility and lower demand for overtime work hours than men. These gender differences are consistent with women taking on more of the household and childcare duties than men, limiting their work availability in the process (Parker et al., 2015; Bertrand et al., 2015).

The original (provocative) "80 cents" statement seems to imply that the problem is simply solved by making sure we don't discriminate in pay (or perhaps just boost women's pay to compensate, or, as I described here, offer higher referral bonuses: https://news.ycombinator.com/item?id=43890123) and that's that, we've solved it. But it sounds like there's more to it, doesn't it?

See also "why is there a gender pay gap" (https://ourworldindata.org/economic-inequality-by-gender#why...), which discusses various adjustments, which in that dataset (contemporaneous with Scott's post, coincidentally) brings it to roughly 90 percent. So right off the bat there exists "well, actually, it's closer to 90 cents when adjusting for..."

To me it was an inflammatory way to say, "for a happier life, just smile and nod and do not engage with the topic", set up to provoke exactly the sort of internet back-and-forth to illustrate the point. Parent at least tries to look for some good faith, whereas its sibling straight out yells that I must be a sexist bigot.
by godelski | 2025-05-21 20:23:53+00:00
> until laptops sold at Walmart or Best Buy start coming with Linux pre-installed as an option

This is a circular problem though. They'll do it if Linux starts becoming more popular.

If you want to see this, make sure your browser agent is broadcasting Linux[0]. Make sure you're using Steam in Linux.

But right now Steam has Linux at <3%[1]. It is more than OSX, but not enough. I do think above 5% and it'll start to be taken seriously, and 10% we'll start seeing moves. Linux doesn't need 90% of the marketshare to dramatically change the world. 10% is more than enough. Even 20% would be momentous and force both Microsoft and Apple to change strategies. Don't feel like there's no hope. Just because it is an unrealistic expectation today doesn't mean it will be tomorrow. And your actions today change the odds of what happens tomorrow. So don't give up.

You don't have to change the world overnight. But you do need to make steps in the right direction, even if small, to make the world move.

[0] You can even do this while using Windows! Hell, you can use Chrome and tell people you're using Firefox on Linux if you believe in those things but just are unwilling to make the switch yourself. The signaling still does something (it is better than nothing).

[1] https://store.steampowered.com/hwsurvey/Steam-Hardware-Softw...
by SubiculumCode | 2025-05-21 20:25:18+00:00
I am a curious amateur, so I may say something dumb. but: Suppose you take a number of smaller embedding models, and one more advanced embedding model. Suppose for a document, you convert each model's embeddings to their universal embedding representation and examine the universal embedding spaces.

On a per document basis, would the universal embeddings of the smaller models (less performant) cluster around the better model's universal embedding space, in a way suggestive that they are each targeting the 'true' embedding space, but with additional error/noise?

If so, can averaging the universal embeddings from a collection of smaller models effectively approximate the universal embedding space of the stronger model? Could you then use your "averaged universal embeddings" as a target to train a new embedding model?
by timschmidt | 2025-05-21 20:25:19+00:00
You're right that the crate, not the file, is the smallest unit of compilation.

My largest rust project is still fairly small at around 8k lines across two dozen files. Still, it builds and links in 30 seconds on my workstation which is several years old and not particularly fancy.

I could see this beginning to become an issue around 100k lines of code, but I'd think most people would be looking to split into multiple crates before that just for readability.
by AStonesThrow | 2025-05-21 20:25:29+00:00
> thoroughly mapped the Oort Cloud

So it’s interesting that the Oort Cloud is often mentioned as a real thing. Surely there are plenty of bodies discovered which are orthogonal to its existence, but Oort’s “Cloud” itself still enjoys only the status of hypothesis and not reality.

https://en.wikipedia.org/wiki/Oort_cloud

Sadly, even Wikipedia editors seem unable to distinguish between the formal definitions of “hypothesis” vs. “theory” when delivering such a scientific article.
by yc-kraln | 2025-05-21 20:27:21+00:00
The article reads like sour grapes: It's always someone else's fault.

It was your company. If you knew the press in the US was better, /why didn't you expand to the US/? /Why didn't you raise money in the US?/ Companies are ultimately transnational, the market for capital, talent, and eyeballs is global, and if you weren't getting what you wanted from the European press, why didn't you go after the American press?

There are some structural things which make things more difficult than if you're living in SF, LA, or NYC--I'd argue more strongly it's the lack of pension funds investing as LPs in funds which results in less overall money in the ecosystem--but there's a LOT of the US which is not those places, and I would strongly argue that it's easier to be a startup in Berlin or Paris than in Chicago or Dallas.
by straws | 2025-05-21 20:27:49+00:00
Both ProseMirror and the newer version of CodeMirror have a pretty elegant solution to this: each modification to the document is modeled as a step that keeps track of indices instead of node/text identities, and uses a data structure called a "position map" that the buffered steps can be mapped through to create steps with updated positions, which are then applied to your document.

In practice, it works quite well. Here's more info:

https://marijnhaverbeke.nl/blog/collaborative-editing.html https://marijnhaverbeke.nl/blog/collaborative-editing-cm.htm...
by LPisGood | 2025-05-21 20:27:55+00:00
I think it is very intuitive that more space beats the pants off of more time.

In time O(n) you can use O(n) cells on a tape, but there are O(2^n) possible configurations of symbols on a tape of length n (for an alphabet with 2 symbols), so you can do so much more with n space than with n time.
by bredren | 2025-05-21 20:28:00+00:00
“Including its software…”

That’s a remarkably big product scope to own!

Are we talking about Devex workflows from docs on getting fed through Ive’s group?

The Verge must have this wrong, it doesn’t make sense and I don’t think Ive would be interested in maintaining design on ChatGPT’s web client.

Besides, only Anthropic beats the UX of ChatGPT. It would seem like a mistake to dismiss the authority of the folks who have built that product up.
by fschuett | 2025-05-21 20:28:01+00:00
> “Take a screenshot every few seconds” legitimately sounds like a suggestion from a low-parameter LLM that was given a prompt like “How do I add an arbitrary AI feature to my operating system as quickly as possible in order to make investors happy?”

No, actual AI is smarter than Microsoft managers, it seems:

Here are some ideas for adding an arbitrary AI feature to your operating system quickly to make investors happy:

- AI File Search: NLP for file/setting search (search files by NLP querying)

- Auto Window Layouts: AI-suggested window organization ("coding mode", "research mode" depending on detected usage patterns)

- Smart Notifications: automatic notification condensing to reduce clutter

- AI Clipboard: Keeping a categorized clipboard paste based on content

- Predictive App Launcher: Suggests apps based on daytime, usage, recently opened files

- AI Wallpaper/Theme: Smart visual suggestions, i.e. wallpaper based on current weather, mood, etc.

- Voice Quick Commands: AI-based voice OS control ("Open browser")

- AI System optimization: for example, content-based disk space cleanup

Any of the above are better than this nonsense.
by wyager | 2025-05-21 20:28:28+00:00
> Do you really think your friends are qualified to have the opinion

Yes... most of the friends in question (MechEs, as I mentioned) work in power generation, petroleum engineering, etc. Not sure what your friend group looks like.

> We are talking about the long-term health/environmental effects of millions of vehicles after all,

If you're going to act like you're doing some kind of utilitarian calculation, you're going to need to do a more convincing job of recognizing this as a tradeoff space rather than seethingly appealing to "science teams"
by mmcnl | 2025-05-21 20:29:05+00:00
I think this is quite strange, imo this is just virtue signalling / activism and much less about privacy. I install Signal on the Windows operating system on the computer I trust. If I wouldn't trust Windows, why would I install Signal? Also Recall is an opt-in feature, it's not spyware, that's simply FUD.

Second, Apple is doing something similar except they send all your data to the cloud (yes I know Apple says private cloud, but there's no such thing). What's Signal's take on that?

I respect their stance on privacy, but this doesn't feel like a rational decision to me.
by mrguyorama | 2025-05-21 20:29:09+00:00
The average person in the US reads at below a high school level.

How do you explain to someone who doesn't understand high school level writing, let alone math, that "No, you can't just say Pi is 4, it doesn't work like that" in a way that they will agree in the end, rather than just calling you an elitist shithead who is patronizing them?
by impossiblefork | 2025-05-21 20:29:22+00:00
For mass shaping tiktok is probably more effective, but Reddit probably shapes people more deeply, since there's actual discussion.

I think people are more critical in this discussion though, so that an apparent consensus may be interpreted by the user as the thread being bot-infested rather than there being a consensus. Thus it may be harder to get a result there, and the really interesting people that you may want to affect might actually be immune because they approach the medium as critically as it should be.
by throitallaway | 2025-05-21 20:30:00+00:00
I absolutely hate how Windows now basically forces you to sign in with a Microsoft ID in order to facilitate this kind of stuff. I just want a local system; I don't need all this online crap built into my desktop OS.

For the last two decades or so I've been running Linux for everything (personal and work) except for gaming. I'm to the point of being sufficiently annoyed with Windows that I'm going to set up a Linux disk for gaming to see how that goes. I've used Wine etc. for gaming sporadically throughout the years. Recently that landscape has improved quite a bit thanks to Valve.
by bigzyg33k | 2025-05-21 20:30:36+00:00
Based on your comment it's apparent you neither follow the industry closely nor understand it's dynamics. The vast majority of the billions of dollars are being pumped into R&D, not marketing existing legacy devices.

You also seem to be implying in your comment that the orion glasses displayed at connect last year were a last minute pivot, which is a ludicrous statement
by jackpirate | 2025-05-21 20:30:38+00:00
I hate to be "reviewer 2", but:

I used to work on what your paper calls "unsupervised transport", that is machine translation between two languages without alignment data. You note that this field has existed since ~2016 and you provide a number of references, but you only dedicate ~4 lines of text to this branch of research. There's no comparison about why your technique is different to this prior work or why the prior algorithms can't be applied to the output of modern LLMs.

Naively, I would expect off-the-shelf embedding alignment algorithms (like <https://github.com/artetxem/vecmap> and <https://github.com/facebookresearch/fastText/tree/main/align...>, neither of which are cited or compared against) to work quite well on this problem. So I'm curious if they don't or why they don't.

I can imagine there is lots of room for improvements around implicit regularization in the algorithms. Specifically, these algorithms were designed with word2vec output in mind (typically 300 dimensional vectors with 200000 observations), but your problem has higher dimensional vectors with fewer observations and so would likely require different hyperparameter tuning. IIRC, there's no explicit regularization in these methods, but hyperparameters like stepsize/stepcount can implicitly add L2 regularization, which you probably need for your application.

---

PS.

I *strongly dislike* your name of vec2vec. You aren't the first/only algorithm for taking vectors as input and getting vectors as output, and you have no right to claim such a general title.

---

PPS.

I believe there is a minor typo with footnote 1. The note is "Our code is available on GitHub." but it is attached to the sentence "In practice, it is unrealistic to expect that such a database be available."
by godelski | 2025-05-21 20:30:39+00:00
So what's your point? I don't get what you're arguing other than giving up. I'm sorry, but if someone wants to take a shit on me I'm not just going to submit to that fate. I'll try to get out. I don't know about you, but I'd rather step in shit than have it forcefully poured down by throat.

At least with Linux, I know there are other people checking. People with expertise I don't have. People not incentivized by their own employer. Certainly this creates higher levels of trust than the closed source setting. If it doesn't, then your argument applies to literally any subject. Medicine, food, whatever. Let's not act like this is a binary setting, it is a spectrum. There are situations that are better than others even if they aren't perfect.
by echelon | 2025-05-21 20:30:40+00:00
Growing up in a strong Southern Christian / Baptist / Pentecostal household [1], WorldCoin feels like the most "Mark of the Beast" plot I've ever seen. 1990's televangelists like John Hagee and Pat Robertson would be screaming to high heaven about Sam Altman being the antichrist if they were still around.

Transacting with your eyeball? Directly out of the Book of Revelations!

[1] I took a strong interest in biochemistry in college and I'm no longer religious.
by wyager | 2025-05-21 20:30:46+00:00
> While technically true, that's not who the article is about.

It is, in fact, what the article is about. The entire article is just denying the existence of a middle ground position or the fact that there's a constrained optimization problem here.

`Second, the idea that emissions controls "ruin performance" is outdated.`

`Either you care about performance within the rules, or you admit you don’t care about the consequences of your actions.`

`Tuners have two choices... Keep crying about regulations while clinging to an outdated, polluting past... [or] Embrace innovation—developing high-performance, emissions-compliant solutions that don’t sacrifice power for legality.` (wow, talk about a GPT-authored sentence)
by bigyabai | 2025-05-21 20:31:02+00:00
> That's just rumors and also without evidence.

Apple services are government spyware. Apple admit to as much after Senator Ron Wyden accused them of collecting Push Notification information on users without a warrant. There is no indication that Apple has changed their architecture to protect users from this unlawful surveillance today: https://arstechnica.com/tech-policy/2023/12/apple-admits-to-...

It shouldn't surprise anyone who paid attention, though. The burden of proof was always on Apple's lap, and they folded like a wet towel when Beijing demanded state-owned iCloud datacenters to facilitate spying on domestic users. If you actually thought Apple would treat Americans any better, then boy you sure drank the marketing Kool-aid.
by doodlebugging | 2025-05-21 20:31:04+00:00
Which of the laws or regulations that apply to diesel vehicles and pollutants emitted do your mechanical engineer friends object to the loudest?

Up here where I live there are many diesel pickup trucks that have been EGR deleted and several local businesses sprang up just to serve that community.

It was very common and still is common to be driving down the highway behind a truck that suddenly rolls thick black smoke on everything around it. Many of these trucks aren't driven by mechanical engineers as I suspect there is a small, insignificant population of that particular specialty locally. They are driven by young, dumbass children or inbred rednecks who bought the libertarian/fascist line about needing to own some libs or the line about the government needing to get out of people's lives and let everyone do whatever they want.

One day they will get their due. Instead of going after the shops that sell this bullshit, regulators need to use the traffic cameras and license plate scanners on every highway in Texas to build a database of vehicles and go after individual owners and businesses who sell and tune equipment or remove exhaust components. Maximize the fines and confiscate the vehicles until the owner pays for the vehicle to be brought back into compliance or back to OEM specs. Then require them all to have monthly inspections at their own expense for at least two years to verify that the vehicle remains compliant.

I've probably just made a couple of dumb suggestions in this post but these coal-rolling assholes piss me off.
by dang | 2025-05-21 20:31:19+00:00
Thanks! Macroexpanded:

Factorizer - https://news.ycombinator.com/item?id=10776019 - Dec 2015 (30 comments)

Animated Factorisation Diagrams - https://news.ycombinator.com/item?id=4788224 - Nov 2012 (72 comments)

Animated Factorization Diagrams - https://news.ycombinator.com/item?id=4713048 - Oct 2012 (2 comments)
by 9dev | 2025-05-21 20:32:05+00:00
A shell script is something very different from a markdown editing app with plugins, file synchronisation, multi-platform support, and many more moving parts. And even a 20 year old shell script is probably going to fare pretty poorly.

Do you remember what the most common processor was in 2005? A Pentium 4, or a Celeron maybe. That was when 64 bit operating systems just became a thing. I’d really like to see you getting a version of, say. OpenSSL from 2005 to compile on modern hardware…
by nedt | 2025-05-21 20:32:22+00:00
IIRC linkedin was one of the breaches where I got a spam email to my linkedin address, told them and they were like "can't be us - must be you who has been hacked". And then later "ah yeah was us, but no personal data was stolen". Like email address is not personal - lucky me for having a catch all domain and being able to just block the address I had used with linkedin.
by saqadri | 2025-05-21 20:33:20+00:00
This is exactly what we're working on at the moment! (If you're curious about following along progress, check out feature/distributed_tracing branch -- https://github.com/lastmile-ai/mcp-agent/tree/feature/distri...)

The nice thing about representing agents as MCP servers is we can leverage distributed tracing via OTEL to log multi-agent chains. Within the agent application, mcp-agent tracing follows the LLM semantic conventions from OpenTelemetry (https://opentelemetry.io/docs/specs/semconv/gen-ai/). For any MCP server that the agent uses, we propagate the trace context along.