MurphyA/hacker-news huggingface dataset:
by steveklabnik | 2025-05-01 21:31:08+00:00
https://www.sfchronicle.com/california/article/how-much-mone...

> the [SF metro] area’s median household income [was] roughly $120,000 [in 2022]

That, being the median, includes a lot of folks who make less.

> Total tangent:

Awesome, so glad to hear it! You're welcome. I wish I could find more time to continue writing V2...
by zoogeny | 2025-05-01 21:31:18+00:00
Yes, I've used Fivetran at VC funded startups that I worked at and I understand the value of not having to build this piece of common infrastructure. Although we did experience regular (probably once every couple of months) issues with our ETL getting out of sync. We even had to do a full re-sync on a couple of occasions (which to their credit they did for no charge).

As I said, I totally understand this market and why these companies are valuable. I respect the work they do. But while I am a tiny, tiny startup I don't want to lock in to anything and I know I can handle the amount of data myself with little effort if I have a basic open source alternative I can manage myself.
by VladVladikoff | 2025-05-01 21:31:44+00:00
As someone who is unfamiliar with your product could you maybe explain to me what your company sells? I looked for a while at your website, and it seems like you sell server hardware, however, when I go to the products section, it talks of demos etc, which sounds more like you sell cloud hosted systems. I don't see any way to find the prices or order the hardware itself. Very confusing website.
by jan_g | 2025-05-01 21:32:16+00:00
Yeah, min.io really soured AGPL license, for me at least. Because of their stance I've switched away from min.io in our company and avoid everything AGPL like a plague. Having read the license many times and also all discussions around it, I understand that it should be fine to use an AGPL project in a commercial enterprise (without modifications, internally in backend network). However, if authors themselves of such a project believe and say otherwise, I'm really not going to risk anything and definitely not asking lawyers if "my specific use of min.io violates the license or not". I'm just using it as-is over network, internally in my backend deployment. Not modified and not exposed to external world.
by mdp2021 | 2025-05-01 21:32:32+00:00
Could you indulge a bit in describing the workflow?

For example, the "story info extraction" and its "results evaluation" deserve some more in depth explanation.

How do you have the LLM summarize the article and the HN submission page: do you put the whole text in the input (as in: "Summarize the following text: <page text here>")?
by krackers | 2025-05-01 21:32:33+00:00
Isn't there some cache of code-signing info? https://wiki.lazarus.freepascal.org/Code_Signing_for_macOS

>Specifically, the code signing information (code directory hash) is hung off the vnode within the kernel, and modifying the file behind that cache will cause problems. You need a new vnode, which means a new file, that is, a new inode. Documented in WWDC 2019 Session 703 All About Notarization - see slide 65 (PDF).

This seems to be described in https://eclecticlight.co/2024/04/29/apfs-beyond-to-vfs-and-v... but I'm just a layman here. I don't quite understand the benefits of this caching if you have to recompute them to detect mismatch anyway. [1]

And I realize now the initial gatekeeper scan is probably just controlled by presence of quarantine bit, the result themselves are probably not cached.

Edit: Now I'm not so sure, spctl has a --ignore-cache option. So the result of gatekeeper is indeed cached somehow. And presumably as you noted it's a cache miss for this which causes the long application launch delay.

[1] https://github.com/golang/go/issues/42684 has a bit more info on this, I'm happy to see that even seasoned experts are confused about these things.
by guywithahat | 2025-05-01 21:32:40+00:00
I think there are some things where a lot of the silicone actually comes from the US, or the designs are static enough that domestic manufacturing could make a lot of sense. I was specifically pitching consumer GaN power supplies, which are simple enough that you can build them without your supply chain blowing up every 3 months or without having to always get the newest and greatest machinery.

Something like a smartphone would be borderline impossible to do well in the US and keep up with trends.
by gigatexal | 2025-05-01 21:33:16+00:00
I get the feeling. I also live in the real world and know that nobody except for a few (most notably RedHat) have figured out how to make sustainable money in open source. These closed licenses didn’t come out of nowhere. They came in response to places like AWS using the open source license to make a mint with a project — and doing so legally (it’s there in the license to do so) — but then the project suffers. So the license change is done to prevent that so the project — ostensibly — can survive. It makes sense. And so does wanting to live up to the promises of open source. It’s a tough situation for sure.
by bsder | 2025-05-01 21:33:19+00:00
It also overlooks the fact that what Amazon was doing was outright illegal for years and they never got handed their ass on a platter.

For years, Amazon enabled everybody to bypass sales tax which gave Amazon a 4-8% advantage on books over brick and mortar that had to pay both rent and sales tax.

Quite a few of the "successful" tech companies followed this pattern: Uber, Lyft, AirBnB, etc. all engaged in blatantly illegal behavior to become big.
by Workaccount2 | 2025-05-01 21:33:25+00:00
I am very curious where waymo is at in adverse conditions. Do the cars totally lock up and become useless? Or are they at the level of your 65 year old mother driving in a thunderstorm at night? Passable, but nothing they are gonna put their name on.

Seems they intend to come to Washington D.C. next year, which does get a pretty wide gamut of weather.
by naikrovek | 2025-05-01 21:33:56+00:00
“Slow” is when the human waits on the computer.

The promise of computing is that what was slow in the 1960s and 1970s would be instant in 1990. And those things were instant, but those things aren’t what people did with computers anymore.

New software that did more than before, but less efficiently, came around, so everything felt the same. Developers didn’t have to focus on performance so much, so they didn’t.

Developers are lazy sacks who are held skyward because of hardware designers alone. And software developers are just getting heavier and heavier all the time, but the hardware people can’t hold them forever.

This cannot continue forever. Run software from the 1990s or 2000s on modern hardware. It is unbelievably fast.

Maybe it was slow in the 1990s, sure. I ask why we can’t (or won’t) write software that performs like that today.

The compiler for Turbo Pascal could compile something like a million lines per second in 1990. We have regressed to waiting for 60+ minute C++ compile times today, on even moderate project sizes.

Debugging in visual studio used to be instant when you did things like Step Over. You could hold the Function key down and just eyeball your watch variables to see what was going on. The UI would update at 60FPS the entire time. Now if I hold down that key, the UI freezes and when I let go of the key it takes time to catch up. Useless. All so Microsoft could write the front end in dotnet. Ruin a product so it is easier to write… absolute nonsense decision.

All software is like that today. It’s all slow because developers are lazy sacks who will only do the minimum necessary so they can proceed to the next thing. I am ashamed of my industry because of things like this.
by jacobgkau | 2025-05-01 21:34:19+00:00
> That sounds REALLY BIG. Like I used to think damn Trillion $ are a lot but if such a case can cause apple to lose 89B$ in span of 2 hours then either I am doing some calculation wrong or this case has a truly big gravity

The thing about a company worth several trillion dollars is that even minor movements involve (what are to us laymen) huge sums of money. Conversely, huge sums of money really are just minor movements to that company.

Some people talk about how the middle class has a hard time understanding the vast difference between a millionaire and a billionaire. The same thing applies (but probably compounded due to being at a larger scale) for thinking about billions vs. trillions of dollars.

(Just speaking to the question of scale; as someone else brought up, there've been other happenings that affect stock prices besides just this case.)
by steveklabnik | 2025-05-01 21:34:39+00:00
> how does anyone buy their cloud?

https://oxide.computer/contact

> Is it only available as a public alpha/beta with remote control? I might have a client interested into this, but needs to have some guarantees that their data remains on-premise.

You are purchasing hardware. You put it on-premise. Our software gives you a cloud-like deployment model, but it's not going anywhere other than your rack.

Happy to answer any other questions, even if they're off-topic :)
by boulos | 2025-05-01 21:35:15+00:00
Our safety research team is interested in this topic, too! In a previous study, they've tried to model it:

> Building on that, the Collision Avoidance Benchmarking paper presents a novel methodology to evaluate how well autonomous driving systems avoid crashes. The study, which to our knowledge is the first of its kind, introduces a reference model that represents an ideal human state for driving—the response time and evasive action of a human driver that is non-impaired, with eyes always on the conflict (NIEON). Put simply, unlike an average human driver, NIEON is always attentive and doesn’t get distracted or fatigued¹. The data showed that the Waymo Driver outperformed the NIEON human driver model by avoiding more collisions and mitigating serious injury risk in simulated fatal crash scenarios.

(From https://waymo.com/blog/2022/09/benchmarking-av-safety)

AIUI (I'm not on that team), a major challenge is getting good baseline data. Collision reports may not (reliably) capture that kind of data, and it's clearly subjective or often self-reported outside of cases like DUI charges.
by jcranmer | 2025-05-01 21:35:18+00:00
No one has been convicted of treason since WWII. One person has been charged with treason, but they were remote-murdered by the US government before they were tried, and it's not at all clear that a conviction would have withstood appeal. Note that Congress did expressly pass a resolution in the Global War on Terror that can be construed as declaring war on terrorists; if anything short of outright declaration of war qualifies as a foreign entity as an "enemy" for the purposes of the treason declaration, that is it.
by jchw | 2025-05-01 21:35:44+00:00
As far as I know virtually all of the EFI vars will be stored on battery-backed NVRAM, so the usual solution is to just clear that, by removing the CMOS battery. I am pretty sure the only solution are things you definitely can not read or write from the host OS (e.g. BIOS passwords.) Does require partially disassembling the laptop though, and I know there's at least a couple random models of laptop that actually stop working if you clear the NVRAM (lol)
by ckw | 2025-05-01 21:35:45+00:00
I’m familiar with the specifics, and if anything gpt-4o is underselling the egregious behavior. It doesn’t mention for example, that those scientists who immediately changed their views concurrently received millions of dollars in new grants, which looks incredibly suspicious in retrospect. It also doesn’t discuss rank self-interest as a possible motive for suppression, namely that Fauci was responsible for funding research at WIV which could plausibly have lead to the creation of SARS-COV-2. I’ll ask 03 to summarize and provide sources:

‘As director of the National Institute of Allergy and Infectious Diseases (NIAID), Anthony Fauci oversaw grant R01AI110964—channeled through EcoHealth Alliance to the Wuhan Institute of Virology—that financed experiments creating chimeric bat coronaviruses whose enhanced growth in human-ACE2 mice met the federal definition of gain-of-function, a fact NIH conceded only in an October 2021 letter after Fauci had publicly denied such funding . A 2023 HHS-OIG audit later found NIH “did not effectively monitor or take timely action” on this award, missing chances to mitigate its risks . On 1 February 2020, e-mails show Fauci was warned the pandemic virus might have leaked from WIV; he then “prompted” authors of the influential Proximal Origin paper and worked with NIH leadership to “put down” the lab-leak hypothesis—actions that, if successful, would deflect scrutiny from his own institute’s funding decisions . A 2024 House Select Subcommittee report further concluded that EcoHealth “used taxpayer dollars to facilitate gain-of-function research…contrary to previous public statements, including those by Dr. Anthony Fauci,” underscoring his personal and institutional stake in suppressing the lab-leak narrative .’

Inline sources are provided in the result, but missing in the copy.
by llm_nerd | 2025-05-01 21:35:52+00:00
Man, I really don't want to be a Damore apologist, but-

"that women were innately less qualified"

He never said that, though. If you have to grossly misrepresent his argument like that, you've demonstrated that you have no good faith retort and have lost the argument at the outset.

His paper was about on the average traits. That if you've split humans into various subsets -- for instance ethnicity, sex, age, etc -- each group has average and percentile traits on a variety of axes, whether it's aptitudes or intelligence spread (e.g. the variability hypothesis), musculature, long distance running, etc. These traits have negligible applicability to any individual person or subset, but if you're selecting from the whole set for exceptional extremes, you likely will get a set that doesn't demographically represent the whole.

NBA/NFL/NHL/MLB players. Nobel prize winners. Top mathematicians. Long distance runners. And so on.

Damore's mistake was that a) there was no value in publishing this, b) he is on the spectrum and didn't realize how dangerous this absolute statement of fact was.

You say that he had bad science, but then you link to a piece that says that it's "politically naive, and at worst dangerous". Which is precisely the sort of tired "but it isn't socially acceptable" sort of response that is just boorish and unproductive.

I get why Google fired him. They pretty much had to (though I would argue that he could have contested it as punishing his handicap). But for all his folly, when people have to misrepresent what he said, or do the "it's bad science because I don't like it"....meh.
by daniel31x13 | 2025-05-01 21:36:01+00:00
> How difficult would it be to import an existing list of links/tags?

Pretty easy if you have it in a bookmark html file format.

> Also, if I were using a hosted version, would I be able to eg insert/retrieve files via an API call?

Yup, check out the api documentation:

https://docs.linkwarden.app/api/api-introduction
by walter87 | 2025-05-01 21:36:39+00:00
This seems like another example of the 'tortured phrases' [1], where AI-generated or machine-translated gibberish slips into papers. It’s worrying how often these nonsensical phrases bypass peer review scrutiny.

[1] https://dbrech.irit.fr/pls/apex/f?p=9999:5::::::
by enolan | 2025-05-01 21:36:41+00:00
Location: New York City

Remote: Sure, but my preference is in-office.

Willing to relocate: No

Technologies: JAX, PyTorch, Machine learning in general, Python, Rust

Resume: https://www.echonolan.net/resume/cv.pdf

Email: echo@echonolan.net

I'm an ML engineer/research engineer looking for work in that vein. I can train models, I can design architectures, I can implement papers, I can gather real and synthetic data, and I can in general solve the problems that come up when trying to build ML systems. Background: I recently ended a 3 month contract at Redwood Research doing AI safety research where I spent about half my time improving our synthetic data pipelines and about half finetuning LLMs to exhibit unsafe behavior in deployment but not training, and to do so while defeating probes trained to detect the unsafe behavior (but only in deployment). I also have an ongoing solo research project working on text-to-image models trained without any text, relying on embeddings for conditioning. [1] is a (very out of date) blog post about that. There'll be a paper soon inshallah. Before the ML stuff I worked at a startup where we built a new cryptocurrency, and before that another startup.

[1] https://www.echonolan.net/posts/2024-03-09-is-it-possible-to...
by steveklabnik | 2025-05-01 21:36:48+00:00
I don't believe we have any traditional dedicated administrative staff at the moment. We're certainly not outsourcing any kind of employees, to my knowledge. (EDIT: I'm told we do currently outsource accounting, I don't interact with that part of the business so I wouldn't know about it, heh. We do have one dedicated finance employee but that's a recent hire.)
by lbotos | 2025-05-01 21:36:50+00:00
> You could say the same thing about paying everyone a flat salary that you attract the middling ones.

This depends on where your flat salary lands right? 200k base pay for remote is a very good salary for most of America.

The hiring process will weed out the middling ones.

> You think the quality of Anthropic’s salespeople had much to do with them crushing their numbers as Claude exploded?

You are right -- a rising tide raises all ships.

> it’s dumb that non-salespeople can’t participate in that abundance.

I think most people can't stomach the risk of the variability. Or else they'd become sales people :D
by yorwba | 2025-05-01 21:36:52+00:00
You may think of these symbols as "Latin" because they're how people writing in Latin script happen to write mathematical expressions, but the exact same symbols are also used by Mandarin speakers, as well as in numerous other scripts. Writing math in Chinese characters is literally as uncommon as someone writing "twelve plus eighty-nine" in English.

In contrast, your examples would be spelled « rendez-vous » and « coup d’État » in French, i.e. easily distinguishable from their English descendants.
by Lammy | 2025-05-01 21:38:09+00:00
I will be sure to think of that the next time I see a human driver whose car has 29 dash cams, 5 lidars, 4 radars, and is using four H100s to process all of its realtime images of me: https://thelastdriverlicenseholder.com/2024/10/27/waymos-5-6...
by macleginn | 2025-05-01 21:38:28+00:00
The way I have experienced this, starting from circa 2018, it was a bit more incremental. First, LSTMs and then transformers lead to new heights on the old tasks, such as syntactic parsing and semantic role labelling, which was sad for the previous generation, but at least we were playing the same game. But then not only the old tools of NLP, but the research questions themselves became irrelevant because we could just ask a model nicely and get good results on very practical downstream tasks that didn't even exist a short while ago. NLP suddenly turned into general document/information processing field, with a side hustle in conversational assistants. Already GPT2 essentially mastered the grammar of English, and what difficulties remain are super-linguistic and have more to do with general reasoning. I would say that it's not that people are bitter that other people make progress, it's more that there is not much progress to be had in the old haunts at all.
by ghostnews | 2025-05-01 21:39:40+00:00
VertexMovies is a fast, ad-supported streaming platform that lets users watch the latest movies, TV shows, and anime episodes instantly—without registration. We combine community-driven curation with a clean, mobile-first interface and a built-in download option. Our referral-based ad-free system boosts viral growth, while native and popunder ads generate steady revenue. Think of us as the "YouTube of free streaming," optimized for accessibility, speed, and global reach.
by abeppu | 2025-05-01 21:39:45+00:00
> “Congress, not California, is the only body that can regulate the interstate automotive market,” Joyce said during a Monday meeting of the House Rules Committee

> Yet the Senate parliamentarian, the nonpartisan arbiter of the upper chamber’s rules and procedures, ruled last month that the waiver is not a regulation subject to the Congressional Review Act.

> Regardless of action on Capitol Hill, the EPA could revoke California’s waivers on its own.

So the House voted to block this but it's pretty murky whether congress has such an authority, but the EPA _does_ have such an authority ... but why does any federal body have this authority? I can see how e.g. if CA attempts to outlaw residents from buying cars in NV, that this would be an inter-state commerce issue. But if a CA resident wants to buy a car (from a dealership) in CA, why shouldn't CA be able to set requirements about that car?
by citizenpaul | 2025-05-01 21:40:05+00:00
>it supposedly works right now; they will be absolutely allowed to say so if the interviewer demands that.

Thats the good thing about being a theocratic dictator. Your rules don't have to be consistent, rational or even make sense. Oh if you slander the supreme leader while holding a goose feather that you burn at his monthly worship you are forgiven. Or whatever.
by rdedev | 2025-05-01 21:40:23+00:00
It's a truly bitter pill to swallow when your whole area of research goes redundant.

I have a bit of background in this field so it's nice to see even people who were at the top of the field raise concerns that I had. That comment about LHC was exactly what I told my professor. That the whole field seems to be moving in a direction where you need a lot of resources to do anything. You can have 10 different ideas on how to improve LLMs but unless you have the resources there is barely anything you can do.

NLP was the main reason I pursued an MS degree but by the end of my course I was not longer interested in it mostly because of this.
by teruakohatu | 2025-05-01 21:40:38+00:00
I am in academia and worked in NLP although I would describe myself as NLP adjacent.

I can confirm LLMs have essentially confined a good chunk of historical research into the bin. I suspect there are probably still a few PhD students working on traditional methods knowing full well a layman can do better using the mobile ChatGPT app.

That said traditional NLP has its uses.

Using the VADER model for sentiment analysis while flawed is vastly cheaper than LLMs to get a general idea. Traditional NLP is suitable for many tasks people are now spending a lot of money asking GPT to do just because they know GPT.

I recently did an analysis on a large corpus and VADER was essentially free while the cloud costs to run a Llama based sentiment model was about $1000. I ran both because VADER costs nothing but minimal CPU time.

NLP can be wrong but it can’t be jailbroken and it won’t make stuff up.
by steveklabnik | 2025-05-01 21:40:55+00:00
Sure thing!

> it seems like you sell server hardware,

We do!

> which sounds more like you sell cloud hosted systems

The server hardware we sell has a cloud-like interface. That is, you don't administer individual computers in the rack, you treat it as one big pool of resources that you can use. We handle the details.

I wrote a lengthy comment a few years back that has more detail: https://news.ycombinator.com/item?id=30678324

I'm happy to elaborate on this or anything else you're curious about.

> I don't see any way to find the prices or order the hardware itself.

We do not publish pricing, and to place an order, you can contact sales: https://oxide.computer/contact