MurphyA/hacker-news huggingface dataset:
by t1E9mE7JTRjf | 2025-05-06 02:26:10+00:00
The framing of it as natural was to point out that you can't get rid of it. It would be like getting rid of people having favourite colours. We just act like that.

>"“We live in capitalism. Its power seems inescapable. So did the divine right of kings. Any human power can be resisted and changed by human beings. Resistance and change often begin in art, and very often in our art, the art of words.”

This was nice to read, although following on from my first point (this comment), I don't think this analogy fits. Kings to capitalism I mean. Kings are one central top down authority, whereas capitalism has many spheres of power which pop up wherever there are humans clustered. It's nature.
by bionhoward | 2025-05-06 02:26:21+00:00
6 (can’t export/import chat history) is already a wrap since every user is prohibited from using ChatGPT chat logs to “develop models that compete with OpenAI,” if you export your chats and give it to Gemini or Claude or post it on X and Grok reads it, then you just violated the OpenAI terms, that’s grounds for a permaban or lawsuit for breach of contract (lol) … maybe your companies accept this risk but I’m in malicious compliance mode

Google is alright, but they have similar stupid noncompete vendor lock in rule, and no way to opt out of training, so there’s no real reason to trust Google. Yeah they could ship tool use in reasoning to catch up to o3, but it’ll just be catching up and not passing unless they fix the stupid legal terms.

Claude IDK how to trust, they train on feedback and everything is feedback, and they have the noncompete rule written even more broadly, dumb to use that.

Grok has a noncompete rule but also has a way to opt out of training, so it’s on the same tier of ClosedAI. I use it sometimes for jokey toy image generation crap but there’s no way to use it for anything serious since it has a copypasted closed ai prohibition

Mistral needs better models and simpler legalese, it’s so complicated and impossible to know which of the million legal contracts applies

IMHO meta is the only player, but they shot themselves in the foot by making Llama 4 too big for the local llama community to even use, super dumb, killed their most valuable thing which was the community.

That means the best models we can use for work without needing to worry about a lawsuit, are Qwen, and DeepSeek distills, no American AI is even in the same ballpark, Gemma 3 is refusal king if you even hint at something controversial. basically, America is getting actively stomped by China in AI right now, because their stuff is open and interoperable, and ours is closed and has legal noncompete bullshit, what can we actually build that doesn’t compete with these companies? Nothing
by isotypic | 2025-05-06 02:26:54+00:00
> By that logic I can slice open a sphere and call it a sheet

You can do this. If you remove a point (or a line, or really any connected component), you get a space which is the same as the plane. What happens if you remove two distinct points? You end up with with a very thick circle. Three points? It starts to get harder to visualize, but you end up with two circles joined at a point. As you remove more points you will get more circles joined together. From a mathematical perspective, these spaces are very different. If we start to allow gluing arbitrary points in the sphere together it gets even worse, and you can get some pretty wild spaces.

The point of surgery is that by requiring this gluing in of these spheres along the boundary of the space we cut out, the resulting spaces are not as wild - or at least are easier to handle than if we do any operation. To give an example, one might have some space and we want to determine if it has property A. The problem is our space has some property B which makes it difficult to determine property A directly. But by performing surgery in a specific way, we can produce a new space which has property A if and only if the original space did, and importantly, no longer has property B.

For property As that mathematicians care about, surgery often does a good job of preserving the property. In contrast things like just cutting and gluing points together without care will typically change property A, so it does not help as much.

> Likewise I wonder why we need to import a sphere rather than just pinch the ends of the tube shut and say it's now a sphere.

I am not an expect on surgery, but I think from a mathematical perspective, pinching the ends of the tube shut and gluing in a new sphere would be equivalent operations. This pinching operation would be formalized as a "quotient space", and you can formalize the sphere as a "quotient" space equivalent to the pinching.
by irjustin | 2025-05-06 02:27:51+00:00
You're right, whatever they pick will be wrong, but that's "missing the forest for the tree"

The goal is to remove uncertainty in the language when documenting/discussing situations for the state.

It doesn't matter that it's wrong colloquially or "feels wrong". It's that when you're reading or talking about a subject with the government, you need to use a specific definition (and thusly change your mental model because everyone is doing as such) so that no one gets misunderstood.

Would it be better to always use raw numbers? Honestly I don't know.
by klodolph | 2025-05-06 02:29:02+00:00
> Not quite. The argument then becomes about pointing out that our accounting systems are stupid, brutish and terrible at modelling second order consequences - social, economic, even moral.

Are you disagreeing with me, or just reframing the discussion? Pick one mode of discussion, please, I find it hard to follow if you start off disagreeing but then switch gears and decide to reframe the discussion.

I encourage you to speak as much as you want about the fact that our accounting system sucks at dealing with externalities. However, we are still slaves to accounting, somewhat. Nobody rational expects a fridge to be a profit source. But if you take taxes, people expect an accounting of how the taxes are spent. “This program costs money but has benefits that outweigh the cost” is pretty easy to understand. The program doesn’t pay for itself because we don’t have a way to put better outcomes on the books.

We also don’t have an accounting system that lets me show a net positive for buying a movie ticket.
by tverbeure | 2025-05-06 02:31:16+00:00
Never is too absolute of a statement, but I bought a Siglent SDS2304X 7 years ago. It has 350 MHz of bandwidth and a 2 Gsps sample rate. I don’t think I’ve ever been limited by what it can do.

I paid the full price for it (>$2000), but almost all Rigol scopes have lower and higher BW versions with the same chassis and electronics. You can buy the lower BW versions for a fraction of the higher one and apply a software patch to unlock the higher BW.

This has been possible for years. Despite many SW revisions, Rigol has never made an effort to block this. I think they know that in the grand scheme of things, they make more money this way.

So research 100MHz Rigol scopes and check if they are hackable. Chances are high that they are.
by viccis | 2025-05-06 02:31:43+00:00
There are so many gotchas. I'm getting so tired of working around it, but my company is all in on serverless so the pain will continue. A lot of it is tied up with Unity Catalog shortcomings, but Serverless and UC are basically joined at the hip.

A few just off the top of my head:

* You can't .persist() DataFrames in serverless. Some of my work involves long pipelines that wind up with relatively small DFs at the end of them, but need to do several things with that DF. Nowhere near as easy as just caching it. * Handling object storage mounted to Unity Catalog can be a nightmare. If you want to support multiple types of Databricks platforms (AWS, Azure, Google, etc.), then you will have to deal with the fact that you can't mount one type's object storage with another. If you're on Azure Databricks, you can't access S3 via Unity Catalog. * There's no API to get metrics like how much memory or CPU was consumed for a given job. If you want to handle monitoring and alerting on it yourself, you're out of luck. * For some types of Serverless compute, startup times from cold can be 1 minute or more.

They're getting better, but Databricks is an endless progression of unpleasant surprises and being told "oh no you can't do it that way", especially compared to Snowflake, whose business Databricks has been working to chew away at for a while. Their Variant type is a great example. It's so much more limited than Snowflake's that I'm still learning new and arbitrary ways in which it's incompatible with Snowflake's implementation.
by godelski | 2025-05-06 02:32:27+00:00
You are pointing out exceptions rather than the norms. Do not cherry-pick. I'm pretty confident that most people in these threads are thinking about computer programmers, white color jobs, and blue color jobs. Things that don't obviously need a degree.

Depending on the type of nurse, you do not need a degree. Some will need to pass an exam though. You can become a lawyer without a degree, only needing to pass the BAR. An engineer doesn't need a license. You are thinking of a Professional Engineer, which is a specific job title that has legal ramifications. This requires a degree but it also requires you working under another PE for some time and then passing state competency exams.

The cases we're talking about here are jobs where if you do something wrong you can kill hundreds or thousands of people and destroy millions or billions of dollars worth of assets. *You've just completely moved the goalpost to try to make your point.*

Do you really honestly believe that these jobs shouldn't require a formal education?

I'm not going to take anyone seriously that is going to argue that medical doctors shouldn't receive formal educations. Come on, don't be dumb. Just have a normal fucking conversation. You don't have to double down and back yourself into a corner.

I know you're not that dumb, so stop bring disingenuous.
by TheTaytay | 2025-05-06 02:32:57+00:00
I agree completely. Every time I need to do Something in AWS I feel like I’m just stumbling over footguns in an infinite sea of footguns. Meanwhile, other providers. (GCP and Azure) have the ability to group resources under projects/folders. They have sensible default isolation primitives that you can understand…

If you forget to tag a resource in AWS, it’s very difficult to find out what it’s being used by. And yeah, infrastructure as code helps with this, but God help you if you created something via the console.

If AWS had a cloud product that had 10% of the surface area, and a simplistic project/RBAC primitive, I would use it in a heartbeat. Hell, it’s essentially what other companies like Heroku are selling (and charging a premium for).

Even if Cloudflare’s R2 cost the same as AWS, I’d use it because the likelihood of one of our engineers doing something wrong permissions is GREATLY diminished.

Anyway, just nodding along to your comment and venting a bit.
by cloverich | 2025-05-06 02:33:46+00:00
To be fair many of us arrived at the idea that AI was humanities inevitable endpoint ahead of and independently of whether we would ever see it in our lifetimes. Its easy enough to see how people could independently converge on such am idea. I dont see that view as related to atheism in any way other than it creating space for the belief, in the same way it creates space for many others.

Id love to believe there is more to life than the AI future, or that we as humans are destined to be perpetually happy and live meaningful. However I currently dont see how our current levels of extreme prosperity are anything more than an evolutionary blip, even if we could make them last several millennia more.
by notepad0x90 | 2025-05-06 02:34:32+00:00
A sibling comment said to repeat what you just said in an interview. Don't do that.

Demonstrating that you are a stable hire who will fit well with the team is almost all that matters. You wouldn't be having an interview to begin with if you didn't technically qualify-ish. Even when speaking to technical interviewers, you will intimidate them. Actually selling yourself comes after your first 90 days of acclimation.
by Brybry | 2025-05-06 02:35:35+00:00
That's an important point that I missed in my research, though it does seem like there are limitations? [1]

If the buyer's previous-year adjusted gross income is too high they still don't qualify, and if the buyer's purchase-year adjusted gross income is too high they can end up owing money to the IRS.

And dealers/sellers have to qualify and register but...

> Advance payments received by the registered dealer are not treated as a tax credit to the dealer and may exceed the dealer’s regular tax liability. Advance payments received by the registered dealer are not included in the gross income of the dealer.

That does read as a direct subsidy equivalent to a refundable tax credit straight from the general fund.

[1] https://www.irs.gov/newsroom/topic-h-frequently-asked-questi...
by 1123581321 | 2025-05-06 02:35:42+00:00
This was hard to follow without clicking on the links. This linked post contained a sampling of criticism. Most of the criticism seemed to be that it was inappropriate to use LLMs to run a sci-fi writing convention because LLMs have been trained on authors’ content. A minority of criticism was about potential inaccuracies. Just sharing what I found. https://file770.com/responding-to-controversy-seattle-worldc...
by SOLAR_FIELDS | 2025-05-06 02:37:25+00:00
They also, like many other cloud providers, need a real physical payment card. No privacy.com stuff. No virtual cards. Of course they don’t tell you this outright, because obscurity fraud blah blah blah, but if you try to use any type of virtual card it’s gonna get rejected. And if your naïve ass thought you could pay with the virtual card you’ll get a nice lesson in how cloud providers deal with fraud. They’ll never tell you that virtual cards aren’t allowed, because something something fraud, your payment will just mysteriously fail and you’ll get no guidance as to what went wrong and you have to basically guess it out.

This is basically any cloud provider by the way, not specific to Oracle. Ran into this with GCP recently. Insane experience. Pay with card. Get payment rejected by fraud team after several months of successful same amount payments on the same card and they won’t tell what the problem is. They ask for verification. Provide all sorts of verification. On the sixth attempt, send a picture of a physical card and all holds removed immediately

It’s such a perfect microcosm capturing of dealing with megacorps today. During that whole ordeal it was painfully obvious that the fraud team on the other side were telling me to recite the correct incantation to pass their filters, but they weren’t allowed to tell me what the incantation was. Only the signals they sent me and some educated guesswork were able to get me over the hurdle
by t1E9mE7JTRjf | 2025-05-06 02:37:45+00:00
You accused someone of eugenics which is a big statement. I'm sure you're aware of the connotations attached to it. As such the onus is on you to back it up. So far you haven't.

That the guy talked about autism as causing suffering and people to miss out (I'm paraphrasing obviously), and thus understanding / curing it is worth doing, doesn't sound like with eugenics to me. That's what I would expect of anyone looking to work in health frankly. Considering his background this makes sense. You can listen to him talk - at length - about the groups of people who came to him for representation regarding autism and health impacts. Autism is broad, and you don't get to gate keep it.

Look at another way. Although there are many high functioning autists (I might guess both of us), there are people who are debilitatingly handicapped. Many non-autistic and autistic people do want to understand more about autism. Since it isn't fully understood what (if anything) causes it. I don't think you need to make it political.

Pushing the knowledge field forward is what science does. It does so not caring about biases (like what seems in your thread to be political). By the way, I'm not maga/conservative, nor a fox news watcher, 1920s textbook reader, or even american. You can throw mud all you like, so far none of it sticks and I think reduces your credibility. Better would be to just make meritocratic arguments.
by wenc | 2025-05-06 02:38:01+00:00
Did Athena on CSV work for you? I've used Athena and it struggles with CSV at scale too.

Btw I'm not suggesting to use Spark. I'm saying that even Spark didn't work on large TSV datasets (it only takes a JOIN or GROUP BY to kill the query performance). The CSV data storage format is simply the wrong one for analytics.

Partitioning is irreversible, but coming up with a thoughtful scheme isn't that hard. You just need to hash something. Even something as simple as a HNV hash on some meaningful field is sufficient. In one of my datasets, I chunk it by week, then by HNV modulo 50 chunks, so it looks like this:

/yearwk=202501/chunk=24/000.parquet

Ask an LLM to suggest partioning scheme or think of one.

CSV is the mistake. The move here is to get out of CSV. Partitioning is secondary -- partitioning here is only used for chunking the Parquet, nothing else. You are not locked into anything.
by photochemsyn | 2025-05-06 02:38:16+00:00
It's equally likely that the Wuhan Institute of Virology was testing constructs created in the Baric Lab in their bat and mice models, and this was initiated during the 2014-2017 ban on gain-of-function research in the USA that Fauci vocally opposed.

The reality here is that there are thousands of mammalian viruses that don't infect humans that could be modified to infect humans via specific modifications of their target mammalian cell-surface receptor proteins, as was done in this specific case of a bat coronavirus modified at its furin cleavage site to make it human-targetable. Any modern advanced undergrad student in molecular biology could explain this to you, if you bothered to listen.

So first, we need an acknowledgement of Covid that vastly embarrasses China and the USA, and second we need a global treaty banning this generation of novel human pathogens from wild mammalian viral types... I guess I won't hold my breath.
by CommenterPerson | 2025-05-06 02:38:20+00:00
Reminder: "I wanted to write about his cruelty to his wife, his crazed domination of his mistress that lasted almost 25 years, his screaming fits, his depressions, his absurd contention that he was the greatest writer in the English language (he first made this claim in Mombasa at the age of 34). "I am a new man," he assured me once, "as Montaigne was a new man." But did Montaigne frequent prostitutes, insult waiters and beat his mistress?" -- from an article on NPR
by ArchitectSys | 2025-05-06 02:39:49+00:00
Original Architect-Level Code

def activate_phase(phase_id: int, *, context=None, silent=False): if context is not None: log_phase_context(phase_id, context) if not silent: announce_phase(phase_id) phases[phase_id].run()

Intent:

silent is a logic switch, not just a UX feature.

context is recorded, not processed.

Execution order is essential — logging and announcing happen before action.

---

Typical GPT-"Optimized" Version (Incorrect)

def activate_phase(phase_id: int, context=None, silent=False): if context: phases[phase_id].run(context) else: phases[phase_id].run() if not silent: print(f"Phase {phase_id} activated.")

---

What Went Wrong:

1. The context is now fed directly into the system — breaking separation of concerns.

2. The logging step (log_phase_context) is removed — assumed unnecessary.

3. The formal announcement step (announce_phase) is replaced with print() — loss of protocol logic.

4. Execution happens before the phase is announced — reversing intended architecture.

---

Conclusion:

When GPT treats everything as "just code," it overwrites logic with patterns. Architects build logic. Assistants reformat. That’s why Architect Mode is not optional — it’s required.
by djoldman | 2025-05-06 02:39:57+00:00
The news industry makes a lot of sense when viewed as a category of entertainment.

Reporters write stories and people read them to be entertained. Newspapers make money when more people read the stories.

No wonder that newspapers don't cite others... That's just an advertisement for their competitor.

This isn't the only way to view the news industry but it certainly explains a lot.
by munificent | 2025-05-06 02:40:43+00:00
> According to the literature 33 out of 100 patients who underwent this operation in the US within the past 10 years died. 90% of those had complicating factors. You [ do / do not ] have such a factor.

Everyone has complicating factors. Age, gender, ethnicity, obesity, comorbidities, activity level, current infection status, health history, etc. Then you have to factor in the doctor's own previous performance statistics, plus the statistics of the anaesthesiologist, nursing staff, the hospital itself (how often do patients get MRSA, candidiasis, etc.?).

And, of course, the more factors you take into account, the fewer relevant cases you have in the literature to rely on. If the patient is a woman, how do you correctly weight data from male patients that had the surgery? What are the error bars on your weighting process?

It would take an actuary to chew through all the literature and get a maximally accurate estimate based on the specific data that is known for that patient at that point in time.
by notedwin | 2025-05-06 02:40:55+00:00
Congrats on the launch!

An application I use for a similar “tweeting but for your eyes only” experience is Memos and the MoeMemo’s app. My main reason for using memos is being able to self-hosted the server and I can use it in the browser and the app.

links:

https://github.com/usememos/memos

https://github.com/mudkipme/MoeMemos
by wrs | 2025-05-06 02:42:32+00:00
AWS’s account system is nuts. I know it grew historically out of the “just buy S3 storage with your Amazon account” original, but it’s 2025 and they run half the internet now.

Until a few months ago, you couldn’t even be signed in to more than one account at a time in the console. Now you can use…up to five? (If you’re following “best practices” you likely have far more than five.)

For anyone who hasn’t seen GCP’s console, there’s just a simple menu to switch your view to any of the projects you have access to. There’s even a search box in case you have enough to need it.
by TZubiri | 2025-05-06 02:42:58+00:00
Only by a very wide definition of "having" your email. Having data in one of your servers means not much if it's not usable or findable.

Can a government submit a subpoena to Gmail asking for your emails? Unlikely, they would just answer that you are not a client of theirs and as such they don't have your emails.

Can they submit a subpoena asking Google to hand over all of the emails that your clients sent or received from your address? Sure they can. It's going to be a way harder sell to the judge and the reason and burden of proof will be that much higher, as it would essentially be closer to fishing or mass surveillance. But it's something that I can see passing for cases of national security or child abuse. Nothing I would personally worry about, but I understand if you want to wear a tinfoil hat.

Semantics and nuance matter.