MurphyA/hacker-news huggingface dataset:
by danudey | 2025-11-03 17:52:00+00:00
I had a python script I was writing that basically just needed to the same shell command 40 times (to clone images from X to Y) and a lot of the time was spent making the request and waiting for the data to be generated so I figured I'd parallelize it.

Normally I do this either through multiprocessing or concurrent.futures, but I figured this was a pretty simple use case for async - a few simple functions, nothing complex, just an inner loop that I wanted to async and then wait for.

Turns out Python has a built in solution for this called a TaskGroup. You create a TaskGroup object, use it as a context manager, and pass it a bunch of async tasks. The TaskGroup context manager exits when all the tasks are complete, so it becomes a great way to spawn a bunch of arbitrary work and then wait for it all to complete.

It was a huge time saver right up until I realized that - surprise! - it wasn't waiting for them to complete in any way shape or form. It was starting the tasks and then immediately exiting the context manager. Despite (as far as I could tell) copying the example code exactly and the context manager doing exactly what I wanted to have happen, I then had to take the list of tasks I'd created and manually await them one by one anyway, then validate their results existed. Otherwise Python was spawning 40 external processes, processing the "results" (which was about three incomplete image downloads), and calling it a day.

I hate writing code in golang and I have to google every single thing I ever do in it, but with golang, goroutines, and a single WaitGroup, I could have had the same thing written in twenty minutes instead of the three hours it took me to write and debug the Python version.

So yeah, technically I got it working eventually but realistically it made concurrency ten times worse and more complicated than any other possible approach in Python or golang could have been. I cannot imagine recommending async Python to anyone after this just on the basis of this one gotcha that I still haven't figured out.
by everforward | 2025-11-03 17:52:22+00:00
> Django has the advantage of being a "complete & proven recipe"

I work on a large Django codebase at work, and this is true right up until you stray from the "Django happy path". As soon as you hit something Django doesn't support, you're back to lego-ing a solution together except you now have to do it in a framework with a lot of magic and assumptions to work around.

It's the normal problem with large and all-encompassing frameworks. They abstract around a large surface area, usually in a complex way, to allow things like a uniform API to caches even though the caches themselves support different features. That's great until it doesn't do something you need, and then you end up unwinding that complicated abstraction and it's worse than if you'd just used the native client for the cache.
by skyriser | 2025-11-03 17:52:26+00:00
Location: Montreal, Canada Remote: Yes Willing to relocate: No Technologies: iOS/macOS (SwiftUI/Swift/UIKit/AppKit/Objective-C), Stock/Forex/Crypto APIs Tools: Xcode, Github, Figma, Jira/Linear/Trello, Cursor/ChatGPT Web: http://chriscomeau.com Resume/CV: http://chriscomeau.com/resume LinkedIn: https://www.linkedin.com/in/christiancomeau GitHub: https://github.com/chriscomeau Languages: English, French Email: chris.comeau@skyriser.com
by neya | 2025-11-03 17:52:33+00:00
Do yourself a favor and use Elixir. Elixir has almost the same top libraries from Python you need to work with AI. As a matter of fact, the Elixir versions are far less fragile and more reliable in production use cases. I documented my journey of writing an AI app using Elixir and listed out the top libraries you can use, especially if you're coming from Python:

https://medium.com/creativefoundry/i-tried-to-build-an-ai-pr...
by et14 | 2025-11-03 17:52:59+00:00
Schoolhouse | Senior Software Engineer | REMOTE (US time zones) | https://schoolhouse.world/

Schoolhouse.world is a non-profit founded by Sal Khan with the mission of connecting the world through learning. Our peer tutoring platform brings genuine human connection to online learning in a world that’s being rapidly disrupted by AI. So far, we’ve reached 150k+ learners from 180+ countries and plan to grow to millions.

You'll be one of six engineers owning full-stack projects from ideation to execution and making an impact on learners and tutors across the world. Our ideal candidates move quickly, have good taste in code, and are AI-forward (eg experience building LLM evaluation frameworks) but still believe humans bring deep value to engineering and education.

Stack: TypeScript, Node, Next.js, React, PostgreSQL, AWS

Compensation: $175K-$200K

Perks: Fully remote, flexible hours, competitive salary + benefits, work-from-home stipend, semesterly retreats

Apply here: https://jobs.ashbyhq.com/schoolhouse-world/4a6b99f6-9f70-4f1...

Ask questions: evan [at] schoolhouse.world
by danans | 2025-11-03 17:53:03+00:00
> I have reasons to believe current AIs are conscious & have qualia/experiences, so the moral question is relevant now as well.

There are very strong reasons to prioritize alleviating the immiseration of humans as a consequence of AI over mitigating any hypothetical conscious suffering of AI.

We already do that with all kinds of known sentient beings, like the animals we subjugate for our needs.

I would go further and put all biological sentient beings (and also many biological non-sentient beings like plants), and ecosystems ahead of AI in priority of the order in which we worry about their treatment.
by UtopiaPunk | 2025-11-03 17:53:16+00:00
John Maynard Keynes wrote an interesting essay in 1930 called "Economic Possibilities for our Grandchildren." It is very optimistic that the gains of the present time (his own time, that is) would lead to a future where individuals could work much less. He looks around in his own time with a cynical but clear-eye, calling out the moral contradictions and outright evils of the industrial age he is living in. But it seems he believes that the current period of evil will be worth it for a better future, his grandchildren's future. In that essay, he supposes that if people share equitably in what labor remains, a 15-hour work week should suffice to adequately take care of society.

Like Keynes, I'm just as optimistic that such a future is possible, and that it could happen very soon if society willed it so. But just looking at the 95 years of history that have passed since Keynes wrote this essay, it is clear we are not natually, inevitably moving towards such a society. The technology is making such a future possible, but such as a society has to be demanded by the people, and it will not be gifted to us by benevolent rulers or captains of industry.

"We shall once more value ends above means and prefer the good to the useful. We shall honour those who can teach us how to pluck the hour and the day virtuously and well, the delightful people who are capable of taking direct enjoyment in things, the lilies of the field who toil not, neither do they spin. But beware! The time for all this is not yet. For at least another hundred years we must pretend to ourselves and to every one that fair is foul and foul is fair; for foul is useful and fair is not. Avarice and usury and precaution must be our gods for a little longer still. For only they can lead us out of the tunnel of economic necessity into daylight. I look forward, therefore, in days not so very remote, to the greatest change which has ever occurred in the material environment of life for human beings in the aggregate."

http://www.econ.yale.edu/smith/econ116a/keynes1.pdf
by electric_mayhem | 2025-11-03 17:53:20+00:00
If someone was hung up on only paying when they need care, the business model needs to support that would probably look a lot like an emergency room or urgent care facility.

For me, I consider it an astonishingly good value paying $1200 a year even when probably nine months out of the year I don’t even talk to them. Being a healthy dude I get proactive tests done twice a year to keep tabs on a couple dozen different metrics ($150 each round, all in) and inform any needed course corrections over time (early insight- vitamin d was low (previous insurance-based provider refused to order test). Later insight- eating trash and five drinks a day for 7 days at a vacation resort made basically every metric go to absolute shit; subsequently did an early test after a month of clean diet and regular exercise showed tremendous improvement across the board). And then when something random comes up I know they’re there for me.

If it sounds like the sort of thing, you might be into find a couple local providers and just have a conversation with them. I’ve yet to speak to a DPC provider that isn’t excited about the model and delighted to communicate its value to prospective customers.

It’s as close to concierge healthcare as I’ll ever able to afford and I absolutely adore that it removes the parasitic insurance from my primary care loop.
by wwilson | 2025-11-03 17:53:28+00:00
Antithesis | Distributed Systems Breaker Extraordinaire | Full-time | SF or London or DC

---

Have you always wanted to channel your inner Kyle Kingsbury? We are looking to hire somebody with a deep understanding of distributed systems who can bring open source or customer software under test in our platform and find fun issues in it.

Preferred locations: SF, London, DC. Remote is a possibility for this role if you're really good (though be aware that we're a very in-person company culturally speaking, so it might be annoying for you).

To apply: email 'will' at our company domain with a description of something interesting that you've worked on.
by 5dE63b6850e83 | 2025-11-03 17:53:35+00:00
BRO WTF

import { Skald } from '@skald-labs/skald-node';

const skald = new Skald('your-api-key-here');

// Create a memo const result = await skald.createMemo({ title: 'Meeting Notes', content: 'Full content of the memo...' });

// Chat with the memo const result = await skald.chat({ query: 'What were the main points discussed in the Q1 meeting?' });
by thomas-arcol | 2025-11-03 17:54:50+00:00
Arcol | Senior Software Engineer | NYC, SF, or Remote (US) | Full-time

Arcol (arcol.io) is a small, high talent density team building the future of building design - a future that's collaborative, fast, and intuitive. We're a web-native, fully collaborative 3d design tool modernizing the experience of architectural design for teams of all sizes.

We're looking for senior engineers with experience in modern web technologies - some of our key technical building blocks are Typescript, Rust, wasm, WebGL - and a strong ownership mindset. Experience with computational geometry, computer graphics, or similar a strong plus. This role sits at the intersection of solving deep technical foundational challenges with shipping a product that solves real problems for real people.

Reach out to me directly at thomas@arcol.io or peruse our careers page (https://www.arcol.io/careers) - we'd love to hear from you!
by sixdimensional | 2025-11-03 17:55:19+00:00
Thank you for your response!

I agree that spending time on inference or compute every time for the same LLM task is wasteful and the results would be less desirable.

But I don't think the thought experiment should end with that. We can continue to engineer and problem solve the shortcomings of the approach, IMHO.

You provided a good example of an optimization - tool creation.

Trying to keep my mind maximially open - one could think of a "design time" performance at runtime - where the user interacting with the system is describing what they want the first time, and the system is assembling the tool (much like we do now with AI assisted coding, but perhaps without even seeing the code).

Once that piece of the system is working it is persisted so no more inference is required, as essentially code - a tool, that saves time. I am thinking of this as essentially memoizing a function body- i.e. generating and persisting the code.

There could even be some process overseeing the generated code/tool to make sure the quality meets some standard and providing automated iteration, testing, etc if needed.

A big problem is if the LLM never converges to the "right" solution on it's on (e.g. the right tool to generate the HTML from the SQL query, without any hallucination). But, I am willing to momentarily punt on that problem as being more to do with the determinism problem and the quality of the result. The issue isn't per se the non-deterministic results of an LLM anyway, it's the quality of the result fit for purpose for the use case.

I think it's difficult but possible to go further with the thought experiment. A system that "builds itself" at runtime, but persists what it builds, based on user interaction and prompting when the result is satisfactory...

I remember one of the first computer science things I learned- the program that could print out it's own source code. Even then we were believing that systems could build themselves and grow themselves.

So my ask would be to look beyond the initial challenge of the first time costs of generating the tool/code and solve that by persisting a suitable result.

What challenge or problem comes next in this idea?
by allenu | 2025-11-03 17:55:58+00:00
I don't think it's quite social media as most people think of it. I treat it more like a message forum.

To me, social media is a broadcast type of media where people are posting for their specific followers and people are following individuals, so you end up with people posting specifically to get more followers (maybe not initially, but it's what fuels further posting).

Hacker News is social, but I don't go here to follow individuals. I usually don't even look at names of who's commenting.
by jeffbee | 2025-11-03 17:55:58+00:00
No, and no individual person can rely on their personal experience to gauge the job market, including you. However if you wish to assert that it is currently more difficult to get a job as a software developer than it was in late 2015, aggregate data suggest this is false. Also, looking back a mere 10 years does not dispel the general impression that you lack context.

If you look at employment in, for example, NAICS 518 "Computing infrastructure providers, data processing, web hosting, and related services" which is one of the larger BLS categories for our industry, the numbers are at all-time highs, having doubled since 2011. An example of a bad job market for software developers was 2001-2011, when this sector shrank by a third.
by mickayz | 2025-11-03 17:56:27+00:00
Hey folks, one of the authors of the original post here.

First, I want to thank simonw for coming up with the lethal trifecta (our direct inspiration for this work) as well as all of the great feedback we’ve received from Simon and others! Our goal with publishing this framework was to inspire precisely these types of discussions so our industry can move our understanding of these risks forward.

Regarding the concerns over the venn diagram labeling certain intersections sections as “safe”, this is 100% valid and we’ve updated it to be more clear. The goal of the Rule of Two is not to describe a sufficient level of security for agents, but rather a minimum bar that’s needed to deterministically prevent the highest security impacts of prompt injection. The earlier framing of “safe” did not make this clear.

Beyond prompt injection there are other risks that have to be considered, which we briefly describe in the Limitations section of the post. That said, we do see value in having the Rule of Two to frame some of the discussions around what unambiguous constraints exist today because of the unsolved risk of prompt injection.

Looking forward to further discussion!
by teaearlgraycold | 2025-11-03 17:56:37+00:00
I’ve worked at a few startups and one big company in Silicon Valley. Over the last 7 years I’ve had periods where I’m really excited to get to work in the morning when I’m going to sleep. I’ve had stretches of time where I realize how lucky I am and that others would be incredibly jealous if they understood how good I had it.

I also had periods of time where a job was making me miserable. Ruining my time outside of work. Making me question everything.
by akash100x | 2025-11-03 17:57:33+00:00
FULL-STACK DEVELOPER - Location: India

- Remote: yes, open to relocate

- Technologies: GenAI, Python, React.js, Next.js,Node.js, Docker, AWS, SQL/NoSQL, CI/CD

- Portfolio: https://www.akashdev.me/

- Github: https://github.com/akash1000x

- LinkedIn: https://linkedin.com/in/akash-kumar-kumawat/

- Email: kumawatap63@gmail.com

- Experience: 1+ years
by deadbabe | 2025-11-03 17:57:41+00:00
No it is not. Here’s why:

Hackernews is more accurately called a forum, and forums have been around way longer than social media.

The key defining aspect of a social media platform, is that the members are minting social currency and building a network. The social net worth of users comes in the form of followers and influence. The content you post on your profile is an asset, it farms for you while you sleep.

On social media, your media is socializing for you long after you’ve posted it. It exists forever, welcoming people to like, to comment, to subscribe, etc. On a forum, your post is read for a few days then never again, as people move on to newer posts. On social media, algorithms keep your content circulating to fresh eyes.

On hackernews, there are no followers or following, there is no network being built. Your comments are not assets, they are ephemeral ideas that quickly dissolve and are never read beyond the first few days they exist. People’s reputation depends on their good name, and most people will not even remember the vast amount of people they talk to in the comments. Often people don’t even look at usernames. There is a karma system, but it is of limited value in terms of influence, it is used more as a sorting mechanism for good posts within comment sections.

On true social media networks, your profile stats are like a credit score. You can post stuff and if you’re a big shot you instantly collect the attention of a vast number of people and easily pick up new momentum.

On HN, you have to fight for attention, and it doesn’t matter if you are a long time user or a brand new noob, you will fight just as hard. There is no long term reward for writing good comments, only momentary glory. This means there is little incentive to chase trends. If you miss a trend, no one will notice or care, and you gain nothing by following the trend. A key aspect of being socially active is that you have some awareness of societal trends and are able to keep up with them, it shows you are conforming to the larger conversation in society and are relatable. This is what social media is about.

So the takeaway is, just because you are socializing on a site, does not mean it is social media.

But, you can still be manipulated even on a forum. Look at the insane cargo cult around Rust that formed here on hackernews a few years back. You can even be manipulated into becoming enraged, but at least because there is little to no monetary gain from writing anonymous comments on the internet, it is the purest form of trolling.
by AnnaHP | 2025-11-03 17:57:58+00:00
Holepuch|Remote, Worldwide|Senior Node.js Software Engineer

At Holepunch, we are redefining the internet’s architecture. Our open-source P2P platform, Pear, enables developers to deploy applications directly from their machine to users, creating scalable, decentralized applications without traditional server infrastructure.

We are seeking Node.js Software Engineers to join our 100% remote, globally distributed team. You’ll work on our P2P stack, which includes over 1500 public npm modules, and help expand our ecosystem.

Why Holepunch?

- Work on groundbreaking technology that prioritizes user autonomy and privacy.

- Collaborate with a team of thinkers and innovators dedicated to reshaping the digital landscape.

- Contribute to a future where technology serves humanity, not the other way around.

Apply now to join our mission:

https://holepunch.recruitee.com/o/p2p-nodejs-engineer?source...

https://holepunch.recruitee.com/o/senior-node-engineer?sourc...
by doctor_radium | 2025-11-03 17:58:15+00:00
I'm more a syadmin type than a developer, but still get hit with online "testing" requests sometimes: a couple SQL tests for some support position, a couple psychological tests, etc. These are now a hard line for me. Why? Maybe I misunderstand...but my time is valuable, too. If HR or the hiring manager wants to reach out for a round 1 interview and then tell me a week later I'm one of your top candidates, and would I please take some online testing to continue the process, fine. But not the other way around.
by renewiltord | 2025-11-03 17:58:18+00:00
Placing a model behind a “Use `curl` after generating an API key using `gcloud auth login` and accepting the terms of service” is probably a good idea. Anything but the largest models equipped with search to ground generation is going to hallucinate at a high enough rate that a rando can see it.

You need to gate away useful technology from the normies, usually. E.g. kickstarter used to have a problem where normies would think they were pre-ordering a finished product and so they had to pivot to being primarily a pre-order site.

Anything that is actually experimental and has less than very high performance needs to be gated away from the normies.
by adverbly | 2025-11-03 17:58:23+00:00
> While I acknowledge not all job postings result in a hire, and some are ‘ghost jobs’, since I was comparing the relative growth in job titles, this didn’t seem like a big issue to me.

Uhhh... That's a very big issue. In addition, there is also a glaringly obvious analysis error here related to layoffs/attrition.

No offence but is this analysis vibe analyzed or something?

All this is actually measuring is how the number of job listings in a specific industry have changed globally. That's not the same thing as "what jobs AI is replacing" at all!

Like nurses decreasing 11%. There is 0% chance that AI is disrupting nurses. If anything, nursing is probably in more demand due to continual aging. It might just be that fewer people are quitting because of covid being over. The total number of nurses might be going up still!

Are we just upvoting anything with AI in the title now? HN used to be pretty respectful of scientific methods. The methodology section here just reads like personal resume filler for showing that you can use AI. I mean I get it and I admire the hustle, but the quality here is pretty lacking overall. https://bloomberry.com/blog/i-analyzed-180m-jobs-to-see-what...
by radug14 | 2025-11-03 17:58:33+00:00
The challenges are designed for an average engineer at the job opening level (junior, mid, senior) to solve in approximately 10 minutes. Furthermore, they are practical day-to-day tasks that should not put pressure just by nature of what's being asked.

For your last point, a review takes on average 5 minutes for a hiring manager. And I think screening more is not inherently a problem. Imagine they turned down the dial on their CV filters and had more applicants do a technical screen - wouldn't that give more applicants an opportunity to shine? In most cases it unfortunately is a numbers game.
by lproven | 2025-11-03 17:58:34+00:00
I am absolutely not pressuring anyone to do anything that doesn't feel right.

But FreeBSD can run Linux binaries without needing a VM or anything, using the built-in "linuxulator", and in recent releases this means it can directly execute Linux OCI containers.

Which is pretty close to running those same containers on top of a Linux kernel, when you're still bypassing much of the OS.
by GenerWork | 2025-11-03 17:59:07+00:00
I agree with this. I'm a product designer, and apparently there's "only" been a decrease in job postings of 2.6%. That doesn't seem bad, however in late 2022 through all of 2023 people were getting canned left and right and the market was incredibly tough. Can't really have big decreases when you're near the bottom of the hole.