MurphyA/hacker-news huggingface dataset:
by HenryNdubuaku | 2025-07-11 03:02:08+00:00
We are following Ollama's design, but not verbatim due to apps being sandboxed.

Phones are resource-constrained, we saw significant battery overhead with in-process HTTP listeners so we stuck with simple stateful isolates in Flutter and exploring standalone server app others can talk to for React.

For model sharing with the current setup:

iOS - We are working towards writing the model into an App Group container, tricky but working around it.

Android - We are working towards prompting the user once for a SAF directory (e.g., /Download/llm_models), save the model there, then publish a ContentProvider URI for zero-copy reads.

We are already writing more mobile-friendly kernels and Tensors, but GGML/GGUF is widely supported, porting it is an easy way to get started and collect feedback, but we will completely move away from in < 2 months.

Anything else you would like to know?
by TheNewsIsHere | 2025-07-11 03:04:28+00:00
I attended a public school system which, while at times did falter in various ways, did a fairly good job meeting its stated mission that was more or less exactly that.

I witnessed far more personal political pressure and cajoling than corporate/future employer. Where I went to school the pressure on schools was usually from parents, students, and local groups concerned with civil matters. I had (until recently) indirect (and sometimes direct) exposure to this because one of parents was an educator and a senior member of their department in an adjoining district to the one I attended.

Where I went to college, it was always very clear to me what was shaped by industry vs. research and academia. I went to a research university for an uncommon hard-science degree and so there was a lot of employer interest, but the university cleverly drew a paywall around that and businesses had to pay the university to conduct research (or agree to profit sharing, patent licensing, etc). There was a clear, bright line separating corporate/employer interest from the classroom.
by lmm | 2025-07-11 03:05:25+00:00
> my point was not "Redis in particular", but "whatever you already have at hand, for this usecase". Could also be Postgres or another SQL server.

But if you're in the habit of using HA-capable systems then whatever you have to hand will be HA-capable, and so there won't really be any additional cost to using that.

And again, I think there's a real antipattern where people take a single-server application and then claim they've made it fault tolerant by making it run on multiple hosts, but it's still relying on a single DB server. In my experience that doesn't actually improve reliability any (at least not if you've got a good deployment process for your single-server application) and it complicates your architecture to no real benefit. (Indeed, frankly, I think a lot of developers reach for an external database because they have no other idea how to store data from their application, when using embedded sqlite/hbase or - shudder! - the local filesystem, would let them use much simpler architecture and not really reduce the actual reliability of the system).

> 1 etcd pod doesn't give you "no SPOF"

No, but it gives you a clear path to removing your SPOF when the need arises. Which is much harder if you've built your system on Redis.
by tehjoker | 2025-07-11 03:05:56+00:00
BEIR VII still supports LNT. There's some criticisms, but it seems like a pretty safe guess that just because the uncertainty climbs at low doses it's not just a straight line projection from the closest easier to ascertain value. Maybe some people are better at DNA repair, but some people have DNA repair defects too. The number of ion tracks is going to correlate with number of DNA breaks, and DNA breaks correlate with increased cancer.

https://www.epa.gov/radiation/blue-book-epa-radiogenic-cance...
by southernplaces7 | 2025-07-11 03:06:58+00:00
>Spoken like someone who either doesn’t have kids, or at least has easier ones than mine.

I do actually and in particular a little one with autism, making part of the process for educating on certain things more difficult than average, but despite being far from parent of the year, I manage and there are things that work.

>You think you’re just going to explain to a four year old the rules about ice cream and they’ll just be like “you’re right daddy. I forgot we had ice cream from the truck yesterday. I’ll grab some carrot sticks instead”?

Well, yeah. That's what parenting is partly about. Establish limits or conduct through repeated insistence on certain rules and lessons to be learned learned, instead of trying to make complaints against others causing a minor inconvenience with their own source of making a living or food choices you don't seem to like.

Parenting isn't easy and each case is different, but if something as minor as a few minutes of ice cream truck marketing is too much to handle with your kids, blaming others isn't your solution to that problem.

And please, the whole ethics thing you describe is just absurd in this context. A jingling ice cream truck, which kids love and which hardly sells something terrible or deceptive, is far from the kind of manipulative marketing you're contriving here. It's just a basic and basically harmless reality: Kids love ice cream, and there's nothing wrong with someone selling a bit of it to them. You're creating an ethical knot that doesn't have any good reason for existing in a normal world.

Example: Every time I take mine home from school, we pass by a Dairy Queen that's on the route home. Oops, and guess what gets asked for each day that this happens? Some days I say sure, and we go get a cone or blizzard. Other days, it's a firm no, and that's that. Repeat insistence made this work out okay. And I don't blame the DQ for anything, even though this particular branch happens to also use music to market its very visible presence.

>Here’s a better question before you call me a Karen: given that most people have freezers, who exactly benefits from daily ice cream truck visits? Not the parents, for reasons above. The kids find it frustrating too. The fact that they had ice cream yesterday usually doesn’t ease their disappointment.

Totally subjective opinions of your own, and in no way justifying getting so annoyed that you want to ban these things, as you seem to. Again, how about not converting your personal dislikes of minor things into trying to shut those things down.
by refulgentis | 2025-07-11 03:08:42+00:00
How does writing a model into an App Group container enable your framework to enable an app to enable a local LLM server that 3rd party apps can make calls to on iOS?[^1]

How does writing a model into a shared directory on Android enable a local LLM server that 3rd party apps can make calls to?[^2]

How does writing your own kernels get you off GGUF in 2 months? GGUF is a storage format. You use kernels to do things with the numbers you get from it.

I thought GGUF was an advantage? Now it's something you're basically done using?

I don't think you should continue this conversation. As easy it as it is to get your work out there, it's just as easy to build a record of stretching truth over and over again.

Best of luck, and I mean it. Just, memento mori: be honest and humble along the way. This is something you will look back on in a year and grimace.

[^1] App group containers only work between apps signed from the same Apple developer account. Additionally, that is shared storage, not a way to provide APIs to other apps.

[^2] SAF = Storage Access Framework, that is shared storage, not a way to provide APIs to other apps.
by SapporoChris | 2025-07-11 03:09:05+00:00
"For example, in Japan, they will open up bags of trash from the dumpster, find your address from a discarded envelope..."

Not near as prevalent as implied.

"Currently, more than half of 62 core Japanese cities are conducting garbage bag opening inspections but Fukushima's local government is the first one to disclose the names of the violators."

https://www.ndtv.com/world-news/japan-to-name-and-shame-thos... Dated: Dec 20, 2024
by xyzzy123 | 2025-07-11 03:09:30+00:00
Depends on the child and the activity right?

Personally I often prefer to introduce new activities just at the point where I'd feel comfortable leaving them unsupervised (once they've learned it).

A major goal of parenting is to guide your children to independence. This is a sort of negotiation between you, reality and the child. While it can be heartbreaking when they come to you with injuries, you can't watch them all the time (and it's not healthy to try).

If you introduce an activity "too early" such that you always have to supervise, it has some advantages for child but can quickly become a drain on you (they want to do that $thing again but you have other stuff to do) and they feel less independent because they always need your help to do it.

What our family looks out for a lot is "cliff edges". This is where an activity or situation has a high / unreasonable risk vs benefit, and the harm happens quickly and is surprising. These require special attention. Once kids know where the "cliff edges" are they can explore more safely.
by jz10 | 2025-07-11 03:09:30+00:00
Sounds a bit nitpicky now that I put it into words but most of my usage is just on the public hostnames panel which is about 3-4 levels deep from the dashboard. There is also a UI disconnect between this and the DNS records screen

I do this flow a number of times and the TUI I made solved this specific problem for me https://github.com/justingosan/tunnelman?tab=readme-ov-file#...
by ookblah | 2025-07-11 03:10:14+00:00
the demo is pretty impressive ngl. knowing it's a bot though makes you want to phrase your questions a certain way, so i tried to just pretend like i was talking to an actual support person.

i always feel with these bots its like way too "polished" in the responses or how it speak. maybe that's a good thing and we are just so used to hearing someone speaking more casually be less well spoken lol. it makes it feels inauthentic, but perhaps that will change over time.
by refurb | 2025-07-11 03:11:12+00:00
You mean the pay package that was approved by shareholders not once, but twice? The pay package people said "the goals are so ridiculous, Elon deserves every penny if he hits them"?

But regardless, it's about predictability. If it's not predictable, business goes elsewhere. If a state wants to be unpredictable, have at it, but businesses aren't going to stick around.
by ActorNightly | 2025-07-11 03:12:24+00:00
Once we have the thing working, optimization can come later.

Also MCP is not really optimal. Every prompt in a sequence of chat gets an injection of MCP capabilities. Its just simply not scalable with lots and lots of MCP servers. Not to mention the protocol changes every month and breaks things.

Furthermore, you can already do MCP like behavior, in a better way, on pretty much any model by basically writing a wrapper around the chatbot and using a system prompt which guides it to print specific text (like "action:load file"), and the wrapper can detect that text and inject the prompt. I have an agent that runs at home using this, which I also use to self improve and define actions on the fly - I ask it to write code, it writes code, then the wrapper takes that code and makes it part of the library and appends it to the system prompt on every new chat.

The point is that we should be able to take the latter, and build something that can do this automatically. Once we have the full loop complete, then we can optimize it down to minimum compute.
The computational cost of corporate rebranding
by rileygersh | 2025-07-11 03:12:49+00:00
Coke Classic, er, I mean HBO Max is Back!

This got me thinking about how corporate rebranding creates unexpected costs in AI training and inference.

Consider HBO's timeline: - 2010: HBO Go - 2015: HBO Now - 2020: HBO Max - 2023: Max - 2025: HBO Max (they're back)

LLMs trained on different time periods will have completely different "correct" answers about what Warner Bros' streaming service is called. A model trained in 2022 will confidently tell you it's "HBO Max." A model trained in 2024 will insist it's "Max."

This creates real computational overhead. Similar to how politeness tokens like "please" and "thank you" add millions to inference costs across all queries, these brand inconsistencies require extra context switching and disambiguation.

But here's where it gets interesting: does Grok 4 have an inherent advantage with the Twitter to X transition because it's trained by X? While ChatGPT, Claude, and Gemini need additional compute to handle the naming confusion, Grok's training data includes the internal reasoning behind the rebrand.

The same logic applies to Apple's iOS 18→26 jump. Apple Intelligence will inherently understand: - Why iOS skipped from 18 to 26 (year-based alignment) - Which features correspond to which versions - How to handle legacy documentation references

Meanwhile, third-party models will struggle with pattern matching (expecting iOS 19, 20, 21...) and risk generating incorrect version predictions in developer documentation.

This suggests we're entering an era of "native AI advantage" - where the AI that knows your ecosystem best isn't necessarily the smartest general model, but the one trained by the company making the decisions.

Examples: - Google's Gemini understanding Android versioning and API deprecations - Microsoft's Copilot knowing Windows/Office internal roadmaps - Apple Intelligence handling iOS/macOS feature timelines

For developers, this has practical implications: - Documentation generation tools may reference wrong versions - API integration helpers might suggest deprecated endpoints - Code completion could assume incorrect feature availability

The computational cost isn't just about training - it's about ongoing inference overhead every time these models encounter ambiguous brand references.
by ActorNightly | 2025-07-11 03:18:38+00:00
LLMS are leaky abstractions. LLMs configured in wrappers can be made to be mostly correct.

For example, define range of input, appropriate output, ask LLM to write code, automatically run that code against the range of input, evaluate the output, ask llm to fix any issues where the input doesn't match the output.

That whole process can be made faster without the need for huge models. The model doesn't need to get trained on everything CS, because it doesn't need to get the code correct on the first try, it just needs to be trained on enough code to understand how something affects the output and iterate on that. I.e basically making the model do smart guided search. It was done with Mu Zero with great success, not sure why nobody is focusing on this now.
by nodesocket | 2025-07-11 03:19:06+00:00
This looks awesome. I am using Twingate (hosted and paid) currently in my production AWS VPC. AWS instance are in private subnets, no public ips attached, using a NAT instance for outbound internet, but very curious to try running Pangolin.

Can Pangolin also provide public access (currently I'm using Caddy as a reverse proxy)?
by sheepybloke | 2025-07-11 03:20:12+00:00
As a zennial, there are a couple things that contribute: 1. No one has a car when you're younger unless your parents are well off. Most people I know didn't have access to a car until college. Makes it hard to get to parties when only 1 of your friends has a car that fills up instantly. 2. Most of your friends are online anyways. You're going to hang out with friends every night because they're on discord, waiting for you to get on and play your social game together. Why would you hang out in person if you can hang out online? You can't get to their house anyways. 3. Similarly to that, none of my friends live near each other anymore. We all moved to different cities for different reasons. So many people I've talked to are similar. It also makes it harder to find new friends, since everyone has their friends. They're just not near.
by bigyabai | 2025-07-11 03:20:34+00:00
His departure from Apple feels like potent foreshadowing of the Apple Steve envisioned. I remember feeling confused hearing the Apple II story growing up, but as I mature in the industry I really empathize with Woz's lack of patience for bad administration. Feels likely that Steve coveted that attitude, maybe a bit too much for an impromptu business administrator.
by CodeAndExile | 2025-07-11 03:23:42+00:00
Posted that VC6 screenshot yesterday (Reddit link: https://www.reddit.com/r/ExperiencedDevs/comments/1lv2l6x/st... ). Some folks thought it was an old pic — nah, that was taken two days ago on my Win11 machine. VC6 still runs. Sadly, so do I.
by southernplaces7 | 2025-07-11 03:27:39+00:00
One sees many of these kinds of papers about X or Y doing this or that incredible feat of life extension in mice. The problem is that aside from many of these papers possibly having some dubious methodology, the subjects are mice. That's some seriously different physiology and a whole pile of other biological differences, right down to the genetic level. Seems obvious, but many news stories about it seem to gloss over just how far a medical advance in mice is from anything resembling useful technology for humans.

Hell, if we could apply to humans all the therapies and treatments that have so far cured or at least helped with cancer, Parkinsons, dementia and aging itself in mice and rats, among other things, we'd long since have created a much easier time with these diseases.
by valenterry | 2025-07-11 03:29:08+00:00
> you can make the recipient poll the table(s) of record for relevant state

That is tricky due to transactions and visibility. How do you write the poller to not miss events that were written by a long/blocked transaction? You'd have to set the poller scan to a long time (e.g. "process events that were written since now minus 5minutes") and then make sure transactions are cancelled hard before those 5minutes.
by seanmcdirmid | 2025-07-11 03:29:24+00:00
HVCD Was supposed to be the answer for china’s big renewable energy surplus out west while most of its energy needs are in the east, but for some reason it hasn’t worked out so they are leaning on nuclear and coal more for eastern power needs. I guess when the imbalance is huge, it’s not that easy. They could move more manufacturing out west, and I think they are doing that to a point, but water supply becomes an issue at that point (and it will always be easier to move energy than water!). Still, I wonder if we will see the rise of cities like Lanzhou that have cheap electricity, the same thing happened for Seattle and aluminum smelting via cheap hydro power (also why boeing started there)

They don’t invest in gas much because they have to import it all, though it will be a long time before they use electricity for cooking as opposed to natural gas or propane.
by thedevilslawyer | 2025-07-11 03:31:09+00:00
> Further, GenAI adoption in industry is overwhelmingly aimed at automating and replacing human effort, often with the expectation that future “AGI” will render human intellectual and creative labor obsolete. This is a narrative we will not participate in

When every learner gets the high quality support and tutoring they need, all around the world, then we can talk about what you're unwilling to participate in. Until then, may every learner get a fantastic tutor via GenAI.
by badsectoracula | 2025-07-11 03:31:23+00:00
> But I can assure you that "pandas count unique values column 'Foo'" is just as effective an LLM prompt as "Using pandas, how do I get the count of unique values in the column named 'Foo'?"

While the results are going to be similar, typing a question in full can help you think about it yourself too, as if the LLM is a rubber duck that can respond back.

I've found myself adjusting and rewriting prompts during the process of writing them before i ask the LLM anything because as i was writing the prompt i was thinking about the problem simultaneously.

Of course for simple queries like "write me a function in C that calculates the length of a 3d vector using vec3 for type" you can write it like "c function vec3 length 3d" or something like that instead and the LLM will give more or less the same response (tried it with Devstral).

But TBH to me that sounds like programmers using Vim claiming they're more productive than users of other editors because they have to use less keystrokes.
by lmeyerov | 2025-07-11 03:32:00+00:00
yes, I keep prompt plan logs

At the same time... that's not why I'm comfortable writing this. It's pretty obvious when you know what good vs bad feels like here and adjust accordingly:

1. Good: You are able to generate a long plan and that plan mostly works. These are big wins _as long as you are multitasking_: you are high throughput, even if the AI is slow. Think running 5-20min at a time for pretty good progress, for just a few minutes of your planning that you'd largely have to do anyways.

2. Bad: You are wasting a lot of attention chatting (so 1-2min runs) and repairing (re-planning from the top, vs progressing). There is no multitasking win.

It's pretty clear what situation you're in, with run duration on its own being a ~10X level difference.

Ex: I'll have ~3 projects going at the same time, and/or whatever else I'm doing. I'm not interacting "much" so I know it's a win. If a project is requiring interaction, well, now I need to jump in, and it's no longer agentic coding IMO, but chat assistant stuff.

At the same time, I power through case #2 in practice because we're investing in AI automation. We're retooling everything to enable long runs, so we'll still do the "hard" tasks via AI to identify & smooth the bumps. Similar to infrastructure-as-code and SDLC tooling, we're investing in automating as much of our stack as we can, so that means we figure out prompt templates, CI tooling, etc to enable the AI to do these so we can benefit later.
by baristaGeek | 2025-07-11 03:32:53+00:00
Postgres is a great DB, but it's the wrong tool for a write-heavy, high-concurrency, real-time system with pub-sub needs.

You should split your system into specialized components: - Kafka for event transport (you're likely already doing this). - An LSM-tree DB for write-heavy structured data (eg: Cassandra) - Keep Postgres for queries that benefit from relational features in certain parts of your architecture
by benreesman | 2025-07-11 03:33:22+00:00
If you combine models/agents with formal systems, you can get them to come back when they're in a corner today: https://gist.github.com/b7r6/b2c6c827784d4e723097387f3d7e1d8...

This interaction is interesting (in my opinion) for a few reasons, but mostly to me it's interesting in that the formal system is like a third participant in the conversation, and that causes all the roles to skew around: it can be faster to have the compiler output in another tab, and give direct edit instructions: do such on line X, such on line Y, such on line Z than to do anything else (either go do the edits yourself or try to have it figure out the invariant violation).

I'm basically convinced at this point that AI-centric coding only makes sense in high-formality systems, at which it becomes wildly useful. It's almost like an analogy to the Girard-Reynolds isomorphism: if you start with a reasonable domain model and a mean-ass pile of property tests, you can get these things to grind away until it's perfect.
by seanmcdirmid | 2025-07-11 03:35:43+00:00
It can get over some mental blocks, having some code to look at can start the idea process even it’s wrong (just like for writing). I don’t think it’s bad, like I don’t think writing throw away code for prototyping is a bad way to start a project that you aren’t sure how to tackle. Waterfall (lots of research and design up front) is still not going to work even if you forgo AI.