MurphyA/hacker-news huggingface dataset:
by matheist | 2025-10-31 22:26:04+00:00
Can anyone explain (or link) what they mean by "injection", at a level of explanation that discusses what layers they're modifying, at which token position, and when?

Are they modifying the vector that gets passed to the final logit-producing step? Doing that for every output token? Just some output tokens? What are they putting in the KV cache, modified or unmodified?

It's all well and good to pick a word like "injection" and "introspection" to describe what you're doing but it's impossible to get an accurate read on what's actually being done if it's never explained in terms of the actual nuts and bolts.
by suprjami | 2025-10-31 22:26:07+00:00
Fun tinkering but I don't find it very compelling to get root access by becoming the root user.

A more exciting usage is pairing this with qemu userspace emulation, so you can uncompress a filesystem from another architecture. You can have a terminal into a Raspberry Pi OS without a Raspberry Pi.

https://ihlenfeldt.net/binfmt-misc/

https://wiki.debian.org/QemuUserEmulation
by mycoliza | 2025-10-31 22:26:12+00:00
> No, just have select!() on a bunch of owned Futures return the futures that weren't selected instead of dropping them. Then you don't lose state.

How does that prevent this kind of deadlock? If the owned future has acquired a mutex, and you return that future from the select so that it might be polled again, and the user assigns it to a variable, then the future that has acquired the mutex but has not completed is still not dropped. This is basically the same as polling an `&mut future`, but with more steps.
by the_gastropod | 2025-10-31 22:26:18+00:00
Please. What common conspiracy theories that have actual political impact have water carried by left-wing politicians?

Here's a short list of RW conspiracy theories with real life political consequences:

- Antivax conspiracies

- Barack Obama wasn't born in the United States ("birther" conspiracy)

- Biden / Ukraine conspiracy theory

- The litany of Covid-19 conspiracy theories

- The "deep state" conspiracy theory

- Sarah Palin's "death panels" conspiracy theory

- Sandy Hook was fake

- 2020 Election Fraud

- Trump / Ukraine conspiracy theory

- QAnon
by switchbak | 2025-10-31 22:26:31+00:00
The Op said: "we're the baddies" when discussing an article about China, implying that we (whoever that is) are worse than China because they added lots of trees. That's a clear and obvious nod to the "are we the baddies" skit about a couple Nazi soldiers slowly realizing they're the bad guys. It's also very fashionable in this moment to self-flagellate beyond any reasonable level.

I'm saying: perhaps we shouldn't be giving that country such acclaims when in addition to adding lots of trees, they're also burning an absolutely colossal amount of carbon just with their coal use alone. Two things can be true at the same time, and we can be even handed in our appraisals.

Your take is uncharitable and inaccurate.
by dennemark | 2025-10-31 22:26:41+00:00
I have AMD Strix Halo (395) on my work laptop (HP Ultrabook G1A) as well as at home with Framework Desktop.

On both i have setup lemonade-server on system start. At work i use Qwen3 Coder 30B-3A with continue.dev. It serves me well in 90% of cases.

At home i have 128GB RAM. I try a bit GPT120B. I host Open WebUI on it and connect via https and wireguard to it, so i can use it as PWA on my phone. I love not needing to think about where my data goes. But i would like to allow parallel requests, so i need to tinker a bit more. Maybe llama-swap is enough.

I just need to see how to deal with context length. My models stop or go into infinite loop after some messages. But then i often start a new chat.

Lemonade-server runs with llama.cpp, vllm seems to be scaling better thoug, but is not so easy to set up.

Unsloth GGUFs are great resource for models.

Also for Strix Halo check out kyuz0 repositorIES! Also has image gen. I didnt try those yet. But the benchmarks are awesome! Lots to learn from. Framework forum can be useful, too.

https://github.com/kyuz0/amd-strix-halo-toolboxes Also nice: https://llm-tracker.info/ It links to some benchmark site with models by size. I prefer such resources, since it is quite easy to see which one fit in my RAM (even though i have this silly thumbrule Billion Token ≈ GB RAM).

Btw. even a AMD HX 370 with non soldered RAM can get some nice t/s for smaller models. Can be helpful enough when disconnected from internet and you dont know how to style a svg :)

Thanks for opening up this topic! Lots of food :)
by physarum_salad | 2025-10-31 22:27:18+00:00
"Wikipedia, in my mind, has two main purposes: A quick visit to find out the basics about some city or person or plant or whatever, or a deep-dive to find out what we really know about genetic linkages to autism or Bach’s relationship with Frederick the Great or whatever."

Completely agree with the first purpose but would never use wikipedia for the second purpose. Its only good at basics and cannot handle complex information well.
by bjoli | 2025-10-31 22:27:26+00:00
Listen, my gripe isn't with ruby in particular. It is with every language out there.

Doing it that way is still going to be slower than doing it eagerly with a manual loop. I am not saying ruby should do away with the other ways of doing it. I am saying that ruby - and just about every language out there - should have a powerful looping facility that lets you do it fast without losing comfort.

If I - a non-programmer - could implement it using macros in scheme there is really no excuse for other languages to have such sucky foreach-like constructs.

For the vast majority of situations my goof-loop has no performance penalty compared to rolling the loop yourself. That is what none of the ruby examples I have been given can do. Using zip is not an acceptable way of iterating over 2 collections at once, at least not if you want to pretend to be efficient.

I don't think what I did is particularly good compared to something like the iterate macro, and all I want is for other languages to do better because I rarely have the pleasure of using scheme when doing coding.
by exe34 | 2025-10-31 22:27:52+00:00
I initially believed his early videos about how he applies the scientific process, with a spreadsheet of the BOM, optimising for specific questions and failing early and all that.

Given his later attitude when it came to careful thought, I'm no longer under the impression that these earlier expositions were his ideas at all. I suspect he got it from the engineers and used it to burnish his image. I know that certain companies, e.g Apple, Dyson, etc have a culture of "all ideas came from the big man at the top, no matter who thought of it."
by LastTrain | 2025-10-31 22:28:31+00:00
“ Grok has historically actually been one of the biggest debunkers of right-wing misinformation and conspiracy theories on Twitter”

Well, no, it hasn’t. It has debunked some things. It has made some incorrect shit up. But it isn’t historically one of the “biggest debunkers” of anything. Do we only speak hyperbole now?
by alephnerd | 2025-10-31 22:28:53+00:00
Becuase it is about pay.

For example, most of the security portfolio that GCP provides is developed and product managed out of the Google Hyderabad office, as is a fairly major Israeli CNAPP product that starts with "A", a large CNAPP from a public Israeli-American security company that is directly positioned against Wiz, and a major security vuln mgmt and redteaming tool used by the DoD, GitHub, and Google. But all these employers pay $60k-130k TC for mid-career security professionals in India.

We scoop up anyone who is remotely competent at transnational firms or startups because we can afford to pay Western salaries, and traditional conglomerates in India largely do not care about web exploits unless they are a web platform first and foremost.

Tata Motors - being an automotive company - does not care about web development for the same reason GM doesn't as well: it isn't tangibly connected to revenue generation. As such, they will just contract it out to TCS (a Tata Group company, but both are independent of each other) at the lowest contract rate possible.
by octoberfranklin | 2025-10-31 22:29:47+00:00
Well the less-footgun-ish alternative would look something like a Stream API, but the last time I checked tokio-stream wasn't stable yet.

Then you could merge a `Stream<A>` and `Stream<B>` into a `Stream<Either<A,B>>` and pull from that. Since you're dealing with owned streams, dropping the stream forces some degree of cleanup. There are still ways to make a mess, but they take more effort.

....................................

Ratelimit so I have to reply to mycoliza with an edit here:

That example calls `do_thing()`, whose body does not appear anywhere in the webpage. Use better identifiers.

If you meant `do_stuff()`, you haven't replaced select!() with streams, since `do_stuff()` calls `select!()`.

The problem is `select!()`; if you keep using `select!()` but just slather on a bunch of streams that isn't going to fix anything. You have to get rid of select!() by replacing it with streams.
by raddan | 2025-10-31 22:29:55+00:00
> Only the stateful things need to remain stateful.

And I think it is worth noting that there is effectively no difference between “stateful” and “not stateful” in a purely functional programming environment. You are mostly talking about what a thing is and how you would like to transform it. Eg, this variable stores a set of A and I would like to compute a set of B and then C is their set difference. And so on.

Unless you have hybrid applications with mutable state (which is admittedly not uncommon, especially when using high performance libraries) you really don’t have to think about state, even at a global application level. A functional program is simply a sequence of transformations of data, often a recursive sequence of transformations. But even when working with mutable state, you can find ways to abstract away some of the mutable statefulness. Eg, a good, high performance dynamic programming solution or graph algorithm often needs to be stateful; but at some point you can “package it up” as a function and then the caller does not need to think about that part at all.
by jameslk | 2025-10-31 22:30:35+00:00
Wikipedia is a great educational resource and one I've donated to for over a decade. That said, I like the idea of Grokipedia in the sense that it's another potential source I can look at for more information and get multiple perspectives. If there's anything factual in Grokipedia that Wikipedia is missing, Wikipedia can be updated to include it

I hope we can keep growing freely available sources of information. Even if some of that information is incorrect or flat out manipulative. This isn't anything new. It's what the web has always been
by pstuart | 2025-10-31 22:30:39+00:00
"You cannot reason a person out of a position he did not reason himself into in the first place."

Fox (and others like it) offer 24/7 propaganda based on fear and anger, repeating lies ad nauseam. It's highly effective -- I've seen the results first-had.

Making ad hominem attacks against "debunkers" doesn't make your case.

And again, trying to change people's minds by telling them what they believe is wrong is a fools errand (99.99% of the time). But it still needs to happen as that misinformation should not go unchallenged.
by bebb | 2025-10-31 22:31:34+00:00
Because it's a genuinely good idea, and hopefully one for which the execution will be improved upon over time.

In theory, using LLMs to summarize knowledge could produce a less biased and more comprehensive output than human-written encyclopedias.

Whether Grokipedia will meet that challenge remains to be seen. But even if it doesn't, there's opportunity for other prospective encyclopedia generators to do so.
by rat87 | 2025-10-31 22:32:01+00:00
Why would we ever want to revisit people like Erlich and the Club of wrong who were famously extremely off in their predictions? And when some of the writings contributed to forced

The claims that theyll be proven right /on track any day now decades after their predictions failed is hard to take seriously.

It's not the business as usual people who made sure that their predictions fail its people working to either improve the world or sometimes to make money that actually changed things. In fact it was the people who pushed neo malthusian thinking that assumed things would continue as usual and therefore get worse
by littlestymaar | 2025-10-31 22:33:01+00:00
Since you are of of the people working directly on this codebase, may I ask you why is select! being used/allowed in the first place?

Its footgun-y nature has been known for years (IIRC even the first version of the tokio documentation warned against that) and as such I don't really understand why people are still using it. (For context I was the lead of a Rust team working on a pretty complex async networking program and we had banned select! very early in the project and never regretted this decision once).
by jononor | 2025-10-31 22:33:07+00:00
A RPi 4/5 has that? The OMAP 3/4 chips in Beaglebone is another alternative. Or Rockchip/Allwinner SoCs. Those are all Cortex A series though, but that can still be programmed bare metal if one wants. There are also Cortex M microcontrollers with support for SDRAM, like STM32H7. Or one can get an FPGA with DDR support like ECP5.
by drdeca | 2025-10-31 22:33:10+00:00
Why would it relate to your past experience of being held in your mothers arms, rather than to whatever inbuilt tendencies that lead one to respond well to being held in one’s mother’s arms while a baby?

Like, if kissing is derived from impulses relating to breastfeeding (which is a hypothesis that, AIUI, is in good standing, though not the only one in good standing nor necessarily more favored than a couple others), I wouldn’t think that therefore someone who was only ever bottle-fed as a baby would therefore not get anything out of kissing. The appeal of “my lips on another person” should be there regardless, just as it was for the first time a baby is breastfed (though, of course, it is also a cultural thing: not all cultures have had kissing as a standardized way of expressing affection, so whether one grows up in a context where kissing plays a role, that probably also plays a part in whether one finds it appealing to have one’s lips on another person).
by j45 | 2025-10-31 22:33:23+00:00
Toyota and Lexus engines still require considerable regular and proactive service and repairs to last the hundreds of thousands of miles the steel is capable of.

This means, seals, gaskets, shocks, etc will all still wear out over time like every vehicle.

If you don't listen to the manufacturer's recommendation and change your fluids far more often, especially the "lifetime" fluids, almost any vehicle will last much longer.
by fabiancook | 2025-10-31 22:33:29+00:00
Awesome to see the Navigation API being talked about at DevFest.

The API is available in chrome today. Safari & Firefox are actively developing their implementations too.

MDN Documentation: https://developer.mozilla.org/en-US/docs/Web/API/Navigation_...

JavaScript implementation usable as polyfill: https://github.com/virtualstate/navigation (I am the author of this repository)
by netsharc | 2025-10-31 22:35:06+00:00
I'm not the grandfather commenter, I'm very much a leftist, but left, right, there's too many whose emotions or tribalism override their logic and make them deny what they see/come up with dumbass theories.

For a left example, there are people who theorize that the guy who missed putting a bullet in Trump's brain must've been a false flag operator. Although it must be mentioned that "leftie" conspiracy theories are mostly just on social media, while "right" ones end up being broadcast by congresspeople and senators, probably because they know their side will take them at face value..
by Dagonfly | 2025-10-31 22:35:26+00:00
That's a really subtle version of the deadlock described in withoutboats FuturesUnordered post [0]

When using “intra-task” concurrency, you really have to ensure that none of the futures are starving.

Spawning task should probably be the default. For timeouts use tokio::select! but make sure all pending futures are owned by it. I would never recommend FuturesUnordered unless you really test all edge-cases.

[0] https://without.boats/blog/futures-unordered/
by Hasz | 2025-10-31 22:35:50+00:00
Wasn't around to personally witness it, but I do not believe the first part is true:

https://www.princeton.edu/~ota/disk2/1990/9015/901507.PDF, specifically page 94.

Also, IMO there is a big difference between an open market that allows for price discovery and free trading versus placing bets against the same casino at predetermined prices.
by physarum_salad | 2025-10-31 22:35:54+00:00
"Warts and all" says it all really. What are those warts? Who's responsibility are they?

Wikipedia is really not ideal for the LLM age where multiple perspectives can be rapidly generated. There are many topics where clusters of justified true beliefs and reasonable arguments may ALL be valid surrounding a certain topic. And no I am not talking about "flat earth" pages or other similar nonsense.
by ThatPlayer | 2025-10-31 22:36:15+00:00
With MoE models like gpt-oss, you can run some layers on the CPU (and some on GPU): https://github.com/ggml-org/llama.cpp/discussions/15396

Mentions 120b is runnable on 8GB VRAM too: "Note that even with just 8GB of VRAM, we can adjust the CPU layers so that we can run the large 120B model too"
by simulator5g | 2025-10-31 22:36:31+00:00
Its too late for that, they're already working on putting ads in ChatGPT. https://www.seo.com/blog/chatgpt-advertising/

This won't only be in the free tier. Altman says they don't even break even on the paid tiers. They will use whatever money is available to fill that gap, and advertising money is available. https://x.com/sama/status/1876104315296968813

Soon we will live in a world where people don't make purchasing decisions for themselves, they ask an AI which will suggest the product that pays the most for ads. Payola World.
by meowface | 2025-10-31 22:37:28+00:00
I am not using hyperbole or speculating. I absolutely mean it.

"Biggest" is tough to quantify, but "most significant" and "most effective" is what I meant. I use Twitter way too many hours a day basically every day and have a morbid fixation on diving deep into right and far-right rabbit holes there. (Like, on thousands of occasions.)

Grok is without a doubt the single most important contributor to convincing believers of right-wing conspiracy theories that maybe the theories aren't as sound as they thought. I have seen this play out hundreds of times. Grok often serves as a kind of referee or tiebreaker in threads between right-wing conspiracy theorists and debunkers, and it typically sides overwhelmingly with the debunkers. (Or at least used to.) And it does it in a way that validates the conspiracy theorist's feelings, so it's less likely to trigger a psychological immune system response.

https://www.reddit.com/r/GROKvsMAGA/ contains some examples. These may seem cherry-picked, but they generally aren't. (Might need to look at some older posts now that Elon has put increasingly pressure on the Grok and Grokipedia developers to keep it """anti-woke""".)

When a right-wing conspiracy theorist sees some liberal or leftist call them out for their falsehoods, they respond with insults or otherwise dismiss or ignore it. When daddy Elon's Grok tells them - politely - that what they believe is complete horseshit, they react differently. They often respond to it 3 - 20 times, poking and prodding. Of course, most still come away from it convinced Grok is just compromised by the wokes/Jews/whatever. But some seem to actually eventually accept that, at the least, maybe they got some details wrong. It's a very fascinating sight. I almost never see that reaction when they argue with human interlocutors.

To be clear, it was never perfect. For example, if you word things in just the right way and ask leading questions, then like with any LLM (especially one that needs to respond in under 280 characters) you can often eventually coax it into saying something close to what you want. I have just seen many instances where it cuts through bullshit in a way that a leftist arguing with a Nazi can't really do.
by alyxya | 2025-10-31 22:37:30+00:00
At a glance, Grokipedia seems quite promising to me, considering how new it is. There are plenty of external citations, so rather than relying on a model to recall information internally, it’s likely effectively just summarizing external references. The fact that it’s automatically generated at scale means it can be iterated on to improve fact checking reliability, exclude certain known sources as unreliable, and ensure it has up-to-date and valid citation links. We’ll have to wait and see how it changes over time, but I expect an AI driven online encyclopedia to eventually replace the need for a fully human wikipedia.
by octoberfranklin | 2025-10-31 22:37:37+00:00
> How does that prevent this kind of deadlock?

Like I said, it doesn't:

> even this doesn't fix the root cause because dropping an owned Future isn't guaranteed to cancel it cleanly.

It fixes this:

> However you also wouldn’t be able run use select! in a while loop and try to acquire the same lock (or read from the same channel) without losing your position in the queue.

If you want to fix the root cause, see https://news.ycombinator.com/item?id=45777234
by giobox | 2025-10-31 22:38:02+00:00
A lot of electronic parking brakes do have a service mode. For most modern Fords, there is a procedure, as one example of many:

> https://www.brakeandfrontend.com/quick-answer-electronic-par...

You typically need the piston fully retracted to replace pads, which very rarely happens just by disengaging the park brake.

If you are old enough to have changed a manual handbrake pad, you normally had to screw the piston back in before you could fit the thicker new pad with a "caliper rewind tool" even if the handbrake was off, the electronic parking brake service mode essentially does this for you, or unblocks the piston permitting a rewind tool to work.

> https://www.thedrive.com/guides-and-gear/how-to-use-a-brake-...

FWIW, I've never found an electronic parking brake I couldn't rewind myself after a few minutes on google.
by ef2k | 2025-10-31 22:38:19+00:00
Maybe it's just me, but reading through LLM generated prose becomes a drag very quickly. The em dashes sprinkled everywhere, the "it's not this, it's that" style of writing. I even tried listening to it and it's still exhausting. Maybe it's the ubiquity of it nowadays that is making me jaded, but I tend to appreciate terrible writing, like I'm doing in this comment, more nowadays.
by roenxi | 2025-10-31 22:38:34+00:00
I'm generally in favour of a <2% land tax because it is basically confiscatory - over the course of a lifetime (~20 years not owning land, 50 years owning land, 100% tax). That forces people to store their wealth in deprecating assets and means over time the economy orients towards competent asset managers having all the wealth as opposed to the usual equilibrium of forming a landed aristocracy. It also can't be escaped because the land can't be destroyed, not created or moved.

So I don't know much about the French situation being more than a continent away, but in principle a 2% wealth tax can't fix a budget hole. It is also confiscatory, making it ultimately a tool of social engineering rather than revenue raising. It is a policy to eliminate large pools of assets. Things that get eliminated can't be taxed sustainably.