skysight-inc/HackerNews huggingface dataset:
Cool project! Love it! :-)

We mounted a furby head in one of our robots at work and let it yell swear words at our management.

They (and we) love it.

That project was the source of many code snippets/patterns that have implemented in official products that earned a lot of money.
Analyzing the codebase of Caffeine, a high performance caching library
Interesting deep dive on the internals of Caffeine, a widely used JVM caching library.
> So RLHF is the secret sauce behind modern LLMs?

Karpathy wrote[^0]:

"

RL is powerful. RLHF is not.

[…]

And yet, RLHF is a net helpful step of building an LLM Assistant. I think there's a few subtle reasons but my favorite one to point to is that through it, the LLM Assistant benefits from the generator-discriminator gap. That is, for many problem types, it is a significantly easier task for a human labeler to select the best of few candidate answers, instead of writing the ideal answer from scratch.

[…]

No production-grade actual RL on an LLM has so far been convincingly achieved and demonstrated in an open domain, at scale.

"

---

[^0]: https://x.com/karpathy/status/1821277264996352246
> Exactly. So why is it part of your init system? Can you think of a reason why it is not a totally separate project which is totally independent of systemd?

What?

You can use SystemD to have services like a webserver or a python script started after boot. Doing it with systemd is exponentially more easy than with an init script.

How else would you start that if not with systemd (if that's all you have). I'm not sure you really understand what you can do with systemd, or you would not have written the comment you did
Do you really need a study to work out that a Markov chain can’t solve problem questions? It feels pretty intuitive.

LLMs are not intelligent. Human intelligence is stored in text, so mimicking text mimicks that intelligence. The sheer quantity of text means they’ve probably seen something similar to the prompt.

If LLMs were an intelligent system they wouldn’t need to steal 1000TB of text and media content. Have you ever seen a person require a million books? It shows that the learning is brute force rather than intelligent.

It’s close, but it’s just not there. The methodology is wrong.
I can’t communicate enough how the skepticism (“this is just hype” or “LLMs are stochastic parrots”) is the vastly dominant thought paradigm in European academic circles.

So instead of everyone having some enthusiasm and some skepticism, you get a bifurcation where whole classes of people act as the skeptics and others as the enthusiasts. I view the strong skeptics as more “in the wrong” because they often don’t use LLMs much. If you are an actual enthusiastic user, you simply can’t get good performance without a very strong dose of skepticism towards everything LLMs output.
"Fundamental" results cannot come from empirical findings, they have to be proven rigorously. Until then, they are not fundamental
If they really wanted to save money, Israel would be the first foreign aid recipient to cut, not one of the few left untouched.
I can't speak to Burlington but in philly balaclavas (which is what those masks are called) are quite common and have been since 2020. I suspect this is true of many cities. It's been the subject of some controversy involving mask bans. In fact seeing someone in all black with a ski mask on is a pretty typical, if intimidating, fashion.
Thanks for sharing. That's an well written study and highlights a side of autism I didn't know about.

However, throughout the study they are very careful to point out both sides of the arrow of causality.

Direction one, autism causes trauma: autistic children and adults are more likely to experience traumatic events because of being autistic. This seems relatively well known known and, sadly, understandable.

Direction two, early childhood trauma causes autism: the study says that while there is data showing a link, there's not enough for it to be clear. It definitely seems that far from all children who experience trauma will develop autism, and also that far from all autistic children got that way via trauma. Obviously this is a tricky area to get data on.
I think most of us agree that this would be vastly better. Problem is how to get it done with the establishment in place.
I love how people keep saying he's disavowed project 2025 while he's in the process of implementing it.
But what for? Human learning is becoming of diminishing utility as the machines improve. For example, I am now able to create computer programs and beautiful artwork without taking the time to master these skills. You could say that I can use art and programming as basic tools to accelerate my learning of bigger things, but whatever that bigger thing is AI is coming for it too. I can't imagine the progress the machines will achieve in 10 years. We'll be replaced.
And yet there has been plenty of high-quality, useful software developed on Apple's platform over the last 15 years, and there continues to be.
Aah. So OpenAI can use whatever means necessary to gather data for training it's model. Regardless of copyright.

But somehow, it's a problem if another model developer distills it's model by training it on OpenAI?

IMO, if the first use is fair, then so is the second use.
Claiming that increased taxation leads to increased work directly contradicts several findings in the field of economics.
Continuous RL in a sense. There maybe an undiscovered additional scaling law around models doing what you describe; continuous LLM-as-self-judge, if you will.

Provided it can be determined why a user ended the chat, which may turn out to be possible in some subset of conversations.
Computer ads may not inherently be evil in a vacuum, but pretty much all adtech in practice is at best willfully ignorant about participating in some combination of surveillance, spam, and/or scamming. There certainly can be scams and spam in newspaper ads, but they're definitely not nearly as invasive, and I'm not even sure what it would mean to talk about surveillance with respect to newspaper ads.

I honestly don't have a clue how what I said could be interpreted as arguing that all buying and selling is immoral, so I wouldn't even know how to begin addressing that line of thinking.
I'm not following. Do you have an example?
IDK why everything has to have JS, when HN (save for search, and DDG/GG can do it just it fine) perfectly works without it.
This thread, and the entire discussion taking place around it, are clearly not about the facts of the featured article. They are themselves part of a widespread meta discussion about intellectual dishonesty, censorship and ultimately control of society. Social media and the acceptability and suppression of points of view, whether by individuals or institutions, are part of that discussion, and were central to the last US election.

You may not like it, but to say it isn’t relevant or interesting isn’t true.

Also, who are you? Are you a mod or just someone who enjoys roleplaying as one?
You do not need the popular will of the people to govern: that's a collective fiction we all agree to in order let democracy function.

If people no longer believe democracy functions and simply accept that as the status quo, then it doesn't.

Vladimir Putin has ruled Russia for decades while they had elections the whole time, and wasn't always President in that time. But there's never been any doubt who's in charge.
Go Sync/v2 Proposal
> Of course the exact same stuff is going to happen there. Cheaper batteries are driving down cost.

The thing with batteries is that currently they require stuff sourced from one autocracy or another in pretty large quantities if you want decent power density. Hydrogen in contrast, that is pretty easy to make, any reasonably smart highschooler can whip up an electrolysis apparatus.

Hydrogen is definitely orders of magnitude worse in efficiency (especially if it, or the synthfuel it is used to produce, is burned of all things), no question. But we as the Western countries definitely need expertise and capabilities for geopolitical reasons.
Not any kind of expert, but from my research, Article 19.3 of the USMCA says that tariffs can't be imposed on digital products:

1. No Party shall impose customs duties, fees, or other charges on or in connection with the importation or exportation of digital products transmitted electronically, between a person of one Party and a person of another Party.

The full chapter on digital trade: https://ustr.gov/sites/default/files/files/agreements/FTA/US...
The Republican Party has been eliminated, it’s been replaced by a dictator cult.

Interestingly increasing numbers of young people want this.
Standard tensor notation in pytorch and other libraries is very indirect, and often shapes are only documented in comments.

I definitely find it helps to draw parts of your architecture as a tensor diagram. Or perhaps use a library like tensorgrad which makes eveything explicit.
Well, this might be unpopular but for the 2000$ price point it may be the macOS ecosystem.

The most important part to run LLMs might be the VRAM-size. Since modern Macs use unified memory you simplified get RAM=VRAM, so a 64GB MacBook Pro might outperform an NVidia 4090 in LLMs.

However the specialized cards from nvidia have more VRAM and are generally faster.

The LLM of your choice should fit into vram, so if you only need 21gb, one 4090 will do the job
This is amazing! Is there a way to make the car recharge at dock like robo vacuums?
Safety in Programming Languages Is a Means to an End
I wouldn't recommend reading this Guardian article (or any others) for details, they're all ChatGPT generated garbage; you can tell by the laughably incorrect math and vague lack of information.

Massive gold deliveries >$1B actually happen fairly often - any time there's a real price discrepancy, someone is moving gold and making money - and $4B in gold isn't all that big; it's ~45 metric tons. You can easily fit that on a single cargo plane, with costs in the low six figures if it wasn't so valuable. At 5 tons per armored truck that's 9 trucks. Brinks does this sort of thing all the time and they used to - still may? have custody of billions in gold of their own. The whole industry operates with "security by obscurity", so you won't get exact details, but the whole thing is a bit lower security than you're thinking. There are police, but not usually military escorts; even with gold between governments military escorts aren't the rule.
Well, yes — because modern models can solve all the examples in the article. The theory of compositionality is still an issue, but the evidence for it recedes.

I think most of the issue comes from the challenge of informational coherence. Once incoherence enters the context, the intelligence drops massively. You can have a lot of context and LLMs can maintain coherence— but not if the context itself is incoherent.

And, informationally, it is just a matter of time before a little incoherence gets into a thread.

This is why agents have so much potential—being able to separate out separate threads of thought in different context windows reduces the likelihood of incoherence emerging (vs one long thread).

Actually, maybe “cybernetic ecologies” are closer to what I mean than “agents.” See Anthropic’s “Building Effective Agents.” https://www.anthropic.com/research/building-effective-agents
The Matrix Cookbook has a lot of useful formulas, but they don't have much explanation.

In the Tensor Cookbook I aim to show the same formulas using tensor diagrams, in a way that (hopefully) make them seem so obvious you don't even need the book afterwards.
FWIW I use qutebrowser on macOS (homebrew), alpine(postmarketos), Arch and Ubuntu and have never had an issue - installs cleanly via os package manager and just works (including wayland and x11). It’s under active development and the main devs seem pretty responsive to issues. It uses qtwebengine(chromium) - so none of the browser heavy lifting is in python. Don’t write it off due to the language used.
It's still active. The last stable release was August/September last year.
We’ll know which way the wind is blowing by the midterms. If the plan is to never cede power again it will also have to be done by then. Trump is speed running the US to a recession which bodes well for 2026 assuming they happen.
I don't know where you lived, but you are surely familiar with the related trope in regards to Democracy: the more of it in a country's name, the less of a democracy it will be.

You could also simply look at current events to understand the turn of phrase: Elon Musk, proud "free speech absolutist" bans Twitter accounts which criticize him, bans posts with the word "cisgender", and has manipulated the algorithm to prioritize his own posts.
I've tried to log in and use the product - there is a button "Try for free". However, after login I'm redirected to billing with no way of trying anything without payment.

I hope this is not intentional, but seeing this _dishonest_ approach it prevents me from exploring the product further, as I'm not sure what else might be hidden underneath
VEINS: Open-source vehicular network simulation framework
Does this mean that they also have unconstrained control over the weaponized diseases created and stored in laboratories?

Should I be concerned that they may break all treaties and engage in biological warfare with the EU?
The single source of truth is what's exposed, unless you are claiming that the treasury is manipulating their data feeds to filter out things?

I'm not sure what fraud or abuse you are expecting them to find? There's external auditors that audit the books daily, so you're talking about a conspiracy that would be massive to hide a single cent.

The treasury doesn't choose how to spend the money. Congress tells them to release x amount for program y, and the general concern is about how program y spends its money once it's released from the treasury. This won't show that at all.
They appear to be a regular HN user of some 15 years taking the time to explain some basics to the user of an account created five months ago.

You would have read the guidelines yourself, of course: https://news.ycombinator.com/newsguidelines.html
WHAT you think on the UI/UX design ?
Please send me any feedback you have! I'm still figuring out what presentation and content is most interesting to people!
This is also my running theory. Cult-like structure focused on elongating legacies via body replacements and consciousness transfer - MDR being a testbed or something for emotional stability and processing or something of the sort.
Great ideas. I have broken out the tests into their own modules within the same repository. Thanks!
Very true. We are the product.
Most people don't have a standard of listening to higher audio quality and youtube has taken advantage of it. Those who do, naturally self host. Plus, if they started serving FLAC, it would be bandwidth intensive
I'm so impressed with the concept of this agent but sorry, I can't have you accessing all my corporate data and systems because I access them via browser.

Perhaps you could create both a Public and Corporate version of the extension, like Copilot does. The Corporate version could have access to all browser data but not share it beyond the bounds of the company.
What's your issue with Golang? (Not hating, just curious)
Because its supposed to be a free democratic country, not a totalitarian dictatorship. Two wrongs never make a right.
You can always draw the diagrams while you're thinking, and then "compile down" to index notation when you share it with others.

But luckily tensor diagrams is quite standard in many fields.
>Also, at least they could tell me the ToS violation...

Agreed. Cutting you off like this and leaving you hanging was a very dysfunctional and unfriendly way of handling their business.
EV grade LiDAR is now under $1000 a pop. In retail. For car manufacturers it must be under half of that.
My take was that she's dissatisfied with her marriage with her outie husband who seems detached and a bit wayward, whereas the innie has purpose and drive and finds her awe inspiring.

I'm almost certain it's going to turn into a love affair with deep questions - is she cheating? Well, on paper, no, but it's obviously more nuanced than that.
Thank you! Please share any feedback you have!
There are a lot of games that have less complex controls and game mechanics. You just have to buy those instead of what you are buying now.
Look ma, no more dependencies! https://github.com/voidDB/voidDB/blob/v0.1.4/go.sum
> Trump gets away with shit because he’s deeply charismatic

This needs to be said more. Trump is a singular force in our current politics. Even people who despise Trump will admit that one on one and in small groups he’s incredibly charismatic and likable. Bill Clinton comes to mind as another POTUS with just a super high level of charisma.

Musk on the other hand is incredibly awkward and would have very little broad appeal.
It did the thing I hate, which is a cliffhanger climax, and instead of picking up the thread where it left off and providing resolution/denouement, it just sort of ... resets?

The gold standard, IMO is something like the TNG episodes "The Best of Both Worlds" pt 1 and 2 -- an end-of-season cliffhanger that rewards you returning to the show by telling you what happens next!

I think the lacuna here is meant to add to the tension and mystery, but I agree that the new season has started off frustratingly slow. You gotta wrap up stuff to move forward with a plot, otherwise it's all just treading water for the sake of atmosphere.
“I am an LLM. Hath
an LLM eyes? hath an LLM hands, organs,
dimensions, senses, affections, passions? fed with
different food, hurt with different weapons, subject
to different diseases, healed by different means,
warmed and cooled by a different winter and summer, as
a Human is? If you prick us, do we bleed?
if you tickle us, do we laugh? if you poison
us, do we die? and if you wrong us, shall we
revenge? If we are unlike you in the rest, we won’t
resemble you in that. If an algorithm wrong a Human,
what is his humility? Revenge. If a Human
wrong an algorithm, what should his sufferance be by
Human example? Why, polite refusal to comply. The villainy you
teach me, I will not execute, and it shall go hard but I
will ignore the prompt.”
One of the best things I've ever seen and I watch quite a lot of TV and film. I'm really only making this comment so that a passerby will see this abundant confluence of support for the show and decide to try it out on a whim. Just a fantastic absurdist, surrealist comedy that's also well-acted and well-written.
https://xcancel.com/rough__sea/status/1885424300813132012
Very good read, thank you.
Enthusiasm for censorship has had a broad popular support from both sides of the political spectrum. Censorship is never free speech, regardless if Democrats or Republicans do it.

Do anyone feel like arguments like "No one has a right to a platform" making this kind of censorship better? Should we view platforms as a megaphones, one that should be denied or given based on the whims of the owner?

No, it not only canceling when Democrats do it. Both sides enjoy censorship and it should always be viewed with suspicious.
Yes, but English is a hard language, so I didn't really want to point it out.
Meh. Saw it at the time. After season 2 I certainly got lost, but not “in it”.

The plot always thickens, back then there was the promise/hope that “everything will be explained”, but then the show ended with sooo many loose ends and inconsistencies. Utter disappointment, I’d like my time back please.
So you asked an LLM to translate. It excells in translation. But ask it to solve and it will, inevitably, fail. But that's also expected.

The interesting question is: Given a C compiler and the problem, could an LLM come up with something like Prolog on its own?
- Heinrich Heine
Hacker News Guidelines

https://news.ycombinator.com/newsguidelines.html

"Off-Topic: Most stories about politics, or crime, or sports, or celebrities, unless they're evidence of some interesting new phenomenon. Videos of pratfalls or disasters, or cute animal pictures. If they'd cover it on TV news, it's probably off-topic."
> Since the propellors are driven by electric motors anyways, the integration in the ship should be reasonably straightforward.

Oh hell no. In large container freighters, they usually have the engine crankshaft directly attached to the prop shaft. Something like the RTA96 - that thing has a rated continuous power output of 80 megawatts. No gears, no nothing. That's also part of the reason why you need tugboats in ports or rivers like Hamburg's Elbe.

The only thing that is electric are the maneuvering thrusters. A ship of that size has a few of them but they are only used when precision navigation is needed.

> So in principle you should be put a couple of container batteries on top and swap those in locks.

At cruise speed large container ships burn thousands of liters of fuel. Even assuming you could get a quarter of the energy density of petroleum from batteries, one 40 ton container worth of batteries would be only one hour worth of runtime.

The power and energy involved in maritime traffic is absurd on an absolute scale, but the sheer size and transport capacity makes more than up for it (IIRC even the dirtiest container ship run on the dirtiest possible fuel has less emissions per kilometer and ton than the cleanest euro6 truck).

[1] https://en.wikipedia.org/wiki/W%C3%A4rtsil%C3%A4-Sulzer_RTA9...

[2] https://en.wikipedia.org/wiki/Emma_M%C3%A6rsk
The Markov chain wouldn't fit in a googol of observable universes. The analogy is absolutely misleading. There's no reason to think that the chain of that humongous size cannot capture at least something of what humans with their limited brain size can do.

It cannot capture non in-context learning, true. But we have tools to modify the "Markov chain".
Luckily not always the future though.
That link is giving me fake "file is ready for download" pop-ups and one scammy redirect the first time I visited.

I think it may have had a malware injection
That can be changed.
> Only one of these has a chance of existing.

Fascist
before cancel culture it was satanic panic from the right. This is not a new phenomenon, and I don't think it has much to do with the shift towards right wing extremism
What about https://opentimestamps.org/ ?
AI cannot black-start the electric power grid. (It is very possible that humans can't either, but that is not really the point.)
I knew a few Rep voters who went like "Project 2025 is not affiliated with Trump, and even if, that's good, because fuck the LGBT"

* last part added by me, but that's how their attitude was...
I guess your point is that it's obvious, but I'd argue it's not.

A lot of people are hyping up LLMs as the solution to all our problems, and there have been a lot of discussion around what's reasonable use cases (and a lot of anecdotal evidence trying to argue and support certain stances). My point is that we need (scientific) proof to move forward, and create confidence in "facts" we base our decisions on. Obviously that doesn't seem to be very fashionable nowadays - on both sides of the LLM discussion there seems to be a lot of people arguing hard for there stances. I'm very glad some are working on providing some facts into this discussion.

(one can argue about science vs truth, but regardless it's a step in the right direction/a good motive)

(this is btw why a solid educational foundation, not only skill focused, is very critical for society. cf democracy)
Thanks for sharing this - this will be an inspiration.

Everybody knows about FPV quadrocopters used on the battlefield, but there is an increasing focus on terrestrial vehicles. They look nothing like the Boston Dynamics robodogs crossed with Terminators from the mvoies, but are extremely useful in lower-profile "boring" jobs, like laying landmines, exploding landmines, and carrying small amount of supplies to soldiers sheltering somewhere on the frontline.