skysight-inc/HackerNews huggingface dataset:
I don't think that'd work without a dedicated startup behind it.

The first (and imo the main) hurdle is not reproduction, but just learning to hear the correct sounds. If you don't speak Hindi and are a native English speaker, this [1] is a good example. You can only work on nailing those consonants when they become as distinct to your ear as cUp and cAp are in English.

We can get by by falling back to context (it's unlikely someone would ask for a "shit of paper"!), but it's impossible to confidently reproduce the sounds unless they are already completely distinct in our heads/ears.

That's because we think we hear things as they are, but it's an illusion. Cup/cap distinction is as subtle to an Eastern European as Hindi consonants or Mandarin tones are to English speakers, because the set of meaningful sounds distinctions differs between languages. Relearning the phonetic system requires dedicated work (minimal pairs is one option) and learning enough phonetics to have the vocabulary to discuss sounds as they are. It's not enough to just give feedback.

[1]: https://www.youtube.com/watch?v=-I7iUUp-cX8
It's twice as fast/cheap relative to GPT-4-turbo, which is still expensive compared to GPT-3.5-turbo and Claude Haiku.

https://openai.com/api/pricing/
I'm in the industry and nobody does that since over ten years. There was just a small phase when Hinton published "Greedy layer-wise training of deep networks" in 2007 and people did it for a few years at most. But already with the rise of LSTMs in the 2010s this wasn't done anymore and now with transformers also not. Would you care to share how you reached your conclusion as it matches 0 of my experience over the last 15 years and we also train large-scale LLMs in our company. There's just not much point to it when gradients don't vanish.
Not sure why this comment is all the way down here. I lived in China for ~3 years and they had military training bi-weekly in the school next to where I lived. Watching their marches and coordination scared me. Looked robotic and unnatural.
Whistle-blowing is hard to distinguish from complaining about others and deflecting blame. These are staples of the narcissist's playbook. If you sound like a narcissist, people quite reasonably might suspect you of being one.

My take is this. If you need to give someone some bad or unsavory news, ease into it gently. Start with the gentlest form of the information. Have documentation and receipts to back up all your allegations. But don't reveal them unless questioned repeatedly.
Yes, I actually do, and I ran multiple tests. Unfortunately I don't want to give them away, as I then absolutely risk OpenAI gaming the tests by overfitting to them.

At a high level, ask it to produce a ToC of information about something that you know will exist in the future, but does not yet exist, but also tell it to decline the request if it doesn't verifiably know the answer.
LLaMA still has an "IP hook" - the license for LLaMA forbids usage on applications with large numbers of daily active users, so presumably at that point Facebook can start asking for money to use the model.

Whether or not that's actually enforceable[0], and whether or not other companies will actually challenge Facebook legal over it, is a different question.

[0] AI might not be copyrightable. Under US law, copyright only accrues in creative works. The weights of an AI model are a compressed representation of training data. Compressing something isn't a creative process so it creates no additional copyright; so the only way one can gain ownership of the model weights is to own the training data that gets put into them. And most if not all AI companies are not making their own training data...
> the collapse of public health, the collapse of our democracies, the collapse of global industrial civilization, and the collapse of our ecosystems.

Her mother was schizophrenic. OK, we get that. People like to deny problems and sweep them under the rug. We get that, too.

However, generalizing her mother's illness to the "collapse of global industrial civilization" is a bridge too far. People can reasonably differ about that, in general, and specifically about what should be done about it if it IS true.
> I'd argue for a third option: don't try to solve it by sitting in your chair. Go out and work on the problem, and see if what you're doing is improving it.

Amen to this. Doing is a strong teacher, sometimes the only teacher.

Mistakes and failure are awesome and underrated.
Or you could use Scala
> video generation also seemed kind of stagnant before Sora

I take the opposite view. I don't think video generation was stagnating at all, and was in fact probably the area of generative AI that was seeing the biggest active strides. I'm highly optimistic about the future trajectory of image and video models.

By contrast, text generation has not improved significantly, in my opinion, for more than a year now, and even the improvement we saw back then was relatively marginal compared to GPT-3.5 (that is, for most day-to-day use cases we didn't really go from "this model can't do this task" to "this model can now do this task". It was more just "this model does these pre-existing tasks, in somewhat more detail".)

If OpenAI really is secretly cooking up some huge reasoning improvements for their text models, I'll eat my hat. But for now I'm skeptical.
OpenAI has been open about their ability to predict model performance prior to training. When Sam talks about GPT-5 he could very easily be talking about the hypothetical performance of a model given their internal projections. I think it’s very unlikely a fully trained GPT-5 exists yet.
Why would you say "really bad"?
There's a stretch between 1914 and around 1955 that I wouldn't want to live through for anything.
I remember having a similar skill when I was younger, until about the same age. When writing papers based on books, I could think about something I remember reading and know which part of the page it was on (left or right facing page and which part of the page). Then I would flip through pages quickly to find the quote.
Hmm, there’s this Gazelle that can take in audio, but to get audio back out you’d have to use something else (e.g. Piper).

https://github.com/tincans-ai/gazelle?tab=readme-ov-file

https://tincans.ai/slm

https://github.com/rhasspy/piper
It’s going to be launched this year. My buddy’s company had a private demo of gpt5
Completely different goals. Mojo seeks to replace / supplement Python in the compute space, Hylo (Val) is an experiment in a value-first semantic language, inspired by Swift.
You probably don’t like it any more than I do, but the people who, for example, are fighting every day to remove rights from minority groups do, in large part, believe that they are kind.

Brainwashing is a helluva drug.

They do not view the systematic attack of minority groups as “evil” because they have been brainwashed in to believing that the groups they are attacking are evil, so, to them, their hypocrisy is justified as righteous.
Square Enix confirms US, EU layoffs as part of restructuring
That's a false dichotomy though. Individual single use plastic bottles and cholera are not the only two options.

Paper packaging, metal packaging, glass packaging, bulk packaging, improved infrastructure, filters, etc. I'm sure there are other reasonable options beyond single use plastic bottles.
Or you just can fight that tendency, fight this “solutionism” worldview, not everything is solvable, things may not turn out all right, but that’s ok, too. I.e. one should embrace the fatalism, the “it is what it is” worldview.
Cellphone use? Colon position is close to pocket height, where our cellphones tend to stay while not charging or being actively manipulated. Someone should try to correlate tumor starting location with handedness. If it tends to start the same side the dominant hand is, that would be a smoking gun.
Compiler and runtime are partially dogfooded now in .NET:

- CoreLib is entirely C# (let alone anything outside it)

- Low-level facilities like thread-locals, instead of C++, are now C# + compiler idioms + C# to unmanaged exports mostly

- Type system facilities have more of their code moved to C# as well

- Memmove/memcpy and other performance-sensitive paths, that are part of CoreLib, are either pure C# using its SIMD API or special-cased in compiler (like unrolling of copies, comparisons (including text) of constant lengths and similar last-mile optimizations)

In addition, ILC (IL AOT Compiler) is fully written in C#, although uses the same back-end as JIT.

JIT could have been reasonably written in C# now that there is NativeAOT but would require more work (also considering that it's a GC-based language), apparently it was considered at some point but ultimately there isn't just capacity to do so - .NET compiler team is fairly small.
Impossible with my reel mower. Nearly impossible with my buddies electric mower. I think a good gas mower will get through it ok.
>harvesting closed captions out of YouTube videos

I'd bet a lot of YouTubers are using LLMs to write and/or edit content. So we pass that through a human presentation. Then introduce some errors in the form of transcription. Turn feed the output in as part of a training corpus ... we plateaued real quick.

It seems like it's hard to get past a level of human intelligence at which there's a large enough corpus of training data or trainers?

Anyone know of any papers on breaking this limit to push machine learning models to super-human intelligence levels?
Here's a translation demo in Pipecat using the now ancient and arthritic GPT-4 Turbo model. :-) https://github.com/pipecat-ai/pipecat/tree/main/examples/tra...

As soon as GPT-4o audio input is available through the APIs, we'll add 4o support to Pipecat. For bidirectional real-time audio, I think they'll need to make new WebSocket or WebRTC endpoints available.
While it is probably pretty normal for California, the insincere flattery and patronizing eagerness are definitely grating But then you have to stack that up against the fact that we are examining a technology and nitpicking over its tone of voice.
But why?

I'm behind a CGNAT (if that's the trigger because of possible same external IP with bots that have nothing to do with me), there's nothing I can do.
People realize where we're headed right? Entire human lives in front of a screen. Your online entertainment, your online job, your online friends, your online "relationship". Wake up, 12 hours screentime, eat food, go to bed. Depression and drug overdoses currently at sky high levels. Shocker.
I've been waiting for this, now, the question is, is this a drop-in replacement for the CM4? If so, these will sell really well (and will have shortages)
Rust deliberately abandoned using the "systems" word many years ago, just so you know.
Major airlines sue Biden administration over fee disclosure rule
The fellow who does this is an absolute class individual. Definitely support this project!
If you look at the history of big technological breakthroughs, there is always an explosion of companies and money invested in the "new hotness" before things shake out and settle. Usually the vast majority of these companies go bankrupt, but that infrastructure spend sets up the ecosystem for growth going forward. Some examples:

1. Railroad companies in the second half of the 19th century.

2. Car companies in the early 20th century.

3. Telecom companies and investment in the 90s and early 2000s.
> Someone's first instinct is to suspect you. It's to accuse you of lying. It's to label you a troublemaker.

I used to assume the expression "Kill The Messenger" meant that the receiver of the message was angry about the message, and simply lashed out unfairly at the person who said it, though they knew the messenger was innocent.

But more recently, I've realized that the receiver of the bad news often seems to genuinely feel suspicion towards the messenger -- not merely lashing out at the nearest convenient punching bag.

I'll distinguish two variants of suspicion towards messenger:

* Only the receiver's beliefs are threatened (e.g., doesn't want to believe they made a mistake, or that things aren't so rosy, or that so-and-so did something terrible).

* The receiver is more concretely threatened (e.g., could lose their job/bonus/promotion, or could be tainted by bad PR, or could be implicated in past enabling).

For things like the abuse case to which the article alludes, the kind could vary by person involved involved in a case.

The latter kind, concretely threatened, obviously there is also a concrete, rational, reason to lash out at the messenger, but not to genuinely suspect them, yet AFAICT they might genuinely suspect the messenger anyway.
Where are you farming?
> It has always struck me as odd that people want to run AI on their phone. My impression of AI is that it creates very generalized solutions to problems that would be difficult to code, at the cost of being very compute inefficient.

I don't equate AI with coding. I want AI locally for photo sorting and album management, for general questions answering/list making that I use GPT for, and any number of other things.

I try not to upload personal data to sites that aren't E2E encrypted, so iCloud/Google photos is a no-go.
Having access to drinkable tap water[1] is an amazing privilege. Some places either don’t have access to enough water or don’t have the infrastructure.

[1] Bonus if it also tastes good!
Because unlike other kinds of extremist, violent, revolutionary political movements, those from the accelerationist + prepper mindset are explicitly opposed to modern life. Think Ted Kaczynski (that is, the Unabomber).

Not all violent extremists are focused on tearing down the modern technological order. ISIS, for instance, is only interested in the end of modern morality, but (evidently, based on their PR/recruiting arm) have no special qualms with modern media technology, industrialization, etc. The Red Army Faction was only opposed to the modern (at the time) government of Germany and a poorly defined concept of capitalism. But there is a specific kind of violent extremist who thinks that computers and mass production and factory farming are the problem. And I understood the GP to be referring to them.
Very impressive. Please provide a voice that doesn't use radio jingle intonation, it is really obnoxious.

I'm only half joking when I say I want to hear a midwestern blue collar voice with zero tact.
Ask HN: What was the story of the attempted addition of a backdoor in WebKit?
I finally began reading Ross Anderson's Security Engineering book and came across a passage which notes that in 2012, Anderson heard that a volunteer working on WebKit was caught deliberately contributing vulnerable code which could later be sold to an exploit vendor.

I have found next to nothing about this online. Only Ross' testimony in a US court case: https://committees.parliament.uk/writtenevidence/61727/html/

For example, I learned in 2012 that a volunteer to the Webkit free software project, which develops and maintains graphics software for use in browsers, had been discovered trying to sneak a vulnerability into the software, with a view to selling it later.

Does anybody else know further details of this? Given the recent xz/openssh backdoor attempt, I would be interested hearing what happened here.
This isn't just useful for their own marketing as some may imply. My guess is building out an ad network/platform for 3p advertisers to run ads on it.
This isn't my tool but based on what I read on the previous thread about it, it doesn't seem to be open-source. However, some folks recommended this tool which does seem to run locally: https://github.com/torakiki/pdfsam
Were humans an interesting species to start with, if they can be reduced to an LLM?
Just found there's a whole section about that in this post: https://openai.com/index/hello-gpt-4o/

It says "Japanese 1.4x fewer tokens (from 37 to 26)" - some other languages get much bigger improvements though, best is "Gujarati 4.4x fewer tokens (from 145 to 33)".
New mRNA cancer vaccine triggers immune response to malignant brain tumor
LLMs on Tabular Data: Prediction, Generation, and Understanding – A Survey
Amazon's self-driving taxi Zoox under investigation by US after rear-end crashes
I found copilot and other AI slowed my productivity, distracting me with irrelevant suggestions.
It happened.

My decision to pick wordpress paid off.
That link only offers GPT3.5 for me and I am a $20/mo paid user.

https://i.imgur.com/4cdtU1o.png
it’s true that no one likes a whinier

that’s why if you do it, you better be right

there’s no should in life, just is

rage not against the world for it will crush you
Even that just shows me GPT-3.5, don't see 4o in the dropdown. Guessing it's being gradually rolled out to accounts?
I guess they are saying they don't need to ask you anymore - if you willingly give your actions (servers you browse, things you say, chats you react to, etc.), and they can infer from that, then where's the foul?

I think it comes before that - the first pieces of data they are scraping. I don't buy that the problem is that they can and will infer your age/gender/etc. based on that.
Plot model performance over the last 10 years and show me where the convergence is.

The graph looks like an exponential and is still increasing.

Every exponential is a sigmoid in disguise, but I don’t think there has been enough time to say the curve has flattened.
yes, exactly.

"other may be doing the same to you"

and they might not even be tricking you into doing the "right thing", just the thing that they want.
How to Win at eBay
The model type is a good point. It's hard to track all the variables in this very fast paced field.

Thank you for sharing your CodeGemma experience. I haven't found a emacs setup I'm satisfied with, using a local llm, but it will surely happen one day. Surely.
Sure, but "not enough, I want moar" is a trivial demand. So trivial that it goes unsaid.
Under the DMA's requirements to protect children I think it will be basically mandatory to do this.

In the UK it already is under the Online Safety Bill.
Ruby is such a malleable language that its syntactic use cases are still being figured out and refined today. I'm loving this language every new iteration I see. A pleasure to use as my go to language.
Yes, I did. 4.5 degrees Celsius would be a newsworthy increase in winter temperatures! :)
If you talk about cookie recipes, you might be the type that buys baking sheets. Discord knows you talk about cookie recipes. Presumably it's in their TOS or something.

To me, this strikes me as someone walking in the park with a stroller getting indignant about someone assuming they might be a parent.
Honestly I probably got rid of my final box of ancient Mac 3.5" floppies in my last move 5 years ago.

Can't say I actually had Aztec C at the time, but it wouldn't have surprised me one way or the other.

Short answer, no I no longer have access to it any longer.

I used to run it on my basement upgraded, 512K Mac with 2 400K drives. Spent real money on it. I think it was $499 at the time. Maybe less, it was certainly no Turbo Pascal that's for sure.
I don't think a bigger model would make sense for OpenAI: it's much more important for them that they keep driving inference coat down, because there's no viable business model if they don't.

Improving the instruction tuning, the RLHF step, increase the training size, work on multilingual capabilities, etc. make sense as a way to improve quality, but I think increasing model size doesn't. Being able to advertize a big breakthrough may make sense in terms of marketing, but I don't believe it's going to happen for two reasons:

- you don't release intermediate steps when you want to be able to advertise big gains, because it raises the baseline and reduce the effectiveness of your ”big gains” in terms of marketing.

- I don't think they would benefit in an arm race with Meta, trying to keeping a significant edge. Meta is likely to be able to catch-up eventually on performance, but they are not so much of a threat in terms of business. Focusing on keeping a performance edge instead of making their business viable would be a strategic blunder.
Show HN: I built a simple task capture inbox app
I've always been frustrated with the complexity of todo mobile apps. I use Todoist and Notion to manage my work, for instance, but every time I'm out and about and think of a task I need to capture, the mobile apps feel too complex. Or I might think of a feature to add to a product, but don't want to deal with Linear's mobile web view. So, I built Defer: a simple iOS "capture" app that syncs to your menu bar on your Mac. No signup needed, it all "just works" with your Apple ID. Intentionally simple and lightweight.
Yea, I use them daily and that’s my issue as well. You have to learn what to ask or you spend more time debugging their junk than being productive, at least for me. Devv.ai is my recent try, and so far it’s been good but library changes quickly cause it to lose accuracy. It is not able to understand what library version you’re on and what it is referencing, which wastes a lot of time.

I like LLMs for general design work, but I’ve found accuracy to be atrocious in this area.
Over a year they have provided an order of magnitude improvements on latency, context length, and cost, while meaningfully improving performance and adding several input and output modalities.
UAVs trash the invasion force. At sea, on the beaches.
I don't think training data is the limiting factor for current models.
And yet, they do.
Golang binaries embed the version of the compiler into them, and can easily add git revision information too.

That's a nice feature for adding "foo -version", or similar, to show the users what their binaries were built from.
Do you think this is a good faith way to communicate with other people? No where in my comments did I attack anyone or accuse people of lying. Yet you suddenly come out of the gate swinging. Why?
Everything is amazing & Nobody is happy: https://www.youtube.com/watch?v=PdFB7q89_3U
Discord has nearly finished killing IRC, so it must be time to enshittify!
Sigh, I thought this was going to be about Spectrum Holobyte’s Falcon AT. From MyAbandonware.com:

> Essentially Falcon 2 but somehow marketed differently, Falcon AT is the second release in Spectrum Holobyte's revolutionary hard-core flight sim Falcon series. Despite popular belief that Falcon 3.0 was THE dawn of modern flight sims, Falcon AT actually is already a huge leap over Falcon, sporting sharp EGA graphics, and a lot of realistic options and greatly expanded campaigns. The game is still the simulation of modern air combat, complete with excellent tutorials, varied missions, and accurate flight dynamics that Falcon fans have come to know and love. Among its host of innovations is the amazingly playable multiplayer options -- including hotseat and over the modem. Largely forgotten now, Falcon AT serves to explain the otherwise inexplicable gap between Falcon and Falcon 3.0.
My limited experience is in Southeast Asia and Mexico tourists used bottled water and natives do not, at the time I went ages ago it was the recommended behavior but the rivers in Southeast Asia had lots of what appeared to be single use containers, there was simply no larger cultural impetus to dispose of stuff properly. OTOH riding my bike around SF Bay Area there is always discarded fast food wrappers and packaging along paved roads, a few of us can’t be bothered even in one of wealthiest parts of USA.
Honestly, the paper is pretty confusing. It's a weird mix of explaining things people reading a hash paper should already know (e.g. avalanche effect) and not explaining the important bits. The mixing stage looks a lot like a Davies-meyer hash, but it's hard to be sure without reading code. If so, this will be susceptible to fixed point attacks (among others). It doesn't particularly matter because this isn't presented as secure, but worth noting.

The paper also doesn't exhaustively verify numbers when domain=codomain, which is a super common scenario and a weird omission. 32 bits is small enough to check everything.