skysight-inc/HackerNews huggingface dataset:
4. If it is personal data, you have to know where they came from, where they are stored and why. If you don't want to do that, then invest the minimal effort it takes to anonymize them during ingestion and then you can do whatever you want with them.

5. Now that is just false, or you have some really bad architects, if you are so sensitive to new legal interpretation (which there haven't been any significant ones)
Yeah, and once that happens, why read anything from them ever agin?
The hospitals were at their breaking point in 2022, many of my family were there. If we would have had the normal 1 million flu deaths + car accidents etc on top of the 1 million COVID deaths the health care system would have completely broken down and we would have had a couple more million deaths of things that would normally have been treatable but weren't because the health care system was broken.
Not a question, but by God I hope Sublime makes enough money to justify continuing to do business, because if you can't both make something you love and get paid a good chunk of change for one of the best quality editors in the industry, then it would make me very sad.
>The US government likely will favor a large strategic company like OpenAI instead of individual's copyrights

Even if we assume this is true, Disney and Netflix are both currently worth more than OpenAI and both rely on the strict enforcement of US copyright law. I do not think it is so obvious which powers that be have the better lobbying efforts and, currently, it's looking like this question will mostly be adjudicated by the courts, not Congress, anyways.
What they really destroyed was the idea that OpenAI would be able to charge $200/month for their ChatGPT Pro subscription which includes o1. That was always ridiculous IMO. The Free tier and $20/month Plus tier along with their API business (minus any future plan to charge a ridiculous amount for API access to o1) will be fine.
More discussion: https://news.ycombinator.com/item?id=42856023
Can you provide any arguments that JIT would in fact decrease security other than "Apple says so"?

Every major mobile and desktop OS other than iOS has supported it for over a decade. Apple is just using this as a fig leaf.
(Except for the tragic ending, of course.)
So, can somebody in the know speculate about how Deepseek (or OpenAI, or whoever really) is actually running their API?

If I wanted to run a production-grade service using the full Deepseek model, with good tokens/sec and the ability to serve concurrent requests, what sort of hardware are we looking at?
yah, so the compacting machines wouldn't pop into half-full bottles all the time yuck. and now the caps are connected to the bottle. which is a Good Thing (TM)
Deepseek is really outstanding.
Also outperforms flink's setup time, and by a bigger factor
> Now do the same thing but assume you have 10x more subscribers because the prices are ~27x lower.

You're in various spots of this thread pushing the idea that their 1B MAUs make them unassailable. How are they gonna get to 10B in a world with less than that total people?

> Just take ChatGPT's ~$200 subscription. Hardly anyone is going to pay ~$200 a month. Reduce that by 27x - and you're at $7.5 per month. Maybe 10% of people on the planet will pay that.

They can't even make money at the $200 price point, though. https://x.com/sama/status/1876104315296968813
They could easily list the data used though.
These datasets are mostly known and floating around.
When they are constructed, instructions for replication could be provided too
Very individualized. I have drastically better gut health, skin health, energy when on a low carb diet for an extended duration.

Maintaining that diet for an extended duration, however, is always the challenge when others in the household do not follow it. Logically, I should stop being a baby and just power on with it. Or at least determine what in my "normal" western diet negatively impacts gut health/skin health and overall energy.
> And that's why decentralized, federated, or whatever social networks will never gain a large scale (>1 million or so) users. The governments of the world will never allow non-corporations to provide the money transfers necessary for people to "make a living" on such sites.

Sure, if you ignore the simple fact that Twitter reached > 100M users when it had zero money transfer feature for the end users.
But the government will now claim this is against "national security". Only American companies are allowed to commit this kind of "sleight of hand".
Benchmarks are great to have but individual/org experiences on specific codebases still matter tremendously.

If an org consistently finds one model performs worse on their corpus than another, they aren't going to keep using it because it ranks higher in some set of benchmarks.
Is that really true? If anything OpenAI was dependent on the transformers paper from Google from Ashish Vaswani and others. LeCun has been criticizing LLM architectures for a long time and has been wrong about them for a long time.
They created an untameable beast (China) thanks to the "cheap factories" there and they thought they would stay that way.

What a bunch of idiots. The propaganda keeps telling us that they don't invent, they can only copy etc., but clearly that's not true.
You dont get to redefine what "open" means.
I think "reverse ozempic" is called weed
I was talking "fairness" from the point of view of the EU in this case, and it is the exact sense that you are delineating in your addendum at the end of the comment.

It is "unfair" that a country gets to run circles around me because it completely ignores things that I consider important rights that my citizens fought for -- sane working hours, right to have my data kept to myself, right to express discontent against the government
It's not used only for authentication, and figuring out what a website is trying to do heuristically doesn't sound easy either (although I believe Chrome on Android does just that, and enforces a site-locked process when they deem it important for security reasons).
China is not anti-intellectual in the same way. I remember watching Xi’s new year speech a few years ago and he was highlighting specific scientific achievements, talking about astronauts, it was very different from a US presidential speech
It really is a shame that WD bought up HGST.
So, they bought a pro plus account, and gathered all the data through it? Sounds just like Nvidia sells tons of embargoed AI chips to China.
Hey, the more clownish I talk, the better chance I have at getting it protected as original work!
Surely that would be amazing for NVDA? If the only 'hard' part of making AI is making/buying/smuggling the hardware then nvidia should expect to capture most of the value.
No, it's because the AI makes shit up. No amount of prompting will fix this.
If it could, it wouldn’t be so tightly coupled and then identical to everything else out there.
I'm not arguing for open training data BTW, and the problem is exactly this sort of myopic focus on the concerns of the AI community and the benefits of open-washing marketing.

Completely, fully breaking the meaning of the term "open source" is causing collateral damage outside the AI topic, that's where it really hurts. The open source principle is still useful and necessary, and we need words to communicate about it and raise correct expectations and apply correct standards. As a dev you very likely don't want to live in a tech environment where we regress on this.

It's not "source available" either. There's no source. It's freeware.

"I can download it and run it" isn't open source.

I'm actually not too worried that people won't eventually re-discover the same needs that open source originally discovered, but it's pretty lame if we lose a whole bunch of time and effort to re-learn some lessons yet again.
I've done a few experiments on some project I've been putting of, one involves parsing some email. There's certainly some interesting use cases, but I've yet to figure out how to actually go about deploying a solution.

It does seem, to me, that the benefits are there, but not to the extend that the AI companies would have me believe.
I'd assume that the existing llama.cpp ability to split layers out to the GPU still applies, so you could have some fraction in VRAM and speed up those layers.

The memory bandwidth might be an issue, and it would be a pretty small percentage of the model, but I'd guess the speedup would be apparent.

Maybe not worth the few thousand for the card + more power/cooling/space, of course.
Intriguing to see the difference of response from HN when OpenAI first came to prominence and now.
Awesome! Better hurry up to graduate out of the slop academy though, the style is becoming a red flag real fast now.
Apple MLX is a game changer for what is possible in Local LLM development for everyone. Getting this to work as a single application that "just works" across platforms has been one of the hardest engineering problems we've ever worked on, but we're determined to get it right.
Sponsoring Hanami
Many thanks! Comments like yours are what I love about HN.

How is the spot to analyze during that year of focus determined?
Yes

PSA to anyone reading: do not use Purple drives for anything non-DVR/NVR related
> focus on higher level and more creative things.

But that's what OpenAI's costumers were supposed to do.
On the odd chance that you read this and feel like replying, I have always been in awe of Sublime Text's UI. Can you elaborate a bit on how it works? There was a short comment by Jon Skinner that it is custom and written on top of a cross-platform portability layer, but I mean, I'd love to hear some more details.
And here I was thinking the main point of social media was socialization.
- "The Sagan paper concerns much larger asteroids, which are correspondingly more rare."

That's a fair distinction—the paper predates the modern telescope surveys that are discovering all the small ones.

- "rather than delivering nukes directly with ICBMs in minutes"

You'd still need multiple years for those nukes to have a useful effect. (The change in velocity is instant; the change in position is not). They wouldn't be ICBM's, either: we'd need a new type of deep-space delivery vehicle, far larger than a suborbital ICBM. That'd probably trigger a new type of nuclear arms race.
> A bad experience for you is a bad couple of hours and a few hundred hours. Ask a woman, what is a bad experience for them?

Playing the situation as though its 0% risk for men and 100% risk for women - making it seem as though only men can be harmful and they are by nature dangerous. Making it sound like no male has ever had a bad experience with women and the onus is completely on the males to fix this situation.

Meanwhile the only men who will listen to this advice are the ones who are already "safe" for women.

Probably the word "intense" shouldn't have been used by me and maybe I'm reading into it too deep.
I was going to ask the exact same question. The title makes it sound like something I might be interested in, then I visited the page and I have no idea what it does.

After some brief reading of docs, I'm trying to write one sentence explanations. Maybe this will be helpful to you

What

Preserves is a specification and set of libraries in popular languages that lets you reliably exchange data between XML, JSON and EDN.

Who

Preserves is built for (data engineers|data framework writers) to reliably interchange data.

Why

Formats like JSON in particular are imprecise. Preserves forces you to deal with these vagaries up front

What else?

With P-Expressions you can search a preserve compliant datasource much like you would query JSON with JQ

Who Not? Who shouldn't use this

This will not help a data analyst exchange data between CSV and Excel
They could, but even if they give this list the detractors will still say it is not open source.
I still have my A500 (with a 1084s), it has a failed floppy drive, but it still works otherwise as far as I can tell.

I want to spend some time restoring it.
If i remember correctly, if you changed the dropdown on the webpage to USA you could download the full version of PGP anyway.
wait, this ain't another whitelabel OpenAI ChatGPT-oOPs cosplay?
I might forgive AI once it starts taking my video calls, nothing important ever happens and no one listens so it's a pretty perfect application.
That was beautiful. Nicely done, and congratulations on your restomod A1000!

I’ve heard people describe it as a 16 bit computer a few times lately though and it always catches me off guard. It was usually referred to as a 32 bit computer at the time, and defensibly so.

Some of its implementation details were 16 bit, like the data bus and ALU, but they were largely invisible to users and programmers. Assembly code used 32 bit math instructions, even if the CPU executed them in 2 steps. It had a flat 32 bit address space, although only 24 address lines were implemented (kind of like how not all 64 address lines are available on a 64 bit CPU today). Registers were 32 bits wide. And later 68K CPUs could run A1000 software on pure 32 bit CPUs natively with no emulation or trickery.

Credit it with those extra 16 bits. It earned them.
I'm reminded of an Adam Savage video. He ordered an unusual vise from China, and he praised their culture where someone said "I want to build this strange vise that wont be super popular", and the boss said "cool, go do it". They built a thing that we would not build in America.

https://youtu.be/NUhrF0xkhhc?si=1WHWYZrhRmfOYO_y&t=1150 (it's about 2 minutes)
oh well, I switched yesterday from a paid plan to a free one and I'm quite happy with the quality improvement.
DeepSeek revealed it's not as hard as previously thought; a much smaller number of less sophisticated chips was sufficient.
a variation of this which may be useful is to use N processors to sort upto N items - in this case the sort becomes O(N) in time
It's amazing to me that "open source" has been so diluted that it is now used to mean "we will give you an opaque binary and permission to run it on your own computer."
Not sure what you're on about with the second statement, but for the first one:

> In 2023, 92% of the surveyed individuals used internet and 70% bought or ordered products or services online in the 12 months preceding the survey.

https://ec.europa.eu/eurostat/statistics-explained/index.php...
I don't think OpenAI stole from Disney or Netflix. Rather OpenAI stole from individual artists and YouTube and other social media who users do not really have any lobbying power.

So I think OpenAI, Disney and Netflix win together. Big companies tend to win.
In the context of a regular end-user desktop machine, this seems overly paranoid to me. The odds of encountering a real, JS-based spectre attack in the wild are basically zero (has anyone ever seen a browser-based Spectre attack outside of a research context? even once?), and the odds of it then being able to retrieve actual sensitive data are also basically zero. That's two astonishingly tiny numbers multiplied together. The threat just isn't there.

For regular end-user desktop machines, the mitigations only decrease performance for no real benefit. Spectre is a highly targeted attack, it's not something you can just point at any random machine to retrieve all their bank passwords or whatever.
One of my core followers named Bruno basically said the same thing under my Linkedin post yesterday:

https://www.linkedin.com/posts/organic-growth_deepseek-the-o...

I welcome friction, so I'll be blunt: I disagree with you, not because what you are saying is wrong but because you only consider systematic data collection.

That's not the issue here.

There's a difference between democracies like the United States or European countries, no matter how IMPERFECT they are, and a dictatorship that does not allow dissenting opinions.

There's a difference in how the data collected will be used.

Freedom of speech, even when it is relative, is better than totalitarianism.
Virgin Money chatbot scolds customer who typed 'virgin'
OneNote now shows the Copilot icon right where I start writing on a blank page. That's infuriating (as much as I see some uses for AI). Fortunately you can turn it off in the 'connected experiences' setting.
That isn't how antennas work. Cell phones are pretty low-power devices, but a station in space is going to be much much more powerful than cell phones. Any tower with an antenna tuned to this frequency is going to have to dump that power somewhere. This is called "front-end overload" and is something most things should be protected against, but there are probably many devices that don't expect several watts of power being dumped on them from a single direction.
Earth's Magnetic North Pole Is Shifting Toward Siberia
For anyone who was confused, this is about the Mark Zuckerberg from Meta, not the other Mark Zuckerberg.
AI creep is like a leaky sewage pipe oozing gray water into everything you'd want to keep it out of. Disabling it is increasingly difficult on every app.
It’s this one thing no one implements correctly ;)
> you aren't in a sandboxed jail, you should probably just use System.Reflection.Emit

System.Linq.Expressions is a useful intermediate (that also works in sandboxes). People overlook its compilation power all the time, especially this long after the DLR (System.Dynamic and especially System.Dynamic's IDynamicMetaObject) has been forgotten, but it is a far easier API than System.Reflection.Emit.

I was half-hoping in this article to see a comparison with BF implemented in System.Linq.Expressions.
I've always found xkcd's radiation chart interesting: https://xkcd.com/radiation/ where it talks about coal vs nuclear plant at the beginning. Maybe his sources would help. ISTR that lignite would often be a bit radioactive and burning so much of it would spread it through leftover emissions ? If you find a proper source, I'm interested too.
A lot of people did complain very loudly about enforcing SSL, and it took decades to get here. Same for cookies.

So yes, breaking changes for privacy/security reasons do happen, but they're very painful, and if there's a more secure alternative (in this case, still isolating communicating processes and providing communication via IPC, and providing an opt-out way of the legacy behavior), that's often the easier path.
yes, all the training code is still closed and doesn't seem it will ever be released. Here's[0] a comment from a dev that worked at deepseek.

tldr: we're already on to the next model, don't expect anything else to get open sourced.

> I was just told that the amount of people there are too limited, and open-sourcing needs another layer of hard work beyond making the training framework brrr on their own infra. So their priority has been to open-source everything that is MINIMUM + NECESSARY to the community while pushing most efforts on iterating to the next generation of models I think. They have been write everything clearly in technical reports and encourage the community to engage in reproduction , which is the unique insight of the team as well I think.

0 - https://x.com/wzihanw/status/1884374329334387017
Only in the sense that it will generate fewer tokens.
They “open sourced” it enough (via the whitepaper) that huggingface is trying to reproduce their training now.
Standing on the shoulders and it's turtles all the way
MoE models aren’t new. Rumors are that GPT4 was one.
Yeah I don't know, Altman is a sociopath who is now trying to get intertwined with local governments (SF) as well as the federal government. He's going to do a lot of weaseling to get what he wants: laws that forcibly make OpenAI a monopoly.

Society will always have crazy sociopaths destroying things for their own gain, and now is Altman's turn.
I have been using deepseek-r1:1.5b/8b on a MacBook m1 pro max. The performance has been pretty good, at par with the o1. So last 2 days i have been running them side by side. I'm satisfied with the results and performance. That's a not very cheap 2k hardware and it does the job.
This has been Musks goal for a long time.

But while trying to accomplish it he's burned the goodwill and much of the public perception of Twitter/X as a good company.

I certainly have a highly negative view of Twitter/X and wouldn't trust the platform with any financial information or using it for financial transactions no matter who its backed by, but that's reflected in my not having a Twitter/X account to begin with so its a moot point.
Falsehoods Data Engineers Believe About Data
I really don't get this. Why would I want to send money via a social media site, especially twitter in its current state?
Well planned? That they shut down so many critical government functions yesterday with their executive order took the WH by complete surprise. They had no idea what the order did or didn't do. The top headline yesterday about it was the mass confusion it sparked because the language they used in the order was sloppy, inarticulate, and vague. That's not focused or well-planned. This is a throw everything at the wall, fill the zone with shit Steve Bannon strategy.
> I’ll never forget that useless Ñ key.

That was uncalled for. You had your Ç too. I mean, it was the perfect Iberian keyboard.
Why can’t ASI optimize its own efficiency and make better/more chips at the same time?
But with starlink internet as far as I know they bypass traditional ISP's.
"That's hilarious!" was my first reaction as well, when I heard about it the first time. When I came to HN and saw this story on top I was hoping this was the top comment. I was not disappointed.

US AI folk were leading for two years by just throwing more and more compute at the same thing that Google threw them like a bone years ago (namely transformers). They made next to no innovation in any area other than how to connect more compute together. The idea of additional inference time compute, looping the network back on its own outputs, which is the only significant conceptual advancement of last years was something I, as a layman, came up with after few days of thinking why AI sucks and what can be done to make it able to tackle problems that require iterative reasoning. They announced it few weeks after I came up with the idea, so it was in the works for some time, but it shows you how basic idea it was. There was nothing else.

Suddenly when there comes a small company that introduced few actual algorithmic advancements which resulted in 100x optimization which is something expected with algorithmic optimizations, the big AI suddenly went into full "dog ate my homework" mode. Blaming everyone and everything around.

Let's not mention the fact that if full outputs of their models could enable them to train a better model at 1% cost then it puts them in even worse light that they didn't do it.
>And this is the functionality that makes social media sites worth it for the vast majority of people.

The feature no major western social media site has had is the one that make it worth it for the majority of users?

Seems like an extreme claim without any backing or logic behind it.
Why should one care if they're still under warranty?
Weights are kind of like a compiled binary, because they are an incomprehensible blob of bits. But they are also unlike a compiled binary, because they can be fine-tuned.
Effective AI code suggestions: less is more
Yes. As an Old now (GenX), I feel like moving all interactions to text and now having AI as a man in the middle is just reinventing ways to get in a situation where a decade down the line you reconnect with someone who used to be a friend and both discover "Hey, that wasn't what I meant at all!"

As ever, T.S. Eliot was right: "It is impossible to say just what I mean!"
> Who benefits?

Phishers.
Haha yup. Going by the current definition of "open source" in AI 100% of software created before the cloud era would have been considered open source.
OpenAI feeling threatened by open AI is just delicious