skysight-inc/HackerNews huggingface dataset:
Without Nvidia, you would still wait for ChatGPT moment and not even think about AI at all.

I have been invested in Nvidia for 9 years and I have not only witnessed what Nvidia has done in ML/AI but also how the entire field evolved.

To say Nvidia is toast is like saying US is toast after Sovjets send a rocket into space.
Oh yes one could provide a repetition penalty for example - the issue is it's not just repetition that's the issue. I find it rather forgets what it already saw, and so hence it repeats stuff - it's probably best to backtrack, then delete the last few rows in the KV cache.

Another option is to employ min_p = 0.05 to force the model not to generate low prob tokens - it can help especially in the case when the 1.58bit model generates on average 1/8000 tokens or so an "incorrect" token (for eg `score := 0`)
I’m not assuming 10x bigger will yield 10x better. We have scaling laws that can tell you more.

But I find it bizarre that you made the conclusion that AI has stopped scaling because DeepSeek optimized the heck out of the sanctioned GPUs they had. Weird.
Where this Scandinavian attitude comes from? That people want to be like them, to live like them. Some kind of inverted double-jealosity psychological marketing trick?
Some people believe they can dodge copyright issues so long as they have enough indirection in their training pipeline.

You take a terabyte of pirated college physics textbooks and train a model that can pose and answer physics 101 problems.

Then a separate, "independent" team uses that model to generate a terabyte of new, synthetic physics 101 problems and solutions, and releases this dataset as "public domain".

Then a third "independent" team uses that synthetic dataset to train a model.

The theory is this forms a sort of legal sieve. Pass the knowledge through a grid with a million fact-sized holes and with enough shaking, the knowledge falls through but the copyright doesn't.
No - these people are loaned to the NSC, they don't lose their job if they no longer have a position there, they return to their previous position in the agency they came from.
Would love to read some ideas to
Nielsen to End Panel-Only Ratings That Have Measured TV for Decades
Is that one public? Like all these news articles that name which party someone is registered for would imply such.
also perplexity.ai (pro subscription)
They are absolutely not improving exponentially, by any metric. This is a completely absurd claim. I don’t think you understand what exponential means.
> Ergo, in the USA it will be embraced by supporters of the orange one, whilst everybody else in the USA will continue to call it "Gulf of Mexico".

Most Americans support ‘the orange one’. There was a poll conducted on this quite recently.
>Presumably, those communities and their internal knowledge will mature eventually, but it's taking a long long time and it's still an absolute mess.

I'm not sure they will. There's a kind of evaporative cooling effect where once you get to a certain level of understanding you switch around your tools enough that there's not much point interacting with the community anymore.
Weizenbaum's nightmares: how the inventor of the first chatbot turned against AI
And the chaos of translation. It is fun to consider whether somewhere like Johannesburg should be called Johannesburg or Johnscity or YHWHisMercifulFortifiedPlace or what in English. The standard is obviously to keep the local term and pronunciation, but then apply that logic to languages with different scripts and nothing really makes sense in a satisfying way because mapmakers can't avoid some amount of translation. It is a muddle of conventions.
There's a carrot and stick. Losing your job seems like a heavy stick, whereas a small redistribution of tax seems more like a carrot.
YR or original both. There’s a fluency to the animations, sounds and gameplay that I haven’t seen anywhere before or after. It just feels like everythibg comes together perfectly.

The units are all unique. The few differentiators between nations are actually very relevant.

The only thing that comes close is Starcraft.
> In your simplification, you have removed everything that isn’t labor (i.e. demand for commodities)

Incorrect, I'm definitely including demand in there.

I'm saying there's no supply.

It's n/0, not 0/0.

> Instead, you should have invested in a farm and some robots. Sorry, there’s no free lunch if you can’t steal it from younger generations.

(1) OK, but that's not what you were saying before

(2) (a) The AI to control those robots does not yet exist, (b) when that AI does exist, we can set the pension age to zero — doing so is called "UBI", and AI is often suggested as both a mechanism to enable it and as an economic transition requiring it.

> Edit: you’ve revised history and now added a bit about “similar arguments” and inflation.

It was intended for clarification, not to "revise history"; FWIW, the para in which you wrote this edit was not present when I clicked "reply".

> This is fine and normal and would be preferable to the present system and is not dependent on future labor in the same way as direct redistribution.

You asked "Please explain how this (obviously naive) strategy is dependent on future labor." — I believe I have demonstrated that it is.
How is this not front page HN??
> Pressing civil servants and government workers to vote the way you need is basically the first trick in the dictator's manual

I'm blown away this isn't illegal.
This. It's gotten to the point where I don't check email at all because of the constant spam of mails that are not actionable and/or urgent. There are so many different types of automated mails that setting up filters is a never-ending battle. For me, email now serves as an archive/log of everything that has been going on in the company. I search my email to find details about things I am notified about via other channels.

Due to many people doing this, all important notifications that are actually actionable are now sent via Slack as well. So far these notifications are only for things where I actually need to urgently respond or do something, so none of the spam has yet reached Slack.

Also, no one ever seems to personally send an email to another employee because Slack is always the better option, and people actually respond on Slack, unlike via email.
Open WebUI is pretty is to set up and works with Ollama https://github.com/open-webui/open-webui
The insight of this article is less in describing the dynamics of chess games than in the fact that you can apply the methodology of network analysis, percolation, phase transitions etc. to recover them.

This is interesting because both chess and complexity science have a long but unrelated history. So it’s a bit harsh to call this out for “Publish or Perish”.
The article is from January 13 .. why post it now?
The good thing is since MoEs are mainly memory bound, we just need (VRAM + RAM) to be in the range of 80GB or so in my tests for at least 5 tokens or so /s.

It's better to get (VRAM + RAM) >= 140GB for at least 30 to 40 tokens/s, and if VRAM >= 140GB, then it can approach 140 tokens/s!

Another trick is to accept more than 8 experts per pass - it'll be slower, but might be more accurate. You could even try reducing the # of experts to say 6 or 7 for low FLOP machines!
Zero impact?

AI is involved in things from writing laws to taking drive through orders.
it (used to) in aggregate trigger human review (i.e. if many people report the same post). However, the humans who reviewed it were underpaid, overworked, and unlikely to have any context, so the output was not necessarily better than the automated system...
> It boggles my mind that others didn't follow suit.

Most fitness smartwatches (Garmin, Coros, Wahoo) used the same display technology for years, called it MIP displays. Nowadays they are switching to OLEDs.

https://garminrumors.com/amoled-vs-mip-in-garmin-devices-a-d...
If you are smart that is the easy way to make money!
Epidemiology and politics do involve systems, I’m afraid. We can call it “practical” or “human” or “subjective” all we like, but human behaviors exhibit the same patterns when understood from a statistical instead of an individual standpoint.
Will write for food: succeeding as a content creator
The US switched from the spoils system to the civil service system because the voters did not want a system where rulers could always put people who align with them politically into non-political offices.

The Pendleton Civil Service Reform Act (passed in 1883) and subsequent laws were put into place democratically. To think otherwise is farcical.

Guiteau took the spoils system pretty personally, as you might recall.
Seems to be a major player at play here. What a lowly move though, gives me sore loser vibes.
Give Google their due. It’s infinitely easier and risk free to just bury and ignore. Thank you, Google!
Also, the authority forces individuals into acts that bind them tighter to the regime while isolating them from other options. Ex:

"Bob wants to join the resistance. He says he was lying about the loyalty oath the oppressors."

"I dunno, even if Bob was always lying about that, it still makes him the kind of person who would deceive people in order to keep his job, so I'm not sure we can trust him either."
Fireworks AI is a great option - https://fireworks.ai/models/fireworks/deepseek-r1
Not receiving the verification code in my Gmail when sign up for DeepSeek
"Throw ideas and see what sticks" sounds very entry-level. Maybe it saves time it would take for one of your team to read first two chapters of a book on the topic.

That exec was hiring consultant and no longer is, in meaningful proportion, thanks to LLM?
How does making corpses taste delicious make them stop moving?
Posthog LLM Observability in Open Beta
You likely mean sampler, not decoder. And no, the stronger the quantization, the more the output token probabilities diverge from the non-quantized model. With a sampler you can't recover any meaningful accuracy. If you force the sampler to select tokens that won't repeat, you're just trading repetitive gibberish for non-repetitive gibberish.
I was so concerned, because it seemed to me "you will not have any other choice".

after digging deeper, it is alright
So I remember Deepseek used float8 for training - Character AI also used int8 for training - it is indeed possible, but sometimes training can be unstable - Deepseek to my knowledge is actually the first lab to use float8 at a large scale without causing loss spikes - they used FP8 tensor cores, then every 4th matrix multiply, they accumulated to a FP32 accumulator - it seems like the Hopper Tensor Cores accumulation mechanism might not be actual FP32 accumulation. I wrote more here: https://x.com/danielhanchen/status/1872719599029850391
I hope to be able to write this blog post in 20 years. My co-founder and I started a bootstrapped company 3 years ago do IaC orchestration and we are slowly but steadily growing. We love being small. We love being accountable to our customers. We love having the freedom to make decisions. Yes, it's not always easy. We explicitly don't want to be a billion dollar company. We want to make a product that serves our niche exactly how they want to be served. We're definitely making less money than if we worked at another company. But we feel we can make it to our goal and think we'll be happy when there.
I wanted the original pebble so much when it came out but couldn't afford it.

Now, I can and still want it.

I don't remember, can it vibrate (for timer/alarm) ?
This is nonsense though. What does "better" mean in this case? A judge is not a black box with an input (the case) and an output (the verdict), the entire point of having a judge is to have empathy, conscience, and personal responsibility built into the system.

It's a blind spot that too many people have because we take those qualities for granted. LLMs unbundle them, so we need to start recognising the inherent value of humans, fast. I wrote a few words about it here: https://dgroshev.com/blog/feel-bad/
The overton window has been at DEFCON Orange for years now.
Party affiliation is public information, at least in Virginia.
Free AI tool for reviewing and enhancing LinkedIn profile
Hi HN!

After seeing "LinkedIn gurus" charge hundreds of dollars for basic profile reviews, I built a free tool to automate this analysis.
Just paste your LinkedIn profile URL and get instant insights:

Section-by-section analysis and score with description of reason of the score
Specific recommendations with explanations
Visual score breakdown

Try it without signup:
https://app.2pr.io/linkedin_profile_review
Would love your feedback on the analysis logic and which recommendations you find most useful.

I'll be here to answer questions.
This is our first Show HN.
Actually, a lot of territorial claims start with "renaming", to provide support for some kind of base for the claim.

That specific case would have been quite minor (in the Trumpian show) except that it comes at the same time as USA (... sorry for all non-Trump supporter, but now that he's your POTUS, he represents all of you) suggest to invade (euh... "take back" ?) Panama and Groenland !

Right now, from outside of the USA, the USA is starting to be seen more as a wannabe-invader than an trusted ally...

So the renaming... that could have been just another Trump-ery (french play on word ;-) )... is taken quite seriously
I read the article and learned something new. Non political (aka career) Members of the NSC are deputized from their parent agencies - FBI, DOJ etc. Those that are removed return to their parent agency to continue line work.

And these are not some line DMV workers. They are high officials. It's not nearly as alarming as the headline makes it sound. I think it's fair for a new elected political leadership to expect high officials to be aligned with the policies they were voted in on.
:) It's my goto test :) I did amp it up by adding 10 conditions and made a scoring card - I found the original R1 to sometimes forget "import os" or miss some lines as well, so I thought it was at least a good check!

I also like to ask the models to create a simple basic Minecraft type game where you can break pieces and store them in your inventory, but disallow building stuff
My first thought. And then I realized that the talk is from 2015, so I wonder if there was cross pollination between people at the time (datomic was released in 2012 according to wikipedia, so it's plausible it predates Martin's ideas but I don't know)

https://news.ycombinator.com/item?id=20937215
Glad they were helpful! :)
> discrimination by political affiliation should be classified as illegal

Political affiliation is almost impossible to define. Voting records and party affiliations are not. It should be illegal to discriminate based on someone's voting record or party affiliation, and it should be illegal for the government to ask about it in the context of employment.
> and you always felt like you were under someones feet

I lived in a late 19th century building for 4,5 years as a student, and the sound of the steps in the apartment above me also drove me insane sometimes. Every apartment I rented after that was always on the top floor. Much higher quality of living.
What specifically is in comma.ai that makes it less technically impressive? Comma.ai looks like epic engineering to me. I haven't made any self driving cars.

Why do you think otherwise? Can you share specific details?
Ask HN: Is there a censorship benchmark for LLMs?
I would be nice to track this over time, what llms surprises what information and when it started.
Using it doesn't mean people like it. It's forced on us. See recent stories about Microsoft.
Maybe. They're under no obligation to tell the truth about this.

Hypothetical: Take a large short position on NVDA, announce the market that you trained a massive model without using 10s of millions of rare-as-hen's-teeth NVDA-sentsitive resources. Settle postition then quietly settle giant compute bill. Difficult to know either way, but the market seems have taken the team at face value. I guess we'll know if and only if this reduced training cost methodology is replicated.
So cool to see this here!

I bought a house in Nyland [1] a few years ago and now I'm turning it into a place to retreat to for focus time / being close to nature.

If someone is interested in sharing the space over a longer period of time (as I'm not living in Sweden), hit me up (email on my profile)

[1] https://maps.app.goo.gl/Ww1GHL5rFXdkcdHfA
> It's not nearly as alarming as the headline makes it sound

It is from a national security perspective. A body borne out of WWII has been rendered into a partisan shell [1]. That's a lot of institutional knowledge walking out the doors.

We started dismantling the spoils system in the 19th century and, other than in Chicago, had largely eradicated it by the nuclear era [2]. It's wild to think that a nuclear superpower's national security advisory board is no longer going to be merit based.

(From a domestic political perspective I agree it's being blown out of proportion.)

[1] https://en.wikipedia.org/wiki/United_States_National_Securit...

[2] https://en.wikipedia.org/wiki/Spoils_system#Reform
Reduce your LLM agent costs by 90% with structure-preserving HTML compression
I built Emmetify to solve a costly problem in LLM automation: when your agents need to process HTML (like for web automation or scraping), they waste tokens on all those <tags> and attributes.

The solution converts HTML into a compressed format that preserves the complete DOM structure. This means your LLM agents can still generate accurate XPath/CSS selectors, click buttons, fill forms, and follow links - just at 1/10th of the token cost.

It works by converting HTML into Emmet notation - a concise abbreviation syntax widely used in web development. LLMs understand this syntax just as well as HTML due to its presence in training data.
Well, that's easy.

People are not globally aware enough to seperate Norway, Denmark and Sweden into seperate societies. So it's easy to confuse/combine the Danish "Hygge" (meaning: Cozy), Norways wealth, and Swedens generous social systems (especially as they relate to summer vacations and parental leave/rights).

As such, Scandinavia (where Sweden is for some reason the most popular stand-in name for Scandinavia - probably because it used to dominate the region) is seen as a mythical place where everyone is happy, wealthy and that the lifestyles are cozy.

Yes, there's some marketing in that, just like there's marketing in the idea that the US is free when it's ranks pretty poorly in freedom globally, or that the UK is a world power, when in reality it's about as globally important at this point as South Korea or South Africa (which, is not an insult as they are medium powers on the world stage and not insignificant).

Remember, companies operating globally from any given country will lean in to what they think that country is known for. You can see it a lot with "Swiss-Made" products, especially privacy products, when in reality there aren't any decent privacy laws in Switzerland- people just remember the banking sector permitting numbered accounts because they saw it in media. -- so these things get reinforced over time, by products marketing themselves as "Scandinavian" and then presenting a lifestyle in advertising.
Did anyone see this coming? That Trump would rename it? I don't live in the US but over here I never heard about any controversy about the name.
In most states it's public. The Republicans would also have access to their own proprietary voter lists or databases, as well as publicly available voter registration records.
You have demonstrated only that the thought experiment is dependent on the future market for a commodity and not on some future labor being exploited. Value in the future is dependent on demand and not on extraction from labor.
Ask HN: How Is 100011_100001 Doing?
It's been three years since the submission [Tell HN: The loneliness of a pretty good developer](https://news.ycombinator.com/item?id=31438426) caught our attention. I'm curious how the original poster has been doing since then. Have you found the balance between coding and mentoring?

Additionally, have you embraced AI tools in your workflow? It seems like a game-changer for many developers, and I’d love to hear how it has impacted your productivity and collaboration with your team.

Looking forward to your update!
can anyone confirm if the fearmongering in the article took place after the inauguration?
I would love to know if other people in the industry (beside hickey/datomic) use the immutable log/stream + integrators. From my small experience in enterprise app: auditability and time travelling are always bolted on good old sql tables/snapshots after the fact and the pain is already baked in.
this was outlined clearly in the project 2025 doc - which is / was online.

so why are people suddenly surprised ?
IKEA certainly has an interest in promoting this image.
As someone who is out of the loop, what’s the verdict on R1? Was anyone able to reproduce the results yet? Is the claim that it only took $5M to train generally accepted?

It’s a very bold claim which is really shaking up the markets, so I can’t help but wonder if it was even verified at this point.
Curious what this phrase is, sounds useful (as a rhetorical device)!!
There's definitely a lot of wiggle room for lawyers and doctors to up their game. People cannot keep up with all the stuff that's published. There's simply too much of it. Doctors only read a fraction of what is published. Lawyers have to be aware of orders of magnitude more information than is humanly possible.

LLMs allow them to take some short cuts here. Even something like perplexity that can help you dig out relevant source material is extremely helpful. You still have to cross check what it digs out.

The mistake people make is confusing knowledge with reasoning when evaluating LLMs. Perplexity is useful because it can use reasoning to screen sources with knowledge; not because it has perfect recollection of what's in those sources. There's a subtle difference. It's much better at summarizing and far less likely to hallucinate than it is when it wouldn't base its answers on the results of a search. Like chat gpt used to do (they've gotten better at this too).

For lawyers and medical professionals this means that they have all the best knowledge easily accessible without having to read and memorize all of it. I know some lawyer types that are really good at scrabble, remembering trivia, etc. That's a side effect of the type of work they do: which is mostly just reading and scanning through massive amounts of text so that they can recall enough information to know where to look. Doctors have to do similar things with medical texts.
how about hardware that software is supposed to run on? that certainly can have effect. let's pin that too into project repo. don't want to continue this thread. but to re-iterate my point, you have to stop somewhere what to pin/version and what to not. I think my criteria is reasonable, but ultimately it is up to you. (so as long whole ecosystem and dependency trees do not become bags of everything, in which case Go here is alright so far. after digging deeper what v1.24 proposing will not cause massive dependency-apocalypsis of tools propagating everywhere and only what you actually use in main is going to be included in go.mod, thanks to module pruning).
There are a few ways - the most basic is per layer sharding - DeepSeek uses 3 dense layers, so that can stay on GPU0 (with the embedding layer). There's 58 MoE layers (256 experts, 8 activated) and 1 shared expert per layer. GPU1 would house layers 3 to 9, and so on.

Then by using pipeline parallelism, if a new request comes, we simply stick them in a queue - GPUs 0, 1, 2, ..., 8. Request A is at GPU 2, Request B at GPU 1, Request C at GPU 0 and so on.

The other option is tensor parallelism were we split the weights evenly. You could combine pipeline and tensor parallelism as well!