MurphyA/hacker-news huggingface dataset:
by mutkach | 2025-08-07 07:08:03+00:00
> Inspired by GPUs, we parallelized this effort across multiple engineers. One engineer tried vLLM, another SGLang, and a third worked on TensorRT-LLM. We were able to quickly get TensorRT-LLM working, which was fortunate as it is usually the most performant inference framework for LLMs.

> TensorRT-LLM

It is usually the hardest to setup correctly and is often out of the date regarding the relevant architectures. It also requires compiling the model on the exact same hardware-drivers-libraries stack as your production environment which is a great pain in the rear end to say the least. Multimodal setups also been a disaster - at least for a while - when it was near-impossible to make it work even for mainstream models - like Multimodal Llamas. The big question is whether it's worth it, since when running the GPT-OSS-120B on H100 using vLLM is flawless in comparison - and the throughput stays at 130-140 t/s for a single H100. (It's also somewhat a clickbait of a title - I was expecting to see 500t/s for a single GPU, when in fact it's just a tensor-parallel setup)

It's also funny that they went for a separate release of TRT-LLM just to make sure that gpt-oss will work correctly, TRT-LLM is a mess
by somenameforme | 2025-08-07 07:08:39+00:00
Cause vs effect. Empires grow exceptionally hubristic over time. For instance the Brits likely never even considered the possibility, in a million years, that they could lose in a military conflict with the colonies. The idea would have been preposterous. It wasn't because of a careful and objective military assessment, but because of hubristic belief in their own inherent superiority - the imperial disease.

At worst it would be a mild rebellion which would be shut down in due order with a bit of good old fashion drawing and quartering. Empires grow out of touch with reality, and base their decisions on this false reality that they create. The outcome is not hard to predict. So for instance the exact same followed the Brits all the way to their collapse. Enjoining WW1 was completely unnecessary and effectively bankrupted them. The Treaty of Versailles was painfully myopic - all but ensuring WW2, and that was essentially the end of their empire.
by globular-toast | 2025-08-07 07:09:33+00:00
Am I the only one who prefers to just have separate models for API and database right from the start? I know it looks not DRY, but it is. Your API and your database schema are not the same thing. It's never that long before you need them to be separate so why not do it right from the start? I feel like this might actually be a win for LLMs because you won't feel the pain of adding a new field to both the db model and API model in trivial cases.

Litestar does look great and a true web framework like Flask and Starlette. Stuff like FastAPI and SQLModel is a joke imo. Developers should be able to compose these things themselves if they want to.
by yoz-y | 2025-08-07 07:09:42+00:00
I don’t like passkeys. Before my process to login was:

- open website

- if not already logged in, log in to 1Password

- autofill password

- autofill TOTP

Now:

- open website

- if logged in to 1Password the Use Passkey usually shows up

- if not:

- log in to 1Password - choose use passkey - this almost always does nothing - choose “use other method” - choose “password” - autofill that - now there is another dialog to choose the 2fa method, choose Authenticator - autofill that

Passkeys would be great if they actually made anything simpler on a computer. They work fine on the phone but that’s not where I spend most of my time.
Ask HN: What brand mention tracking service do you use for your startup?
by raydenvm | 2025-08-07 07:10:12+00:00
I want to keep track of when people talk about our products online. This includes forums, social media, blogs, and news sites. I feel we are missing out on opportunities to talk with customers and deal with their problems because we find out about them too late (or not at all). For people who are always checking how many times their brand is mentioned online:

- Which service do you use?

- How much money do you have each month for this?

- Have you ever had an important mention get lost?
by t_mann | 2025-08-07 07:11:31+00:00
I agree, but unfortunately the spec authors are already going out and dangling possible bans in front of projects who implement Passkeys in more user-friendly ways:

https://github.com/keepassxreboot/keepassxc/issues/10407

> To be very honest here, you risk having KeePassXC blocked by relying parties

But having a choice about how you store your credentials shouldn't depend on the good faith of service providers or the spec authors who are doing their bidding anyway. It's a bit similar to sideloading apps, and it should probably be treated similarly (ie, make it a right for users).
by alex-moon | 2025-08-07 07:12:13+00:00
I relate to so much of this. So much. First: the job which involves mostly burning code - so satisfying, I wouldn't call that my dream job, but that element of the job is one of the most rewarding for me - when it's my code, anyway! A nonsignificant part of my job now is deleting code my business partner has written with Cursor - so far we are mostly happy with this, it takes less time for him to write the code and for me to delete it than it does for me to write the code. But we are a tiny team with no front-end devs. Which brings me to the second thing: "The LLMs don't learn." My god! Sometimes I just want to take Cursor by the lapels and shake it. "Read the .cursorrules! They are rules for Cursor! You are Cursor! They are rules for you!" So much of what Cursor does that shits me to tears is stuff where, if it were an actual junior dev, I'd sit them down and walk through it with them - precisely the process that evolves them to Gyarados, like you say. That lack of meaningful development on the machine's behalf is so frustrating and really kind of alienating - you do meet devs like that, the ones that stubbornly refuse to learn and do better, and they are some of the worst people in the world.
by mynti | 2025-08-07 07:12:55+00:00
i have been anticipating this release for some time now. I am an avid user of ecosia and find the results passable in comparison to google. A couple of queries a week I am unsatisfied with and switch to google or a chatbot these days. I hope this new index is also comparable in quality and one step closer to a bit more competition in this market. Sadly, I could not find an official blog post or anything on the qwant news site..
by hunglee2 | 2025-08-07 07:13:03+00:00
This is not corruption, this is tribute to the Great Kahn.

Tim Cook has been forced to move operations from China to India and now to the US, each decision economically unjustifiable and now to great loss to Apple's bottom line. People may not realise it, but this is the state reasserting control over the capitalists. Trump is the first US President to actually try and do this. Not dissimilar to Xi Jinping in 2020 incidentally.
by teiferer | 2025-08-07 07:13:09+00:00
> It's entirely reasonable we'd have the will to make it happen

"We" are not even able to sustainably inhabit our current planet. We have hundreds of millions starving every day, we have wars in many places, the threat of thermonuclear war looming as strong as ever, and are still using natural resources at an unsustainable rate even though we know that that's the case. Settling on other planets has all these problems plus the issue of getting there plus the issue that the environment you find there is more hostile than the most hostile desert areas here on earth.

We currently live on paradise planet and can't even make things work well around here. Hard to see how you could make things work on Mars where you can't just go outside pick a leaf to eat and get some water to drink. Or just, you know, breathe.
by radu_floricica | 2025-08-07 07:13:53+00:00
Availability heuristic.

If you read "changes in personality" listed as a very rare side effect on the drug's sheet (which yes, you should read once when you start taking the drug), you can evaluate it, maybe make a mental note etc.

But if you make (or share) a bbc article on a particularly rare side effect, completely out of context, you're privileging the hypothesis. Why this particular side effects should be brought up for consideration? Other than in sounds weird and gets clicks.
by cjk | 2025-08-07 07:14:05+00:00
Yeah, I’d be taking the buyout.

As a hiring manager, I _vastly_ prefer hiring someone that values work-life balance over this grind culture bullshit. YMMV, but in my experience, the folks that care about balance tend to be more focused and productive during the hours they are working.

Of course, exceptional circumstances exist where long hours are required. Not disputing that. But making that the default for the company culture is insane.
by thiago_fm | 2025-08-07 07:14:11+00:00
I also do have eye floaters, it's very annoying and I've looked into surgery, but have given up as there are risks.

Some doctors would definitely push you to do surgery to make money, you should be glad this doctor didn't.

Here where I live that surgery is almost free, but I've decided to not do it because it's a minor annoyance.

Every surgery has risk during the recovery process, an infection can happen etc. Even though small, doctors can also make mistakes.
by WithinReason | 2025-08-07 07:14:21+00:00
We had the technology to do it in 44 years 60 years ago:

An atomic (fission) Orion can achieve perhaps 9–11% of the speed of light. [...] At 0.1 c, Orion thermonuclear starships would require a flight time of at least 44 years to reach Alpha Centauri, not counting time needed to reach that speed (about 36 days at constant acceleration of 1 g or 9.8 m/s2).

https://en.wikipedia.org/wiki/Project_Orion_(nuclear_propuls...
by defrost | 2025-08-07 07:15:03+00:00
I heard US jobs were up*, hadn't realised this was how.

* 500 Million New Jobs Added to US Economy, After Trump Fires Statistics Chief

Other metrics for the US economy were also impressive. GDP growth was recorded at a healthy 47% – coincidentally mirroring Trump’s Presidential number – while inflation dropped to zero. Worldwide, only North Korea had better economic data for the month of July.

https://theshovel.com.au/2025/08/05/500-million-new-jobs-add...
by augment_me | 2025-08-07 07:15:27+00:00
I am a PhD student who teaches part-time in some courses, and a difference I have personally ran into is that disinterested students still had agency over what they had written. When you present something, or hand something in that you have written, you still display the information that you know at that time. This makes feedback helpful because you can latch it onto SOMETHING.

When I get obvious LLM-handins, who am I correcting? What point does it have? I can say anything, and the student will not be able to integrate it, because they have no agency or connection to "their" work. Its a massive waste of everyone's time, I have another 5 student in line who actually have engaged with their work, and who will be able to integrate feedback, and their time is being taken by someone who will not be able to understand or use the feedback.

This is the big difference. For a bad student, failing and making errors is a way to progress and integrate feedback, for an LLM-student, its pointless.
by musicale | 2025-08-07 07:15:48+00:00
Regulatory entrepreneurship in action. Dodging regulations that apply to competitors is what has allowed (Uber, Airbnb, crypto, AI, etc.) to prosper. (Also paypal when they evaded banking regulations, amazon when they evaded sales tax, ...)

Crypto and AI are now going the distance with massive lobbying to change the law in their favor.
by bradley13 | 2025-08-07 07:15:55+00:00
Seriously? Regulate use cases? That's sort of like the very short-lived attempt to regulate automobiles, by requiring someone to walk in front of every vehicle, ringing a bell.

Actual, useful AI is a disruptive technology, just as the automobile was. Trying to regulate use cases is the wrong solution. We need to find out how this technology is going to be integrated into our lives.
by RyanJB | 2025-08-07 07:17:24+00:00
Would You Bet on Traffic? We’re Building the “Uber x Polymarket” of Decentralized Betting—Need Your Thoughts

Every day, 1.3 billion people sit in traffic. It’s not just lost time—it’s lost life, lost wages, lost energy.

I’ve built a prototype called Traffic Market Predict, a decentralized Web3 platform where people can bet on how fast or slow traffic clears—turning gridlock into an opportunity. Think: Polymarket meets Uber, but for traffic.

The idea is to let drivers (starting with vetted ride-hailing drivers from Uber, Lyft, Bolt, etc.) earn real money by contributing GPS + speed data to prediction markets about congestion. Commuters could place micro-bets on when traffic clears—and win. Real-time GPS. Ride-hailing driver income boost. Greener incentives for EV drivers. Behavioral economics meets urban chaos.

[Prototype here US patent pending] (https://v0-traffic-predict-market.vercel.app/)

We’re exploring data partnerships with Waze, TomTom, Inrix. Long-term, this could reshape how we experience travel, time, and cities.

Would you use this when it launches? What would make it better?

Would love your thoughts.
by valenterry | 2025-08-07 07:17:58+00:00
> Passkeys is the way to go

No, at least not on its own. Let's not repeat the mistakes.

Password managers are the way to go and ONLY FOR RARE EXCEPTIONS we should use dedicated MFA, such as for email-accounts and financial stuff. And the MFA should ask you to set up at least 3 factors and ask you to use 2 or more. And if it doesn't support more or less all factors like printed codes, OS-independent authenticator apps and hardware keys like yubikey, then it should not be used.
by mutkach | 2025-08-07 07:18:13+00:00
This is a good take, actually. GPT-OSS is not much of a snowflake (judging by the model's architecture card at least) but TRT-LLM treats every model like that - there is too much hardcode - which makes it very difficult to just use it out-of-the-box for the hottest SotA thing.
by radu_floricica | 2025-08-07 07:19:11+00:00
I said "reasonable side effects". I was _not_ trying to suggest that drugs have no side effects or need no consideration when taking them. Tylenol can give you a pretty horrifying death if you misuse it.

But this reinforces my main point - if we ended up comparing ozempic with ibuprofen, we definitely lucked out. Considering the benefits it offers it might be worth taken by some people even if it was on the level of chemotherapy.
by twothreeone | 2025-08-07 07:19:39+00:00
Agreed 100% FastAPI works but building complex applications in it is just not great. Taking a step back (and this will date me but..) I'm still astonished how the "Python microframework world" is slowly rediscovering everything JavaEE had 15 years ago. Anyhow, this looks nice. Now tell me how to handle error cases during streaming.. >.<
by darthrupert | 2025-08-07 07:20:10+00:00
Ok, so I checked it out slightly more and noticed that the omarchy installation script enables the chaotix.cx repo, which contains packages automatically built from AUR. I.e. packages contributed by practically anyone. So you'll be trusting not just one unknown set of people (AUR) but a completely second one too (chaotic.cx).

Omarchy enables all this silently with pacman -U --noconfirm.

This is probably fine for a hobbyist, and this is what people in the Linux world generally do, but also constitutes a pretty bad supply side attack vector. Then again, not significantly worse than what things like npm/node do.

On a positive note, using the concept of migrations in a tool like this is neat.
by r721 | 2025-08-07 07:20:51+00:00
Other discussions:

https://news.ycombinator.com/item?id=44808145 (9 comments)

https://news.ycombinator.com/item?id=44811733 (162 comments, [flagged])

https://news.ycombinator.com/item?id=44814204 (28 comments, [flagged])

https://news.ycombinator.com/item?id=44816077 (41 comments, [flagged])

https://news.ycombinator.com/item?id=44818241 (7 comments)
by _flux | 2025-08-07 07:21:53+00:00
Btw, LLMs are actually quite helpful for configuring Emacs, in particular for creating custom functionality..

But yeah, I broke my home Emacs setup somehow so that rust-mode no longer works in some situations. I have my config in git, though, so maybe I'll figure it out!

At least I've started migrating to use use-package for configuration, to bring some structure to the configuration.

Zed does seem rather interesting, but I don't ever see it being as configurable/extensible at runtime as Emacs. I suppose one could always just implement such features into the Zed itself; I presume its code is not too indimidating, given it's a modern code base and not likely to break in unexpected ways.
by nelox | 2025-08-07 07:23:33+00:00
This article acknowledges a key shift: AI tools are not replacing scientists, but changing how they work. The concern is that if models generate convincing but incorrect summaries, they risk distorting the literature, especially when researchers use these tools without checking the sources. That is a valid risk, but it is a problem of tool misuse, not of the tools themselves.

The same has always been true of citation practices and review articles. Poorly written reviews can mislead just as easily. The difference is speed and scale. But the solution is the same: better training, transparent standards, and accountability in research outputs.

Concerns about LLMs producing hallucinated references are real, but that is a known limitation. It is not hidden. The responsible response is to insist that authors cite sources they have verified. That expectation already exists. AI should not change it.

The alternative would be to pretend that these tools can be banned or ignored. That is unrealistic. AI-assisted research is here, and the answer is not fear but proper oversight. Just as we adapted to calculators, spreadsheets and search engines, we can adapt to LLMs. The misuse of tools is a human failing, not a technological one.
by iEchoic | 2025-08-07 07:23:51+00:00
Four times a day, I get an email notification that someone requested a password reset for my Microsoft account, which gives me a six-digit number to recover my account. So every day, an attacker has four shots in 1,000,000 of stealing my account by just guessing the number. They've been doing this for years.

If the attacker's doing this to thousands of accounts - which I'm sure they are - they're going to be stealing accounts for free just by guessing.

I wrote up a security report and submitted it and they said that I hadn't sufficiently mathematically demonstrated that this is a security vulnerability. So your only option is to get spammed and hope your account doesn't get stolen, I guess.
by TrackerFF | 2025-08-07 07:24:18+00:00
My mother is Finnish, and my parents traveled and mover around a lot during our younger years - but we did live in Finland from I was age 3 to 7, so Finnish is the language I first learned to speak fluently.

Picking it up again once a year wasn't hard (usually when we'd get relatives visiting us, or the other way around), but around the time I became a teenager, I started speaking less - for no other reason than that I traveled less to relatives during the summers. These days I can read some, and listen to some conversation, but speaking is very hard - probably 25 years since I spoke it fluently. It is a shame, as I have to speak English with my grandparents, aunts, etc. - but language is def one of those "use it or lose it" things.

With that said, for the English speaking people - you'd be surprised how much Norwegian / Swedish / Danish (Germanic language) you can understand, with the amount of shared, or very similar words, the languages have.

Same way for us Scandinavians and Dutch. Can't really understand much when the language is spoken, but when reading some text, there's a lot of structure and words you can understand.
by bscphil | 2025-08-07 07:24:37+00:00
The site is comparing this method to plain username + password though. Doesn't that miss the obvious point that evil.example.com could do the exact same thing with the username + password method, except it's even easier to phish because they just get your username + password directly (when you type them in) and then an attacker can log in as you via a real browser?
by hvb2 | 2025-08-07 07:25:08+00:00
> Not to mention all the times FDA has said “you have to do X to get approved” and the company happily complies despite it delaying sales by several quarters.

The company happily complies?

Or just does it begrudgingly because not doing it delays sales a few more quarters if not indefinitely?

I'm not sure where you're getting the idea from that a company would happily do anything additional. It's a cost of doing business. Let's not pretend they're angels, they're in it for the money not the greater good.

And if that last statement needs a rationale, tell me who is doing the work to find the next antibiotic or any other non chronic disease medication
by kazinator | 2025-08-07 07:25:47+00:00
I believe (and the article should make it clear) that the article is criticizing specifically the use of the code that user must enter into a box, which invites man-in-the-middle attacks.

The article is not advocating against e-mail-driven URL-based password reset/login, whereby the user doesn't enter any code, but must follow a URL.

The six digit code can be typed into a phony box put up by a malicious web site or application, which has inserted itself between the user and the legitimate site.

The malicious site presents phony UI promoting the user to initiate a coded login. Behind the scenes, the malicious site does that by contacting the genuine site, and provoking a coded login. The user goes to their inbox and copies the code to the malicious site's UI. The site then uses it to obtain a session with the genuine site, taking over the user's account.

A SSL protected URL cannot be so easily intercepted. The user clicks on it and it goes to the domain of the genuine site.
Core arch vs. external abstractions when building AI SaaS
by somangshu | 2025-08-07 07:26:11+00:00
Unpopular opinion: when building a AI SaaS, in-house AI based implementation is much better compared to using external libraries like llama index. For smaller use cases it works well, but for complex workflows it often fails, mostly because AI development is really fast, interconnected dependencies cause problem in production that will slow down engineering and hinder user experience.
by dgoldstein0 | 2025-08-07 07:27:06+00:00
But why are those teams incentivized to exist?

For roads, brushes, wastewater, sewer, electricity - it's because these things are public utilities and ultimately there is accountability - from local government at least - that some of these things need to happen, and money is set aside specifically for it. An engineer can inspect a bridge and find cracks. They can inspect a water pipe and find rust or leaks.

It's much harder to see software showing lines of wear and tear, because most software problems are hard to observe and buried in the realities of Turing completeness making it hard to actually guarantee there aren't bugs; software is often easy to dismiss as good enough until it starts completely failing us.

A bridge is done when all the parts are in place and connected together. Much software is never really done because - it's rare to pay until we have nothing more to refactor - the software can only be as done as the requirements are detailed; if new details come to light or worse, change entirely, the software that previously looked done may not be. That would be insane for a bridge or road.