MurphyA/hacker-news huggingface dataset:
by _neil | 2025-07-25 14:01:42+00:00
I actually started with this but the export always had the appearance of stalling unless I left it for long periods. For a first version, the CSV export app was much quicker. And actually, the author of the app (Eric Wolter) has a nice site that will convert the xml format to csv using the FileReader api, etc.

I would like to go back to this though and add it as an integration option.
by jalopy | 2025-07-25 14:02:02+00:00
Super valuable resource - thanks!

What tools / experiments out there exist to exercise these cheaper models to output more tokens / use more CoT tokens to achieve the quality of more expensive models?

eg, Gemini 2.5 flash / pro ratio is 1 1/3 for input, 1/8 for output... Surely there's a way to ask Flash to critique it's work more thoroughly to get to Pro level performance and still save money?
by christianqchung | 2025-07-25 14:02:15+00:00
There is something of a middle ground here for benchmark skepticism. Big companies wouldn't want a massive divergence between benchmarks and real performance that people could actually notice, and I'd argue for the most part that this hasn't happened too much (although above I posted a problem with Qwen and ARC). However, finetunes by random people/groups don't carry the same downside so I'm basically skeptical of all finetunes before using them for a particular case.
by mystraline | 2025-07-25 14:02:20+00:00
That all depends if you're willing to run stuff yourself, or be subservient on the good will of companies not to enshittify (pro-tip, they always will).

I self-host the following:

Video: Jellyfin Audio: Navidrome Audiobooks: Audiobookshelf Phone image sharing: Immich Home automation: Homeassistant Office suite: NextCloud Monitoring: LibreNMS Compute: Proxmox AI/LLM local: open-webui
by alberth | 2025-07-25 14:02:39+00:00
A lot of people misunderstand why companies outsource to Asia. It’s not just about cost—it’s actually more so about manufacturing expertise.

Asia has a massive pool of highly skilled manufacturing talent, and that kind of deep expertise is something the U.S. is quickly forgetting.

So my question is: with TSMC building a fab in the U.S., are Americans actually getting retrained in real manufacturing skills? Or are they just being taught to push the buttons TSMC tells them to push?
by badsectoracula | 2025-07-25 14:02:56+00:00
Yes but Control isn't sold "just so the end user can enjoy exercising their new GPU and monitor", it is sold for gamers to play a great game. And IMO it is Remedy's best game since Max Payne 2 (i haven't played Alan Wake 2 though) because of its gameplay and atmosphere, not because of its visuals (which, do not get me wrong, are great, but that is largely because of the art direction and visual design, not because of raytracing -- in fact personally i first played and finished the game on an RX 5700 XT which has no raytracing at all and had to tone down a few visual effects, but still found the visuals great).
by alterae | 2025-07-25 14:03:12+00:00
agreed. and the setup for this tool in particular looks… complicated and annoying, at least at first glance

for myself, if i want a shell script to be _portable_ i just write it in POSIX sh and try to be smart about dependencies

and if i don't care about portability, i'd rather just use a nicer shell like bash or zsh or fish (i'd actually like to mess with ysh at some point)

i feel like i'm much more likely to encounter a system with one of those shells available than one with modernish installed, and the idea of introducing a bundling/build step into shell scripts is deeply unappealing to me.

i can see why this exists, i think, and i imagine there are people who find it useful. i simply am not among them.

i also find it disappointing that their most basic example shows the setup in bash instead of sh, but that might just be me.
by rimunroe | 2025-07-25 14:03:16+00:00
I appreciate the thorough response! Again, I'm not a lawyer or even very familiar with it. I looked up the concerns people had, and then tried to find the bit which seemed likely to cause that concern.

I don't know if it sounds likely, and you seem more familiar with this kinda thing than I am, but given the erosion of a bunch of norms I can understand why people would have much less trust in any sort of regulators actually verifying that banks were following the law or their ability to win a lawsuit. Do you know if this would allow private action?
by gus_massa | 2025-07-25 14:04:15+00:00
This is not what scientists are supposed to be doing. This is the academic version of click baiting or the version of the TV show where everything was made by ancient aliens.

It's fine to have a few fringe theories under the table and take a look from time to time, but before publishing them is important to get enough evidence. Otherwise it removes the credibility of science for important topics.

[Anyway, the important thing is not that a guy/gal with a white coat said it, it's understanding that the claim has enough support. You don't trust science, you analyze the evidence.]
by throwaway328 | 2025-07-25 14:04:27+00:00
I am not a scientist, and was primarily having a laugh with my comment.

That said, I do know that the type of person who likes configuring things very in-depth can set up intricate and powerful workflows in Emacs. I don't know what kind of data science IDE specifically you're interested in putting together, but here's a general article:

https://michaelneuper.com/posts/replace-jupyter-notebook-wit...

There's also this MOOC on reproducible research in French and English from Inria, where you're encouraged to follow the course in one of three ways: Jupyter, RStudio, or in Emacs' Org-Mode. I'd love to do it, but can't really justify spending the time at the minute.

https://www.fun-mooc.fr/en/courses/reproducible-research-met...

Creator of org-mode is Carsten Dominik, who is an astronomer by trade, so, it's a scientist's tool. A few of his talks are listed on this page, if you're interested in going straight to the source:

https://orgmode.org/worg/org-tutorials/
by knappa | 2025-07-25 14:04:32+00:00
But correctly formatting references is pretty much a solved task through reference managers, possibly plus bibtex. It's a well-defined task, after all, and well suited to traditional software techniques. [1] If someone used an LLM to format the references, you would still have to go back through them.

If there is any use for LLMs in paper writing, I would think that it is for tedious but not well-defined tasks. For example, asking if an already written paper conforms to a journal's guidelines and style. I don't know about you, but I spend a meaningful amount of time [2] getting my papers into journal page limits. That involves rephrasing to trim overhangs, etc. "Rephrase the following paragraph to reduce the number of words by at least 2" is the kind of thing that LLMs really do seem to be able to do reliably.

1: As usual, the input data can be wrong, but that would be a problem for LLMs too. 2: I don't actually know how much time. It probably isn't all that long, but it's tedious and sure does feel like a long time while I'm doing it.
by Hizonner | 2025-07-25 14:04:56+00:00
No, what's happening is that people like NCOSE and Collective Shout are putting pressure on the processors. They've loudly bragged about it. It's not the first time they've done it. And they've been known to enlist government actors to help with the pressure ("Operation Choke Point").

Every time this issue comes up, a bunch of people crawl out of the woodwork trying to prove how "wise" they are by mouthing this idea about chargebacks. And the processors are happy to keep their heads down and not dispute it, or even encourage it, since they really want the whole issue to just go away.

Chargebacks are not the issue here, and if you haven't paid any attention at all to what's actually going on, you're best advised not to make yourself look like a fool by talking about what you guess might "most likely" be happening.
by os2warpman | 2025-07-25 14:05:19+00:00
Why does everything (in big-budget video games) look shiny and wet?

If it is an attempt at realism, reality is not constantly shiny and wet.

If it a subjective artistic choice, it is objectively wrong and ugly.

Is there an expectation that everything look shiny and wet to make it seem more "dynamic"?

Is it an artists' meme, like the Wilhelm Scream in cinematic sound design?
by atonse | 2025-07-25 14:06:05+00:00
I actually strongly agree with this philosophy because it’s about fostering a certain culture.

But as a counterpoint for the sake of argument, money and time spent on optimizing the website could be better spent on the actual race related stuff. So that might be where the optimization is happening.

In reality, it’s probably the simpler explanation, that they know how to hire mechanical engineering talent and just see IT as a cost center (and a nuisance) so probably are cheap in that department.
by dathinab | 2025-07-25 14:06:14+00:00
> Which raises the question: do they even own those books?

nop, but legislators should really force that anything bought without "deadline" also doesn't randomly disappear/cost extra no matter if you bought a license or not

in additions license with clear deadline should always be required to have a "be aware that this product has only a limited guaranteed availability of ... days/month/years _dialog_" which you need to agree on and which isn't allowed to be just another checkbox (which yes seems mean against companies, but their is no reason to not treat scam like, abusive business practices meanly. It's kinda the point of countries to fight against anything harming their citizens weather that is abusive business practices or violence .)
by iudqnolq | 2025-07-25 14:06:18+00:00
I have a gut feeling that writing this kind of MCP server can't be the future of software development. I'd expect a two year old AI model to need this kind of handholding, but I don't understand why it's still necessary.

Couldn't any modern AI model know that Zig docs are relevant to the question, figure out how to find the docs, write some code to parse it, and guess how frequently to update it's cache?

I expect there to be plenty of problems AI can't write for the foreseeable future but they have a very different vibe from this.

Edit: I just asked Claude Sonnet 4 to pretend it has a tool that makes docs available that has an update frequency parameter. It said the zig stdlib should be updated weekly but the Java stdlib would only need quarterly. Seems reasonable to me.
by sigwinch | 2025-07-25 14:07:58+00:00
Should be obvious that purposefully publicizing some derivative of reputation is going to be used for more harm than good.

New Federal laws mean that individuals can get certain pictures removed. AI likenesses might circumvent those, but you have to wonder how far to trust (positive or negative) anonymous ratings from someone who put the work into crafting an avatar of some guy.

While there’s a noble pursuit behind it, we’ll never see the trouble that it prevented. Instead we’ll see scams where a guy will provide doctored screenshots from Tea that cannot be independently verified. Of course, he’ll be new in town, or need some money.
by do_not_redeem | 2025-07-25 14:07:58+00:00
Not every job is glamorous. Would you be proud of your child for becoming a garbage man? "You'd make such a good garbage man!", we could say encouragingly to a new grad considering between sanitization engineering and Stanford.

Probably not, yet society depends on garbagemen to function smoothly. And we should be happy that in the modern era people can pursue unglamorous careers, and be accepted by society, and not suffer from the abuse and degredation of times past. Society is improving. It's only a dwindling number of bigots who look down on people because of their career choices.
by rossdavidh | 2025-07-25 14:08:13+00:00
In terms of actual actions, Starlink has done a lot more for Ukraine than almost anyone else, since early on. Musk says stuff from time to time in order to try to keep Putin from noticing this, and pushing him out of a window or something. But his actions are that he let Ukraine use Starlink for over a year for free, and they still use it widely today.
by netsharc | 2025-07-25 14:08:14+00:00
My "citation needed" theory is that 14 years of austerity and incompetent Tories (heh Cameron sounds more intelligent than Boris, but he's also a Grade-A moron) have destroyed the government's capabilities to control things. Police budgets were also slashed, and now criminals snatch your phones off your hands.

Let's see if the same rot shows up in the USA soon...
by hermitcrab | 2025-07-25 14:08:38+00:00
There has been a big move to web based apps (SAAS) as web-based software has improved. The biggest plus to web based software for the user is that there is no need to install anything.

BUT, you are going to be paying a monthly sub as long as you keep using the service. And soon as the service goes down (due to financial or other reasons) - game over man.

So there is still a lot to be said for downloadable software, even if it is no longer cool or fashionable. Pay once. Keep your data secure locally. Keep using it until you can't find a computer that runs it any more.

I develop 3 commercial downloadable software products. No plans to move them to web.
by NitpickLawyer | 2025-07-25 14:08:49+00:00
> The only place I am aware of is going to these provider's individual website pages to check the price per token.

Openrouter is a good alternative. Added bonus that you can also see where the open models come in, and can make an educated guess on the true cost / size of a model, and how likely it is it's currently subsidised.
by dcow | 2025-07-25 14:08:49+00:00
I’m sorry… all these comments about societies banning nudity and graphic violence are really skirting the point. In the context of modern age regulation, at a social level, nobody is arguing people at large should not have access to violent and sexual content. This isn’t about religion oppressing women’s sexual freedom. The argument is that children should not have unguided access to adult content. On top of that most parents I know allow children to experience violent and sexual content with supervision. The goal is not to censor society, it’s to draw some reasonable and realistic lines in the sand so parents can introduce sensitive content to children in a way that is empathetic with their child’s context and maturity level.

Now I’m sure even that is arguable, but the conversation should be around that and not superficially related tangents.
by snorlaxmorlax | 2025-07-25 14:09:14+00:00
Hey, we try to maintain attribution from our wiki setup, still. Our contributors are of the utmost importance to us, and if you can tell me about the page you contributed to, I can share more.

Here's a wikihistory for the lexical grammar page → https://developer.mozilla.org/en-US/docs/Web/JavaScript/Refe...
by LeafItAlone | 2025-07-25 14:09:23+00:00
The best way I’ve found to interact with it is to treat it like an overly eager junior developer who just read books like Gang of Four and feels the need to prove their worth as a senior. Explain that simplicity matters, or you have an existing pattern to follow, or even more specific.

As I’ve worked with a number of people like what I’ve described above, the way I’ve worked with them has helped me get better results from LLMs for coding. The difference is that you can help a junior grow over time. LLMs forget after that context (Claude.md helps, but not perfect).
by Hizonner | 2025-07-25 14:09:24+00:00
Because the money involved is peanuts, they don't want people running around trying to put them in the headlines as "enabling sexual exploitation", and a certain number of their internal people actually believe in the "cause".

Contrary to popular belief, corporations are composed of humans and do not reliably or mechanically follow only financial incentives. Nor are they always perfect in understanding their actual financial interests. Boycott threats are probably empty, but some people may not want to take the chance, or may have other motivations that cause them to overestimate that risk.
by rs186 | 2025-07-25 14:09:27+00:00
> My wife and I now have a computer in our house that runs open-source equivalents to Google Drive, Google Photos, Audible, Kindle, and Netflix. It syncs to all of our devices. It's secured behind our own VPN. And it's wholly, truly owned by us.

Good for you. But for most people, it is an endeavor with zero gain, meaning no positive impact to their daily life, if not full of negative impact.
by awongh | 2025-07-25 14:09:58+00:00
This is great, but as others have mentioned the UX problem is more complicated than this:

- for other models there are providers that serve the same model with different prices

- each provider optimizes for different parameters: speed, cost, etc.

- the same model can still be different quantizations

- some providers offer batch pricing (e.g., Grok API does not)

And there are plenty of other parameters to filter over- thinking vs. non-thinking, multi-modal or not, etc. not to even mention benchmarks ranking.

https://artificialanalysis.ai gives a blended cost number which helps with sorting a bit, but a blended cost model for input/output costs are going to change depending on what you're doing.

I'm still holding my breath for a site that has a really nice comparison UI.

Someone please build it!
by energy123 | 2025-07-25 14:10:16+00:00
I don't believe these companies see their customers as being able to tell the difference between a real GPQA score and a GPQA score that's fudged upwards by 10%. Look at Elon Musk presenting himself to the world as a Path of Exile expert when in reality he likely hired an expert to level up his account while he himself is an amateur. They think we are idiots and will lie to us to capture market share and lock us into their ecosystem.
by Swizec | 2025-07-25 14:10:17+00:00
> For racing games or flight simulators or such it is less of a problem,

Cars are also easier to make photorealistic. Less uncanny valley effect, lots of flat shiny surfaces.

What absolutely breaks immersion for me in most AAA car games is the absolute lack of crash, scratch, and dirt mechanics. Cars racing around the track for 2 hours don’t look like showroom pieces! Make ‘em dirty darn it. And when I crash into a wall …

I’m really excited to try Wreckfest 2 when I get around to it. Arcade-ish driving, not super photorealistic, they put it all on realistic soft body collision physics instead.
by woodylondon | 2025-07-25 14:10:26+00:00
This is really cool - I recently worked on a tool that I installed on my iPhone, which extracts all health data nightly to CSV and then to a cloud database.

This was quite straightforward once you understand the permissions. I wonder why the OP didn’t do this and was instead using a simple health export CSV?

The main concern I had with releasing this or turning it into a tool was data security.

I have been swimming 1500m x 365 days of the year for the last 7 years. My use case was to build a personalised dashboard for my daily swimming and heart rate data to track detailed progress beyond what Apple offers. Having the ability to query this data with AI could be quite useful, rather than relying on manual reports.
by PaulKeeble | 2025-07-25 14:10:45+00:00
The reason why giving this storage and control over to any company doesn't work is because their incentives are always towards enshitiffication. The issue of community access can always be solved by self hosting on a rented cloud server, its still your data under your control its just someone elses box with a high speed internet connection and global accessibility, self hosting gives you the choice who sees and uses it and how. The hardware isn't actually the important bit, its the software.

I think its not the future in its current form either, because it requires too much configuration and maintenance for typical users, although NAS devices do it quite well and easily nowadays. But I also think that the cost of having Amazon et el do the maintenance has resulted in a lot of downtime that wipes out the internet every month or so for hours at a time and with the data theft and abuse and ever increasing profit extraction.
by adrian_b | 2025-07-25 14:10:46+00:00
The only question that matters is how far behind TSMC they are.

Intel has just said that unless a miracle will bring them serious external customers for their 14A CMOS process, they will stop developing it, which would leave the Intel 18A manufacturing process (to be used for Panther Lake later this year) as the last Intel manufacturing process.

In that case, there will be only 3 state-of-the-art semiconductor makers, TSMC, Samsung & Rapidus, with no American or European competitor.
by slightwinder | 2025-07-25 14:11:07+00:00
> I don’t think most people realize how much they’ve given up.

I think many are overstating how much people are giving up. People exchange control for comfort, but most people never had any need or ability for this control in the first place. That's why cloud-services became popular, and remain popular.

> Unfortunately it’s a fair bit of work to reclaim everything as your story shows.

This work would be necessary anyway, that's the whole reason why people prefer letting other people doing this work.

> I switched to my own modem and router recently for privacy from my ISP

I'm curious, which privacy can you regain from an ISP, who is already seeing all your internet-traffic? And are we talking here about separate modem & router?
by bluGill | 2025-07-25 14:11:47+00:00
It is not just that it is a lot of work, it is that you lose power, or add a lot of risk. The example doesn't mention backups at all - when (not if) the computer fails then what? How do you access this cloud when not at home - again I didn't see this. How do you share data (only some please) with friends? How will you handle zero-days if the attacker decides to attack you - will you even notice or be the bad guy on the internet enabling attacks on others? Once you get things working when/how will you update - I've had several services that worked good until I updated and something in the config didn't migrate correctly and so it doesn't work.

I have some self hosted things, but because of the above I'm realizing that it is better to find someone to pay to take care of things for me. Someone large enough to get a sysadmin around 24x7, do trail upgrades, write the software/features... Unfortunately finding someone you can trust to do the above is important, and for many things there is no option.

I will likely always run jellyfix (or similar) for legal reasons. However for most things it would be better to pay someone I trust.
by NotPractical | 2025-07-25 14:12:19+00:00
Even if you aren't concerned about the possibility of "backdoored hardware" (and I am not, for one), I'm still sympathetic to the argument that giving money to Google is morally wrong because it provides financial support for their data-harvesting business model (though since you use GrapheneOS, they'll only be able to use it to harvest other users' data, of course, not yours). Buying a used Pixel doesn't support Google financially, so perhaps that's more ethical.
by flntzr | 2025-07-25 14:13:06+00:00
I'd like to switch phones soonish and was looking at the fairphone 6 with /e/OS but feel deterred by its mid range specs which would probably limit its longevity. I would like to get away from google.

Is waiting for the new pixel and then putting grapheneOS on it a good way forward? Seems weird to pick a google device to get away from that company.

Has anyone else done the same?

Alternatively, there is the iPhone but I do like fdroid and the more open nature of android.