MurphyA/hacker-news huggingface dataset:
by Imustaskforhelp | 2025-08-12 18:05:52+00:00
This is really really cool. I had earlier wanted to entirely run my searches on it and though that seems possible, I feel like it would be sadly a little bit more waste of time in terms of searches but still I'll maybe try to run some of my searches against this too and give me thoughts on this after doing something like this if I could, like, it is a big hit or miss but it will almost land you to the right spot, like not exactly.

For example, I searched lemmy hoping to find the fediverse and it gave me their liberapay page though.

Please, actually follow up on that common crawl promise and maybe even archive.org or other websites too and I hope that people are spending billions in this AI industry, I just hope that you can whether even through funding or just community crowdwork, actually succeed in creating such an alternative. People are honestly fed up with the current search engine almost monopoly.

Wasn't Ecosia trying to roll out their own search engine, They should definitely take your help or have you in their team..

I just want a decentralized search engine man, I understand that you want to make it sustaianable and that's why you haven't open sourced but please, there is honestly so much money going into potholes doing nothing but make our society worse and this project almost works good enough and has insane potential...

Please open source it and lets hope that the community tries to figure out a way around some ways of monetization/crowd funding to actually make it sustainable

But still, I haven't read the blog post in its entirety since I was so excited that I just started using the search engine.., But I feel like the article feels super indepth and that this idea can definitely help others to create their own proof of concepts or actually create some open source search engine that's decent once and for all.

Not going to lie, But this feels like a little magic and I am all for it. I have never been this excited the more I think about it of such projects in actual months!

I know open source is tough and I come from a third country but this is actually so cool that I will donate ya as much as I can / have for my own right now. Not much around 50$ but this is coming from a guy who has not spent a single penny online and wanting to donate to ya, please I beg ya to open source and use that common crawl, but I just wish you all the best wishes in your life and career man.
by hadlock | 2025-08-12 18:06:02+00:00
I think we are already there. You can run a pretty ok LLM on a 4gb raspberry pi that will write most any simple 20-150 line bash script today, or toy application in python/rust. Old laptops pulled out of the trash are probably capable of running smaller LLMs and can explain how functions work. They're no claude code but you probably want a rough-around-the-edges LLM that can't do everything for you, if you're planning on using it to learn to code.
by ffitch | 2025-08-12 18:06:13+00:00
I wonder how modern models fair on NovelQA and FLenQA (benchmarks that test ability to understand long context beyond needle in a haystack retrieval). The only such test on a reasoning model that I found was done on o3-mini-high (https://arxiv.org/abs/2504.21318), it suggests that reasoning noticeably improves FLenQA performance, but this test only explored context up to 3,000 tokens.
by kergonath | 2025-08-12 18:06:30+00:00
> I don’t think it’s just (or even particularly) bad axioms, I think it’s that people tend to build up “logical” conclusions where they think each step is a watertight necessity that follows inevitably from its antecedents, but actually each step is a little bit leaky, leading to runaway growth in false confidence.

I really like your way of putting it. It’s a fundamental fallacy to assume certainty when trying to predict the future. Because, as you say, uncertainty compounds over time, all prediction models are chaotic. It’s usually associated with some form of Dunning-Kruger, where people know just enough to have ideas but not enough to understand where they might fail (thus vastly underestimating uncertainty at each step), or just lacking imagination.
by Shank | 2025-08-12 18:06:51+00:00
I was a really big fan of taskwarrior for the simple reason that it did do an approximation of telling you the best thing by calculating urgency, based on a simple weighting method where "the most urgent tasks" blocked other tasks, were due soon, had extra tags, had dependents, and were the oldest.

But I do feel very strongly that people only jump into "the great trap" because they feel that they were let down by their system, or that it didn't quite model their life accurately. A lot of todo apps are opinionated and those opinions, if incompatible with the the person using them, will lead to frustration. The quest for a more perfect life model often continues when this incompatibility is found.
by ASalazarMX | 2025-08-12 18:07:29+00:00
It's clearly a defensive excuse, as it is extremely unrealistic to expect final users to read all the docs of all the dependencies of a Linux distro. It's the responsibility of the maintainer to read the subset of docs relevant to the package(s) they're contributing, not the user's.

It could be that they were caught with their pants down and posted an ill-thought response, but I'd lean strongly towards malice with such a poor defense, it borders on confession. Clipboards are one of the most critical privacy/security features, you don't ever want to leak them unintentionally.

Did we already forget about the XZ Utils backdoor? There have to be multiple efforts to infiltrate backdoors in Linux going right now.

https://en.wikipedia.org/wiki/XZ_Utils_backdoor
by shagmin | 2025-08-12 18:07:32+00:00
I don't think it's widespread by any means but the US Supreme Court has been directly pulled into this exact topic.

https://www.npr.org/2024/10/21/g-s1-28919/supreme-court-judg...

https://www.brennancenter.org/our-work/research-reports/judg...

https://news.northeastern.edu/2025/03/27/judge-shopping-expl...
by ductsurprise | 2025-08-12 18:07:49+00:00
Friendly FYI: Some M.2 slots offer up to 4 PCIe lanes.

Though, it looks like on the lite version mentioned here, there is but one PCIe lave available on the slot.

Edit: Adding the size is likely the reason and full regular PCIe is not there. The PCIe card would likely be as big as the board it self. :)
by ajdude | 2025-08-12 18:07:56+00:00
> Microsoft being the cool guys phase is slowly over

I'm going to re-post something that I wrote in 2022:

I'm a bit surprised at how many of my friends have jumped ship to Visual Studio Code, including those who are very much for free software. They have always been in the business of embrace, extend, extinguish[0]. People tend to forget how evil M$ used to be because recently they have seemed like a beacon for Open Source, but I think they are just still evil[1].

I think we're still dealing with the same Microsoft that we've dealt with through the 90s. They are not a champion of open source, and they are still up to their old tricks.[2]

[0] https://news.ycombinator.com/item?id=31966414

[1] https://keivan.io/the-day-appget-died/

[2] https://social.platypush.tech/@blacklight/108719097530863121
by dang | 2025-08-12 18:08:26+00:00
"Don't be snarky."

"Please don't post shallow dismissals, especially of other people's work. A good critical comment teaches us something."

https://news.ycombinator.com/newsguidelines.html

Ask questions out of curiosity. Don't cross-examine.

https://news.ycombinator.com/showhn.html
by lesuorac | 2025-08-12 18:08:38+00:00
It's not at zero extra charge. Most of the Buy-Now-Pay-Later companies charge higher transaction fees to the merchants than say MasterCard [1].

Now, the business of accepting debt from people that uh can't repay that debt is probably going to have to change.

[1]: https://www.merchantmaverick.com/klarna-for-business/
by Imustaskforhelp | 2025-08-12 18:09:44+00:00
I wish all the best wishes to fediverse too. I'd like to take this one step too that communities have gone a similar transition too from forums to mostly now discord and I wish them to move to something like matrix which is federated (yes I know it has issues, but trust me sacrifices must be made)

What are your thoughts on things like bluesky/nostr and (matrix) too.

Bluesky does seem centralized in its current stage but its idea of (pds?) makes it fundamentally hack proof in the sense that if you are on a server which gets hacked, then your account is still safe or atleast that's the plan, not sure about its current implementation.

I also agree with AI not being the next awesome. Maybe for coding sure, but not in general yeah. But even in coding man, I feel like its good enough and its hard to catch more progress from now on and its just not worth it but honestly that's just me.
by smithclay | 2025-08-12 18:09:48+00:00
For the skeptics: using Claude Code from your phone is kind of great. Think this sort of solution is excellent once you've figured out a good workflow.

Open-sourced my own duct-taped way* of doing this with free/open-source stuff a few weeks ago, recommend you give this kind of Claude on the go workflow a try during your next flight delay / train ride / etc.

*https://github.com/smithclay/claudetainer
by snarf21 | 2025-08-12 18:10:04+00:00
I think it is more simple in that we love tribalism. A long time ago being part of a tribe had such huge benefits over going it alone that it was always worth any tradeoffs. We have a much better ability to go it alone now but we still love to belong to a group. Too often we pick a group based on a single shared belief and don't recognize all the baggage that comes along. Life is also too complicated today. It is difficult for someone to be knowledgeable in one topic let alone the 1000s that make up our society.
by LeifCarrotson | 2025-08-12 18:10:12+00:00
I think there are two reasons:

First, SBC processors are just a step up from microcontrollers, they're designed to talk to GPIO devices and servos and UARTs and sensors, not GPUs and network cards. The JH7110 only has a two lanes of PCIe 2.0, one of which is used for USB 3.0 and the other mostly (I assume) to provide an M.2 interface. However, it also has 6 UARTs (Universal Asynchronous Receiver-Transmitter, think RS232 serial), 7 channels of SPI (not counting the QSPI Flash controller directly integrated), 8 channels of PWM, 7 channels of I2C, 64 channels of general-purpose IO, I2S, SPDIF, two channels of CANbus, a directly integrated Ethernet MAC, USB 2.0 host, a MIPI-CSI camera interface and a MIPI-DSI video display block with either HDMI output or for directly driving a 24-channel parallel LCD.

Embedded system designers don't want to add a PCIe-to-RS232 card to their industrial robot, NAS, or video camera, heck, they don't want to add an external GPU. They don't even want to add a separate northbridge/southbridge or PCH, they want a single-chip SOM. Going up and down those layers between PCIe and SATA or USB or Ethernet is expensive in terms of chip count and power.

Second, I don't think they want to deal with the drivers. If you want to plug in your choice of PCIe device - be it a GPU, RAID card, sound card, who knows what - that's a level of compatibility and modularity that SBCs are bad at.
by mikewarot | 2025-08-12 18:10:13+00:00
It's my strong opinion that Von Neumann's architecture is great for general purpose problem solving. However for computing LLMs and similar fully known execution plans, it would be far better to decompose them into a fully parallel and pipelined graph to be executed on a reconfigurable computing mesh.

My particular hobby horse is the BitGrid, a systolic array of 4x4 bit look up tables clocked in 2 phases to eliminate race conditions.

My current estimate is that it could save 95% of the energy for a given computation.

Getting rid of RAM, and only moving data between adjacent cells offers the ability to really jack up the clock rate because you're not driving signal across the die.
by nicce | 2025-08-12 18:10:34+00:00
Einstein predicted LLMs too?

> If I had an hour to solve a problem, I'd spend 55 minutes thinking about the problem and five minutes thinking about solutions.

(not sure if that was the original quote)

Edit: Actually interesting read now that I look the origin: https://quoteinvestigator.com/2014/05/22/solve/
by jsbg | 2025-08-12 18:10:53+00:00
> the theory of comparative advantage

It's not a theory. Firms trade internationally because it's cheaper, not because they "believe" in free markets.

> But government (society) can take a longer term view than a company that is influenced by pricing signals

Private markets routinely make multi-decade bets; entire industries (mining, energy, infrastructure, biotech) work on 20–100 year horizons. Risk and time are already priced in.

> Free market works in theory because you assume complete information

Free markets don’t "assume" anything; they function through decentralized price signals. And even with imperfect information, dispersed actors still aggregate and react to knowledge far better than any central planner can.
by jonbiggums22 | 2025-08-12 18:10:56+00:00
Certainly better than where we are now but I never really loved it. It was to heavy for me, the search doesn't find files that are there reliably and the update system system sucked. Windows 7 always developed disk sucking WinSxS folder cancer, a particularly fatal disease during the early SSD era where space became a premium again.

It did have faster file copying though. I'd say it had 64-bit for more memory addressing but that was actually available with XP as well.
by grace77 | 2025-08-12 18:11:06+00:00
We keep our system prompts across the board as bare bones as possible: https://www.designarena.ai/system-prompts

As for good game dev prompts, here's one from a user that made a pretty fun game: Make asteroids with 2 computers playing against each other on one screen. There should be asteroids flying and 2 ships being controlled by 2 computers. Pay attention to thoroughly implementing the logic to make the ships avoid asteroids at all costs. Absolutely no user input should be necessary, no click to start, no click to restart. The game starts automatically on load and automatically restarts when either computer is dead. The ships should survive as long as possible. The ships should fly around, avoid asteroids as a priority, but also shoot asteroids and each other. Make ships and asteroids positions random each time. Asteroids should split when shot. The goal is to create a robust algorithm for ships so they can survive as long as possible. The game should be playable at 500x500 screen resolution.
by xyst | 2025-08-12 18:11:32+00:00
All this does is make some poor offshore schmuck toil away for hours trying to get this data.

If companies begin to _cancel_ their contracts with MSFT/GH because of a breach of SLAs, then maybe conditions will improve.

Reality: companies locked into multi year deals with MSFT including a MSFT-shit suite and windows licenses.

Migrating away from it will be expensive. MS knows this. Thus the reason why nothing will change.
by gausswho | 2025-08-12 18:11:37+00:00
> Also as a side rant, I honestly don't think "projects of love" are a good counter argument to anything. They're clearly not of love because otherwise they would find a way to make them profitable.

I appreciate the... tough love here, and also acknowledge that 'doing it for love' is ambiguous. But I strongly disagree that declining to make something profitable indicates that it's not out of love.

To clarify my own situation, it's more out of wanting to share knowledge with the world and build a community. It's a very popular site, ubiquitous in its niche, but that's about as much as I'll divulge.

I'll grant that we've been benefitting from the subsidy/hook up to now. But I'll also add the wrinkle that a substantial increase in bandwidth is due to AI harvesters. They are becoming an existential threat to projects like these.
by tracker1 | 2025-08-12 18:11:45+00:00
Mostly agreed... I understand it's easier to print http://foo.bar/123 than http://markettingsite.com/?campain=xyz&... But there's absolutely nothing stopping every website from hosting their own.

It's mostly for print usage anyway.. and with all the TLDs out there now, you can definitely still get some short options. I literally have one strictly for (reverse)dns for my server(s). Another for my mail server, separate from the domains the server hosts.

Also, hosting your own means you don't have to worry about being associated with externalized spam links. Of course, if you are a spammer, then it works even better for users that will block you.,
by genghisjahn | 2025-08-12 18:11:49+00:00
I've recently started attending an Episcopal church. We have some people who lean heavy on transubstantiation, but our priest says, "look, something holy happens during communion, exactly what, we don't know."

See also: https://www.episcopalchurch.org/glossary/real-presence/?

"Belief in the real presence does not imply a claim to know how Christ is present in the eucharistic elements. Belief in the real presence does not imply belief that the consecrated eucharistic elements cease to be bread and wine."
by whyenot | 2025-08-12 18:12:00+00:00
> The US has shown absolutely no willingness to carry out antitrust cases the past many years

Lina Khan's FTC brought cases again Microsoft, Meta, Amazon, Mastercard, and more. They also prevented mergers (consolidations) in a lot of different industries. Could they have accomplished more? Certainly, but they did certainly did display a willingness to bring antitrust cases.
by wolrah | 2025-08-12 18:12:01+00:00
> this page is a great example of the UI ramifications of GDPR.

No, this is an example of malicious compliance. There are so many bad GDPR banners because the people creating them want you to be annoyed by them. They want to have the easy path being the one that lets them collect as much data as they can and the most private path is as annoying as they believe they can get away with under the law. They want people complaining that the GDPR did nothing but cause all these annoying banners.

It'd be possible for many if not most web sites to not have such banners at all by simply defaulting to privacy-friendly behaviors, but there's too much money to be had in the behaviors the GDPR seeks to reduce.
by hinkley | 2025-08-12 18:12:54+00:00
I think this is in the same space as 'imperative shell, functional core'. Because what ends up happening is that in a tree or DAG you keep swapping back and forth between decision and action, and once the graph hits about 100 nodes only people who are very clever and very invested still understand it.

A big win I mentioned elsewhere involved splitting the search from the action, which resulted in a more Dynamic Programming solution that avoided the need for cache and dealing with complex reentrancy issues. I'm sure there's another name for this but I've always just called this Plan and Execute. Plans are an easy 'teach a man to fish' situation. Sit at one breakpoint and determine if the bug is in the execution, the scan, or the input data. You don't need to involve me unless you think you found a bug or a missing feature. And because you have the full task list at the beginning you can also make decisions about parallelism that are mostly independent from the data structures involved.

It's not so much enabling things that were impossible as enabling things that were improbable. Nobody was ever going to fix that code in its previous state. Now I had, and there were options for people to take it further if they chose.
by AaronAPU | 2025-08-12 18:13:38+00:00
At the VERY beginning I asked it to reverse a hash, and was stunned that it was able to. This was in that first moment when the transformer burst on the scene.

Turned out it just knew that particular string because it was on the internet. I don’t recall exactly but it was probably “hello world” or something like that.

Anyway to your specific question, many of the models call Python tools behind the scenes now.
by michaeldoron | 2025-08-12 18:13:59+00:00
Where do you see that in the text? I am looking at the Hebrew script, and the text only reads that as Elisha went up a path, young lads left the city and mocked him by saying "get up baldy", and he turned to them and cursed them to be killed by two she bears. I don't think saying "get up baldy" to a guy walking up a hill constitutes bullying him into killing himself.
by akomtu | 2025-08-12 18:14:00+00:00
It's a religion of an overdeveloped mind that hides from everything it cannot understand. It's an anti-religion, in a sense, that puts your mind on the pedestal.

Note the common pattern in major religions: they tell you that thoughts and emotions obscure the light of intuition, like clouds obscure sunlight. Rationalism is the opposite: it denies the very idea of intuition, or anything above the sphere of thoughts, and tells to create as many thoughts as possible.

Rationalists deny anything spiritual, good or evil, because they don't have evidence to think otherwise. They remain in this state of neutral nihilism until someone bigger than them sneaks into their ranks and casually introduces them to evil with some undeniable evidence. Their minds quickly pass the denial-anger-acceptance stages and being faithful to their rationalist doctrine they update their beliefs with what they know. From that point they are a cult. That's the story of Scientology, which has too many many parallels with Rationalism.
by randcraw | 2025-08-12 18:14:13+00:00
The second-most common cognitive mistake we make has to be the failure to validate what we think we know -- is it actually true? The crux of being right isn't reasoning. It's avoiding dumb blunders based on falsehoods, both honest and dishonest. In today's political and media climate, I'd say dishonest falsehoods are a far greater cause for being wrong than irrationality.
by grace77 | 2025-08-12 18:14:25+00:00
yes - the changes since Show HN have been builders (https://www.designarena.ai/builder), audio (https://www.designarena.ai/audio), video (https://www.designarena.ai/diffusion), and compare (https://www.designarena.ai/studio). We also had a feed at some point, but ripped that out because it looked messy
by markb139 | 2025-08-12 18:14:45+00:00
I’ve tried 2 AI tools recently. Neither could produce the correct code to calculate the CPU temperature on a Raspberry Pi RP2040. The code worked, looked ok and even produced reasonable looking results - until I put a finger on the chip and thus raised the temp. The calculated temperature went down. As an aside the free version of chatGPT didn’t know about anything newer than 2023 so couldn’t tell me about the RP2350
by parineum | 2025-08-12 18:14:50+00:00
Yes, I did. Not everybody has their own product that might benefit from a $200 subscription. Most of us work for someone else and, unless that person is paying for the subscription, the _value_ it adds is irrelevant unless it results in better compensation.

Furthermore, the advice was given to upgrade to a $200 subscription from the $20 subscription. The difference in value that might translate into income between the $20 option and the $200 option is very unclear.
by AlotOfReading | 2025-08-12 18:15:25+00:00
I don't know what you want from me.

Yes, my speculation on incomplete information was wrong. That's obvious to anyone who can read. I haven't hidden it, I haven't said I was ever correct, and even in that thread I explicitly said there are two possibilities and here's the one I find more likely.

Yet you're acting like I kicked a puppy and need to apologize for my moral failings. Chill, it's not a big deal. I'll probably be wrong about something else in the future too. All I can do is update my understanding and try not to make the same mistakes going forward.