MurphyA/hacker-news huggingface dataset:
by dagw | 2025-07-01 11:12:00+00:00
Crawling up the abstraction ladder and 'forgetting' everything below has been the driving trend in programming since at least the 60s and probably before.

We for example have a whole generation of programmers who have no idea what the difference between a stack and a heap is and know nothing about how memory is allocated. They just assume that creating arbitrarily complex objects and data structures always works and memory never runs out. And they have successful careers, earning good money, delivering useful software. I see no reason why this won't continue.
by user923851 | 2025-07-01 11:12:54+00:00
I don't agree with the average user not being bilingual, but I do see your point about who the target audience is here.

I don't have any numbers but it seems plausible that the average user doesn't make an informed decision about where they consume their videos or which search engine they use. They buy a smartphone to connect to their family and friends, to learn and to use essential services.

Unfortunately the smartphone is not designed to help users with this goal. It is a medium for tech companies to shove garbage down the throats on people who are just trying to live their lives, and to perform the largest mass surveillance campaign in the history of mankind. Communication and connectivity is the Trojan horse used to sell the malware that the smartphone is.

This feature is designed for users who "don't know any better".
by xoa | 2025-07-01 11:13:48+00:00
>You can’t solve social problems with technical solutions.

Sure, this has a fair amount of truth to it. However, security is not a social problem, it's an economic one. No one, not even the most well funded and skilled organizations like the NSA, has access to infinite resources. Whether a given attack/data harvesting effort costs $1 million, $10 thousand, $100, $1, or $0.01 makes an enormous difference in impact. Can a given three letter agency afford to spend $1m on anyone? Sure. Can they afford it against everyone? No. Same with private orgs, if harvesting data costs $10000/person, it has to generate well over that much money in profit to make it worth it. Is that likely on average? Probably not. If it costs fractions of a cent, then they will be incentivized to scale it as hard as possible, since payoff from even one person will cover thousands of duds.

So sure, by all means we should pursue laws too, as that also shifts costs a bit. But there is zero reason not to simultaneously pursue technical means to make costs as high as possible. Both tracks matter a lot.
by djaychela | 2025-07-01 11:13:49+00:00
Yes, do. Although I have one whose output seems OK but doesn't power the system ok when connected. They definitely were built to be cheap rather than to an engineering standard!

Not slating them, times were different and every penny counted. I've got 4 spectrums here... 3 are 48k but one is original 16k....which is the most interesting one but it's the one that doesn't work!
by JimDabell | 2025-07-01 11:14:17+00:00
This seems like it’s going about things in entirely the wrong way. What this does is say “okay, you still do all the work of crawling, you just pay more now”. There’s no attempt by Cloudflare to offer value for this extra cost.

Crawling the web is not a competitive advantage for any of these AI companies, nor challenger search engines. It’s a cost and a massive distraction. They should collaborate on shared infrastructure.

Instead of all the different companies hitting sites independently, there should be a single crawler they all contribute to. They set up their filters and everybody whose filters match a URL contributes proportionately. They set up their transformations (e.g. HTML to Markdown; text to embeddings), and everybody who shares a transformation contributes proportionately.

This, in turn, would reduce the load on websites massively. Instead of everybody hitting the sites, just one crawler would. And instead of hoping that all the different crawlers obey robots.txt correctly, this can be enforced at a technical and contractual level. The clients just don’t get the blocked content delivered to them – and if they want to get it anyway, the cost of that is to implement and maintain their own crawler instead of using the shared resources of everybody else – something that is a lot more unattractive than just proxying through residential IPs.

And if you want to add payments on, sure, I guess. But I don’t think that’s going to get many people paid at all. Who is going to set up automated payments for content that hasn’t been seen yet? You’ll just be paying for loads of junk pages generated automatically.

There’s a solution here that makes it easier and cheaper to crawl for the AI companies and search engines, while reducing load on the websites and making blocking more effective. But instead, Cloudflare just went “nah, just pay up”. It’s pretty unimaginative and not the least bit compelling.
by d4rkp4ttern | 2025-07-01 11:15:31+00:00
Neat. I've been looking at paid options: Superwhisper, Wispr Flow, Willow Voice, and VoiceInk. I found Superwhisper to be slow. Willow is almost instantaneous. VoiceInk is faster than SuperWhisper, using the Whisper Large Turbo 3 model. All require a sub (at least $12/mo) except VoiceInk which has a one time cost.

How does the accuracy of yours compare to Whisper-based models?
by Alifatisk | 2025-07-01 11:16:26+00:00
What is it with Youtube and adding things no one asked for? I especially dislike when they make it default, so I have to figure out how to disable new features. My browser language is EN, my preferred language in YT settings is EN, I live in a European country, yet, videos get translated into Arabic? What the hell Youtube. Why can't I just visit your platform, look up videos I am interested in and watch it.

The old Youtube was way nicer, it felt snappy, easy to interact with and didn't have all that bloat we have today. I also miss when the ads where a popup at the bottom of the video instead of having to watch double ad segment every 5 minute.
by superhappy369 | 2025-07-01 11:17:40+00:00
We have created an iOS/Android app for expats and tourists in the Netherlands. As we are two people with limited capital, we are currently using Facebook and Instagram ad's but need more effective ways to promote our app. Could you provide advice on:

Additional tools and platforms to use for promotion 1.Cost-effective marketing strategies, 2.Mediums that can help us reach a broader audience, 3.Any insights or resources would be greatly appreciated as we aim to increase adoption of the app.

As I mentioned, we don't have much capital to spend on influencers or ad platforms. Kindly do share your suggestions and recommendations.
by lenkite | 2025-07-01 11:17:51+00:00
> All information presented is mostly unverified testimony printed verbatim by the press from untrustworthy sources on both sides.

Why do you say its "unverified" ? The commander in question: Brigadier General Yehuda Vach is formally under investigation for several crimes already: https://www.timesofisrael.com/idf-said-to-launch-probe-into-...

This nutcase general has faced consistent accusations from soldiers under his own command over the last year for over a dozen incidents alone. What is your holy threshold for evidence ? How can you "wait and see" if the press is not allowed at the food distribution site ? Basically, you are saying "wait and sweep it under the carpet".
by OtherShrezzing | 2025-07-01 11:19:00+00:00
I think you're looking at the wrong side of the market for the incentive structures here.

Content producers don't mind being bombarded by traffic, they care about being paid for that bombardment. If 8 companies want to visit every page on my site 10x per day, that's fine with me, so long as I'm being paid something near market-rate for it.

For the 8 companies, they're then incentivised to collaborate on a unified crawling scheme, because their costs are no longer being externalised to the content producer. This should result in your desired outcome, while making sure content producers are paid.
by sillytwice | 2025-07-01 11:21:19+00:00
Recently I sent a product on guarantee to Amazon for reparation using a tag label and paying 42€, and the next day they cancelled the label of the product (they are investigating why) and the product was rejected in the Amazon store. Now, following indications, I have to wait the product to come back and resend it paying another 42 € that they promise to refund me later. The product is an air conditioned system for an old woman, here in South Spain the temperature is very high (a hot wave), and I think it will take a long time to be repaired (just to match up with their repairing service described below).

The product maker cecotec, from whom I hope never to buy a product from, uses the following repairing process: you have to create an account to submit your data and then when you try to login into the caretaker page the system announces that the account you created does not exist (I have tried several times, several days, both with mine and my wife email and personal data). Furthermore there is no way someone should take the telephone on cecotec.

Another step that failed is to ask the Spanish postal service to give me some option to try to send again the product from its current location, stopped expecting sender order, to Amazon Storage avoiding the product come back step: they informed me that they can not respond to my email because the privacy law forbid it, perhaps this is because the product was send with my wife name and address. I don't suppose the air conditioned system to have some personal information attached to it.

Buddishm says that you can learn from any experience and maybe the karma of this product is to never be repaired and the fate has decided to condemn the old lone woman to suffer the hot wave, perhaps to expire some past life bad karma.

Fortunately all that comes goes by, and in this case I am happy to be able affording to buy a new machine that produces cold air, so, kind reader, be quiet there is no real problem. Furthermore, this experience can expand my empathy: it could be that for some people life don't work as it should, for them this anecdote is the normal course of actions where one problem calls another. For those a stream of problems is the only repl. To those I, most sincerely, wish peace of mind and hope their fortune reverse.

In this anecdote or episode human intelligence is not producing correct results and that could create a hope: that those small LLM models enhanced with intelligent agents could provide better support.

Today, in my current mental state I envision that the contrary could occur: those system could convert the bad things that happens once into the bad things that happens every day. So be careful with what you wish.

My hope it is that the greatest agents, ourselves, get together to solve whatever problem we have to cope with. But don't fool yourself that require real human deep intelligence and human hard work.
by mensetmanusman | 2025-07-01 11:21:24+00:00
Temperature is one of the easiest things to measure.

We know the effect of urban heat islands, stations sitting issues, mercury to thermistors upgrade transitions, time of observation bias, etc.

What we do with this data is a political situation, as the world is in a cooling cycle globally: https://www.climate.gov/media/16817

We have the technology to mitigate all of this, but not a critical baseline of education in the population to make the necessary sacrifices.
by rwmj | 2025-07-01 11:21:53+00:00
A modern Meanwell power supply is simply going to be safer as well as far more efficient (and smaller!) Just make sure you get the polarity right.

This stackexchange question is quite good on how and why the 9VDC supply at the jack gets converted to 5V, 12V and -5V internally: https://retrocomputing.stackexchange.com/questions/2242/how-...
by wizzwizz4 | 2025-07-01 11:22:02+00:00
There are jailbreaks available for iOS 16.6.1 (released in 2023), and every iOS version prior to it. I count that as "recent", though I understand either way.

Recent versions of iOS have specific anti-jailbreak mechanisms (anti-downgrade mechanisms, ephemeral root filesystems) which don't provide general security, so they're sort of cheating. These mechanisms just mean it's harder to use the vulnerabilities for good, without significantly stymieing evil. (And they aren't wholly effective, seeing as 16.6.1 contains all of them, and it's still got a semi-untethered jailbreak.)
by PeterStuer | 2025-07-01 11:22:18+00:00
So:

1. Encourage fencing off everything by default to maximize need for bypass

2. Offer bypass through payment

3. Profit!

You wouldn't believe the number of public administrations with public information that have (mostly unwittingly) had some lazy contractor put Cloudflare in front of their entire site, blocking even their RSS feeds from M2M. Yes, you can send them mails and call and sometimes, if they even understand the problem, they will fix it after a few months just before the next cheapest contractor is hired and we start all over again.

Not saying Cloudflare is just an extortion racket, but it's getting closer by the day.
by ggm | 2025-07-01 11:22:54+00:00
Oldest being 1880s. It's not a Viking find, it's late period romanticism seeking to reinforce skandi culture.

Still fascinating. Imagine arguing for adoption of runes as the national alphabet.. "ok children the new national orthography board for England has come in, it's ogham" (yes I know, ogham is not runic)
by thedanbob | 2025-07-01 11:23:55+00:00
> I also had this idea to turn this into an IoT device that has 5 RGB lights and sits on your desk. It would light up when each friend you have delegated joins your Discord voice channel and you could customize the colour for each friend. If I get some traction I might turn it into a real product, so email me at my email address in my about page if that seems something you'd like.

Hah, I'm also building something like this for notification purposes. My wife's tablet sometimes doesn't show notifications and she's often not near her phone, so I ordered some ESP32's and LED boards[0]. Going to scatter them around the house and link them to a switch in Home Assistant so I can light them up if I need to get a hold of her. I'm planning a back-and-forth scan effect to make sure they're eye-catching, already named them Cylons.

[0] https://ae-pic-a1.aliexpress-media.com/kf/S9b244caf41934a5eb...
by spinlock_ | 2025-07-01 11:24:08+00:00
I noticed this "feature" after wondering why everyone was using "sie" instead of "du" while searching for reviews on reddit for a new graphics card I wanted to buy. This "shoving AI down your throat" is not just annoying, but also insulting and the accelerated enshittification of the web makes me sad. Thinking about "the good old days" also puts me in a state of nostalgia.
by samrus | 2025-07-01 11:24:48+00:00
We cant deny the LLM has utility. You cant eat the stone but the LLM can implement design patterns for example.

I think this insistance on near autonomous agents is setting the bar too high, which wouldnt be an issue if these companies werent then insisting that the bar is set just right.

These things understand language perfectly, theyve solved NLP because thats what they model extremely well. But agentic stuff is modelled by reinforcement learning and until thats in the foundation model itself (at the token prediction level) these things have no real understanding of state spaces being a recursive function of action spaces and such stuff. And they cant autonomously code or drive or manage a fund until they do
by mprovost | 2025-07-01 11:24:52+00:00
I chose clap as the argument parsing crate for my book on Rust CLI programming and it's been my biggest regret. Folk sometimes complain that Rust itself is a moving target but I haven't found that to be the case at all. On the other hand, clap has gone through several, incompatible major releases over the past few years. Unfortunately, in order to keep this forward momentum, it also starts deprecating things which means that I had to pin it to a quickly outdated version. If I ever go back and update the earlier chapters I'd pick a simpler, slower-moving library.

On the other hand, this situation is a great example of why keeping things like argument parsing out of the Rust standard library is such a good idea. It's much better to let the community gel around some crates which are able to iterate (and innovate) faster than something with strict backwards-compatibility requirements. Looking at the discussion here there's clearly not one way to solve this - there's no way that something as large and complex as clap has evolved into will ever become "standard".
by nullc | 2025-07-01 11:25:04+00:00
VN extrator is a specific case of a more general idea: When you independently (hard assumption of VN extractor) draw M times with N possibilities then you can extract entropy from their permutation.

Assign some scheme for converting permutations to an index.

Then get uniform bits out, maintain two variables: one is the product of the number of permutations, the other gets multiplied by the number of permutations and the index added. Whenever the number of possibilities is divisible by two, output the LSB of the index accumulator and halve the number of possibilities.

Size up your groups and accumulators and you can get arbitrarily high extraction rates.

Doing it efficiently and in constant time (e.g. without divisions) is the more exciting trick. A colleague and I managed an extractor for the binary case that packs takes 10+3N multiplies and N CTZs to pack N bits (giving an exact invertible encoding when bits choose ones is < 2^64).
by info_manews | 2025-07-01 11:25:30+00:00
Hey HN,

I'm sharing a resource that's been a game-changer for my own data workflows, and I believe it can be for many of you too. If you're a Python developer, data scientist, or ML engineer, you know the pain: endless hours spent on data cleaning, wrangling, and exploratory data analysis. It's critical, but it often feels like a massive time sink.

My colleague, Dr. Musa Abdulkareem (PhD in AI, 15+ years experience building scalable systems), has compiled "50 Expert-Level ChatGPT Prompts for Python Data Cleaning & EDA Automation." This isn't a theoretical guide; it's a practical toolkit designed to let AI write production-ready Python code for complex data tasks.

Why I think this is valuable for the HN community:

• Real-world problems solved: Prompts cover everything from advanced missing data imputation and outlier detection to time series analysis, NLP, and MLOps integration. These are the problems we face daily.

• Production-ready code: The focus is on generating robust, reliable Python code suitable for deployment, not just quick scripts.

• Massive time savings: The promise is 10-20 hours saved per week on repetitive coding. Imagine what you could build with that reclaimed time.

• Leveraging LLMs effectively: It shows how to move beyond basic ChatGPT interactions to truly expert-level prompt engineering for data automation.

I've personally seen the impact of these techniques on efficiency and scalability. It's about working smarter, not harder, and letting AI handle the heavy lifting of data preparation.

I've written a more detailed breakdown of what's inside and why it's so powerful on my blog. You can read about it and get your copy here:

https://shop.corelinkai.com/blog/news/stop-drowning-in-dirty...

Looking forward to any thoughts or questions from the community. How are you all leveraging AI for data automation?
by imiric | 2025-07-01 11:25:33+00:00
This should be the standard business model on the web, instead of the advertising middlemen that have corrupted all our media, and the adtech that exploits our data in perpetuity. All of which is also serving to spread propaganda, corrupt democratic processes, and cause the sociopolitical unrest we've seen in the last decade+. I hope that decades from now we can accept how insidious all of this is, and prosecute and regulate these companies just like we did with Big Tobacco.

Brave's BAT is also a good attempt at fixing this, but x402 seems like a more generic solution. It's a shame that neither has any chance of gaining traction, partly because of the cryptocurrency stigma, and partly because of adtech's tight grip on the current web.
by mike_hearn | 2025-07-01 11:26:43+00:00
I wonder if NVIDIA are worried about how concentrated their AI customer base is. The paper is more like a personal blog post than a scientific investigation.

Anyway really love the idea but many years of experience with decentralization / security / privacy projects makes me think it probably won't happen. Their description of how to incorporate SLMs at the end gives the game away: it's a description of a large, complex project that requires fairly good data science skills e.g. they just casually suggest you autoclean the data of PII then run unsupervised clustering over the results to prepare data for model fine tuning using QLoRA, and then set up an automated pipeline to do this continuously. Sure. We'll get right on that.

The history of computing is pretty simple: given a choice between spending more on hardware or more on developers, we always prefer more hardware. For NVIDIA this is a good thing modulo the fact that nobody buys their hardware directly because it's too overpowered. But that's the way they've chosen to segment the market. Given a choice between using a sledgehammer to crack a nut, or to make a custom hammer for nut cracking, we're gonna spend the money on outsourced LLMs every time.

Naturally, perhaps in future LLMs will create these SLM factories for us! If you assume software is mostly written by LLMs in future then past experience about expressed preference of software teams might not apply. But we're not there yet.
by carlosjobim | 2025-07-01 11:27:51+00:00
> In order to get a vaguely usable stock YouTube, you need to install at least UBlock, SponsorBlock, No Translation, and arguably DeArrow as well.

UBlock: Solved by using YouTube Premium

SponsorBlock: Solved by not watching low-quality channels with sponsors. Also YouTube has started rolling out their own version of SponsorBlock to skip these segments.

No Translation: Yeah, this is a pain in stock YouTube

DeArrow: Why would I want clickbait thumbnails and titles fixed? Those are perfect indicators of a low quality video to not click.

> Same goes for Windows

Sure does. People who want a nice experience get a Mac, which is somewhat equivalent to paying for YouTube Premium.

> GrayJay

Can't install it on a Roku or on Apple TV. YouTube Premium is still the best option for TV watching.
by samrus | 2025-07-01 11:28:25+00:00
Its definitely not there yet. You have to babysit it alot. Its not autonomous.

The utility i find is that it helps _me_ do the real engineering work, the planning and solution architechting, and then can bang out code once it has rock solid instructions (in natural language but honestly one level above psuedocode) and then i have to review it with absolutely zero faith in its ability to do things. Then it can work well.

But its not where these guys are claiming it is
by nullc | 2025-07-01 11:29:58+00:00
Why does any additional encryption need to be broken? Signal dark patterns users into using insecure few digit 'pins' to protect their data, then waves some SGX hokum around that as an argument as to why very short pins have acceptable security. Of course, no one with physical access / state level resources is meaningfully impaired by SGX, so the security is just a trivial pin crackable by a speak and spell.

Concerns that were all dismissed when the insecure pin system was introduced because only contacts and settings were hosted, not content. ...

It's already known that users can't choose secure passwords even without UI that tries hard to encourage an insecure choice and that the rare ones that are secure are the ones that also get lost/forgotten. As a cryptosystem "user chooses and remembers a key" is known to be broken. So backup to the cloud really just means "hand to NSA with already known broken encryption".