MurphyA/hacker-news huggingface dataset:
by ndiddy | 2025-05-26 19:17:10+00:00
This isn't true, Marginalia Search has a crawler. The guy who runs the site writes a lot about the trials and tribulations of running a web crawler on his blog if you're interested. https://www.marginalia.nu/log/ I just checked and my site is listed despite me never manually submitting it. I guess if nobody links to your site, you would have to manually submit it due to it not showing up in crawls, but that's true about any search engine.
by jdbs_alter_ego | 2025-05-26 19:17:30+00:00
Ah, there it is. As a long-time Pi lore aficionado (is there such a thing? or am I just obsessed with a company that the CEO amusingly describes as "the other fruit computer company"?) in any thread that gets traction there's inevitably a screed posted along these lines:

* "I'm mad because there's not an open source hardware/software/gpu/schematics/BOM" so I can't hypothetically make a clone of it

* If (1) above is not the motivation, then it's because there's some specific use-case that doesn't work that the rage-post precipitates, and crucially - includes zero links to bug reports or a log of efforts that the OP has attempted

* "All the designers are idiots because minor fault X is indicative of systemic failure Y" - with no supporting evidence

* General assertions that all these faults are catastrophic and should bankrupt the company (often conflated with the Foundation, which is a completely separate legal entity)

There's been about 80 million units sold so far. They must be doing something right.

Disclaimer: I own RPI.L stock. It's one of the few tech stocks on the LSE that have actually performed OK and not tanked since IPO.
by KaiserPro | 2025-05-26 19:19:21+00:00
So on the one hand I am sympathetic. On the otherhand, I'm also pretty sure cloudflare won't take down pirated stuff, so what do they expect?

I don't like the way that large football conglomerates abuse copyright, but then those same rules _should_ be open to me for anything I produce. The main difference is I don't have a team of lawyers.
by bird0861 | 2025-05-26 19:19:26+00:00
I would put myself in the 100x camp but my start in AI (and programming) was symbolic approaches in lisp/scheme, then I put that away for about a decade and got into NLP and then got into question answering and search/information retrieval. I have read probably at least 20 papers on LLMs a week every week since December 2022. So I have some familiarity with the domain but I also would not exactly call myself an expert on LLMs. However, I would say I am confident I mostly understand what is required for good results.

Getting the best possible results requires: - an LLM trained to have the "features" (in the ML/DL sense of the word) required to follow instructions to complete your task - an application that manages the context window of the LLM - strategically stuffing the context window with preferences/conventions, design information, documentation, examples, your git repo's repo map, and make sure you actually use rules and conventions files for projects. Do not assume the LLM will be able to retrieve or conjure up all of that for you. Treat it like a junior dev and lead it down the path you want it to take. It is true, there is a bit of micromanagement required but Aider makes that very very simple to do. Aider even makes it possible to scrape a docs page to markdown for use by the LLM. Hooking up an LLM to search is a great way to stuff the context window BTW, makes things much simpler. You can use the Perplexity API with Aider and quickly write project plans and fetch necessary docs quickly this way; just turn that into markdown files you'll load up later after you switch models to a proper code gen model. Assume that you may end up editing some code yourself, Aider makes launching your editor easy though.

This mostly just works. For fun the first thing I did with Aider was to write a TUI chat interface for ollama and I had something I could post to github in about an hour or two.

I really think Aider is the missing ingredient for most people. I have used it to generate documentation for projects I wrote by hand, I have used it to generate code (in one of my choice languages) for projects written in a language I didn't like. It's my new favorite video game.

Join the Aider discord, read the docs, and start using it with Gemini and Sonnet. If you want local, there's more to that than what I'm willing to type in a comment here but long story short you also need to make a series of correct decisions to get good results from local but I do it on my RTX4090 just fine.

I am not a contributor or author of Aider, I'm just a fanatical user and devotee to its way of doing things.
by pixl97 | 2025-05-26 19:20:19+00:00
> it doesn't generate a neat sounding paragraph "explaining" why candidate A is the obvious choice.

Here I will argue that humans do the same thing. For any business of any size recruitment has been pretty awful in recent history. The end user, that is the manager the employee will be hired under is typically a later step after a lot of other filters, some automated some not.

At the end of the day the only way is to measure the results. Do LLMs produce better hiring results than some outside group?

Also, LLMs seem very good at medical pre-diagnosis. If you accurately portray your symptoms to them they come back with a decent list of possible candidates. In barbaric nations like the US where medical care can easily lead to bankruptcy people are going to use it as a filter to determine if they should go in for a visit.
by codr7 | 2025-05-26 19:20:22+00:00
If you're going to drag Linus and Stallman into this, at least read up on your history. A commercial Unix or Lisp Machine was quite a bit more expensive than $15/month. They both got shafted by companies that couldn't care less about anything beyond profit. It's part of the ugly side of capitalism, fuck people and fuck the world.
by baby | 2025-05-26 19:20:33+00:00
This is so crazy, this happened not far from my place and we saw a lot of cops around, even crazier some people broke into my building 3 days after the kidnapping looking for a "john", even crazieeeer I had coffee with this john (the kidnapper) in 2019 in SF. He seemed a bit odd but overall nice, kind of like a blackhat that had found a job on the other side (he was doing security for a crypto project called grin).

Most likely this is not your typical kidnapping, I would bet that they knew each other and that there's something else at play. Also the apartment he was staying at is $75k/month rent, that's insane...
by skydhash | 2025-05-26 19:21:06+00:00
> AIs might really get good enough that none of us write code anymore, in the same way that it's quite rare to write assembly code now.

I don't have much hope for that, because the move from assembly to higher level programming languages is a result of finding patterns that are highly deterministic. It's the same as metaprogramming currently. It's not much about writing the code to solve a problem, but to find the hidden mechanism behind a common class of problems and then solve that instead. Then it becomes easier to solve each problem inside the class. LLMs are not reliable for that.

> 2. We're still writing, editing, and debugging code artifacts, but with much better tools.

I'd put a lot more weight on that, but we've already have a lot of tooling that we don't even use (or replicate across software ecosystems). I'd care much more about a nice debugger for go than LLMs tooling. Or a modern smalltalk.

But as you point out, the issue is not tooling. It's understanding. And LLMs can't help with anything if you're not improving that.

[0]: https://lisp-docs.github.io/cl-language-reference/chap-6/g-c...
by SXX | 2025-05-26 19:21:19+00:00
Free tier that let you hide your server IPs, cheap domain registry (with no margin) and even some also tunnels for zero trust. Like I used them for a lot of personal and tbh even commercial projects for years paying them $0. Also they have bandidth alliance with Backblaze so you can serve 100s of TBs for free.

So there a lot of convinience and free stuff. It's quite obviously that when I had commercial customers where for whatever reason free tier wasn't anough I juse used them as well. Why not? There are horror stories about their corporate pricing, but for smaller company paying $20-200 for CDN is no brainer.

Also huge massive advantage of CloudFlare is that majority of their services are not metered so it's hard to wake up to $100,000 bill like it can happen with AWS and almost any other CDN provider.

I still believe this kind of centralized MiTM is bad for us all, but honestly I'd rather it be CloudFlare than Amazon, Microsoft or some other "evil corp".
by swanYC | 2025-05-26 19:22:16+00:00
For a detailed discussion on features and usage, which may be beyond the scope of HN, please email us at contact@heynomi.com.

Our standard approach is to first confirm mutual fit, then run a pilot to ensure an increase in your deal closure rate and adoption in your team. Only after that, we will move toward the established pricing based on your usage, and critical feature needs.
by ujkhsjkdhf234 | 2025-05-26 19:22:18+00:00
It isn't even about that. Tiktok is taking market share from FAANGs. Zuckerberg has spent a pretty penny on this Tiktok disinformation campaign and if you look at the members of Congress behind the ban Tiktok bill, most of them purchased huge amounts of Meta stock before introducing it to Congress. It's corruption all the way down.
Show HN: Emalias.app – a free online email privacy toolkit
by pippin_mole | 2025-05-26 19:22:24+00:00
This project started basically because I got loads of spam from random Gmail addresses, and I wanted to answer the question: 'how are they getting a hold of my e-mail'. My e-mail address is pretty unique and not very easy to guess.

That's what led me to build emalias.app - a service which allows you to create individual e-mail addresses (such as ebay@emalias.app), which forward to your real inbox. This concept completely hides your primary e-mail address, and gives you great oversight over which services are selling your data to third-party advertisers. If a certain alias starts receiving spam, you know exactly who gave your information away, and you can deactivate it.

This project started off as an undergraduate university dissertation, and I chose to build on it more and more, as it provides real value to users. Currently, the free tier provides 50 aliases, which is way more than most other aliasing services. I won't be reducing this limit ever. I've also got some great features which I'll be adding to the free tier too.

I'd love to hear feedback on the project. The project is built using Next.js, Postgres, DigitalOcean, Golang, Docker and Postfix. I'm happy to answer questions :)
by bigyabai | 2025-05-26 19:22:25+00:00
I'd take anything Luke Smith says with a grain of salt. He's well-spoken and prolific, but watching through his older stuff I always got the sense he was profoundly unwell. Especially his livestreams, which were pretty obviously (if not deliberately) invaded by the /g/ types who harassed him into religious diatribes and political witch-hunts. What would be relatively insightful content is ruined by unrelated digression, to the point that he makes Louis Rossmann appear calm and collected by comparison.

Normally I detest ad-hominem debasement, but Smith has stretched his credibility too thin over too long a period of time.
by LatteLazy | 2025-05-26 19:22:26+00:00
This reminds me of the way Scottish banks used to issue their own notes independently (they still issue them now but are required to have Bank of England notes of equivalent value in storage)

They were not legally currency (or legal tender) but acted as such. It if a bank was viewed to be in trouble its notes would start trading at a discount.

Effectively it was a free market for currency issuance. Which I guess this would be too?
by Retric | 2025-05-26 19:22:32+00:00
If it’s just a savings account, that’s not a pension.

Assuming it’s a defined benefit pension it can include guarantees like inflation adjustments. That’s the fundamental advantage which largely offsets the disadvantage of lower average returns.

I’m not saying putting all your money into a defined benefit plan is ideal, but due to the diminishing marginal utility of money a guaranteed minimum lifestyle is extraordinarily valuable.
by xnickb | 2025-05-26 19:22:35+00:00
Very interesting.

For me the key point in such projects is always handling of distributed queries. It's exciting that pgDog tries to stay transparent/compatible while operating on the network layer.

Of course the limitations that are mentioned in the docs are expected and will require trade-offs. I'm very curious to see how you will handle this. If there is any ongoing discussion on the topic, I'd be happy to follow and maybe even share ideas.

Good luck!
by araes | 2025-05-26 19:22:37+00:00
Decent number of folks are posting stuff related. Another one that's related that takes a bit of reading to get to is the Reuters article that tipped off a lot of this type of investigation back in 2022.

The website was a supposed soccer fan website, Iraniangoals.com, and it was (opinion) criminally badly designed. Type in a search bar request and it's really your password, that then goes right to a secret messaging app...

> Marczak and Edwards quickly discovered that the secret messaging window hidden inside Iraniangoals.com could be spotted by simply right-clicking on the page to bring up the website’s coding. This code contained descriptions of secret functions, including the words “message” and “compose” – easily found clues that a messaging capability had been built into the site. The coding for the search bar that triggered the secret messaging software was labeled “password.”

https://www.reuters.com/investigates/special-report/usa-spie... America’s Throwaway Spies, Joel Schectman, Bozorgmehr Sharafedin, Corinne Perkins, John Emerson, Marla Dickerson, Ronnie Greene, and Kieran Murray
by ChrisSD | 2025-05-26 19:22:52+00:00
More or less, yes. It is guaranteed that tier 2 at least builds so they'll be a nightly available every day though it's possible they might have a serious bug. To be honest though that's always a risk for nightlies even with tier 1 targets. Tests don't catch every potential problem (even if they do catch a lot) which is why there is a beta period before a release.
by ttoinou | 2025-05-26 19:23:15+00:00
32k CHF / year in Bern, the LLM must have made a mistake (:

If I understand correctly, the best course of action would be to be able to tick / untick exactly what the LLM knows about ourself for each query : general provider memory ON/OFF, past queries ON/OFF, official application OneDrive ON/OFF, each "Connectors" like GitHub ON/OFF, etc. Whether this applies to Provider = OpenAI or Anthropic or Google etc. This "exploit" is so easy to find, it's obvious if we know what the LLM has access to or not.

Then fine tune that to different repositories. We need hard check on MCP inputs that are enforced in software and not through LLMs vague description
by davidcox143 | 2025-05-26 19:24:06+00:00
I've been using Nix and NixOS since 2022. I can't imagine not using Nix at this point and agree that the reputation for "being too hard" is not quite accurate. Nix is different - that's the point.

The learning curve is a thing, although I'd argue that it's nowhere near as steep as the tools many of us use every day (C++, Rust, AWS/GCP, etc.)

Nix's "difficulty" IMO comes from defaults that are not sane and a split community. For example, if you use the official Nix installer, flakes are not enabled by default (despite being widely used [1]), but they are if you use the Determinate Systems Nix installer.

Flakes are realistically the only way to obtain the benefits that motivate learning Nix (deterministic pure builds, fine-grained control over dependencies) and are the "primary driver of Nix's adoption" [2]. AFIK there isn't a viable alternative to flakes other than maybe atoms [3], which are relatively new (like "lock files are totally hand made" new [4]). Yet, the official Nix stance on flakes is to wait... for... what?

For a day-in-the-life look at more of Nix's rough edges, I posted some rambles here [5].

[1] https://x.com/d4r5c2/status/1896415101386928539 [2] https://x.com/grhmc/status/1896551138104844389 [3] https://x.com/nrdexp/status/1925892763301695978 [4] https://x.com/nrdexp/status/1925707692447871283 [5] https://youtu.be/TwVamLq5OHY
by magicalhippo | 2025-05-26 19:24:44+00:00
The introduction seems quite clear on it being an alternative to H.264 and friends:

Traditional video codecs like H.264 and H.265 achieve impressive compression by discarding "imperceptible" visual information. But what if we could guarantee perfect reconstruction while still achieving meaningful compression? This project explores an unconventional approach: repurposing Bloom filters—typically used for membership testing—as a lossless video compression mechanism.

Further down comes the explanation for why this scheme might possibly work:

Rather than compressing whole video frames, this system applies Bloom filter compression to frame differences. This capitalizes on temporal coherence—most pixels change little (or not at all) between consecutive frames, creating a sparse difference matrix ideal for this approach.

Of course, using delta-frame compression has been a common theme of many video codecs for ages now, and many like H.264 and H.265 use additional techniques like motion estimation[1] to reduce the information in the delta frame further before final entropy coding step[2][3].

As such, the best is probably to view this as an alternative to the entropy encoding in H.264 or similar.

[1]: https://en.wikipedia.org/wiki/Motion_estimation#Video_coding

[2]: https://en.wikipedia.org/wiki/Context-adaptive_variable-leng...

[3]: https://en.wikipedia.org/wiki/High_Efficiency_Video_Coding#E...
by mrmdp | 2025-05-26 19:24:57+00:00
Chomsky has the ability to say things in a way that most laypersons of average intelligence can grasp. That is an important skill for communication of one's thoughts to the general populace.

Many of the comments herein lack that feature and seem to convey that the author might be full of him(her)self.

Also, some of the comment are a bit pejorative.
by globie | 2025-05-26 19:25:00+00:00
If you have a single server flooding spoofed traffic, it appears as a DDoS to the victim. It's at this point that the distinction between DoS/DDoS breaks down slightly.

It is very much not "trivial" to buy 100Gbps+ of DDoS. I'm highly confident the majority of D/DoS attacks are from single servers, because it works. If you have a 10Gbit server and your target has 1Gbit (or you 1Gbit and them 100Mbit, it still happens), it's not a question of if you can take the target down, but how long you can sustain that traffic level before your upstream notices.

Painting every D/DoS as the most bandwidth ever is a play out of Cloudflare's marketing. If every website operator knew that 1, you don't need that much bigger of a pipe, and 2, you shouldn't buy pipes that charge you $20+/TB like AWS anyway, then Cloudflare would have a much harder time selling you a downgrade in quality, and we would have faster and cheaper networks to boot.
by leoc | 2025-05-26 19:25:08+00:00
I've never had the pleasure of experiencing DuoLingo myself, but by all accounts it's an exceptionally time-inefficient way of learning a language. If the objective is to have fun playing a buzzy mobile game with the rest of the world then whatever, but if you actually want to make progress in a language you'd be much better advised to head over to something like Refold https://refold.la/ or Dreaming Spanish https://www.dreamingspanish.com/ . Even if you simply must have a phone app which does everything for you, you'd probably do better with something like Busuu https://www.busuu.com or Glossika https://ai.glossika.com/ .

So the AI furore is a bit ironic: people profess to hate "bullshit jobs", but if anything is a bullshit job it's probably providing the manpower for a language-learning app which doesn't actually teach languages effectively. Replacing mechanical-Turk slop with AI slop probably is a genuine productivity gain unleashed by AI here, yes? OTOH a drop in subscriber numbers and total user-hours is probably a good thing too, so don't let any of this put you off from giving up on DuoLingo.
by amsilprotag | 2025-05-26 19:25:26+00:00
Maybe you are right that I give too much benefit of the doubt. I have been following the saga and I believe the AI turn was a bad move on every level. That's why I stopped using the app. But I can still believe that the CEO doesn't want to ship the cluttered garbage that is the present app. I think the pop-ups are a net-negative even purely financially with churn outweighing subscriptions. So my model for the situation is that he spent his credibility on AI, which was bad, and now doesn't have the credibility to spend to change the metrics that guide every team's behavior, so the company decays entropically. Maybe the clutter comes from the CEO trying to up subscriptions, but based on the first 10 years of the app, I believe he has better taste than to do that, so I look for a more complex explanation. Again, may be giving too much benefit of the doubt.

[edit: thinking about it more, I think I have built up a lot of goodwill with the app over the years, and it's a strange mental process for years of goodwill to evaporate over the course of a few weeks]
by manbitesdog | 2025-05-26 19:25:31+00:00
OMIWORD.com ⬛⬛⬛⬛⬛⬛⬛ ⬛⬜⬜⬜⬜⬜⬛ ⬛⬜⬛⬛⬛⬜⬛ ⬛⬜⬛⬛⬛⬜⬛ ⬛⬜⬛⬛⬛⬜⬛ ⬛⬜⬜⬜⬜⬜⬛ ⬛⬛⬛⬛⬛⬛⬛ Solved #146 (Easy) Time spent: 01:17 29 moves • 0 hints
by andrewstuart | 2025-05-26 19:25:33+00:00
>> Instead of being in a landfill and leaching microplastics

I want plastic to be in landfill leaching microplastics.

The idea of storing all waste plastic in warehouses is impractical, it has to go somewhere.

Where do you want it leached to, if not into the contained area of a landfill? Do you want it somewhere in the environment?

And I’m pretty sure landfills are toxic anyway.
by zdragnar | 2025-05-26 19:25:36+00:00
In the case of language learning, the external motivation provided by gamification is supplanted by the external motivation of having access to conversations, music, movies and literature that you previously didn't have access to, or required third party interpretation to appreciate. Being able to converse directly is a massive boon in the right situations, such as when travelling where you need to know the language to get around, or when your coworkers natively speak that language but not your own.

Discipline is well and good, and if you're willing to put in the effort to become better disciplined to push through difficult things, I agree that you're probably better off. I do not agree that someone who already has that level of discipline would be hurt by a gamified system, though. The rewards of gamification on their own are fairly minimal, as they merely provide a (possibly false) sense of progress independent of their own assessment of how they are doing.
by michelpp | 2025-05-26 19:25:45+00:00
FRENCH GUARD: You don't frighten us, English pig-dogs! Go and boil your bottom, sons of a silly person. I blow my nose at you, so-called Arthur King, you and all your silly English k-nnnnniggets. Thpppppt! Thppt! Thppt!

GALAHAD: What a strange person.