MurphyA/hacker-news huggingface dataset:
by AnthonyMouse | 2025-11-05 00:55:19+00:00
> even while finding, in some of those and other cases, that pirating to get copies to then use in training is not

I still don't get this one. It seems like they've made a ruling with a dependency on itself without noticing.

Suppose you and some of your friends each have some books, all legally acquired. You get them together and scan them and do your training. This is the thing they're saying is fair use, right? You're getting together for the common enterprise of training this AI model on your lawfully acquired books.

Now suppose one of your friends is in Texas and you're in California, so you do it over the internet. Making a fair use copy is not piracy, right? So you're not making a "pirated copy", you're making a fair use copy.

They recognize that one being fair use has something to do with the other one being, but then ignore the symmetry. It's like they hear the words "file sharing" and refuse to allow it to be associated with something lawful.
by nullhole | 2025-11-05 00:56:57+00:00
Don't have much to add except to mention again that the magic number for TIF is 42, and it's 42 because of the meaning of 42:

https://web.archive.org/web/20210108174645/https://www.adobe...

Bytes 2-3 An arbitrary but carefully chosen number (42) that further identifies the file as a TIFF file
by epolanski | 2025-11-05 00:57:02+00:00
I can discriminate you because it's you. I don't like you and I don't want to do business with you. End of story.

It's your problem to prove that it was racially or religiously motivated or something.

It's not a strong statement it's a fact.

You cannot force anybody to do business with you. Not me, can't force my brother, can't force my mother's laundry to have you as client.

Guess what? I can't force other companies to do business with me too! I can't force a lawyer to have me as a client, nor I can force a bank, nor an insurance.

Do you know how many countless "no"s companies I worked in got?

API companies unwilling to have us as clients because too small. Wanting to open the wallet? Not enough if we can't prove we can't ramp it up fast.

What could we do? Nothing.

Stripe or other payment processors can notoriously deny you services without owning you any explanation.

You just can't. Business is about trading and I can't be forced to trade with those I don't want to, nor they can be if they don't want me, for whatever reason (unless discrimination can be proven).

The only businesses that most laws force to offer a service are public utilities and even then, I can guarantee you 100%, that even banks if they don't want you as a client, even if they are among the few businesses that have, they still won't have you and rather drag this through courts and then maliciously comply to the point of effectively being unbanked.
by vincenthwt | 2025-11-05 00:57:40+00:00
You're absolutely right, deep learning OCR often delivers better results for complex tasks like handwriting or noisy text. It uses advanced models like CNNs or CRNNs to learn patterns from large datasets, making it highly versatile in challenging scenarios.

However, if I can’t understand the system, how can I debug it if there are any issues? Part of an engineer's job is to understand the system they’re working with, and deep learning models often act as a "black box," which makes this difficult.

Debugging issues in these systems can be a major challenge. It often requires specialized tools like saliency maps or attention visualizations, analyzing training data for problems, and sometimes retraining the entire model. This process is not only time-consuming but also may not guarantee clear answers.
by canada_dry | 2025-11-05 00:57:58+00:00
A way to select all (or by Q/A paragraph) for export (e.g. to pdf or how about a .ipynb) would probably be the most useful. Perhaps as just a plain "export" option in addition to an analysis/insights summary.

p.s. kudos on the promo code that enable folks to kick the tires with as little friction as possible.
by swyx | 2025-11-05 00:58:24+00:00
we obviously agree but one of the problems i had with onboarding as a key proposition is that onboarding "seems" like a onetime problem. i lacked the datapoints or anecdotes to convincingly pitch "onboarding = context switching", a more recurring problem as the size of your team and size of your codebase and size of your tenure grows, even if its technically the same codebase, you're "always" onboarding to wahtever it is you're working on or maintaining or putting out fires.
by tho423i43344324 | 2025-11-05 00:58:35+00:00
Unsurprising.

India, which given its colonial-era ruling-elites who are maniacally obsessed with the Anglosphere, is today considered a "laboratory" for doing social experiments that'd be considered a outrage against human dignity in their own countries. This country was the first in line not only the biometric identification projects (Aadhar), and for demonetization (of 2016 with UPI). All of these were funded and pushed by USAID.

Both of these were implemented by running roughshod over constitution and regulation, by "roping-in" key regulatory people by giving them what they desire the most - access to the ruling elites in the US. Eg. Infosys' Nandan Nilekani was thrust to the top with his USAID funded projects.

Now the results of this "human corralling" experiments (note: a lot of what Orwell described came out of his experience in British-colonial India), is now coming to the West.
by fragmede | 2025-11-05 00:59:09+00:00
> randomized clinical trials

The problem; the circle that needs to be squared but seems impossible to, is that it seems impossible to establish a good control group for certain drugs, eg MDMA. It is extremely obvious during trials as to who got the drug and who got the sugar pill.Testing does show that MDMA works, but showing that it does, to a rigorous scientific standard, with an acceptable control group has proved difficult. Funding is but one issue.
by stanfordkid | 2025-11-05 01:00:04+00:00
In my opinion the whole agents.txt thing is bullshit and/or politeness, and should have zero legal significance.

If something is openly available on the internet you should be able to crawl it, and it is the server's responsibility to identify, authenticate and/or ban clients that do not adhere to it's requirements. If Amazon states "You must not use agents" in it's website terms of service then it would be the individual perplexity user not perplexity itself that is breaking it's terms of service, since they are the one operating the agent.

All in all lame move by Amazon.
by soraminazuki | 2025-11-05 01:01:21+00:00
> Free content would win out over paid content regardless of quality.

Quality has never been synonymous with monetization for as long as I can remember. The primary driver of low quality or harmful content is greed. Guess what fuels the most greed in modern society?

> A search engine which prioritizes free content over paid would become nothing but a propaganda engine.

Are you suggesting that including Twitter in search results would mitigate propaganda?
by gjm11 | 2025-11-05 01:02:28+00:00
What looks like the relevant table has a summary line saying "geometric mean: 1.45x" so I think that in this case "45% slower" means "times are 1.45x as long".

(I think I would generally use "x% slower" to mean "slower by a factor of 1+x/100", and "x% faster" to mean "faster by a factor of 1+x/100", so "x% slower" and "x% faster" are not inverses, you can perfectly well be 300% faster or 300% slower, etc. I less confidently think that this is how most people use such language.)
by yawaramin | 2025-11-05 01:03:14+00:00
Yes, and the htmx philosophy is that it gives you some default functionality out of the box, it doesn't just hand you a bunch of building blocks and ask you to put everything together yourself. Both are valid approaches. I don't know why one side always has to come in and try to put down the other. Without htmx, there is no Datastar.
by defrost | 2025-11-05 01:04:24+00:00
It's more like stating that Margaret Thatcher knew what her son was up to and could have stopped him had she wanted to.

It's exactly embracing the notion that five eyes track the volumes of their arms sales and are indiffeent to their arms being used to kill children, civilians, etc. as long as they're not being stockpiled for use against the originating nation in any significant volume.

I'd suggest that Russia is less adept here than the US or the UK if they're being harmed by thir own supply.
by linohh | 2025-11-05 01:05:09+00:00
I've been in banking for quite some time of my life and hands down, there is no country in the world that makes bankers with let's say questionable skills in risk assessment and decision making more afraid. Millions in fines, maybe more? Zero fucks given. Messing with regulators in Singapore? Not worth it. Wouldn't be surprised if they send or have sent people out to tell the somewhat gory stories of the canings in Singapore.

Personally, I don't believe in preventive effects of draconian punishment, but I also don't believe in cokeheads. Being a cokehead in Singapore means risking facing the mandatory death sentence for posession of more than 30g of cocaine, which depending on the habit is a months supply max for some.
by bigiain | 2025-11-05 01:05:59+00:00
> static analysis tools that produce flowcharts and diagrams like this have existed since antiquity

Today I am apparently on of xkcd's "Lucky 10,000".

Does anyone have any recommendations for such tools? Ideally open source, but that's not a hard requirement. (Although "Enterprise - if you have to ask the price you can't afford it" options will not work for me.)

I'm particularity interested tools that work with Python, Java, and Javascript (Angular flavoured Javascript, it if matters)?
by ggm | 2025-11-05 01:06:30+00:00
I don't disagree with the tone of this but I think people need to understand the limits of what "make async/concurrency easier" means. It means being a LOT smarter about logical flows, and assumptions about pipeline ordering over your data streams for one thing.

If you have single entry bottlenecks, your concurrency will maximise the length of the queue on that backlog very quickly. I've hit this several times.

Sometimes the easier path is to shard input data and use heavyweight processes and then re-order/sort/insert at the end, when all is said and done. Easier means more comprehensible. If you can make it do random order insert into the final state then sure, async/concurrent processing of the easy stuff from input can be a dream.

I think I live in a very stone-age world. my primary data source is logfiles and pcap sources. They tend to be linear inputs.
by hombre_fatal | 2025-11-05 01:07:23+00:00
You haven’t made a case for why free content should be more important than relevance.

If the search engine orders by relevance, than I can make the decision for myself of where to trade-off with paywalls.

I don’t want a search engine to make the decision for me because it cannot: what if the only answer to my question is behind a paywall?
by koito17 | 2025-11-05 01:07:38+00:00
On this site, I've seen these kind of takes repeatedly over the past years, so I went ahead and built a little forum that consists of a single Rust binary and SQLite. The binary runs on a Mac Mini in my bedroom with Cloudflare tunnels. I get continuous backups with Litestream, and testing backups is as trivial as running `litestream restore` on my development machine and then running the binary.

Despite some pages issuing up to 8 database queries, I haven't seen responses take more than about 4 - 5 ms to generate. Since I have 16 GB of RAM to spare, I just let SQLite mmap the whole the database and store temp tables in RAM. I can further optimize the backend by e.g. replacing Tera with Askama and optimizing the SQL queries, but the easiest win for latency is to just run the binary in a VPS close to my users. However, the current setup works so well that I just see no point to changing what little "infrastructure" I've built. The other cool thing is the fact that the backend + litestream uses at most ~64 MB of RAM. Plenty of compute and RAM to spare.

It's also neat being able to allocate a few cores on the same machine to run self-hosted GitHub actions, so you can have the same machine doing CI checks, rebuilding the binary, and restarting the service. Turns out the base model M4 is really fast at compiling code compared to just about every single cloud computer I've ever used at previous jobs.
by anotherevan | 2025-11-05 01:08:02+00:00
Hmmm, I think you have to figure out how to do your database backups anyway as trying to get a restorable backup out of RDS to use on another provider seems to be a difficult task.

Backups that are stored with the same provider are good, providing the provider is reliable as a whole.

(Currently going through the disaster recovery exercise of, "What if AWS decided they didn't like us and nuked our account from orbit.")
by jand | 2025-11-05 01:08:31+00:00
This becomes much clearer with a balance sheet in front of you.

What is saving? _Spending less_, that's all. Saving generates no income, it makes you go broke slower.

Independent of the price or the product, you can never save more than factor 1.0 (or 100%).

Wasn't there a guy on TV who wanted to make prices go down 1500%? Same BS, different flavor.
by nexle | 2025-11-05 01:08:34+00:00
> Singapore is an odd country

The reason you find it odd is because you really can't find another country that the citizen have such a high trust towards the government and let the government do (almost) anything they wanted, yet the government doesn't abuse this power (mostly, at least) and continue focus on long term benefits of the country (rather than short term gains because the political party need to survive the next election in few years time)

> One of the most militarized countries (#3 by military spending per capita) in the world, yet their military has barely been used.

Ther reason is quite simple: Singapore is a very small country and it is very easily to be invaded. The high military spending is more of a deterent.

> What would you even call their socioeconomic system?

It is very much a free market capitalism with some state intervention, similar to many other countries. If anything, I would say Singapore is more free market than many western countries due to the fact that the government is very pro-business as the country is heavily rely on foreign businesses to survive.
by bloppe | 2025-11-05 01:09:06+00:00
There's a reason Java applets got deprecated in every browser. The runtime was inherently insecure. It just doesn't work for the web.

Also, targeting the JVM forces you to accept garbage collection, class-based OO and lots of pointer chasing. It's not a good target for most languages.

Java's pretty good, but wasm is actually a game changer.
by dahart | 2025-11-05 01:09:13+00:00
Still not seeing why you claimed color is definitely not something you can plug into a 3D model. We can, and do, use 3D color models, of course. And some of them are designed to try to be closer to perceptual in nature, such as the LAB space like @zeroq mentioned at the top of this sub-thread. No well known perceptual color space I know of, and no color space in Photoshop, accounts for context/surround/background, so I don’t understand your claim about Photoshop immediately after talking about the surround problem, but FWIW everyone here knows that RGB is not a perceptual color space and doesn’t have a specification or standard, and everyone here knows that color spaces don’t solve all perceptual problems.

I find it confusing to claim that cone response isn’t color yet, that’s going to get you in trouble in serious color discussions. Maybe better to just be careful and qualify that you’re talking about perception than say something that is highly contestable?

The claim that a color model must model perception is also inaccurate. Whether to incorporate human perception is a choice that is a goal in some models. Having perceptual goals is absolutely not a requirement to designing a practical color model, that depends entirely on the design goals. It’s perfectly valid to have physical color models with no perceptual elements.
by godshatter | 2025-11-05 01:09:41+00:00
I use gpt4all and have downloaded some models. It's not that hard, and doesn't take a huge system. It's pretty easy if you use models on their list, it's a bit more work to find the right chat interactive script (forgot what they are called) for your class of model if you downloaded one that's not on the list, but not that hard. I have 8GB VRAM, and it's slow but they work. I like that it's local and private, but then I don't use them for much other than as an oddity that is fun to interact with.
by whoooboyy | 2025-11-05 01:09:49+00:00
FWIW, I've believed we've had an authoritarian in power for quite a while now. Obama, Trump, Biden, and Bush have all tried and succeeded in expanding executive power. They've all engaged in extrajudicial killings overseas.

Nothing sets me off like seeing people think this behavior from Trump doesn't have shared roots across both parties.

Biden kept kids in cages. Obama bombed weddings. Yes, the current admin is accelerating hard but like, prior admins were accelerating.

People should really try to stop thinking about politics like it's a two party game where you have to pick a side. Figure out your principles, and start finding candidates who match those principles.
by itake | 2025-11-05 01:11:17+00:00
> it’s time for parents to “enjoy their best lives”.

Personally, spending money doesn't bring joy to my life above a certain threshold. Research agrees with this sentiment [0]. I don't believe that a $400 camping trip near my house is 10x worse than $4000 trip to Europe. Likewise, you moving to FL (reducing lifestyle costs by 20%) doesn't make your life 20% worse than wherever you were living before.

My issue with broad national or global surveys is they are largely meaningless on the individual level. You could be double the national income/wealth, but you still can't retire in Manhattan (if that is where you want to live due to being near your kids). Also, why stop at national? Why not compare yourself to global income/wealth?

But circling back to the original point: If the next generation wants to live in a good area [2] in a tier1 city, the either need to the top 10% of their field or their parents need to lift them up. If someone wants to skip college to pursue plumbing, great! but they will never be able to compete with DINK tech/finance/medical households or trust fund kids bidding on properties in Buckhead.

Land isn't growing, but population is. Even if only 1% of the parents each year subsidize their kid's housing, as t approaches infinity, cities will be filled with DINK and trust fund families.

[0] - https://penntoday.upenn.edu/news/does-more-money-correlate-g...

[1] - https://www.amazon.com/Die-Zero-Getting-Your-Money/dp/035856...
by yawaramin | 2025-11-05 01:11:21+00:00
This is kinda my point. I wonder why OCaml gets a full 'pain points' blog post, but Rust's error handling gets just a 'it's annoying but it's actually good'. Like I wonder why OCaml doesn't get a 'these parts are annoying but here is why they are actually good'. This is a pattern I see a lot with people coming from other languages (especially Rust). They have a tendency to over-emphasize the pain points and downplay the strengths (a single line at the end of the post, which is in my opinion the most important one–despite its flaws OCaml is the best choice for your use case).
by richardfeynman | 2025-11-05 01:12:49+00:00
I see you're linking to some debunked articles about the gaza starvation hoax.

Do you seriously think Israel had a policy of starvation? Obesity is common in gaza; there are restaurants everywhere; there aren't any pictures of starving families; all the pictures of starving kids have turned out to be of kids with serious pre-existing conditions; there have been only about 200 malnutrition related deaths in two years of war in gaza, orders of magnitude less than here in the US. And no belligerent in the history of war has ever allowed in more aid to the opposing side than Israel.
by ChadNauseam | 2025-11-05 01:13:17+00:00
A color value for each point is a good starting place to gain an intuition. Some readers might be interested to know that the color is not constant for each point, but instead dependent on viewing angle. That is part of what allows splats to look realistic. Real objects have some degree of specularity which makes them take on slightly different shades as you move your head.
by EMM_386 | 2025-11-05 01:13:35+00:00
You don't even need a framework for a SPA.

I have a SPA that is just vanilla web components and is clean, small, fast and tidy. No outside frameworks, just my own small amount of transpiled TypeScript.

I prefer to write them that way because it meets my needs for the particular site and is very responsive. But I've also done PHP, ASP.Net, Rails and other server-side work for many years. Best tool for the job, and sometimes they are very different.
by solomonb | 2025-11-05 01:13:41+00:00
You didn't explicitly call your examples major milestones of human progress but you did use rather trite examples of consumer capitalism as a counter example to my disappointment at the lackluster end game of 20th century techno-futurism.

As other commenters have stated the techno-futurist vision that comes out of the Whole Earth Catalog was radically utopian and far grander then "I get to watch low value consumer media whenever I want."
by bjconlan | 2025-11-05 01:13:48+00:00
Yeah, but it's specifically testing things that implement against a posix API (because generally that's what "native" apis do (omiting libc and other os specific foundation libraries that are pulled in at runtime or otherwise) I would suspect that if the applications that linked against some wasi like runtime it might be a better metric (native wasi as a lib/vs a was runtime that also links) mind you that still wouldn't help the browser runtime... But would be a better metric for wasm (to native) performance comaparison.

But as already mentioned we have gone through this all before. Maybe we'll see wasm bytecodes pushed through silicon like we did the Jvm... Although perhaps this time it might stick or move up into server hardware (which might have happened, but I only recall embedded devices supporting hardware level Jvm bytecodes).

In short the web browser bit is omitted from the title.
by arugulum | 2025-11-05 01:13:50+00:00
>that they need to rig their elections against themselves to get dissenting voices

I don't believe this is true. If you're talking about Non-Constituency Members of Parliament, they are consolation prizes given to best losers, and there are many things they cannot vote on. Moreover, the ruling party almost never lifts the party whip, i.e. members of the party CANNOT vote against the party line (without being kicked out of the party, which results in them being kicked out of parliament). In other words, since the ruling party already has a majority, any opposing votes literally do not matter.

If you aren't talking about the NCMP scheme, then I do not know what you're talking about, as the ruling party does institute policies that are beneficial for the incumbent party.
by richardfeynman | 2025-11-05 01:14:26+00:00
Just because you called my argument a strawman doesn't make it one. Since I see you're not willing to advocate for normal common law justice, I don't think we'll ever agree, and I'll put this argument to rest.

By the way, there is no serious debate about whether the video was altered. Any casual watcher an see it's spliced clips. The question is only whether it was altered maliciously, to paint a specific picture. That is what needs to be tested in court.