MurphyA/hacker-news huggingface dataset:
Show HN: OCR pipeline for ML training (tables, diagrams, math, multilingual)
by ses425500000 | 2025-04-05 05:22:33+00:00
Hi HN,

I’ve been working on an OCR pipeline specifically optimized for machine learning dataset preparation. It’s designed to process complex academic materials — including math formulas, tables, figures, and multilingual text — and output clean, structured formats like JSON and Markdown.

Some features: • Multi-stage OCR combining DocLayout-YOLO, Google Vision, MathPix, and Gemini Pro Vision • Extracts and understands diagrams, tables, LaTeX-style math, and multilingual text (Japanese/Korean/English) • Highly tuned for ML training pipelines, including dataset generation and preprocessing for RAG or fine-tuning tasks

Sample outputs and real exam-based examples are included (EJU Biology, UTokyo Math, etc.) Would love to hear any feedback or ideas for improvement.

GitHub: https://github.com/ses4255/Versatile-OCR-Program
by takeda | 2025-04-05 05:22:36+00:00
If you can put any person 12 years and up in jail without a trial, and you don't care about accidentally hurting innocent ones I'm surprised it is 2.5 per 100,000 and not 0 per 100,000.

El Salvador currently has the highest incarceration rate in the world, and its president now is serving second term which is not allowed by their constitution.
by robertlagrant | 2025-04-05 05:22:39+00:00
You're assuming bigot. This is where you're going wrong. It could be anyone for anything, even if the thing was fine to do 5 years ago - and maybe is fine again now - and it was done 15 years ago.

Precociously exclaiming "Well, personally I don't like horrible people!" isn't likely to be relevant above quite a young age.

I say the same to people who assume everyone going to an El Salvadorean jail is guilty. They're the same person as you, just in the other tribe.
by jhbadger | 2025-04-05 05:23:10+00:00
I'm not sure either of those are particularly progressive -- the current president seems to be a fan of tariffs, a form of planned economy popular in the 19th century (and condemned by most economists since, who favor free trade). And child brides are a common feature of many right-wing religious groups, argued on the grounds that that people (particularly female) traditionally married in their teen years.
by totallynothoney | 2025-04-05 05:23:48+00:00
Are you baffled that people dislike companies that create killing machines? All the stuff made by Anduril will end up causing "collateral damage" in a middle eastern wedding.

I understand that you have an ethical framework that ignores or justifies this, but a lot of people don't. My normie mother would spit in your face, it's a given that a niche FOSS community wouldn't look kindly to MIC ads.
by LightHugger | 2025-04-05 05:25:06+00:00
IBM/red hat, google, apple are all receiving extremely well evidenced anti white and asian discrimination lawsuits. When a lunatic goes on a racist tirade about how she hates hiring white people online and doesn't want to work with them she's not fired from her job at EA, these instances of public unfairness stack up and have become evidence of an ongoing systemic issue over the past 10 years.

Discriminating against people on the basis of race or gender is unacceptable, that's the bottom line, going "do you think anyone will actually take you seriously" and accusing me of being an uber driver (?) is the theme type of language i'm talking about. Segregationists in the 60s and 70s constantly used this exact style of derision and appeal to marketability, spend some time just reading the writings of segregationists at the time and you will see yourself. Sorry but there's a simple objective truth here and you're on the wrong side of it, trying to call me racist while you're defending racist practices is just pointless, it looks like a fish floundering.

And it's actually really amazing how your post boils down to 'You're white so you deserve it, nobody will take whites seriously!' despite you not even knowing my race!
by genevra | 2025-04-05 05:25:30+00:00
Today while staring at my strawberry plant I started wondering if the soil had enough nitrogen for it. 10 queries, some fluff learning, and an in depth discussion about the stoichiometric steps required to convert the nitrogen consumed by a single strawberry plant got me to some workable measurement of fertilizer I could add. I think anyone bored of it is using it for too much, and too often.
by ofrzeta | 2025-04-05 05:27:08+00:00
No idea why there's almost no PaaS solution for Kubernetes. It would be a great platform with some add-ons. I know there's Porter but only on AWS and Azure if I understand correctly. Which is fine for many use cases I guess. Still I want to self-host for dev without huge cost.

There's also Korifi which implements the Cloud Foundry API on Kubernetes but it's still in progress and its future might be uncertain.
by csense | 2025-04-05 05:27:35+00:00
I'm not really happy about this either, there's a strong case to be made for tariffs to be limited to enemies, rivals and economic cheaters.

But on the other hand, the US's entire industrial base has fallen into complete ruin and needs to be rebuilt. Broad tariffs will help with that.

I see both sides of the issue, and I'm not really sure which is right. But the political leadership has made its choice; now the rest of us are along for the ride.

Personally I'm skeptical it will work out exactly as hoped, but I'm still decently optimistic it will put us in a better position than we had before.

One good thing is that everyone's now on notice: Taking advantage or over-relying on the US now has consequences. It's no longer an all-benefit, no-risk strategy.

Undoubtedly there will be short-term pain but that's the price of fixing the disastrous neoliberal trade policies that destroyed the Rust Belt.
by jmyeet | 2025-04-05 05:27:59+00:00
There are two silver linings to all this:

1. The evisceration of American soft power will really diminish the direct and indirect harm the US intentionally and unintentionally causes. Just look at China, South Korea and Japan deciding to respond to tariffs together [1]. That is an absolutely astonishing event given fairly recent history. Future retellings of history will correct portray the US as the actual Evil Empire; and

2. All of these actions are doing a ton to break the myth of meritocracy. The people involved in this, at the highest levels, are clearly demonstrating just what complete and utter morons they are. This is why fascism flames out: valuing loyalty above all else results in an administration of sycophantic morons.

This is going to do untold economic harm in the interim but ironically it's accelerating the rise of China as a global power, despite the fact that this administration are China hawks and see these tariffs as a means reducing China's power, which it won't.

[1]: https://www.reuters.com/world/china-japan-south-korea-will-j...
by charcircuit | 2025-04-05 05:28:03+00:00
>The trade deficit with a given country is not determined only by tariffs and non-tariff trade barriers, but also by international capital flows, supply chains, comparative advantage, geography, etc.

All of those other things, minus geography are influenced by the terrifs. Terrifs make economic incentives to invest in America, for America to gain comparative advantages, etc.
by rramadass | 2025-04-05 05:28:05+00:00
This is what i was thinking of yesterday after folks on HN pointed me to the "official formula" from the govt. I could not understand why the "elasticity" parameters were chosen in such a manner as to cancel out. Now it seems it was chosen deliberately to give "room for maneuvering" when the concerned countries inevitably come to the negotiating table; never mind that the formula itself is not economically sound. It also explains why Trump and his Team keep saying the "economic hardships" will be short-term and will get better soon.
by ggm | 2025-04-05 05:28:29+00:00
Ultra processed food? Single biggest change for the last 30-50 years. And colorectal and Oral cancers are the problem. Guaradasil fixes the latter. Diet influences the former.

Outside of food, could be some other chemical exposure. Or, genetic drift at scale but hard to explain that, noting allergies are rising worldwide too.

(Not an epidemiologist)
by NitpickLawyer | 2025-04-05 05:28:30+00:00
Perhaps a bit tangential on the subject, but in the same spirit - does anyone know of an open source self-hostable alternative to runpod/vast for managing your GPUs? Our small team has some bare metal servers and I'd like to try something light to manage / reserve instances w/ the convenience of a webui and a place where the team can see at a glance who is using what, and eventually some notes on how long each deployment is likely to take (self filled ofc).
by chongli | 2025-04-05 05:28:40+00:00
That’s awesome! I have been playing off and on since 2009!

If you haven’t heard of it, check out The November NetHack Tournament [1]. I played it for the first time in November of last year and almost got a Wizard win (ran out of time) after getting so close with a Monk (got killed by Rodney’s touch of death after he stole my only source of magic resistance).

I’m looking forward to playing again this year!

[1] https://tnnt.org/
by dragonwriter | 2025-04-05 05:29:01+00:00
It is even worse than that as Martinique is a “territory governed by France” in much the same way that Hawai’i is a territory governed by the USA.

Martinique is a region and department of France—and administrative subdivision of the same type as those in the French mainland, differing only in that the the top two levels of subdivision (region and department) are coextensive rather than nested in Martinique and the other overseas region/departments.
by colechristensen | 2025-04-05 05:30:31+00:00
no, this is not emotional government

it's just incompetence

real estate allows a lot of bullshit from a leader like this because they're not going to go in and give orders to the structural engineers or the electricians that can actually cause huge problems, the only thing a bullshit artist is going to influence are the outward appearances which are easy and you can't do so wrong that the building falls over. the thin facade can really just be whatever and you can always screw over a new set of suppliers or go bankrupt again and keep going

now the lifelong real estate scammer is taking that facade bullshit attitude which basically couldn't go wrong and directing towards the very impactful machinery of the global economy expecting the same kind of bluster to be the same kind of effective

it's not emotional reactions it's just stupidity, people who didn't understand things voted for the guy that puts on a much better show

and didn't vote for the people who put on a terrible show, displayed zero hutzpah, and have the attitude of "i know better than you" and "i told you so" and make no effort to hide it
by matus_congrady | 2025-04-05 05:31:21+00:00
3 things:

- Situation on the SWE hiring market. It's way harder to find a job.

- I personally know people from SW dev agencies that are all saying its very hard to find an opportunity (project) to work on.

- In fact, I'm 99% convinced that we're in a recession, even though its not official. Companies are cutting costs left and right. And think about it this way. When a company invests in a software, it's an investment for them, which will eventually pay for itself in a few years. But if the company is struggling to just stay alive, investments are the first thing they cut.
by robocat | 2025-04-05 05:32:00+00:00
> someone else but not me

This is the core behind so much popular rhetoric about taxation (the 99%, wealth taxes, supporting individuals ripping off businesses). The selfish motivation where you accuse the people you want to tax of being selfish.

The second part is cutting down the successful - a very popular game down under. Although we do laud our sportspeople.
by GIFtheory | 2025-04-05 05:32:32+00:00
I don’t see how tariffs magically create wealth for foreign exporters that translates into higher wages. Let’s say I can buy a $10 shirt from Lesotho with zero tariff. Now a 50% tariff gets imposed. I can either eat the tariff and pay $15, in which case Lesotho still gets their $10, or Lesotho can eat the tariff to keep their exports competitive, in which case Lesotho now makes $5.

The part about giving a competitive advantage to local producers is true, though…
by tombert | 2025-04-05 05:33:05+00:00
Considering how open they've been about their clear conflicts of interest (Trump launching a cryptocurrency on day 1 of his presidency, being in charge of a publicly traded company that he's made no effort to remove himself from, and the Diablo cheater being in charge of a department that gets to determine "efficiency" while also bidding on government contracts), I think we should really consider the possibility that Trump and Musk shorted or bought Puts on companies that would be hit especially hard by tariffs.

I debated doing that. I wish I had, I would have made a bit of money in the last few days.
Show HN: Corral – A Visual Logic Puzzle About Enclosing Numbers
by MohammadAbuG | 2025-04-05 05:33:10+00:00
Hey HN!

I just finished building a puzzle game called Corral, and I’d love to share it with you. It’s a logic puzzle played on a rectangular grid, where some of the cells contain numbers. Your goal is to mark which cells are inside a single continuous loop that encloses all the numbers.

For each numbered cell, the number tells you how many cells are visible in the four orthogonal directions (up, down, left, right) until a wall of the loop is hit, plus the cell itself. So a cell with a 2 must see one empty cell before hitting the loop boundary. Gameplay is all about deduction: you can mark cells as definitely inside or definitely outside the loop. The loop must be one continuous shape, with no "islands" inside. Every puzzle has a solution and can be solved using pure logic.

There are three difficulty levels that you can choose from, enjoy!

Would love to hear your thoughts, ideas, or bug reports. Thanks for taking a look!
by mindcrime | 2025-04-05 05:34:38+00:00
From what I've seen, generally speaking, yes. Even more so if the site wasn't submitted by the owner.

Self-promotion has even always been explicitly allowed here, but I believe the guidelines contain some verbiage to the effect of "your primary activity here should not be self-promotion". I have no official info, but just from observing things over the years, it appears that accounts who promote their own content overly frequently, and/or only post self-promotional content, are the ones that get shadow-banned or set to auto-dead status.
by fspeech | 2025-04-05 05:35:35+00:00
Housing and healthcare are the two things that have little to do with trade. Housing affordability is almost entirely policy driven. In a "free" market (quoted because the definition typically doesn't take into account the necessity of a functional society to maintain property rights and values, just ask Detroit), housing affordability is entirely dependent on one's relative income and propensity to spend, i.e. you can have high absolute income (say in NYC) and still find you desired housing unaffordable. I think people intuitively understand this. Healthcare costs are more complicated but is also almost entirely a domestic issue.
by atom058 | 2025-04-05 05:36:02+00:00
This is what happened in Sweden about 10 years ago, when they started charging a $7 "administrative fee" on all packages privately imported from China. Prices for resistors went from $1 for a pack of a hundred to $8. As a student at the time, it effectively made the hobby non-viable over night because it got too expensive.

Lately, there have been some domestic actors filling in the gap. But it's still a significant cost increase compared to the glory days.
by kristopolous | 2025-04-05 05:37:26+00:00
they have terrible names. I can never remember. A put option I think gives me the right to sell you a stock at a price.

So say, ACME is trading at 110. I can buy the right to sell you ACME at 100. You say ok because it's at 110.

But then ACME crashes to 50.

I buy it at 50 and you are on the hook to buy it from me at 100.
by freebird00 | 2025-04-05 05:37:29+00:00
Indian Union minister criticized Indian start-up ecosystem highlighting the lack of deep-tech start-ups and innovation. He also expressed his concern over too much focus on "quick food delivery" and "healthy ice cream" type start-ups which are basically what Indian start-up ecosystem comprise of at this moment. He also drew comparison with China highlighting their strides of innovation and development in fields like EV, AI and more and called for Indian entrepreneurs and start-ups to strive for something like that.

Indian start-up ecosystem, however, hasn't taken this comment lightly and some of the founders have come out openly to criticize the minister and the government as a whole claiming the lack of support and capital to build something like this in India.
by RossBencina | 2025-04-05 05:37:46+00:00
I knew I wanted one, but I didn't know that it was called a "chip clip" and indeed "IC clip" and "IC test clip" seem to be a better match.

The clip will give you a electrical connection to the SPI flash but I'm not sure you'll be able to talk to it without jumpers on the board. Is it possible without jumpers?
by rocqua | 2025-04-05 05:38:05+00:00
This makes sense. I think even MAGA might agree if you pitch it as "we use tarrifs to prevent American labor from being undercut.

But it is clear that the reasoning here is "I want tarrifs, how do I easily get them". And then they found the easiest possible way to say something about 'countries putting a tarrif on the US'.

The stupid theory behind this is effectively: not having a minimum wage is equivalent to putting a tarrif on the US. Which would suggest that the low US minimum wage is actually already a tarrif on the EU.
by dragonwriter | 2025-04-05 05:39:29+00:00
> There used to be a garment industry in the USA...

Yeah, but the last large piece of it (there are still some amall remnants) got wiped out with the most recent push for eliminating large scale non-penal slavery in the US.

And, no, I don’t mean abolishing formal chattel slavery with the 13th Amendment, I mean the push to eliminate the informal de facto slavery that persisted in the US territory of the Confederation of the Northern Mariana Islands around the turn of the millenium.
by mcshicks | 2025-04-05 05:39:36+00:00
I don't know, it's hard for me to know what the author means by "fundamentals". I looked at the table of contents from the amazon website, and somethings that I consider pretty fundamental like Thevenin's Theorem didn't seem to be listed there. By comparison it's in Chapter 1, page 9 on my copy of "The Art of Electronics". I'm not trying to knock the book, it could be very handy, but I would use the term "basics" as opposed to "fundamentals" to describe the content as I understand it.
by IgorPartola | 2025-04-05 05:40:58+00:00
Kamal proxy is good enough to sit behind a load balancer. I would not let it be what a client sees. There are some major features missing and it just hasn’t been battle tested enough to be subjected to DDoS type traffic, etc.

Overall, I do like the Kamal approach which basically boils down to the fact that instead of a complicated cluster orchestration system the developers decide which machines code runs on.

Once it has real support for doing DB migrations as a part of its deploys, a proxy that is less magical and more feature rich, and its CLI fixes some poorly documented and frankly somewhat annoying issues it will be a real workhorse.

I am also curious about Dokku + k3s. I have used Dokku for a long time but only on a single host.
by GianFabien | 2025-04-05 05:41:10+00:00
I see programming as a means to an end. That is, one of several tools to use in creating solutions to real problems.

Perhaps the problem is that much of what passes for programming activity is in pursuit of addressing some trivial problem or burnishing some manager's ego.

Of course, most of the big problems of our age cannot be solved by computer technologies alone. Solving such problems requires skills in numerous domains, most of which require deep levels of specialized expertise.
by jabl | 2025-04-05 05:41:33+00:00
Which countries would that be? Capturing CO2 from the atmosphere in order to have a source of carbon is, to this day, a technology in the prototype stage.

If you're thinking of Germany during WWII, or South Africa during apartheid, they produced synthetic liquid fuels from coal. That was technology that worked, though it was very expensive. And of course CO2 emissions were much higher than using petroleum.
by lelanthran | 2025-04-05 05:42:16+00:00
> This is just the 'you made me do it' defense argued by every abuser ever.

Meh. You can say that about every consequence ever if you determine a priori, like you have, that consequences are only performed by abusers.

In any case, it's not a defense when many many people were saying this before it happened.

IOW, it was a prediction before the fact, not a defense after the fact.
by JackYoustra | 2025-04-05 05:42:19+00:00
No that's not what I mean I mean like if I have 99% of my assets in ...business capital (read: mostly stock) what's the plan? I'd have to front-run, but the wealthy own half of the business capital in the US so that's also incoherent because there's just not that much besides other wealthy to front-run.

If the wealthy wanted to buy something up on the cheap that they didn't own, they'd do residential real estate: something that's majority middle class owned (a fun corollary: property taxes are just wealth taxes on the middle class, the proportion of business capital the middle class owns is teeny). However, house prices have gone in the opposite direction as you'd expect from this theory!
by paradox242 | 2025-04-05 05:43:08+00:00
Given the amount of military and economic power wielded by the US compared to our nearest competitor, we are one of the most benign great powers in history, which is saying a lot about considering the harm that we have caused. Calling the US "the real evil empire" is puzzling when we have still have the regimes in Russia, China and North Korea still at large.
by Hojojo | 2025-04-05 05:43:13+00:00
What you're advocating for is these 30.000 people to lose their jobs, not earn anything and starve.

How does that help them? Oh, right. You don't care about them, actually. You just have this vague ideal that people should earn more money. Maybe not even that. You just want tariffs for some inexplicable reason. Because tariffs cannot give these people higher salaries. That's not how any of this works.
by leg0m4n | 2025-04-05 05:44:02+00:00
you missed the most important part of the Declaration of Independence: “We hold these truths to be self-evident, that all men are created equal, that they are endowed by their Creator with certain unalienable Rights, that among these are Life, Liberty and the pursuit of Happiness.” you forgot by whom those right were endowed, by “the Creator”. It’s either this, or by the definition of it, you don’t have those rights.
by rocqua | 2025-04-05 05:45:03+00:00
Such a tarrif on low wage countries would prevent the exploitation of low wage countries. Because any county could easily 'defeat' the tarrif by setting a minimum wage. It doesn't help raise the people being exploited out of poverty. But it does prevent countries from getting stuck in a cycle of depending on low wage labor.

Whether that works out better for the exploited is uncertain. But the alternative argument is effectively "these poor countries should be happy to let themselves be exploited" it is their only way out of poverty. And that really doesn't sit right with me.