MurphyA/hacker-news huggingface dataset:
by lisa_coicadan | 2025-07-25 10:14:10+00:00
Great thread, we’ve seen the exact same pain points around working with large volumes of complex PDFs/Word docs.

At Retab.com, we focus on the “hard pre-RAG” layer: turning raw documents : including scanned reports, OCR messes, financial statements, or regulatory filings... into clean, structured, model-ready data.

Instead of relying on embeddings over noisy text chunks, we use schema-driven generation, multi-LLM consensus, and an evaluation UI to ensure output is accurate, complete, and explainable. No manual parsing, no hallucinations, just structured JSON (or any format you want), ready for retrieval, agents, or analytics.

We work with teams doing RAG on contracts, audits, earnings reports, etc.. anywhere that “close enough” isn’t good enough. Happy to run your hardest docs through Retab if you want to benchmark against WFGY or LlamaParse
by kelnos | 2025-07-25 10:14:17+00:00
When (not if) China invades Taiwan, those Taiwanese-made chips will disappear overnight. Even if China takes over the TSMC fabs intact, they'll be disrupted for years.

So sure, right now we might not want to pay that 20% markup for US-made chips, but 20% will be cheap if the only operational TSMC fabs are in the US.
by markus_zhang | 2025-07-25 10:14:26+00:00
I only know this occurrence. Maybe it is a pattern. From what I know, they operate from a hotel in a Chinese city semi-publicly (the locals know). Developers are not supposed to leave the hotel. The reason they are extremely talented can be partly explained by the training they received: years of system programming training with access to all kinds of source code.

Of course I have never seen this with my own eye, but this friend is the original CTO of Deepin Linux so I believe him. I don’t get the military uniform part though, as it scares away potential employers. Maybe this is one of the requirements of the Chinese government.
by Harvesterify | 2025-07-25 10:14:50+00:00
For those who don't want to root the phone, you can still avoid most of the ads by using a filtering DNS server with the Private DNS functionality on stock Android ROMs (or only at browser level if your favorite browser support DNS over HTTPS).

It comes with some minor usability issues with captive Wifi portals sometimes, but the trade-off of not having ads in app or while browsing is way worth it IMHO.
by smallerfish | 2025-07-25 10:14:53+00:00
Yes but it's clunky as hell. We need something like a curl x.sh | firejail --new, which prompts a) do you want overlayfs? b) do you want network isolation? c) do you want to allow home directory access?

And then, some equivalent for actually running whatever was installed. This would need to introspect what the installation script did and expose new binaries, which of course run inside the sandbox when invoked.

To move past the "| bash" lazy default, people need an easy to remember command. The complexity of the UI of these tools hinders adoption.
by f1shy | 2025-07-25 10:15:07+00:00
The “mostly” there is so important! But also HN suffers from other problems (see in this thread the discussion about over policing comments, and calling fast hyperbolic and inflammatory).

And don’t get me started in the decline on depth in technical topics and soaring in political discussions. I came to HN for the first, not the second.

So we are humans, there will never be a perfect forum.
by cess11 | 2025-07-25 10:15:40+00:00
I'm quite fond of the Bumbu XO, spiced but not overly sweet. Nice bottle too.

Stroh 80 sucks on its own, but as a component of a cocktail it's actually quite nice. Try mixing it into warm toddy or tonic based drink depending on season, and use roughly half the amount you'd use of a 40% spirit.
by timschumi | 2025-07-25 10:15:56+00:00
> My main complain by far to LineageOS is the necessity to wipe everything for major releases on my S10. That's not possible every year.

Are you sure that you are not just misinterpreting the upgrade instructions?

For the S10 a mandatory wipe-on-upgrade has last been the case when upgrading from versions _older than LineageOS 21.0_.

During the time where LineageOS 20 was the current version there was no requirement to wipe listed at all, so presumably it didn't exist then.
by other8026 | 2025-07-25 10:16:42+00:00
Wow. Reading and responding to your comments in this thread, I can see you are very motivated to trash GrapheneOS and its founder.

> Well, he can do everything to your phone, software and data by pushing software updates.

Other developers are doing the bulk of development work these days, so this is nonsense.

> Paranoia could result in just making the system more secure, but why not add a backdoor to find the spies in your userbases that communicate with the black suited men that secretly run our government?

Again with the baseless claims that he's crazy. Your argument here is that "he is crazy, so maybe this happens too." It's nonsense. There are no backdoors, and if there ever were any backdoors, they would be found. GrapheneOS isn't some small project that nobody knows about. It's famous for being very secure, even famous people have said publicly that they use it or others should use it. Cellebrite cannot even hack into it. Backdoors wouldn't go unnoticed. This is also nonsense.
by Ey7NFZ3P0nzAe | 2025-07-25 10:16:50+00:00
Let me give you an example from just a minute ago: in plenty of cases np.array works on arrays as well as on lists.

So you can have for example:

``` import numpy as np

def func(inputA: np.ndarray, inputB: np.ndarray) -> np.ndarray: return np.concat(inputA, inputB) ```

But then you want to modify the code for some reason way later and do this:

``` def func(inputA: np.ndarray, inputB: np.ndarray) -> np.ndarray: if len(inputB.shape) == 1: return np.concat(inputA, inputB) else: return inputB ```

Now imagine that inputB is directly received from some library you imported. So pyright might not be able to check its type and inputB is actually a List. Then you will never get a crash in the version 1. But its types are wrong as inputB is a List.

The version 2 on the other hand will crash as List don't have a shape attribute. Notice also how func returns inputB, propagating the wrong type.

Sure that means the code still works until you modify version 1, but any developpers or LLM that reads func would get the wrong idea about how to modify such code. Also this example is trivial but it can become much much more complicated of course.

This would not be caught in pyright but beartype would. I'm basically using beartype absolutely everywhere I can and it really made me way more sure of my code.

If you're not convinced I'm super curious about your reasoning!

PS: also try/except in python are extremely slow so figuring out types in advance is always AFAIK a good idea performance wise.
by stared | 2025-07-25 10:17:02+00:00
I agree that after a challenge is something can be done at all (heavier-than-air flight, Moon landing, Gold medal at the IMO) then next question is makes sense economically.

I like ARC-AGI approach for the reason that it shows both axes - score and price, and place human benchmark on these.

https://arcprize.org/leaderboard
by jajko | 2025-07-25 10:17:03+00:00
I have a different opinion than yours. So what if that's some, very narrow definition of life? If I develop a tumor is it also a life? It certainly behaves so.

World is full of human life. West (and not only) manufactures failed wars that killed millions of civilians without a blink of an eye (Vietnam, Iraqs, Afghanistan just to name a few) and sends its own people to death. Where are those life-at-all-costs defenders?

Such people are the last to force their own viewpoints on protecting life unto literally everybody else. Yet they feel the most righteous due to whatever fucked up morals they have to spread them and attack everybody who dares to think differently.

Another story - very similar people (to the point of calling them often the same) have huge mental barriers unplugging their relatives from life support, in situations when there is 0 chance for any sort of recovery and brain is heavily damaged. Wife is a doctor and most of them are religious freaks, ie italian where we live (nothing against you guys, apart from this). They let their closest people suffer horribly (within the limits of their state) for months or even years, put a massive financial burden on whole society just because they don't feel like signing papers for unplugging already dead person, its just some parts of their body is sort of kept alive. Absolutely deplorable weak 'humans', I have no nice word for those. Suffice to say wife saw her share of such folks during her years in hospitals and it was one of the reasons she moved to private sphere.
by f1shy | 2025-07-25 10:18:30+00:00
I refrain from any of those X, mastodon, etc. so let me ask a question:

are all equally bad? Or same bad but a different aspect? E.g. I read often here that X has more disinformation, and right wing propaganda, while mastodon here was called out on another topic.

Maybe somebody active in different networks can answer that.
by Theodores | 2025-07-25 10:19:18+00:00
Thanks for that, I just checked out their free tiers and there is enough there to get started with. This is very much for hobby or development purposes, which is fine.

Imaginably I might want to write an app that needs weather data at scale, even for a simple thing. Imagine I sold chocolate teapots online and, in the delivery notes, wanted to advise customers to not leave their deliveries outside for too long if it was going to be sunny in their postcode area on the day of delivery. The free tier might work.

If it was something more popular, for example milk or veg boxes, then I would need to start paying. This would be for a marginal value but of wording in a delivery note, but something that might differentiate the service.

Or, imagine I sold outdoor gear, with a newsletter that goes out to 100,000 customers. Depending on their postcode I might want to promote deckchairs or umbrellas. Although this level of personalisation isn't going to win any awards for innovation, it is something that could be done, enabling a medium sized company to compete against the big companies that are optimising their promotions for the weather.

There is also the research aspect, to verify a suspected phenomenon against data in an amateur way that you would never get a research grant for.

All considered, I wish they did free with no restrictions.
by FirmwareBurner | 2025-07-25 10:19:23+00:00
>There used to be open war between European countries every 30 years or so. That hasn’t happened.

I meant how did that ensure peace between Ukraine, Russia and EU? It clearly didn't even though EU was buying shit tonnes of gas from Russia, and Russia was buying shit tonne of aerospace parts and stuff from Ukraine. War still happened.

[..edited out the Yugoslavia argument..]

All the proof shows "peace through trade" does not work. The only thing that works is "peace through strength", which then you can use to enforce and defend your own favorable trade policies for you and your close allies, which has been the US's MO since 1945.
by FirmwareBurner | 2025-07-25 10:20:11+00:00
>Very well?

I meant with EU Russia and Ukraine.

Plus, France and German economies were also connected before WW2 and that didn't stop the war. And the economies of former Yugoslav nations were very well connected, that didn't stop them going to war with each other.

What stopped the wars after WW2 was western Europe being under the rule of a nuclear superpower needing to unite against a bigger nuclear superpower next door, and the countries having democracies with separation of powers making war declarations on their neighbors impossible politically, nothing to do with economies.

So the famous "muh economies connected = no war" is a very reductionist and short sighted take that ignores evrything else.
by other8026 | 2025-07-25 10:22:11+00:00
> I do provide sources.

You provided exactly 0 sources in all of the comments I've seen posted by you so far.

> Showing his true colors = not accepting that there is an evil conspiracy and asking for proof.

"Evil conspiracy"? You say that someone else is paranoid and yet you are saying things like this? It's kind of ironic.

> You are completely brainwashed

Okay. If you say so.
by atoav | 2025-07-25 10:23:15+00:00
No it isn't. All current nuclear waste models purely rely on geology and perfect engineering and assume that 100 to 300 years in the future those sites need zero staff, zero maintenance and zero monitoring.

Which is of course a "cool" assumption to make if you're profiting from this being the conclusion today. Critics of these models (like me) are sceptical of that overly opportunistic conclusion, especially since the timeframes involved are so long and the storage still needs to be maintained long after the profits stopped for one reason or another. I am not saying that this can't be done, I say the current models are insufficient and rely on future generations "dealing with it" somehow.

If you can convince me my worry is unfounded, I'd be happy to hear why I am worrying too much or why we can be certain that this works out as we wish it would.
by kelnos | 2025-07-25 10:23:28+00:00
The manufacturing cost is 5%-20% more expensive. That doesn't say much about what AMD is going to do with the prices they charge customers. They may be able to absorb that cost, albeit with lower margins, and may choose to do so for exactly the reason you state: people won't buy it if they can get a more or less identical product elsewhere for cheaper.

Whether or not AMD is motivated to eat that cost is another question, of course.
by mg | 2025-07-25 10:24:14+00:00
I really don't know what to think of HDR.

I have yet to get any benefit out of it.

I disable it everywhere I can. In Instagram for example. When it is turned on (the default) every now and then I get some crazy glaring image in my feed that hurts.

Maybe it is because I don't play games? Is HDR useful anywhere outside of games?
by globular-toast | 2025-07-25 10:24:37+00:00
There are some more obvious things you should do (in order):

1. Have backups. You are running software all the time that can corrupt your files either maliciously or, more likely, accidentally. It doesn't really matter where it comes from,

2. Get into the habit of running things in sandboxes. You don't need anything magical here, a separate (unprivileged) user account is a good enough sandbox for many things. I outline an approach for installing Calibre like this on my blog[0] (the official site uses the `curl ... | sudo sh` pattern!)

You could do more clever things like using bwrap[1] to isolate things, or use a distro designed for this kind of thing. Be aware if using a separate user account that your home directory might still be readable so if you're worried about privacy check that, or use bwrap so it's not exposed at all.

[0] https://blog.gpkb.org/posts/calibre-rootless-install/

[1] https://github.com/containers/bubblewrap
by Tade0 | 2025-07-25 10:24:41+00:00
I agree that 250 nits is too low, but my monitor clocks in at 400 and HDR already looks better, if only thanks to the increased colour channel resolution - particularly visible in highlights, clouds etc. Where there previously was just a single colour blob I now can observe details impossible to display with just eight bits per channel.

Interestingly my laptop's display reaches 500 nits and that is already painfully high outside of midday hours. My phone goes to 875 and I find that only to be useful outside in the summer sun.
by conartist6 | 2025-07-25 10:24:49+00:00
Idunno, I have a near-total lack of confidence in their engineering. I reported a Firefox bug six years ago and I may as well not have. It's still there for everyone.

Nobody there seems to believe anything in a way that puts fire in their belly. They pick 8 directions and then discover they have no commitment to any of them.

If I want to see the world changed, I've decided that I have to do it not wait for Mozilla
by uncircle | 2025-07-25 10:25:04+00:00
I found this video to visualise what tone mapping is trying to achieve, and why "photorealism" is hard to achieve in computer graphics: https://www.youtube.com/watch?v=m9AT7H4GGrA

And I indirectly taught me how to use the exposure feature in my iPhone camera (when you tap a point in the picture). It's so that you choose the "middle gray" point of the picture for the tone mapping process, using your eyes which have a much greater dynamic range than a CCD sensor. TIL.
by pama | 2025-07-25 10:25:26+00:00
This sounds very reasonable to me.

When considering top tier labs that optimize inference and own the GPUs: the electricity cost of USD 5000 at a data center with 4 cents per kWh (which may be possible to arrange or beat in some counties in the US with special industrial contracts) can produce about 2 trillion tokens for the R1-0528 model using 120kW draw for the B200 NVL72 hardware and the (still to be fully optimized) sglang inference pipeline: https://lmsys.org/blog/2025-06-16-gb200-part-1/

Although 2T tokens is not unreasonable for being able to get high precision answers to challenging math questions, such a very high token number would strongly suggest there are lots of unknown techniques deployed at these labs.

If one adds the cost of GPU ownership or rental, say 2 USD/h/GPU, then the number of tokens for 5k USD shrinks dramatically to only 66B tokens, which is still high for usual techniques that try to optimize for a best single answer in the end, but perhaps plausible if the vast majority of these are intermediate thinking tokens and a lot of the value comes from LLM-based verification.
by xyzzy123 | 2025-07-25 10:26:28+00:00
P.S. There are a LOT of details in this specific idea, some consumers are bad actors and are never happy, some merchants likewise are bad actors. Resolving these issues without disclosing sensitive information is extremely difficult. But largely processors are sort of punting on it in various ways when common sense resolutions seem possible. Like if a consumer has 50k transactions with 0 chargebacks and they initiate a chargeback, it's probably a merchant problem. This argues for collapsing the layers but channel-specific resolutions have the advantage of being able to look for delivery signals and other specific mechanisms of performance. Figuring who is right in the world is a hard problem in general. Possibly the Stripe Elite will correct me here since this is the Hard Problem of payments. Which can be solved well enough with statistics. Payments has a whole lot of Hard Problems which seem easy at first, it's a great area.
by other8026 | 2025-07-25 10:27:57+00:00
> On the other hand, it only increases the perception that he is could enact significant harm if he ever comes after you.

But that would be incorrect. It's not possible for anyone from the GrapheneOS project to target a GrapheneOS user that way. Look into how updates and the update servers work.

> neither you can audit GOS code with enough confidence to declare that the risk of an exploit or backdoor being introduced is zero.

The updater app is pretty easy to read through. I think a software developer would be able to understand it. The update servers' setups are also very easy to understand. It doesn't take a software developer genius to figure these things out.
by mppm | 2025-07-25 10:29:30+00:00
> Every time you look up something related to Radon, it's always cited as "the second leading cause of lung cancer after smoking"

> I wonder if that's really true.

That claim is in fact based on extremely poor research methodology. It is made by combining the linear no-threshold model of radiation damage (which contradicts everything we know about cellular repair and hormesis) with evidence from "case-control studies", a kind of retroactive hand-waving that has nothing whatsoever to do with a "controlled trial", despite the name.
by fmajid | 2025-07-25 10:29:33+00:00
I am (very slowly) migrating from iOS to GrapheneOS, for the same reasons as OP (privacy, Apple's increasingly user-hostile and developer-exploitative policies).

Apart from migrations concerns, which are not GrapheneOS' fault, the main shortcoming I see is the lack of proper backup/restore, e.g. when switching phones. There is Seedvault, but I've found it unreliable.
by Quarrelsome | 2025-07-25 10:30:50+00:00
I always thought political parties were very sensitive to electoral issues and therefore played everything overly safe, in terms of attempting to avoid consequences for their potential electors. So this legislation actually getting to this point today was very surprising.

I think it speaks volumes of a strong bias in their analysis teams, as well as indictating they're even more out of touch than expected. What they've done is given direct negative consequence to millions of electors in exchange for indirect and mostly imperceivable positive consequence to concerned parents. Personally I don't see a way that ever makes electoral sense, especially given how close the last election was (in raw votes, not seats) and where opinion polls are today (Reform seemingly being considerably ahead, albeit opinion polls are _not_ reliable).

Obviously there's a lot to say about consequence, how the use-case of authentication is at odds with the desire of users to be incognito, how VPNs are considerably better UX; but their use undermines previous legislation like recording host names to help combat extremism, how encouraging users to dish out sensitive id documents online isn't the best habit, how id verifiers are not regulated and often are services hosted abroad. Obviously the biggest negative is that sketchy websites who don't care about being legal will gain considerable traffic, at the expense of websites who are trying to be legit. Children will still probably be able to access pornography and it may just be the case that the pornography is even "worse", yielding the most counter-intuitive outcome.

I'm particularly alarmed that many websites are responding by blanket age-verifying NSFW content. So now reddit resources on mental health, drugs, suicide, domestic abuse, etc are locked behind age verification.
by SkiFire13 | 2025-07-25 10:31:04+00:00
In my opinion this is missing a very important different between the two approaches: using `unsafe`/`sun.misc.Unsafe` in Rust/C#/Java is a very deliberate choice which presence can easily be checked syntactically, meanwhile data races in Go are most often unintended and you can't easily check for their _guaranteed_ absence. Otherwise C/C++ are also "GIMSO" with the caveat "don't UB"!
by zapzupnz | 2025-07-25 10:31:07+00:00
I have a C4 OLED and I thought what you said was also true for me until I figured out what settings I needed to change on my TV to match my console (Nintendo Switch 2). Had to turn on HGiG, manually adjust the peak brightness level on the console itself, and suddenly things looked great.

Not that many games on the console that take advantage of it, mind you. More testing needed.
by cogman10 | 2025-07-25 10:31:24+00:00
The same, which is why I support universal healthcare and expanding healthcare to include nursing support/housing for the disabled.

If someone gets cancer, then yeah they should be covered such that they aren't made homeless because of their disease.

If someone has a stroke that leaves them unable to work, again a social safety net that keeps them from being homeless should be in place.

The ethics are pretty simple. It's reasonable for a good society to support those in need through force of taxation. Just like it's good for a society to keep the water clean through force of taxation and regulation. Everyone benefits or has the potential to benefit from such a universal system that protects them from circumstances outside their control.