skysight-inc/HackerNews huggingface dataset:
> It would be ridiculous to say, in response to someone showing a hat they they've knit: "Why did you consider it important to knit yet another hat? What is the core benefit of this specific knit hat?"

Not at all. Knitting has a clearly defined purpose: to make a particular garment with a particular shape and pattern so that you can wear it, give it as a gift or sell it (coincidentally, I have detailed first-hand insider knowledge on this topic). But I don't think we need to continue this discussion because it doesn't bring me any closer to the answers to my questions, and apparently you don't have the answers either.
> still have no real comprehensive understanding how the models work.

We do understand how they work, we just have not optimised their usage.

For example someone who has a good general understanding of how an ICE or EV car works. Even if the user interface is very unfamiliar, they can figure out how to drive any car within a couple of minutes.

But that does not mean they can race a car, drift a car or drive a car on challenging terrain even if the car is physically capable of all these things.
Do these browsers employ any additional tracking protections? "Browser integrity checks" are browser-specific and they might rely on the "entropy" those tracking vectors provide.
I think you’re making an academic rather than practical point. Sure, he won a much larger share of the electoral college than the popular vote and the existence of the electoral college likely influences some voting patterns. Even then though, in PA he won with barely 1.5% more of the vote yet got all 19 electoral votes. Given the how close the election was forecast and how important PA was, I don’t think the electoral college drove much of the voting patterns. So my point still stands: he barely has a mandate and most certainly did not win an overwhelming victory. And yet, he gets to implement a radically destructive gutting of the federal government.
I know! Maybe this paranoa would be justified, if they would already killed millions and destroyed countries!
Cloudflare is actually pretty upfront about which browsers they support. You can find the whole list right in their developer docs. This isn't some secret they're trying to hide from website owners or users - it's right here https://developers.cloudflare.com/waf/reference/cloudflare-c... - My guess is that there is no response because not one of the browsers you listed is supported.

Think about it this way: when a framework (many modern websites) or CAPTCHA/Challenge doesn't support an older or less common browser, it's not because someone's sitting there trying to keep people out.
It's more likely they are trying to balance the maintenance costs and the hassle involved in allowing or working with whatever other many platforms there are (browsers in this case). At what point is a browser relevant? 1 user? 2 users? 100? Can you blame a company that accommodates for probably >99% of the traffic they usually see? I don't think so, but that's just me.

At the end, site owners can always look at their specific situation and decide how they want to handle it - stick with the default security settings or open things up through firewall rules. It's really up to them to figure out what works best for their users.
They aren't. They are informing the President and the President does it either by EO or asking congress.
It's clear that OCR & document parsing are going to be swallowed up by these multimodal models. The best representation of a document at the end of the day is an image.

I founded a doc processing company [1] and in our experience, a lot of the difficulty w/ deploying document processing into production is when accuracy requirements are high (> 97%). This is because OCR and parsing is only one part of the problem, and real world use cases need to bridge the gap between raw outputs and production-ready data.

This requires things like:

- state-of-the-art parsing powered by VLMs and OCR

- multi-step extraction powered by semantic chunking, bounding boxes, and citations

- processing modes for document parsing, classification, extraction, and splitting (e.g. long documents, or multi-document packages)

- tooling that lets nontechnical members quickly iterate, review results, and improve accuracy

- evaluation and benchmarking tools

- fine-tuning pipelines that turn reviewed corrections —> custom models

Very excited to get test and benchmark Gemini 2.0 in our product, very excited about the progress here.

[1] https://extend.app/
> This is a Bjarne issue.

I have come to find this category of error to be distressingly large.
I am not on either side of the 2 party system. I am pointing out the hilarity of former members of the panopticon now understanding the value of privacy preserving technologies.
Google has a campus under construction in Hyderabad that can accommodate 30K contractors.
Cloudflare has been even worse for me on Linux + Firefox. On a number of sites I get the "Verify" challenge and after solving it immediately get a message saying "You have been blocked" every time. Clearing cookies, disabling UBO, and other changes make no difference. Reporting the issue to them does nothing.

This hostility to normal browsing behavior makes me extremely reluctant to ever use Cloudflare on any projects.
Elisp Cheatsheet for Python Programmers
Yeah, validate your assumptions. Nothing ever works the first time. Quick iterations to get feedback is the way.
Poll: AI Movies/TV in 10 Years
In 10 years from now (2035), how much of the work do you think AI will do in high quality movie/TV production?
Everything. A single prompt will generate a full-length, high quality movie.
One person will be able to spend a few weeks or months to produce a high quality movie using AI generated or AI accelerated visuals and audio.
AI will never replace key aspects of high quality movies, although it's not quite clear yet which aspects. It could be writing, acting, music, or something else.
AI will never replace most aspects of high quality movies.
Society will rebel against AI in movies; it doesn't matter how good AI gets, most people will not watch movies touched in any way by AI.
I like this. DEI efforts and investments should be at least as much about planting the right seeds as it is about tailoring the current “harvest”.
Will be making a cross country trip next month and explicitly avoiding any Tesla chargers. Planning to share my anecdotal experience. My car has an API so I can get trip and charging details to make for a nice HN data driven post
The loss of DEI programs is good, as it reduces the pressure for these companies to discriminate against white and asian men in hiring.
Fogwatch: Real-Time Log Viewing for Cloudflare Workers
"Lately"?

The genocide in Gaza has been going intensely for more than a year, dead and mutilated children streamed out pretty much every day. Now it has moved to the West Bank.

Similarly a genocidal process has been ongoing in Sudan, perpetrated by a proxy of the UAE, close partner to the US.

Do usians not see these images and only just now with the new administration's inauguration entered a mood of distress?
> It's hard to say no to a free service that provides feature you need.

Very true! Though you still see people who are surprised to learn that CF DDOS protection acts as a MITM proxy and can read your traffic plaintext. This is of course by design, to inspect the traffic. But admittedly, CF is not very clear about this in the Admin Panel or docs.

Places one might expect to learn this, but won't:

- https://developers.cloudflare.com/dns/manage-dns-records/ref...

- https://developers.cloudflare.com/fundamentals/concepts/how-...

- https://imgur.com/a/zGegZ00
Forgot to clarify: this is not about an increased amount of captchas, or an annoyance issue.

The Cloudflare tool does not complete its verifications, resulting in an endless "Verifying..." loop and thus none of the websites in question can be accessed. All you get to see is Cloudflare.
This is a fantastical speculation based on no evidence other than political bias. We do have evidence, though, that candidates had to go through performative hiring practices to prove that they support "diversity".
Good news: you’re right!

Bad news: this limitation will be enforced by… Musk himself.

https://www.bloomberg.com/news/articles/2025-02-05/white-hou...

> The White House said Elon Musk, the billionaire leading President Donald Trump’s government cost-cutting efforts, will determine if there are conflicts of interest between his work reviewing federal spending and his overlapping empire of six companies.
Wow, cool! Here's my poll. We'll see if anyone notices. :-)

https://news.ycombinator.com/item?id=42955244
Memory safety issues show up all the time outside of security exploits. Industry began pursuing memory safety long before anyone cared much about security, simply because of the productivity impact of chasing down memory leaks and use-after-free bugs. So if they've used C++ for years without having to do that, its pretty meaningful. It also matches my experience working on a large C++ application that had ubiquitous use of smart pointers. I wouldn't want to do that again, but RAII takes you a long way.
I think it is more than just Trump. We do have to remember that some companies are currently being sued by shareholders for attempting to keep DEI around. Or at least was threatened to be.

I don’t know if these lawsuits would win or not but given the current political climate I sure wouldn’t bet against it. From a purely business prospective on that alone, I can see why they would do it. And do it so quickly.

This is the latest symptom of a very powerful opposition that just gained almost unlimited power. Or at least unchecked power. To be clear here Trump is also a symptom, this didn’t come out of nowhere with him.

Be mad and hold these companies accountable but we also can’t afford to be distracted by the symptoms when those in power are going to make it so much worse.
If you trace how first governments formed… it’s literally true. When the mafia gets everyone in its ranks it becomes the defacto ruling body.

In present times, you can look at cartels providing government services of better quality than the government itself in some parts of the world.
As someone who wrote 60 pages of design for a new VCS before writing a single line of code, I appreciate this post.

Design is crucial. The optimal time for that design may be different for different things, but I do know that incremental design can, and often does, fail.
Companies like Google and Cloudflare make great tools. They give them away for free. They have different reasons for this, but these tools provide a lot of value to a lot of people. I’m sure that in the abstract their devs mean well and take pride in making the internet more robust, as they should.

Is it worth giving the internet to them? Is something so fundamentally wrong with the architecture of the internet that we need megacorps to patch the holes?
I guess I was a bit flippant about my guesses and realized I made two guesses that were invalid because they weren't actually checkmates.

IMO those should count as guesses.

I felt like an imposter getting the praise "Wow, you're fast!" and "only two guesses!" when I'd actually submitted 4 guesses... just that two were so bad that the game rejected them outright. lol.
Unironically, the comments such as yours are downvoted. I had an idealised view about our industry, but it has now shattered during the course of the last year.
And which country has some checks and balances and which has none? If an autocratic leaders wants you to disappear, you disappear. And journalists inside the nation will never talk about you again. Apart from maybe that you have retired, are an amazing painter now, and are having a lovely time.

Joe Tsai about his former Alibaba co-founder: https://youtu.be/KveMLJNhwkc
> Both realities reveal something urgently broken with the United States.

Our government operations expect people to conduct themselves as adults.

Clearly, if we survive Elon's coup, we need to encode these norms into law.
So this would only be "bad" move by cloudflare if you could get around it by recompiling the browser with spoofed UA/strings. Otherwise they'd have to support every possible engine which is infeasible. That saying, the "open web" is indeed dead.
That's the grand bargain to escape the monopoly lawsuit. Now we'll have another monopoly protected by Trump.
I think it's always worth keeping in mind that every single piece of media you consume was created primarily to benefit its creator and almost always the relationship is parasitic (you're the host). Only rarely does media engage in mutualism.
Location: Poland Europe
Remote: Yes
Willing to relocate: maybe
Technologies: Python, SQL, statistics, data science, numpy, pandas, scikit-learn, GCP, Airflow, Dataflow, Pub/Sub, Apache Beam
Résumé/CV: https://drive.google.com/file/d/1zzi5WJ3T8zchhNOyWu0rpQZoAlitiyL3/view?usp=sharing
Email: in CV

About me: Data Science Leader with 5+ years of experience at Eastern Europe's largest e-commerce platform (Allegro), specializing in advanced analytics, A/B testing and data engineering (GCP). Architected an enterprise-scale experimentation platform processing terabytes of daily data. Mathematics and Physics graduate from Poland's top university, with research experience in quantum computing and brain-computer interfaces. Combine strong mathematical foundation (Mathematics Olympiad finalist) and practical engineering skills to solve complex business problems. Proven track record in leading technical teams and implementing data-driven solutions at scale.

(posting for my so)
The DC parasites take a third of our entire economy and do not produce anything. Of course there is fraud.

This is also why tens of thousands of far left government and NGO employees are screaming their heads off... They are afraid of being caught.
> Politico Propped Up by Millions of Dollars from US Government

Apparently it was entirely funded by USAID. All of it. The supposedly "independent" news source.

4000+ stories here on HN linked to propagandist Politico pieces.

Do you guys begin to understand?
This is a fantastic insight and really has my gears spinning.

We need to cluster the AI's insights on a spatial grid hash, give it a minimap with the ability to zoom in and out, and give it the agency to try and find its way to an answer and build up confidence and tests for that answer.

coarse -> fine, refine, test, loop.

Maybe a parallel model that handles the visualization stuff. I imagine its training would look more like computer vision. Mind palace generation.

If you're stuck or your confidence is low, wander the palace and see what questions bubble up.

Bringing my current context back through the web is how I think deeply about things. The context has the authority to reorder the web if it's "epiphany grade".

I wonder if the final epiphany at the end of what we're creating is closer to "compassion for self and others" or "eat everything."
Corporate social media does not care about its users. They are just biomass to fuel various goals: ad revenue, political influence, etc. In fact, the more addicted you are, the better.
Hmm I have been doing a but if this manually lately for a personal project.
I am working on some old books that are far past any copyright, but
they are not available anywhere on the net.
(Being in Norwegian m makes a book a lot more obscure)
so I have been working on creating ebooks out of them.

I have a scanner, and some OCR processes I run things through.
I am close to 85% from my automatic process.

The pain of going from 85% to 99% though is considerable.
(and in my case manual)
(well Perl helps)

I went to try this AI on one of the short poem manufscript I have.

I told the prompt I wanted PDF to Markdown, it says sure go ahead
give me the pdf.
I went upload it.
It spent a long time spinning.
then a quick messages comes up, something like

"Failed to count tokens"

but it just flashes and goes away.

I guess the PDF is too big?
Weird though, its not a lot of pages.
That’s not how DEI programs operated at places I’ve worked. They were more about expanding candidate searches to look for high quality people at other places than we’d been looking, reducing alcohol at company events etc
It’s also still deeply embedded in education. DEI might be less popular in the workforce but in primary and secondary education stuff like lowering standards, ignoring test failures, removing gifted classes, merging special needs classes in mainline, changing classroom conflict resolution to not remove disruptive kids from classrooms, etc are all still going strong and increasing in prevalence. That will have a ripple effect in the workforce for decades after the Overton window has shifted back.

And in the US the federal government can’t stop it as it’s mostly defined in local and state gov (which is many times larger than the federal workforce). Dept of Education would only have limited influence there.
By having a 5 min group meeting where only the manager speaks. Manager is not allowed to talk about what direction the team should go and what the team should do. Anything else will give instant insights on whats going on at the isolated top.
And how do you figure out what the requirements are? In my 10+ professional years, I have never gotten requirements by asking for them. Almost always I had to show my interpretation of what I think the requirements are, and use the feedback I got to define the actual requirements. The quickest way to get there is by iterating.
The challenge for me is that there is useful stuff in there that I want to access.

There are neighbourhood groups and other really useful forums on Facebook. There are tech discussions on BlueSky.

But it's annoyingly hard to run the gauntlet of politics and outrage bait to get to the stuff I actually want.
Fascinating, and I’ve been working on a native UI project I call Figuro for a couple of years now (1) that’s built on the idea of simple nodes.

It’s surprising how similar to HTML it’s becoming. I feel like it's sorta an inverse of the Flutter story. Lately I’m working on adding a subset of CSS. Adding padding and margins too seems like a good idea too, etc. Part of me wonders how much of a webpage I could render with it.

1: https://github.com/elcritch/figuro
When I came over to the states to go to a tech conference at a NASDAQ listed billion dollar corp that bought us, the only black people I met were either working at the hotels (90% of that staff) or living in the nearby inner city.

I don't pretend to understand the USA, and maybe that conference wasn't representative, but to me it was quite shocking that the disparity was so clearly visible. So I think its a bit of a shame they're losing this, because from my perspective there was still a clear gap in terms of education outcomes which feed corporate and I would have liked to think these policies were helping to address that.
It's written in Rust:

> The malware, which we dubbed “SparkCat”, used an unidentified protocol implemented in Rust, a language untypical of mobile apps, to communicate with the C2.

So all the Hacker News folks will probably think it's great.
I use boring stacks in all my software development including jQuery, also 5 years programming and not a dime of revenue. American software development not easy. Even though I offer free account, how messed up is that.
I think that the social media is okay as long as no algorithmic feed gets involved. Visiting a few select tech subreddits doesn't affect me negatively. On other platforms the feed can't be avoided as easily.
The problem is that the new regime appears to be more interested in amputation than footwear for most of these depts/agencies. Those less committed to their mission of walking and running will leave. Those left behind will be the more intransigent veteran operators, "somebody has to keep everyone's feet attached".
They made a new one to unite them all: Microsoft Fabric.

https://xkcd.com/927/
Well we are shutting down the Department of Education...
This is more like noob logic. Good players are eager to learn from those better than them.
I think to say that it's very hard to solve it underestimates the development of skills that can be done for adults. I think it's merely hard.
Interesting precedent thanks for sharing.
I still think you should try a book which has been much less studied than the ones you mentioned. The LLM is almost certainly trained on Wikipedia, which has a lot of this information, plus a lot of essays for high school level assignments.

I found 'Annotating Characters in Literary Corpora: A Scheme, the CHARLES Tool,
and an Annotated Novel' at https://aclanthology.org/L16-1028/ which describes some manual annotation efforts for Pride and Prejudice. I don't know if the result is available, but the text suggests it is.

It points out a fun observation: "characters maybe referred to by multiple names, sometimes drastically different (e.g. Dr. Jeykll and Mr. Hyde)"

Huh. https://aclanthology.org/2022.latechclfl-1.10.pdf says "that the character
networks of translations differ from originals in case of long novels, and the differences may also vary depending on the novel and translator’s strategy."

Ooo, it cites https://theseaofbooks.com/2016/04/29/the-5-least-important-c... which is about the 5 least important characters in Pride and Prejudice:

> So if you filled out our reader survey and are fairly sure you didn’t come across 117 people in Pride and Prejudice last time you read it, this is because when we compiled that list, we added every last entity that could possibly be considered a character. In fact, Pride and Prejudice has a small, cast of characters, compared to certain of our other novels. Ever wanted to know the population of Middlemarch, for example? By our reckoning, it’s the tidy figure of 333! (Admittedly, some of them are goats.)

This might be useful:
"Using Citizen Science to study literary social networks" at https://txtlab.org/2024/12/using-citizen-science-to-study-li...

> By mobilizing volunteers to annotate character interactions, we gathered a high-quality dataset of 13,395 labeled interactions from contemporary fiction and non-fiction books. This dataset forms the foundation for understanding how genres and audience factors influence the social structures in narratives.

This appears to be an interesting field, which I have no time to explore any further. :(
They had a much more convincing argument before the Play Store started forcing the same exact thing that they said was one of the main problems with F-Droid, and F-Droid started providing reproducible builds.
> if perhaps it's sophisticated enough to get past the user agent spoofing

As a part of some browser fingerprinting I have access to at work, there's both commercial and free solutions to determine the actual browser being used.

It's quite easy even if you're just going off of the browser-exposed properties. You just check the values against a prepopulated table. You can see some of such values here: https://amiunique.org/fingerprint

Edit: To follow up, one of the leading fingerprinting libraries just ignores useragent and uses functionality testing as well: https://github.com/fingerprintjs/fingerprintjs/blob/master/s...
There is a massive amount of evidence that Americans basically think everyone else is having a terrible time, but asked to review their own living situation things are going well. Here’s a decent summary from late 2024: https://www.nytimes.com/2024/05/23/opinion/biden-trump-vibec...

Instead of engaging in the data, opponents usually yell the equivalent of what you put “You’re just out of touch!” Or throw in an anecdote like “well my cousin is having a terrible time!”.

What’s going on the US is weirder than a “normal” economic problem. That’s what makes it so frustrating and politically polarizing.