skysight-inc/HackerNews huggingface dataset:
Historically/as national origin story, no.

But it has in recent decades accepted quite a large number of immigrants, and is at this point at a higher foreign-born % than the US, if still lower then Canada or Australia.

That's not quite the same as having a culture rooted in the immigration narrative, but it has changed significantly.

And I'll also mention that while integration of significant immigration into an existing society is clearly a challenging prospect everywhere, the UK is overall, doing noticeably better with it than most of it's European peers. Both from my subjective perspective as a somewhat regular visitor, and from a lot of the metrics I see.

This is a decent piece for the data side of that claim: https://samf.substack.com/p/the-truth-about-integration
Certainly! And please let me know if I'm off or otherwise confused here. I can guarantee I'm not the brightest bulb around here! :D
Is there any research on Unsupervised Learning?
All I'm seeing today is supervised learning, llm, openai, deepseek, r1, blabla, supervised stuff. But none of these will help us reach true AGI. Is there ny research being done (or places where I can keep myself up to date on that stuff) out there?
I tested palemoon on Win with one of my Cloudflare sites and didn't see any problem either.

It's probably dependent on the security settings the site owner has choosen. I'm guessing bot fight mode might cause the issue.
This would be very welcome as it brings us closer to understanding the secret sauce behind training a real, practical LLM.
Yes.

If Elon says one thing and someone else thinks the opposite, it comes down to a battle of wills... and Elon doesn't back down. Sure, it can go to the courts, but the courts only matter if they're listened to or enforced. Neither of which will happen here.
I use different things based on what it's for. Ground flax seeds for baking, aquafaba for souffles, tofu with black salt for scrambles, "Just Egg!" for egg wash when frying, and maple syrup for egg wash on breads. Of those, I mostly bake, so keeping the flax seeds around is much more convenient for me than regularly buying eggs anyway.
The SVGs are starting to look actually recognisable! You'll need a new benchmark soon :)
> It is completely valid to say something is illegal and unenforced.

It seems somewhat vacuous to say it when it applies to every second administrative act.
Anything you can share? Papers? Examples?
Good for you for being able to ignore /r/all, /r/popular, etc. I just can't, I always end up relapsing.
I'm a Data Engineer which uses Spark daily. I guess the only important cert would come from Databricks, but I think it will be more worth your while to read the book mentioned here and try to do a little project ingesting/transforming data
Just to be clear, I liked memory handling in Rust. It was the sheer size of the language that made it... not fun. But borrow checker made sense.
I think we need a better battery chemistry for grid scale batteries when it comes down to it.
At minimum, drawing people's attention to the ongoing issues can result in a different batch of congressional representatives in the future.

Politics doesn't always act on instant gratification.
> What is a better test?

Exactly. A true objective test doesn't exist.

As far as the SAT: You can take prep classes, hire a tutor, and do all sorts of resource-intensive things that will boost your SAT without really contributing to your overall intelligence. You can study for the test. And guess who is more likely to have resources available to access these things? Is a rich kid who spends a year in prep inherently smarter than a poor kid who can't afford a tutor and has to work an evening job to help her family make ends meet?

And why, more broadly, are we completely fine tilting the tables in favor of the wealthy and entrenched but the second something seems like it might give an ounce of advantage to a disadvantaged class people lose their minds?

We get rid of DEI, but I haven't heard a word about getting rid of legacy admissions and rooting out nepotism.
I suspect they're saying there is no such thing as "fine" except in the eye of the receiver of the chemical signals. Seems like a strong stance for something lacking any foundation.
AI/ML is a solution, not a problem.

DARPA’s mission is to define the problem space, not the solution space.
To predict future and make your decisions, e.g. on where to live, what skills to learn and what to do in general.

If you're on HN, it's most likely you can't control reality much, but you can navigate it better.
We parse millions of PDFs using Apache Tika and process about 30,000 per dollar of compute cost. However, the structured output leaves something to be desired, and there are a significant number of pages that Tika is unable to parse.

https://tika.apache.org/
FastAPI Deconstructed: Anatomy of a Modern ASGI Framework
There's a big difference between obeying laws (which all companies pretty much have to do if they want to stay in business) and voluntarilly aligning with what they think a new president wants without there being any specific law forcing them to do that.

I actually think the business reason FOR the DEI stuff (to appeal to customers by coming accross as fair and progressive) made more sense. Have the customers really changed their minds just because someone else is in the Whitehouse?
Key Points:

In a task of generating SQL queries, I found that Google Gemini Flash 2.0 was much better than DeepSeek R1 and OpenAI o3-mini. Specifically, I found that it was:
* Very significantly cheaper
* Had a much higher context window
* Lightning fast
* Was more accurate when it came to generating syntactically-valid SQL queries
If you look how every dictatorship works, they always make sure that the military and police force do well. That and they look the other way when police steal from people.
Here’s one from a few months ago “HOW I ADDED MAPS TO MY TRAVEL POSTS”

https://news.ycombinator.com/item?id=41532958
"Net zero", as opposed to a plan for a clean energy transition based on engineering and ecological principles, was always about financialization. (e.g. take your flight and buy $5/ton of junk carbon credits)
> For one thing it's trivial for malicious actors to change their user-agent.

Absolutely true. But the programmers of these bots are lazy and often don't. So if Cloudflare has access to other data that can positively identify bots, and there is a high correlation with a particular user agent, well then it's a good first-pass indication despite collateral damage from false positives.
Diversity targets are usually built around under-represented groups, not necessarily specific races.
Would that cause employees to break laws if they accepted employment elsewhere during that time?
You will be told that any systemic initiatives to address that are racist against whites who deserve more of a share of whatever is being done for others. Likewise any policies or initiatives along class line divisions are taking resources away from others who deserve a share of what may be given for disenfranchised/impoverished classes
> You literally cannot add too many comments to test code

In my opinion, almost every developer I've worked with who advocated for generous amounts of comments has overestimated their (and or others') ability to write good quality comments.

Obvious ones like `a = b; // set a to b` while useless are also mostly harmless, but I've been lead astray by outright factually wrong comments, many more times than I can count. I certainly don't feel confident in my own ability to not write factually incorrect comments. So yeah, I'd rather the code do the talking.
Because COVID happened much sooner and has likely had a bigger impact than the hiring practices from a decade ago - notice we don't have a concrete number of "disadvantaged qualified candidates" from this article. Whereas, I can point COVID with actual numbers: https://news.ycombinator.com/item?id=42952695

If we're going to say "Did that contribute to a shortage of qualified ATC..?" then you have to considering all inputs into what is a current conversation rather than extrapolate your already asserted points from the article.
I do agree that citing specific laws is best. However, if the building is on fire, I want the alarm bells on immediately even if it's low specificity.

What sort of assumptions have you been seeing?
Indeed, this is how rust handles it.

A mutable String or Vec has all three fields, but the borrowed slice or str has just pointer and length.

Go chooses to be simpler by not having those kinds of separations, which also makes it a little less efficient under some circumstances.
Fixed size chunks is holding back a bunch of RAG projects on my backlog. Will be extremely pleased if this semantic chunking solves the issue. Currently we're getting around an 78-82% success on fixed size chunked RAG which is far too low. Users assume zero results on a RAG search equates to zero results in the source data.
If accessible knowledge about how LLMs work ever disappears, it won’t be due to YouTube.
> I was a happy mercurial user until market forces and consulting needs made me, regrettably, use the inferior, more complex, more error-prone git.

IMO Mercurial did a lot of this to themselves. I also preferred it at first but switched away from it due to their stance on no in-repo branching. They, of course, also lost due to git's author and network effects (github), but it wasn't all just "market forces".
Interesting. What's your setup ?
> Emotion is something you feel, not something you decide to allow yourself to feel.

Recognizing your emotions when you are making a decision is key. The emotions you feel will largely be outside your control but you can catch a thought you disagree with when you have it and wonder what triggered that thought. If the trigger was an emotion, you can wonder what triggered the emotion. Ask "five whys" (google it if you don't know what I mean). You have more control over this than you seem to think; you will just have to practice exercising it.
> My feed is full of wannabe “thought leaders”

Block them, it's easy. I have only close friends and coworkers that I don't hate on that site.
This is a minor detail but reducing or removing alcohol all together (my company) from social events for inclusion reasons is excluding people who like consuming alcohol at social events. We somehow pivoted to embracing restrictions in order to accommodate small groups of people, instead of offering alternatives (e.g. vegan options). This will always irritate other groups of people and is not a sustainable way to improve inclusion.
Tech workers would take a pay cut for remote jobs
Will 2.0.1 also change everything?

How about 2.0.2?

How about Llama 13.4.0.1?

This is tiring. It's always the end of the world when they release a new version of some LLM.
> leaked the drivers licenses and passports of its patrons

Source?
For someone who wants to get into systems programming professionally, is C++ going to be a hard requirement or can one mostly get away with C/Rust?
This is using exactly the wrong tools at every stage of the OCR pipeline, and the cost is astronomical as a result.

You don't use multimodal models to extract a wall of text from an image. They hallucinate constantly the second you get past perfect 100% high-fidelity images.

You use an object detection model trained on documents to find the bounding boxes of each document section as _images_; each bounding box comes with a confidence score for free.

You then feed each box of text to a regular OCR model, also gives you a confidence score along with each prediction it makes.

You feed each image box into a multimodal model to describe what the image is about.

For tables, use a specialist model that does nothing but extract tables—models like GridFormer that aren't hyped to hell and back.

You then stitch everything together in an XML file because Markdown is for human consumption.

You now have everything extracted with flat XML markup for each category the object detection model knows about, along with multiple types of probability metadata for each bounding box, each letter, and each table cell.

You can now start feeding this data programmatically into an LLM to do _text_ processing, where you use the XML to control what parts of the document you send to the LLM.

You then get chunking with location data and confidence scores of every part of the document to put as meta data into the RAG store.

I've build a system that read 500k pages _per day_ using the above completely locally on a machine that cost $20k.
I worked on some DEI programs. The problem was mixed. Most companies (at least the ones with DEI programs) thought they had big DEI issues because minorities had worse outcomes. But if you looked hard, that wasn’t usually the case. It was merely that minorities were more represented at lower levels and lower levels had higher attrition and what not. On the whole, it tended to look like hiring, retention, and even promotions looked surprisingly equitable. That is, while it would take a long time, it did seem as if things would stop being crusty old white men at the top exclusively.

However there are some noteworthy qualifiers. First, the biggest thing these programs did successfully was just diversifying the entry points so that you could even begin to start conversations with people from other backgrounds. That’s huge and effective.

Second, and this one is more anecdata, but I never really felt the hiring pool of diverse candidates was randomly sampled at all. For all the groaning about meritocracy and white candidates getting shat on, I tended to find in my personal hiring that diverse candidates were often MUCH stronger candidates. I rarely saw unmotivated, underqualified minorities and women make it to an interview stage whereas there’s a ton of white and Asian guys that did. Getting these candidates was harder. Which is to say, without putting any intrinsic value on racial or cultural backgrounds, I do think DEI programs somehow greatly streamlined a meritocratic highlighting of talented folks from diverse backgrounds. Which is ironic because that’s often the opposite claim.

That is, given you are a minority applying to an advanced position, odds are you’re really strong.
Where have DEI initiatives lowered standards of hiring at Google?

I think you’re making that up! Be specific, don't deflect and shift into general discourse topics. I am not talking about distractions at work, I'm asking about your specific claim that hiring standards were lowered.
Apparently there's a coup taking place in the United States right now.
digital junk food. I haven't stumbled across this term and I gotta say as someone whose right on the edge between millenial and genz this term summarizes what most "public" social media is.
I'm old enough to have grown up mostly with TV, with Internet being my escape hatch and twitter/facebook/tiktok/insta feel waaaay closer to old schoold programming TV than Internet.
Anyway I'm an Internet person, not a TV person, so I've quit using all of them (I do have some "just in case" unused in years accounts everywhere because I suffer from a bad case of FOMO...)
Yeah! Leetcode hards for everyone! Including the PMs, EMs, Directors, and C-suite hires!
That's what they think, at least.

When push comes to shove, it'll be less clear.
Yup yup, I know, but requires a lot of setup on CI. We are using project references btw. They are very cool
Not exactly. They say:

"Challenges are not supported by Microsoft Internet Explorer."

Nowhere is it mentioned that internet access will be denied to visitors not using "major" browsers, as defined by Cloudflare presumably. That wouldn't sound too legal, honestly.

Below that: "Visitors must enable JavaScript and cookies on their browser to be able to pass any type of challenge."

These conditions are met.
Q&A With: Game Designer Steve Meretzky (Infocom)
> the part of my text you declined to quote

Okay? Would you feel better if I quoted the whole thing?

> I feel like the part of my text you declined to quote "you needed to use their wizards. " clarifies things, or at least the context. I don't have specific examples because it's been like 15 years since I played with it, although Upstart, their own gui environment, and snaps are all probably at least loosely related examples.

I have used Ubuntu a very long time, and I don't remember having to use a wizard for anything.

Also, upstart is no longer a thing. It definitely didn't require a wizard to use. Additionally, snaps didn't exist 15 years ago.
Joke's on you, circular reasoning works well when people accept it!
> Neither Rust is memory safe due to stackoverflow on recursion or in the call chain being possible.

Does a stack overflow trigger a crash, or does it cause undefined behavior and/or remote code execution? You'd have a point if it's the latter, but I also assumed that I would have heard about it before if that were true.

And if it's not the latter, then it's not a failure of memory safety as most people mean it.
Not the parent, but we process PDFs with text, tables, diagrams. Works well if the schema is properly defined.
I have personally hired less qualified candidates based on race and gender. I have made this choice from direct superior's comments as well as political requirements to climb the ladder of the organization I was in.

The truth is that if you are on the "left" your blind to what many are thinking. In person I will never tell you the bias or problems I see. I've learned doing so would make it nearly impossible to work with you.

Not saying you are "wrong" but the problem I an many like me face is that the softpower pressure to conform to left ideals mean I never do or say anything because I assume everyone around me would push back or push me out.

It's partly paranoia but it's also part of a factual experience I've had in highly liberal environments. They don't want to hear it and if they do you are damaged. Very different from the people we all know who are expounding and preaching liberal ideals in ever conversation they have.
Sure and one answer to that was simply to ensure soft beverage availability in addition to alcohol. Which was an initiative borne from a DEI program. We’re debating specifics of DEI-relevant initiatives. What I’m saying is these discussions only happen when there is space for DEI consideration
Provinces handle it well enough but some better than others. The teaching curriculum did use to be less political but bringing federal politics would only make that worse. We have very diverse populations and needs from province to province. We generally rank well globally.
Ireland is under control of the Irish and has been since independence. The Irish are the native population and the majority group there.
I was recruited through Google's diversity program twice.

The first time, what that meant was that they invited their diversity candidates to a small pre-interview preparation session which, oddly enough, didn't bother to touch on what they were looking for in interviews. I took the interviews and was informed that I'd failed them.

The second time, I paid for coaching from interviewing.io, and I learned what they were looking for in interviews. This was not cheap. (There are some surprises! For example, they don't care whether you can answer their questions. If you can't, you're supposed to ask them how. This is not a normal testing style.) I took their interviews, and my recruiter informed me that I had passed, wished me congratulations, and told me to expect a job offer by the end of the current hiring cycle (which was about six weeks away). In the meantime, I'd have a set of "team fit" interviews.

Then, they never contacted me again, except to say that they'd realized that on second thought my interview scores were too low for them to hire me. Not a single thing was scheduled until the hiring cycle ended and they let me know that while my scores were good enough to have passed their interviews, they weren't good enough to be hired after passing the interviews.

There was no obvious "diversity" angle to that one, but when I complained to a family friend working at Google, they looked up the recruiter and were surprised to see that she was specialized in diversity hiring.
Check that you are allowing webworker scripts, that did the trick for me. I still have issues on slower computers (Raspberry pies and the like) as they seem to be to slow to do whatever Cloudflare wants as a verification in the allotted time, however.
Congressional inaction isn't assent. The Constitution clearly and explicitly gives the power of the purse to Congress (and this is also the understanding of I think Madison in the Federalist Papers and the interpretation we've had for now almost the entire history of the US so there's no reasonable dispute of this). Until Congress passes a law allowing this the president is constitutionally obligated to take care of the laws passed.

Though you do have a point of even if it's illegal who will enforce it? The courts have started to some but are necessarily reactive and slow.
YES! I should add that they should be thinking about intelligence generally, not AI/ML.
Not exactly a social network but I am kind of addicted to the Google Home curated list of news - that thing on Android (maybe just Pixel?) when you swipe all the way to the left.

I read it every morning in bed.

It contains all the topics I'm interested in as it knows me probably better than I know myself.
The idea that there’s one specific axis on which to judge job candidates that’s 100% objective is a fantasy. Leetcode certainly doesn’t predict how well someone will do at Google, or what they can contribute to a team. If anyone actually believed that they wouldn’t even do interviews.
We are kind of locked into what we have. A single digit percentage of House races are ever contested. The vast majority of House districts are won by the party that already holds them[1].

1: https://www.pewresearch.org/short-reads/2024/10/30/decade-af...
there is also https://ds4sd.github.io/docling/ from ibm research which is mit license and track bounding boxes as rich json format
Sure. Remember this when people say that the dems constantly complain about the repubs, and that people are tired of hearing people say things are illegal.

My guess is that at this point, talk is cheap, and actions speak louder than words.

So saying the same thing, just a different language.

And no: I have zero clue what the actions would look like. Maybe suing the govt?
I need examples
Got it, millennia old "listen to the other side" principle pushes women out of software engineering. Such a pity.
Vaguely related, Paul Graham tweeted "I worry Elon has no idea how much he has damaged his personal brand ...", re UK stuff and Elon posted a pages of text rant as a result. Not sure if it was written by him or Grok. I worry Elon's going a bit bonkers with drugs or whatever.

Conversation here: https://x.com/elonmusk/status/1879785727468163505
All the talk about "diversity" in tech companies always reminds me of this Silicon Valley scene - https://www.youtube.com/watch?v=Dek5HtNdIHY. Still the perfect representation of the entire effort.
The bcrypt implementation in the Zig standard library has both the bcrypt() function (where truncation is explicitly documented) and the bcryptWithoutTruncation() function (which is recommended and automatically pre-hashes long passwords).
Welcome to the modern world. Any deviation from the average will get you flagged as a suspicious deviant. It's not just browsers. It's everything.
But this never happened.