skysight-inc/HackerNews huggingface dataset:
I'm trying to follow the example and getting lost.

> Imagine the scenario where "mary had" occurs in the following positions: [1, 6] and "a" appears in the position [2], so "mary had a" occurs in the positions [2]

Okay so basically this means "mary had a" ends at token position 2 (assuming "mary" is token position 0), and you're trying to create an efficient algorithm to do this backwards linking process.

It's not entirely clear from the article what's pre-computed ahead of time (when documents are added / indexed by the system) and what's done on-the-fly (in response to a user's specific search query).

Based on skimming the article it appears that you're doing this backwards linking process on the fly for a specific phrase the user enters (but I could be wrong about that).

> allows us to decompose this value

What value is being decomposed? It is not clear what "this value" refers to.

> one representing the group and the other the value

Ctrl+F is telling me that's the first occurrence of the word "group" in this post. What is the "group" being represented?

> pos = group * 16 + value

Okay so you're bit-packing two fields into pos. One of the things being packed is called "group," and it seems to be 16 bits. The other thing being packed is "value," and it seems to be 4 bits. So in total "pos" has 20 bits.

> the maximum document length is 1048576 tokens

It seems that "pos" simultaneously corresponds to a token position and our two-field bit-packed thing above. I can't figure out how these two things are in one-to-one correspondence.

I stopped reading there, given my confusion so far it seems unlikely I'll really be able to really understand much of what follows.

PS: I skimmed the article on roaring bitmaps. Seems they're basically bitmaps where each 1k (8192-bit) chunk has a storage format (dense, sparse, or RLE), and algorithms for quickly doing intersection, union, etc. with various optimized cases chosen roughly by the number of 1's. (Intersecting two dense bitmaps with say ~50% randomly distributed 1's you can't get faster than ANDing together the bit vectors. But if you're, say, intersecting a small sparse bitmap with ~5 1's against a big dense bitmap with ~4k 1's you can iterate over the 1's in the sparse bitmap checking whether each 1 is in the big bitmap.)

So in my mind I'm basically just blackboxing roaring bitmaps as "java.util.BitSet or vector<bool> with some extra optimizations that kick in if your data has sections where most of the bits are the same".
This editorial oversight is not evenly spread over the opinion pages. Bret Stephen’s isn’t edited.
The day Bitwarden was VCed I knew there will be a time when I will be desperate to find alternatives. I guess that time is coming closer.

The thing I despise most among their UI “improvements” is entry click expands the entry now. To fill you have to find that tiny “fill” button and click that.
You can also brew install the gnu tools package and have both side by side for compatibility (gnu tools are prefixed with 'g', gls, gcat, etc

I have a script that toggles the prefix on or off via bash aliases for when I need to run Linux bash scripts on a mac.
>"I'm not going to deep dive all the flawed logic around removing trans people from sport. internet search is there for you."

I gave you paragraphs of my time. I'm trying to be open and honest about things that I honestly find difficult to discuss.

Again I completely understand and support the argument that gender is a social construct. Intersex and pre-puberty trans folks are deserving of dignity and respect. They are an absolutely minuscule part of society, and will always be a special case. When the vast, vast, vast, vast majority of trans athletes are trans women, I can understand when parents think it's not fair. Again, I think it's pretty clear that our sport segregation is about sex differences, not gender differences. There just aren't many Chris Mosier's out there.

>as to immigration... we're about to see what happens to the US food supply when you remove migrant workers from the equation. why do they never go after the employers, just the employees? (we both know the answer)

I fully agree, it's going to suck. If it helps us get to a sensible immigration system, it'll be a silver lining, but I'm not optimistic.
Facility score may IMHO be understood as some statistical measure of tactical involvement. It has really nothing to do with the established and important concept of weakness in chess, which looks at significant static features of a position. For example in the position from figure 1, white's pawns on the queen side are all weak, especially c4. Also the black squares around the white king are weak. After 1...exd4 these weaknesses are pronounced sharply. Considering fragility score, I see nothing that points towards these weaknesses. a4 and b6 are not attacked, hence ignored. c4 is attacked once and defended once, but there is no trajectory over it. Weak squares are not considered. If we look at the knight D4, it's BC score may tell us, that after taking it with a pawn, which can be done in two different ways, the bishop e3 is hanging, hence we gain a tempo, which is significant, also f3 is weaker (noise) and bishop e6 is not under pressure any longer.
Hardly something which convinces to identify the key moment, but may be useful in a statistical sense. Nevertheless it appears to be an oversold complexity measure.
I, too, use both Desmos and Geogebra in my classroom. One of my favourite things about Geogebra is the ability to export to tikz. It can save a lot of time when making complex geometry problems while keeping things nice and neat in your latex file. I also like using the Geogebra 3D AR app to get kids to see the different ways planes intersect, and what a parameterized solution “looks like” in a 3x3 system. It makes for a lot of “aha” moments.

On the other hand Desmos is quick, easy to use, and looks nice. The test-mode app works well on phones and the College Board will be using it for their AP exams this year, so they must be doing something right. Their new 3D apps look promising but I haven’t played with them much, yet.

Both tools have their place, but my heart is 100% with Geogebra.
"Site blocking" here seems to be an rightsholder term that covers every technical way they can think of to block access to a service, from DNS/IP blocks to DPI.

The sort of meat of this article is that they're pushing for it again in the USA, and they want it to be responsive enough that it can be instantly updated by the rights holder to cover services that quickly switch domains.
The next generation will love your idealism.
The article itself is terrifying.

But also, what’s happened to Torrent Freak? I think of them as having a pro-freedom anti-restrictions stance, and they pretty uncritically reported a deeply alarming conference. Has there been a shift in leadership or priorities? Or has this been happening for a while and I missed it?
What's the right thing? Are you sure that you and I agree on that? Do you and Elon Musk agree? The tax pool is taken from everyone. In practice, I believe you would find a 50% tax distasteful because it's pretty much guaranteed that it's not going to be spent exactly as you direct.

What used to happen before vast income tax regimes and welfare states arose was that people who were wealthy would donate huge amounts of money to charities that did what they thought were the right thing. Even the working class donated 10-20% of their income to charities that did the right thing. The way you guarantee that money is spent on the right thing is by having the power to spend it, which means lower taxes.
Complete aside, but I think this is the first time I’ve seen Apple’s internal DNS outside of Apple.
>This is framed as a mechanism of eliminating DEI programs.

Did we watch the same campaign? Trump absolutely campaigned on ending DEI too. The electorate hates DEI programs. Cutting spending and DEI programs is what got him the popular vote.
No. Federal employees take an oath to defend the Constitution, not the current executive.

Civil service in the US has been neutral politically and merit based for the last 140 years. It stands directly opposed to the "spoils system" which awarded positions to friends, campaign contributors, family members, etc.
https://en.m.wikipedia.org/wiki/Spoils_system
As opposed to sentiment the article was likely written with - I warmly welcome the initiative.

The organization that digests humongous amount of taxpayers money, consistently fails audits for years in row, participates and encourages global wars - should be dismantled or severely reformed at bare minimum.

Whether Trump administration be able to achieve that remains to be seen, but hopefully it's a start.
Neither I nor (to my knowledge) the previous owners were in any way penalized or even notified that the required inspection was missed when I bought the house and registered it as my primary residence at the city hall (for property tax purposes).

It mostly seemed like something to benefit buyers given that, and I would assume that a company changing hands would mean the the purchasing party has already done their due diligence.
Loyalty to whom? Your spouse? The country? Your immediate supervisor? Your coworkers?

It's the things that aren't said that make it feel so Orwellian.
It is unfortunate that the term "slop" is being adopted for this.

Make a new word! Slop has so many meanings already.

/half-s
> this could only happen if you passed a `Network` object to the logger

Yeah, this is not only an effects type system, it's a static effects type system.
This is amazing!! What kind of applications are you considering for this? A part from saving variable costs, fine tuning extensively and security… I’m curious to evaluate this in a financial perspective, as variable costs can be daunting, but not too much “yet”.

I’m hoping NVIDIA comes up with their new consumer computer soon!
It sounds dismal. In an economic downturn the funding would dry up
when people need it most.
eMusic was so good!
I was looking for the Pandora mention. They're what's really wanted, Spotify isn't targeting the same thing.
Unfortunately those are both 10-15x the cost of deepseek direct.

Deepinfra is pretty cheap though as a deepseek provider.
What was your experience with Tidal? I felt like it was better at recommending new albums and artists I want familiar with and there was much less of a focus on playlists.
I am amazed mlx-lm/mlx.distributed works that well on prosumer hardware.

I don't think they specified what they were using for networking, but it was probably Thunderbolt/USB4 networking which can reach 40Gbps.
Oh I see, so training on copyrighted content is fine unless it's your AI model...
its good but very "pop". if you're already in the matter, either deep dive on papers not books from Graeber or go to the still verry relevant source of all this, wich i consider to be Gramsci.
I think for $6000 you can run an EPYC setup. But the token/sec is going to be objectively slower than the Macs. What you gain on them is speed. I read this [0] on X earlier today which seems like a good guide on how to get yourself up and running.

[0] https://x.com/i/bookmarks/1884342681590960270?post_id=188424...
Midpandemic was great for hiring in my memory, but I guess that was after the lockdowns probably.
Puma 6.6.0 Released – Return to Forever
There's two images where the face is transferred to the final image. The references images with blurred faces are all being used for a different reference; the pose, or "necklace", etc.
The faces are blurred in every image unless they explicitly want the face transferred to the final image, at least that's how it seems.
Someone also got the full Q8 R1 running on a $6K PC without a GPU on 2x EPYC with 768GB DDR5 RAM running at 6-8 tok/s [1].

Will be interesting to see the value/performance compared to next gen M4 Ultra's (or Extreme?) vs NVIDIA's new DIGITS [2] when they're released.

[1] https://x.com/carrigmat/status/1884244369907278106

[2] https://www.nvidia.com/en-us/project-digits/
You know what else injects money back into the economy? Letting tax payers keep more of their tax dollars.
Yep, I use IPS monitors for this reason. Gotta avoid PWM to help prevent the headaches I experienced on other types. IPS looks really good too, so that works out.
This reminds me of a tongue-in-cheek phrase we used to use in college.

"Hours of coding can save minutes of planning."

"Discovery Coding" sounds fun, but be careful with your time!
I created a similar product to Delicious Library years before its launch and peer to peer version of it was the direction I had been planning to take it. This was all long before mobile devices, long before Apple SDK's had any support for syncing such data, etc but the idea was there and wasn't just mine, I had users requesting this as well.

But alas the revenue dried up with Delicious Library hitting the scene. It received crazy levels of press about how beautiful it was. I recall feeling at the time like they were paying the press to cover their product but knowing what I know now, I'm quite certain that was the case. The reviews never mentioned any competitors. There were several all at a cheaper prices with more tons more features.
scv = Santa Clara Valley
Don't worry, OpenAI definitely didn't improperly obtain any of their training data nudge nudge wink wink.
Genuinely insane to the point that I don't believe he'll actually do it. I have no idea who this is for. It will certainly alienate the US tech sector that just spent the last month bending the knee to Trump. It will push Taiwan into the arms of China. I have no idea how this is remotely compatible with all the hawkish AI rhetoric. Baffling on all fronts.
Few people, even in decently earning roles like in tech, will have the runway to try and make something successful on their own all of a sudden after job loss.

Starting a freelancing practice is more likely to bear fruit, but it's a very different ballgame of overheads than "just" the core job itself, if you want to get the full rewards of being a freelancer.
Janus Pro WebGPU
The Henry Ford school of product
I have often heard this described as a change in how people of different generations access information. Younger people today are used to using search bars to find what they need immediately [1], but older people like myself grew up used to it taking time to find relevant information, and often had to organize the information ourselves. Younger people aren't using the library because from their perspective, information is just available everywhere and immediately available on top of that. From their perspective, there simply is not need to go to the library if you can find what you need immediately.

I personally think it is horrible that many universities are selling their physical collections, but I just want to post some reasoning as to why there is a shift in usage. As a researcher, I think that being able to get an immediate answer is often great, but the problem is that it prevents you from exploring the information more deeply and broadly. It gives you a false sense of finality that doesn't require you to question what you are reading more closely or more broadly by examining many sources (like the neighboring books on a library shelf). And when you are doing deep research, that really is a skill you need.

[1] https://www.theverge.com/22684730/students-file-folder-direc...
Full contents of post on Bluesky: https://bsky.app/profile/brainking.bsky.social/post/3lgsco7c...
oh the irony

also, I bet the Chinese are quaking in their boots at the thought of an investigation by Microsoft
Came here to say the same. Got musk written all over it
Well, largish town in the northeast for the most part.

When my family moved to the rural county in Virginia my father chose to retire to, the county "library" was a metal carrel of used paperbacks in one corner of the basement of the old Courthouse, open two afternoons a week, staffed by a volunteers from a local ladies auxiliary --- it took almost 3 decades of fund-raising before they were able to build a library on a small plot of land donated by the local school system.
"We think there is a fundamental misconception about piracy. Piracy is almost always a service problem" - Gabe Newell, owner of Valve, the most profitable per employee company.

They don't need to block anything, they need to stop screwing over consumers.
In 201X in at university they were used, but mostly as study areas.
the fact their dictator is so butthurt is actually quite funny to me xD
It depends who is deciding what illegal is…
He would have read this:

https://fosdem.org/2025/news/2025-01-16-protests/
> All global powers engage in

And the populations in them usually are against these things, which is why there is deception, and why fascination with and uncovering of these things have been firmly intertwined with hacking since day one. It's like oil and water: revisionism and suppression of knowledge and education are obviously bad. Torture is not just bad, it's useless, and not to be shrugged off. We're not superpowers. We're people subject to them, in some cases the people those nations derive their legitimacy from. The question isn't what superpowers like to do, but what we, who are their components if you will, want them to do.

As for your claim, I simply asked it:

> Yes, Palestinians, like all people, deserve to be free. Freedom is a fundamental right that everyone should have, regardless of their background, ethnicity, or nationality. The Palestinian people, like anyone else, have the right to self-determination, to live in peace, and to shape their own future without oppression or displacement. Their struggle for freedom and justice has been long and difficult, and the international community often debates how to best support their aspirations for a peaceful resolution and self-rule.

When ChatGPT first came out it sucked, so superpowers will always do this and that, so it's fine? Hardly.

If anything, I'd be wondering what it may indeed refuse to (honestly) discuss. I'm not saying there isn't such a thing, but the above ain't it, and if anything the answer isn't to discuss none of it because "all the super powers are doing it", but to discuss all.
It’s a tensor stored in GPU memory to improve inference throughput. Check out the PagedAttention (which introduces vLLM) paper for how most systems implement it nowadays.
> Whether Trump administration be able to achieve that remains to be seen

Does it? Do we truly need to be born anew every day, unable to look into the past to see how Trump has run his businesses, or how he conducted his first term, or how he has promised to run his second?
From the letter (emphasis mine):

If you choose to remain in your current position, we thank you for your renewed focus on serving the *American people* to the best of your abilities and look forward to working together as part of an improved federal workforce.
That doesn't necessarily mean final weights are 8-bit though. Tensor core ops are usually mixed precision- matmul happens in low precision but accumulation (i.e. final result) is done in much higher precision to reduce error.

from deepseek v3:

"For this reason, after careful investigations, we maintain the original precision (e.g., BF16 or FP32) for the following components: the embedding module, the output head, MoE gating modules, normalization operators, and attention operators...To further guarantee numerical stability, we store the master weights, weight gradients, and optimizer states in higher precision. "
Not on a per-capita basis. Real GDP growth per-capita rose 2.2x* between 1866-1913. That's smaller than say, the period starting after WW2, 1946-1993 which as 2.5x.

Even post-WW1 1919-1966, it went up by roughly the same as post-civil war, 2.2x - and that period includes a depression and heavy income taxes.

Given how much easier it is to double a small economy than a large one, the fact post-WW2 period beat it is doubly impressive.

Also one should note there was actually an income tax from 1861-1872.

* Using Maddison Project estimates of real GDP
Bill Atkinson – Lisa Source Code [video]
They've already issued RTO directives with timelines in place, and non-compliance will result in people losing their jobs. This letter is not about that. This is just a way to reduce headcount by the end of this FY before going to voluntary separation options like early retirement which might cost more (in total).
Absolutely. I’ve been using rails for almost 20 years, and it’s been mostly a joy to watch it evolve. I will say- there was a short period of time (the webpacker era) where it was losing its allure, but that already feels like a distant memory. For the last decade that I’ve been doing freelance/contract development, I’ve always been able to find plenty of Rails/Ruby work, so it still feels like a valuable thing to specialize in as well. And the Ruby community is just incredible. Rails motto should be “come for the productivity, stay for the community”.
CEOs are replaceable by a bag of D20s. Let's not waste the watts on a LLM.
All of the conservatives I know have given up and vote for the democrats. For one thing, Trump primaries / purged all the conservatives from the GOP during his first term.
Also if you use flux, or at least flux-impregnated wick, it works way better.
I agree they are symbolic, but I believe we should see them as a symbol of how much knowledge has been created that yet remains potentially untapped and unexplored.

https://www.themarginalian.org/2015/03/24/umberto-eco-antili...

I'm sure people would make an argument to the effect that writing that has existed for X years or decades would have already been tapped if it was of any value, and I would respond by saying many publications make little impact on their contemporaries only to be discovered later to have been ahead of their time.

If we start using "engagement" as a metric for the retention of writing, then knowledge will suffer under the tyranny of the majority. Instead I think the most unread books in a library should be celebrated and promoted by the librarians for the sake of having been unread, even if it ends up being kind of funny how bad they are.
That was 1000% a feature and not a bug. It's naive to think that a concentration of children on the internet is safe from creeps without some safety measures.

I, too, wish there weren't bad people in the world and we could just trust everyone around our kids.
I really appreciate this essay.

I've never been a [traditional] artist, but I reckon that those working in the arts, and even areas of the programming world where experimentation is more fundamental (indie game development, perhaps?), would intuit the importance of discovery coding.

Even when you're writing code for hairy business problems with huge numbers of constraints and edge cases, it's entirely possible to support programmers that prefer discovery coding. The key is fast iteration loops. The ability to run the entire application, and all of its dependencies, locally on your own machine. In my opinion, that's the biggest line in the sand. Once your program has to be deployed to a testing environment in order to be tested, it becomes an order of magnitude harder to use a debugger, or intercept network traffic, or inspect profilers, or do test driven development. It's like sketching someone with a pencil and eraser, but there are 5-10 second delays between when you remove your pencil and when the line appears.

Unfortunately, it seems like many big tech companies, even that would seem to use very modern development tooling otherwise, still tend to make local development a second class citizen. And so, discovery coders are second class citizens as well.
Web 2.0 came out of the dotcom bust. As a HN oldtimer, I really wish I was seeing more posts on HN about people partnering up to build cool stuff right now given there’s ton of collective idle bandwidth out there. Maybe it’s happening somewhere else and HN is not the place for that these days?