skysight-inc/HackerNews huggingface dataset:
There is a LOT of effort in the research community currently:

1. Improving the Self-Attention in the Transformer as is, keeping the quadratic complexity, which has some theoretical advantage in principle[1]: The most hyped one probably DeepSeek's Multi-Latent Attention[15], which kind of is Attention still - but also somehow different.

2. Linear RNNs: This starts from Linear Attention[2], DeltaNet[3], RKWV[4], Retention[5], Gated Linear Attention[6], Mamba[7], Griffin[8], Based[9], xLSTM[10], TTT[11], Gated DeltaNet[12], Titans[13].

They all have an update like:
C_{t} = F_{t} C_{t-1} + i_{t} k_{t} v_{t}^T
with a cell state C and output h_{t} = C_{t}^T q_{t}. There's a few tricks that made these work and now being very strong competitors to Transformers. The key here is the combination of an linear associative memory (aka Hopfield Network, aka Fast Weight Programmer, aka State Expansion...) and pushing it into a sequence with gating similar to the original LSTM (input, forget, output gate) - while here this is only dependent on the current input not the previous state for linearity. The linearity is needed to make it sequence-parallelizable, there are efforts now to add non-linearities again, but let's see.
Their main benefit+downside both is that they have a fixed-size state, and therefore linear (vs Transformer-quadratic) time complexity.

For larger sizes they have become popular in hybrids with Transformer (Attention) Blocks, as there are problems with long context tasks [14]. Cool thing is they can also be distilled from pre-trained Transformers with not too much performance drop [16].

3. Along the sequence dimension most things can be categorized in these two. Attention and Linear (Associative Memory Enhanced) RNNs are heavily using Matrix Multiplications and anything else would be a waste of FLOPs on current GPUs. The essence is how to store information and how to interact with it, there might be still interesting directions as other comments show.
Other important topics that go into the depth / width of the model are: Mixture of Experts, Iteration (RNNs) in Depth[17].

Disclaimer: I'm author of xLSTM and we recently released a 7B model [18] trained at NXAI, currently the fastest linear RNN at this scale and performance. Happy to answer more questions on this or the current state in this field of research.

[1] https://arxiv.org/abs/2008.02217

[2] https://arxiv.org/abs/2006.16236

[3] https://arxiv.org/pdf/2102.11174

[4] https://github.com/BlinkDL/RWKV

[5] https://arxiv.org/abs/2307.08621

[6] https://arxiv.org/pdf/2312.00752

[7] https://arxiv.org/abs/2312.06635

[8] https://arxiv.org/pdf/2402.19427

[9] https://arxiv.org/abs/2402.18668

[10] https://arxiv.org/abs/2405.04517

[11] https://arxiv.org/abs/2407.04620

[12] https://arxiv.org/abs/2412.06464

[13] https://arxiv.org/abs/2501.00663

[14] https://arxiv.org/abs/2406.07887

[15] https://arxiv.org/abs/2405.04434

[16] https://arxiv.org/abs/2410.10254

[17] http://arxiv.org/abs/2502.05171

[18] https://huggingface.co/NX-AI/xLSTM-7b
I mostly mean scenarios where your limit order might not be marketable, end up resting on the book, and then get traded "through". I'm speaking from the perspective of an actual direct market participant, where you're not using a market order but are trying to enter a position while adding liquidity/collecting a rebate. (Most exchanges reward participants who have some % of their trades as liquidity-added, with rebate tiers).

Round lots are excluded from the NBBO so that the NBBO can't be as easily influenced by quantities of shares that don't represent any material price signal. 1 share of practically anything but BRK class A represents ~nothing. Less than a round lot on a price level is basically no liquidity available at that level.
So, the headline is a bit misleading. The real source of the "get out of manufacturing" (or at least foundry) business at Intel was the board, who fired the CEO who had made it his primary focus. This all happened without Trump's involvement, I believe. I think that TSMC taking over Intel's manufacturing (or at least the foundry part) would be the least bad outcome, of the ones that the Intel board left on the table.
Ask HN: Who's regularly using LLMs at work?
For those of you that are, what do you do and what are you using them for?
I like it! It's provocative and opinionated, just what I want out of a blog. Blogs are casual, personal, subjective. I read a lot of blogs like this and appreciate being able to take in many broad opinions, many of which yeah I think are dumb, but I like to have them all bounce around my head. Gives me a window into how people are thinking across the community
> He isn't saying that, he's saying he does understand the paper

He literally says 'I can't really follow what it's doing', linking to a paper that discusses some issues with instrumental variable regression (what GMM is used for).
The most likely reason since it broke so many water features.

Pretty obvious that they aren't sending their best to do their dirty work. These DoGE guys are ultimately expendable and if things go south for the current administration the DoGE guys will need to be absorbent enough to handle all the blame that will fall on them when people begin to be held accountable. They need to be multi-layered Downy guys. The men at the top will slick themselves down with lawyers so it all slides downhill and hang everyone else out to dry once they are past their usefulness date.
And that sort of proves my original point which is that we're probably gonna keep riding the same wave as far as it will go!! i.e. keep the tech stack mostly with just what we know works best.
> OpenSCAD is programmatic which suits someone with a software engineering background

Perfect. I already knew how to code, so it was just a question of minutes to learn the basic stuff of the language and then I could just do what I wanted.

Fusion360, AutoCAD and organic modeling tools like Blender you need to learn several concepts, keybindings, navigating through menus, panels, tabs, workspaces, etc, etc. So many things _before_ doing something. In OpenSCAD you can even code in the text editor you're already familiar and then use it only to render the object (which can also be done through CLI!)
Work might be the only distraction they have.
And, historically, CEOs only were the CEO of one company and had one job.
> HTTPS isn't usually used as far as I'm aware. Wait until you discover that your time server's TLS certificate has "expired" according to your local machine; or hasn't yet become valid (valid in the "future"). Good luck syncing after that!

Hilariously, openntpd does it the opposite way, and will go check a HTTPS site to decide what time range might possibly be valid.

https://man.openbsd.org/ntpd.conf#CONSTRAINTS
Even ones that were objectively good for their companies were often divisive. Steve Jobs comes to mind.
This is cutting off your head to cure a migraine.
Maybe a better measure of the CEO factor would be the Tesla Power Wall. That tech still seems good, perhaps better than much of the competition
My problem with Tesla (besides Elon) is that you look at the corners being cut and can only think "Imagine how much better it would be if they hadn't built Cybertruck".

I have a 2018 M3 and was almost tempted by the redesign, until I saw how they butchered the steering wheel, and some of the worst customer support I've ever had to deal with.

Also stiffing customers on what should be warranty repairs, but because the suspension is a wear item they only provide free labor, all 2018 M3 have suspension problems.

Now they are all in on self driving robo-taxis that we all know are going to be far more problematic than Waymo.
OK. That only speaks to the fact that the government has grown. Your original point was about turnover. What I am driving at is surely, even going all the way back to 1880, mean that rank and file federal employees, until recently, turned over with every change in administration. Because that is what we’re talking about, not cabinet members or appointed positions.
As other manufacturers come out with electric drivetrains, Tesla is really falling behind.

I own a Model Y and it’s really barebones and plasticky. For the similar price, the Ioniq 5 is much nicer.

Similarly, the Rivians blow Model X out of the water in terms of features.
It's "lede" if you're showing off or writing for a publication, where they deliberately search for "lede" and "hed" and "tk", which exist specifically to stick out from ordinary text.
Even if it turns out to be worse, having an alternative can be good. Imagine a bunch of therapists in [insert country you find evil], they obviously depend on salaries and for example could divert critical but healthy sentiments toward e g the local military. Strange example but just the cultural variation and independence I mean can be worthwhile.

But then there’s the logs and the training and telemetry maybe a journalist for example would have to run locally if they had such a demand without better alternatives
It’s also important to consider the upcoming tax cuts. Don’t assume the efficiency savings are to return $50.50 to your back pocket.
I rode in a Tesla once for my Uber. The suspension was like a golf cart, super stiff. It made me sick to my stomach. I had to ask the driver to pull over so I could get out. Not sure if they since changed that. The Musk love vs hate that people foolishly adopt as their identity is the result of a power struggle between teams of elites.
Which you are! What ever happened to the MIG implementation work that y’all were working on? Last I heard it was “cursed” and nearly made someone go insane, which is very normal for NVIDIA hardware :)
The longer you carry the dead with you, the longer they cannot rest. Let them go. They would not want to see you suffer in their name.
was right before
The attack surface area for local LLMs is much smaller than almost any program that you would download. Make sure you trust whatever LLM execution stack is being used (apparently MLX here? I'm not familiar with that one specifically), and then the amount of additional code associated with a given LLM should be tiny - most of it is a weight blob that may be tough to understand but can't really do anything nefarious, data just passes through it.

Again, not sure what MLX does but c.f. the files for DeepSeek-R1 on huggingface: https://huggingface.co/deepseek-ai/DeepSeek-R1/tree/main

Two files contain arbitrary executable code - one defines a simple config on top of a common config class, the other defines the model architecture. Even if you can't verify yourself that nothing sneaky is happening, it's easy for the community because the structure of valid config+model definition files is so tightly constrained - no network calls, no filesystem access, just definitions of (usually pytorch) model layers that get assembled into a computation graph. Anything deviating from that form is going to stand out. It's quite easy to analyze.
maybe you told someone you were
going to be some place else

maybe you were with your other family and this unwarranted disclosure revealed that to a scorned spouse and friend group that are always looking for holes in the story 40 years later

not criminal issues, not an FBI problem, and yet can alter your private life
I bought a used Tesla in 2020. It's been a great car. I will never buy another Tesla while Musk is the CEO. He has a stench I will spend the rest of my life trying to wash off myself. He is an anti-brand and he's wrapped himself around Tesla like a python.
I think it's worth calling a font when there were likely cases of the font being transmitted, by copying from one source to another. E.G. Gorton being made by machines licensed from another company, then the output of those machines being used for lettering guides.
You’re right, but only if voters have an obligation to vote along party lines (tribalism). If, however, they’re encouraged to vote for purple or independent representatives, then no one party can hope for sustained majority control. I think the selling point of moderate politics is cultural stability, but maybe there’s something I haven’t considered, and this is not the most ideal solution for factionalism.
They do later talk about the real origin in 1894 in England, with TT&H creating it due to the constraints of their self-built lettering machine to engrave tiny letters on their products
I love how clean and simple the implementation is (even the tedious parts regarding instruction encoding).
Nvidia vGPUs are time-sliced; MIG isn't. Neither work in arbitrary hypervised VMs.
I'd add that, if done well, it humanizes the company. It tells us something about the author, and you don't get that in other forms of advertising.

Fogbugz is just another company, but Joel took the time to write (well) about it in a way that was interesting, relatable and smart. It made you believe that the products they make are interesting and smart.

Paul Graham did the same. YC was humanized via his essays (which didn't really talk about YC.) Patrick MacKenzie made a business making bingo cards, but look at him now.

Fundamentally people do business with people they like. Writing stuff down allows enough personality to come through to give readers "someone to like".

Of course writing quality blogs takes a skillset lacking in most businesses. So yes, there's an element of cargo-cult, in that the result requires more than "we have a blog". Good blogs are enormously valuable- but most blogs are not terribly good.
I don't own stock in Tesla. How do shareholders of any of his companies consider it acceptable for Musk to do what he is doing as a CEO? By that I mean, dividing his attention between so many projects, and co-opting the resources of one company for another. It reeks of a potential shareholder lawsuit waiting to happen.
Not gonna lie, I've always been slightly bearish on Tesla. Electric powertrains are simple enough that most manufacturers can figure it out, and they've all got far more auto building experience than Tesla...

Tesla did have that Apple-esque hype going for it though, can never underestimate that...
TSMC taking over manufacturing means that there is no more technology development for advanced nodes taking place on US soil.
Let me repeat my previous observation:

Meta killed off it's DEI programs[1]
1 https://www.axios.com/2025/01/10/meta-dei-programs-employees...

> high performers

I'm not sure where you got that. There's a vast middle between low performer and high performer.

> profit-focused decision makers, not Judd's Confederate Bake Shop.

Have you been paying attention to Zuckerberg?
It's ELIZA[1] before; now, it's ChatGPT.

From technology point-of-view, Humanity have progressed a lot; however, psychologically speaking, we're still almost the same as we're then (in 1960s).

--

[1] - https://en.wikipedia.org/wiki/ELIZA
This is a great idea for exploring new music. Lately I have had trouble doing that with Spotify -- too much I've already heard, or just stuff that's too mainstream/bland.
There are tracking studies on some of the turtles that navigate from Gulf of Mexico to Atlantic and back that appear to know where the favorable currents are so there is alot of genetic memory like the Monarch butterfly migrations taking multiple generations to get from North America to Mexico.
True. But I can vote for someone who ensure my tax dollars are going where I want them to go.
http://www.antipope.org/charlie/blog-static/2014/10/not-a-ma...

This blog has a brilliant insight that I still remember more than a decade later: we live in a fantasy setting, not a Sci-fi one. Our modern computers are so unfathomable complex that they are demons, ancient magic that can be tamed and barely manipulated, but not engineered. Modern computing isn't Star Trek TNG, where Captain Picard and Geordi LaForge each have every layer of their starship in their heads with full understanding, and they can manipulate each layer independently. We live in a world where the simple cell phone in our pocket contains so much complexity that it is beyond any 10 human minds combined to fully understand how the hardware, the device drivers, the OS, the app layer, and the internet all interact between each other.
High priced, low quality, fake marketing cars, built by a company whose CEO stokes hatred?

Nothing is obvious folks.
Well, before diving into new use of power, it should be noted that much of the national regulatory and investigatory infrastructure is managed by NY state as a matter of them being host. So even considering non-controversial actions like actually investigating claims of rote illegal behavior, NYS has a lot more investigators and courts that are prepared to process those cases. It's just like Florida has more laws regarding theme parks, and Colorado has more laws involving skiing, and California has more laws involving movie making.

Texas just has less legal tools and employees ready. It's been evident for years that companies want to avoid scrutiny and make investigations harder. Moving to Texas is essentially "security through obscurity" where they're just hiding from legal apparatus. Similarly, there is a direct correlation between the number of IRS employees and the unpaid taxes found in audits of big companies.

Much of the regulatory power they're wielding is "benign" to the average American - more strict details on reporting and disclosures, ethics, etc. They require more years and documentation of income, strict accounting standards, etc. The big thing is that it brings most companies into NY state jurisdiction for unrelated-to-exchanges things that impact finances. Over time, they've just grown and fine-tuned the "industry" of maintaining these laws. Just like actual wall street has grown.

The NY vs Texas jurisdictions are relevant because different state governments (Texas) compete on being "business friendly" and take a very lax approach to actually enforcing and investigating laws, as a matter of policy. A big and familiar - but political - example is trump's court cases on (allegedly) defrauding banks by lying about his properties worth - cases like that happen all the time (to less politically involved people too) in NY but not in Texas.

As some specific examples, The laws on exchanges in NY are more strict, so most crypto exchanges can't operate there. There are also state taxes on stock transactions.

Many people have written a lot about DEI and ESG requirements in financial disclosures, which is controversial, but they're not actually state laws of NY. They came from the SEC.

The only strong political example of "newly wielding power" would be the growth in attacks against oil and gas companies in NY by claiming that they lied in their financial disclosures related to risks of their product (ie. climate change).
I think that they've been fine with it so long as the stock price has continued to climb. If it starts to meaningfully fall, I'd except sentiment to more meaningfully change on him running multiple businesses/DOGE.
We have a model-Y for 18 months, it was our first electric vehicle. In another 18 months when we change the car, I'll get another EV but not a Telsa. Only because of Elon, unfortunatly.
I genuinely have no idea what was going through their head with the throttle design that seems to make coasting impossible. I too caught an Uber in a Tesla and got sick because in traffic you're just getting jerked forward and back constantly. The huge sunroof was cool but that was about it.
Yep, I've particularly been enjoying the recent "watchfiles" feature where a comment can be added to the source file, and ending it with "ai?" or "ai!" triggers use of said comment as a prompt to ask about or change that section upon save.
What bad things are you worried about happening if you buy one?
Do you happen to have a link for your HP t6x0 reference? I tried https://www.ebay.com/sch/i.html?_nkw=hp+thin+client+32gb+-(4... and there seemed to be plenty with 32GB of storage but none that I could find with that much RAM
Test it out here:

https://github.com/NX-AI/mlstm_kernels

https://huggingface.co/NX-AI/xLSTM-7b
>The infamous "Oh my gosh!" scream in Skrillex's "Scary Monsters and Nice Sprites" was sampled from a viral sport stacking video from 2008.

The story fits!
Do you have selective memory? A lot of CEOs are activist and this is not recent. Look at Davos.
It strikes me as obviously inappropriate to be using the same batteries appropriate for EVs for stationary storage. There must be better packaging/chemistry when you don't need the power density and vibration tolerance that an EV does.
> The Musk love vs hate that people foolishly adopt as their identity is the result of a power struggle between teams of elites.

Yeah there's certainly no justifiable way a middle class person could arrive at at "Elon Musk is bad for me" independent of the elites telling us
Related OpenAI release: https://openai.com/index/openai-and-guardian-media-group-lau...
Love the illustrator. And love linking out and supporting her.
I've read a fair amount of history (half my family is from germany, and the other half, jews who escaped in time) and what's happening now is remarkably similar to what happened in the lead-up to WWII, historically speaking.

We're not being hysterical, we're being realistic. Trump is mostly a buffoon but Miller, Musk, and Vance are all truly evil people (I don't say this lightly) whose vision for America is truly terrifying. Like, Handmaid's Tale wasn't speculative fiction, but a working manual for these guys.
> And It's Not Just About Elon Musk

Considering how important brand is to Tesla, it’s ridiculous to think someone could pretend they can evaluate it without that factor.

The change in attitude on this very board since 2018 is strong evidence of that.

It’s Kind of funny to watch the Tesla owner shift from proud liberal to frugal suburban dad, like Prius did.
Lawrence Fossi's older substack articles go into great depth about the ought-to-be-illegal level of control that Musk has over the board. Lawrence is a commercial trial lawyer so he views Musk's nonsense in a different, more rigorous light. Link: https://montanaskeptic.substack.com/
https://m.youtube.com/watch?v=woPff-Tpkns&pp=ygUSdW5kZXJ0YWx...
You do know sometimes business people talk with lawyers about business topics right? There are business conversations sensitive enough to not be recorded and transcribed by some cloud service that could be breached.
Of course they don't - they're referring to those still photos you've seen already which look nothing like a fascist salute in their original videos
I have no idea how the shareholders approved that $50 billion pay package (now worth more than $100 billion).
All well and good, but the system deals with money. You cannot have rounding issues.
For non COBOL systems, rounding issues are a big issue.
Curious why they call sheriff deputies and not city police? Is that not the police’s jurisdiction? I’d expect city police to be present but it sounds like the sheriffs were not immediately there
Citizen's United [..] happened under Obama

I'm sorry, but WTF? What the hell did Obama have to do with that ruling, other than serving as a convenient scapegoat in your story? It was a Supreme Court ruling, and last I checked there was still a separation of powers between the Judicial and Executive. Obama publicly called it a devastating outcome.
Running it in a podman/docker container would be more than sufficient and is probably the easiest approach.
this is an absurd comment to read in 2025. "tacitly support running anti-democratic black ops around the world or you're supporting the enemy!" is some PATRIOT Act 2001 era shit.
There's nothing moral about it. The profitability of the tax prep industry depends on taxes being hard to file. Lack of official free e-file is regulatory capture. Any associated blather about making taxes cumbersome to keep people mistrustful of taxes is a fig leaf, as is this case with most "conservative" viewpoints.