skysight-inc/HackerNews huggingface dataset:
Go doesn't use the C calling convention, but has its own growable stack system and goroutine scheduler that maps to goroutines to threads. So a goroutine can't just call a C function directly.

In order to interface with C code safely, Go's runtime has to jump to the system stack and do some additional setup, make the call, and then switch back. (Adding to that, if the call takes too long, this prevents other goroutines on the same OS thread from running, so the scheduler must jump in and move those goroutines to a different thread.)

All of this is expensive, though we are talking about nanoseconds, not milliseconds. Performance is mostly a problem when doing lots of very quick calls (e.g. you're writing a game engine interacting with something like OpenGL) or lots of slow calls (causing scheduler trashing).
The popular hallway track! Talk to the people while you queue up, what they are working on, what their interests are etc may be super interesting than the actual talk itself. It may be intimidating at first but almost everyone I have encountered at fosdem are fellow nerds and easy to talk to. Remember there (almost) always streaming and recording, don't be so disappointed if you miss a talk.
HN comments are good, but the more nested a thread, the more inane they get. You see things like people arguing over punctuation, or the definition of punctuation.
The point is running locally, not efficiently
Wasn’t available on the $20 plan for me.
The 'brand' of the FBI is worthless. For half of the country it was investigating the criminal.
For the other half of the country it is the result of the purge.

No-one will trust the FBI from here on out.

Need to delete it and re-create the function with a different name.
How is it that cloud LLMs can be so much cheaper? Especially given that local compute, RAM, and storage are often orders of magnitude cheaper than cloud.

Is it possible that this is an AI bubble subsidy where we are actually getting it below cost?

Of course for conventional compute cloud markup is ludicrous, so maybe this is just cloud economy of scale with a much smaller markup.
Also, LPDDR memory, and no published bandwidth numbers.
How does inference happen on a GPU with such limited memory compared with the full requirements of the model? This is something I’ve been wondering for a while
It feels like they were after a similar strategy as when Fiddler was sold. They can control the narative and likely use it as an onramp to their other (much more expensive) products when developers introduce any of their tolling into the enterprise.
https://github.com/cryptocode/terminal-doom
What I really like is the fact that you can basically build anything in this language. From command line tools over Apps or small GUIs up to full fledged Server Backends or Webservices, even WASM... everything is possible.

The NativeAOT approach is also very interesting making it possible to build native binaries similar in size and performance to languages like Rust and Go (not quite actually, but close).

It's also possible to build "single binary" tools by using <PublishSingleFile> which comes in handy when building small helper tools for the command line.
Drowning in Newsletters? This Simple Trick Puts Them All in One Feed
I subscribe to a lot of newsletters, but my inbox quickly became unmanageable. Important emails got lost, and I never actually read half of what I signed up for.

I wanted a better way to consume newsletters without them taking over my inbox, so I set up a simple system:

Kill the Newsletter to convert email subscriptions into RSS feeds
Gmail forwarding to bypass newsletter blocks (especially Substack)
FreshRSS to read them in a clean, distraction-free feed

Now, all my newsletters arrive in one place where I actually read them—without cluttering my inbox.

Would love to hear how others manage their newsletters. Do you use RSS, email filters, or something else?
https://medium.com/@xphract/drowning-in-newsletters-this-simple-trick-puts-them-all-in-one-feed-a721919bb7b6
Very cool! As I understand the flow is transcription with whisper, followed by note generation with GPT4. I guess the prompts in the second step is the secret sauce?
Yes you use the models for the same things, and one is better than the other for said thing. The reasoning process is an implementation detail that does not concern anybody when evaluating the models, esp since "open"ai does not expose it. I just want llms to to task X which is usually "write a function in Y language that does W, taking these Z stuff into account", and for that i have found no reason to switch away from sonnet yet.
I have a question about those tools.

One thing I really like in the SoapUI, is the ability to have mocks(for both REST and XML), so I can mock the responses of some of the requests. Any of those other opensource alternatives have that option?
Alternatively, international worker solidarity should be the model we work for, as we did with the current 5-day work week. It was neither productivity studies nor economic competitiveness that solidified the 5-day work week, it was workers demanding it under threat of violence and agreeing (or being coerced) not to break strikes even internationally.

Throughout human history, this has always been the only model that has ever brought social progress. Voting for more enlightened leaders sounds nice, but the reality is that massive pressure from working people (in the form of actual strikes and violence) has been the only thing that has actually worked. Not to say that it has always worked: even when the riot is not successfully suppressed , it can be co-opted into bringing in even worse regimes and problems (see Russia, China).
It does say "temporarily offline" while they adjust the transgender settings.
But then there will be no comments to summarize.
When there's a will, there's a way.

It's a bit silly but I rolled out my own(*) "no-deps" C++ Jinja template library (https://github.com/google/minja) just to add tool call support to llama.cpp (https://github.com/ggerganov/llama.cpp/pull/9639).

(*): I mean, technically my employer's :-D*
The average SS recipient receives more in benefits than they contributed. (including reasonable interest).

It is a tax, and an income redistribution program.

For the record, I agree with the overall program. Old people need some support from society.
Yes, but because you need to say exactly what one is better than the other for. Not because o1 spends a bunch of tokens for "reasoning" you cannot even see.
Having more people drive like Waymo would likely result in faster travel times for all. It’s a well studied phenomenon. In cities the intersections are a bottleneck and driving at slower average speed often means stopping less often.

Also, don’t you think it’s weird that you complain that the car goes 15 on a road with speed limit equal to 15?
Looks cool.

Just a heads up, the pricing page says the yearly plan is $90/yearly or $15/month billed annualy (grey text under "Yearly"). I'm guessing it should say $7.5/month.
I’m fine with useful content linking to affiliate links too. I am still confused at the ram specs required and those they linked to being off by a factor of 2 though. IF the setup is not realistic or accurate then that wouldn’t be cool.
I’m calling it now: in a few years the amalgamated style of AI headshots will look desperately uncool. Even lighting, defocused background, too-perfect hair, senseless focus on the wrong details, etc.

All it will take is one trendsetter to get the ball rolling, accelerated by the backlash against scam profiles, and all the current AI models will be worthless for the task.
The target isn't the people, the target is science. It is becoming clear that the intent is to govern through fear.
Sorry if you guys get so overwhelmed with deepseek submissions these days. This will be my one and only in the next time. It is cool to have an anti-weight to all these pay models.
Yeah, and touchpad behavior in Linux can be configured to a satisfactory degree, but with admittedly excessive fenagling. Modifying dozens of different parameters in a command line interface to get full functionality is silly. The default settings can easily be interpreted as deliberate cruelty.

I am unusually OCD with touchpads though, and have a history of actually smashing them during times of high stress. Why the touchpad isn't taken more seriously in Linux-land is a mystery to me and certainly a point of contention. For all the other benefits of Linux on a laptop, it is something I've always just accepted and been otherwise very grateful for.
It’s terrifying that data US taxpayers paid for, collected and analyzed in the name of public health, can be removed on a whim. While there are a lot of efforts to archive said data, it would still make it unavailable to Americans who are not tech savvy. Unfortunately, that seems to be the idea, I think.
> Can c# run on mobiles?

Yes: Google Maui Cross Platform App Dev
The UX on MacOS is so bad here. First, a notification prompts you to enable Apple Intelligence. When you dismiss the notification by clicking the "x" in the corner, it instead opens the system settings and proceeds to download something (?) before showing you a checkbox where you can enable/disable it. It feels quite forced.
https://en.wikipedia.org/wiki/Session_fixation

In short, in at least one variation, the attacker is able to smuggle in a known (unauthenticated) session token into the victims browser. Once the victim logs in the session token is authenticated and known to the attacker.

The easy countermeasure is to renew the session token on login and not reuse a previously unauthenticated session token. Or your application has no session at all before login.
They explicitly sold themselves as an Insomnia alt.

Here is their usage graph: https://star-history.com/#usebruno/bruno&Date

Insomnia introduced account shenanigans around the end of Sept 23: https://github.com/Kong/insomnia/discussions/6590
Isn't that just because they can get massive discounts on hardware buying in bulk (for lack of a proper term) + absorb losses?
This is going to sound really unfair, but compared to some of the more hip languages, the .NET/JVM ecosystems feel a bit more like they have adults at the helm who at least try to maintain backward compat. They’re also stodgy as hell sometimes, but I’ll take that. There’s a real difference in culture that manifests in both what is made and what is held up as good engineering. And that has an effect of raising the bar on what is acceptable from an ecosystem POV.

Yes, it’s possible you’ll have to deal with Enterprise-y code sometimes. But, it’s usually your team’s choice as to what is written. Also, people don’t seem to complain quite as much about it when they encounter it at a FAANG elsewhere that tries to do “good” engineering, but that’s another discussion. :)
Base model new iphones like the $200 prepaid burner SE I’m typing this on still have only 64gb of storage.
I have instead opted for a headshot of the goomba from the 1993 live action super Mario bros. Movie which typically gets me requests to change my headshot as people find it disturbing. Perhaps your idea is a better one. Haha.
These studies are entirely irrelevant. No one will ever convince any corporation or private owner that they can get more work out of people working less, even if it were true (which I personally highly doubt).

And that is also entirely irrelevant. The relevant question is whether our society can maintain similar levels of good fortune if we all worked less. And the historical evidence is clear: there are many times more workers today, using tools that are monumentally more advanced, than in the 1930s or even 1950s. And yet, we are all required to work just as much as we used to 100+ years ago, while being paid less in real terms.
FCC demands CBS provide unedited transcript and video of Kamala Harris interview
To add another datapoint, I've been running the 131GB (140GB on disk) 1.58 bit dynamic quant from Unsloth with 4k context on my 32GB Ryzen 7 2700X (8 cores, 3.70 GHz), and achieved exactly the same speed - around 0.15 tps on average, sometimes dropping to 0.11, tps occasionally going up to 0.16 tps. Roughly 1/2 of your specs, roughly 1/2 smaller quant, same tps.

I've had to disable the overload safeties in LM Studio and tweak with some loader parameters to get the model to run mostly from disk (NVMe SSD), but once it did, it also used very little CPU!

I tried offloading to GPU, but my RTX 4070 Ti (12GB VRAM) can take at most 4 layers, and it turned out to make no difference in tps.

My RAM is DDR4, maybe switching to DDR5 would improve things? Testing that would require replacing everything but the GPU, though, as my motherboard is too old :/.
I haven't tried it but there is Posting in a TUI: https://github.com/darrenburns/posting
Idea looks cool, however I'd appreciate to open your landing page and have immediately a try!
This link traps your browser tab at https://explainarxiv.org/explain due to the auto redirect. Not very polite.
> I’d be curious if this would just be a linear slowdown proportional to the RAM MHz or whether CAS latency plays into it as well.

Per o3-mini, the blocked gemm (matrix multiply) operations have very good locality and therefore MT/s should matter much more than CAS latency.
Because it's not always about you. A lot of examples on why these features are useful are about others who exist around you, not for your own convenience. You live in a society.
Then something happened which the Casio F91W did not intend. It was found by the most unlikely creature imaginable.
This is really weak. I'm all for benevolent dictators ruling their projects to protect the conceptual integrity - until that means anti-user behaviour to only enrich themselves.

"But we need to do this to survive!"

no you don't; every handy tool with many substitutes doesn't need to be a startup, especially when your competitive difference is temporarily not doing the thing you're now going to do.
What an odd choice of words for a headline.
Expecting something to do with big balloon tyres that could drive on water or something.

They meant hydrogen powered wheeled excavator.
I could understand it if it was just the hacker news title but the article headline doesn't either.
Not sure if this human error, bad AI or deliberately click bait.
Bruno was supposed to free us from the other bad guy, then they added a subscription too. Fuck Bruno I guess.
They are not incorruptible but they have effectively purged their own ranks on many occasions.
Kubecon is probably bigger these days but it's much more corporate and expensive.
Jmeter is old and awkward, yet so powerful. Great for performance testing.
Between compile times and HLS feeling fragile in VSCode, I’m pretty much done with Haskell at this point. Very nice language, just not my thing anymore.
What do you mean, exactly, about the doubting part? I thought it was fairly well known that LLMs possess superior translation capabilities.
You know damn well that I don't think they purged ALL bad things. Grow up.
Science sides with your mom. Your immune health has much more to do with which bacteria survive in which proportions than with your fear of exposure, because it's incredibly unlikely that you've never been exposed to those species. You were probably born with them and so was baby. If your saliva is well formulated, they are in a healthy balance and you're fine. If not, you might have some bad genes because you're not making good saliva. Floss and brush, and get regular cleanings.
>> The offline-first API client you'll love

so I get I can run it offline, and call local (dev) apis, but is this really the major feature we want & need? How are people going to react when he pulls the same bait and switch for their API tooling a second time?
- a coping Software engineer
Show HN: Turn your MRI into a 3D printable model
Hey there,
If you haven't got a head MRI, brain-stl will download a publicly available one from OpenNeuro. The outputted brain.stl file can be printed via e.g. https://www.shapeways.com/

I will respond to any potential questions!
Apple reportedly gives up on its AR video glasses project
Tailpipe – open-source SIEM for instant log insights, powered by DuckDB
That part I understand and it is quite easy to imagine, but that mental model means that novel data, not present in dataset in a semantical sense, can not be mapped to any exact point in that latent space except to just random one, because quite literally this point does not exist in that space, so no clever statistical sampling would be able to produce it from other points.
Surely, we can include hex-encoded knowledge base into dataset, increase dimensionality, then include double-hex encoding and so on, but it would be enough to do (n+1) hex encoding and model would fail. Sorry that I repeat that hex-encoding example, you can substitute it with any other example. However, it seems that our minds do not have any built-in limit on indirection (rather than time & space).
Winner not yet chosen. More cool ones are here https://software.annas-archive.li/AnnaArchivist/annas-archiv...
Anyone tried if this works against ChatGPT as well?
Very cool visualisation!

There are more cool submissions here https://software.annas-archive.li/AnnaArchivist/annas-archiv...

Mine is at https://isbnviz.pages.dev
It's cheaper because you are unlikely to run your local AI at top capacity 24/7 so you have unused capacity which you are paying for.
Noel recommends def self.foo over class << self, implying that these are syntactic equivalents, but I beg to differ; the former does not update the third implicit context (aka the default definee) whilst the latter does, per yugui’s classic article on the matter https://blog.yugui.jp/entry/846, and this makes more sense to me in common usage.

So instead of treating them as syntactic equals when they’re not, I reserve the former as a special case, a clear sign that the following method body was intended to operate in the implicit definition context of its surroundings for some reason.
Careful what you wish for. Cities that don’t fight back such a mass influx of self-driving cars running errands for everyone would become absolutely non-livable.
PyComet – Git commit messages generator using multiple LLM APIs
Really appreciate the detail and contact. You’ll hear from me.

I have a large collection of Neo-Latin texts I’m trying to get translated.

My goal is to increase the accessibility of the works — not to create a perfect translation. I want to use LLMs to put text on the facing page of the source text. Errors present in the translation, I hope, can be addressed in a Wikimedia-style community editing system.

This approach could .01x lower the cost of translation—and train readers to question translations (something that is a very good thing to learn!)
I'm still in the dark about the problem with storing a salted hash, assuming a decent hash function and a decently long random salt.

Simply replying "everyone knows what the problem is and has know since the 70s" is not as helpful as "here is the problem in three sentences".

You can assume a base level of knowledge in your answer, as I have worked in encryption for a little bit, having written the 3DES implementation for some firmware, and done EMV development.
As a potential tech fix to the endless debates about flagging maybe there should be an upvote/downvote system for flagging rather than just a flag option?
Analysis of past chats in bulk.
It's a new technique called "reverse GC" where you care about the first living object instead of the last one /s

Also:

> nullable can hold references

We have: https://en.cppreference.com/w/cpp/utility/functional/referen...

> Assigning nullval [...] does not trigger the destruction of the underlying object

That's weird.
Yep. You’ll wake up one day and realize the tech itself is not the interesting part — it was understanding and solving problems for people.

Thus, anything that gets in the way of that is not worth it.
They get their guy at all costs and will trample innocent people to do it. Many times, even often and predictably, they will extort oranipulate people into putting themselves in harms way to obtain their objectives. I didn't say the FBI is all unicorns and rainbows.
Bill Gates Memoir/Autobiography
How do I replace it by third party intelligence?
By far the best summary of Palantir from the inside.

Yes, Karp is clearly... hmmm eccentric.

Yes, Shyam is the golden anchor of the engineering culture.
He's a tremendously inspiring influence,
often overlooked by outside commentators.
Which can’t run Apple intelligence anyway…
> They’re also stodgy as hell sometimes, but I’ll take that.

Can't speak for Java, but C# has been evolving very rapidly and for the better with each iteration.

I feel like the C# team really focuses on DX when evaluating language features.

Best place to get a feel for how rapidly the language evolves for the better is the version release docs for C#:

C# 13: https://learn.microsoft.com/en-us/dotnet/csharp/whats-new/cs...

C# 12: https://learn.microsoft.com/en-us/dotnet/csharp/whats-new/cs...

C# 11: https://learn.microsoft.com/en-us/dotnet/csharp/whats-new/cs...

etc.

Compared to JS, Go, Java, etc. I feel like C# evolves significantly faster and the team is faster to validate, implement, and deliver improvements to the language.

I think this is also why some folks who tried C# say 5-6 years ago have no idea how fast the language has evolved for the better.
This is an interesting concept.

I think a parent needs to have some level of controls and direction on how this will be used, plus you’ll need to give some metrics to them on a regular basis to keep them engaged (the parent again).

I live the private and physical aspect of it. Fell free to reach out if you’d like to discuss as I’m also thinking of building something similar for another audience.
Yea this, need to give people a quick hit. Perhaps create an account, 30 mins free or something that is manageable from a cost point of view. Theres a lot of tools around now so you goto try harder to get attention.
Llama.cpp now supports tool calling (OpenAI-compatible)
Supports 8+ models’ native formats (Llama, Functionary, Hermes, Mistral, Firefunction, DeepSeek) + generic fallback for all other models.

Runs anywhere; on a Mac:

brew install llama.cpp
llama-server --jinja -fa -hf bartowski/Qwen2.5-7B-Instruct-GGUF:Q4_K_M

Still fresh / lots of bugs to discover, feedback welcome!
Free as in beer?
Is Mono free as in free beer, or .NET, which at any time can be commercialized?
You would think so, but it’s a clearly stated goal of the new POTUS. So here we are.
However, the free market dictates that you will be outcompeted by anyone who is willing to work 40+ hours. So much for progress.
... Except the obvious argument for a 4 day week is that in a knowledge economy, downtime is more critical to meaningful work. People like Tolkien don't just write 9-5, there's no reason consultants or programmers should work that way, it just doesn't scale.
https://sfconservancy.org/blog/2021/mar/25/install-gplv2/
https://sfconservancy.org/blog/2021/jul/23/tivoization-and-t...
https://events19.linuxfoundation.org/wp-content/uploads/2017...
Mother/water/bed/food/etc easily translates into most (all?) languages. Obviously such concepts cross languages.

In this analogy they are objects in high dimensional space, but we can also translate concepts that don’t have a specific word associated with them. People everywhere have a way to refer to “corrupt cop” or “chess opening” and so forth.
In case you missed it, you can just click the left and right arrows at the bottom to move through the game, the best and worst moves are highlighted with ! and ? and sometimes different colours.
This analogy doesn't work because women cannot accelerate the 9 months - mother nature has set the time period.

Reducing the hours whilst retaining output is an efficiency improvement for the businesses.

The 200 companies is simply a list of those who have successfully achieved this efficiency target.