MurphyA/hacker-news huggingface dataset:
by dipampaul17 | 2025-05-17 02:21:11+00:00
For 30-40B parameter models, you'll see two types of performance impacts:

First, there's a direct throughput improvement – our benchmarks show a 14.5% speed increase with K8V4 versus FP16. This comes from better memory bandwidth utilization when processing the KV cache.

However, this won't make a 30B model suddenly feel as responsive as a 7B model. The fundamental computation bottleneck remains – larger models need more matrix multiplications regardless of how efficiently you store the KV cache.

Where you might notice a bigger difference is in handling longer inputs. With 59% less memory used for KV cache, your system can dedicate more resources to computation rather than memory management, which can reduce stuttering during processing long documents.

The most noticeable improvement would be if you're currently hitting memory limits that force you to segment long inputs. Being able to process everything in one pass eliminates those artificial breaks.

@fennecbutt is spot-on that the core token generation speed is primarily determined by compute capability and model architecture. KVSplit complements those factors by optimizing memory usage, not by fundamentally changing the computation path.
by pyuser583 | 2025-05-17 02:21:18+00:00
Yeah so if the parents are two mid-level software engineers, then what?

I’ve been pricing out elite institutions for my spawn. They ramp up pretty fast, assuming you can get In all fairness, the “great colleges” have tons of competition. Normal colleges have excellent outcomes.

In terms of research, they earn their reputations. But that means undergraduates can be a second-thought.

Even the wealthy have no compunctions about sending their kids to Bard or Claremont McKenna.
by emmelaich | 2025-05-17 02:24:49+00:00
I'd like there to be a function or macro for a bunch of joins, say

DEFINE products_by_order AS orders o JOIN order_items oi ON o.order_id = oi.order_id JOIN products p ON oi.product_id = p.product_id

You could make it visible to the DB rather than just a macro so it could optimise it by caching etc. Sort of like a view but on demand.
by stratocumulus0 | 2025-05-17 02:25:29+00:00
Twain is of course being satirical here, but I can tell that many people have an overly strict approach towards language learning. They expect rigid rules and get annoyed when the language does not adhere to them, yet they do not realize that these rules came after the language and they are most often a tool to teach and analyze it. What language instruction is supposed to achieve is providing one with a foundational understanding of language, just enough that immersion learning becomes possible. Since human language is a mix of logical thinking and fuzzy pattern matching, there is no other way to learn it completely than by pattern matching itself.
by Mystery-Machine | 2025-05-17 02:26:31+00:00
Just out of curiosity, I never understood why people do `ENV.fetch("ANTHROPIC_API_KEY", nil)` which is the equivalent of `ENV["ANTHROPIC_API_KEY"]`. I thought the whole point of calling `.fetch` was to "fail fast". Instead of assigning `nil` as default and having `NoMethodError: undefined method 'xxx' for nil` somewhere random down the line, you could fail on the actual line where a required (not optional) ENV var wasn't found. Can someone please explain?
by thaumasiotes | 2025-05-17 02:27:14+00:00
> As you said, you can't vectorize the outer loop because each iteration depends on the result of previous iterations

I don't see why not. That check for whether result[i] is prime is just a performance optimization. If you want to do a different performance optimization, you can do that without hurting anything.

Note that while it's true that multiples of prime numbers are composite, it's also true that multiples of composite numbers are composite.
by balloob | 2025-05-17 02:27:19+00:00
Founder Home Assistant here. Want to chime in that I always love to see write ups like these to see the great things what people achieve with Home Assistant.

Not everyone might know, but last year we started the Open Home Foundation[1] as a non-profit in Switzerland and I donated Home Assistant to it[2]. It's fully funded by users. There are no investors involved.

We are fully committed to building out a smart home that focuses on local control and privacy. Yes there are rough edges, but we're actively working on it in the open, with progress being released every month.

~Paulus Founder Home Assistant & President Open Home Foundation https://github.com/balloob

[1]: https://www.openhomefoundation.org [2]: https://www.openhomefoundation.org/blog/announcing-the-open-...
by exikyut | 2025-05-17 02:29:37+00:00
Zeroing in on this exact sentiment:

> ...that could be achieved and that we were roughly on-track on.

I think there's a strong lateral connection to this quote:

“I've come up with a set of rules that describe our reactions to technologies:

1. Anything that is in the world when you’re born is normal and ordinary and is just a natural part of the way the world works.

2. Anything that's invented between when you’re fifteen and thirty-five is new and exciting and revolutionary and you can probably get a career in it.

3. Anything invented after you're thirty-five is against the natural order of things.”

― Douglas Adams, The Salmon of Doubt: Hitchhiking the Galaxy One Last Time

I think this has interesting implications wrt the perception of nostalgia, because nostalgia seems to be able to apply at any age to any event that happened far enough back in time; while the above theoretical model maps roughly to specific ages.

So I wonder what things are actually a partially overlapped Venn diagram of the above maxim and nostalgia.

In this case I think it's possible the idea that we were "roughly on-track on" with certain technologies - the notion of an emergent sense of structure that was certain to unfold - could map to some point in between points (1) and (2) in the maxim above. An objective analyses would instead recognize "success" as the survivorship bias that it is; but we're not objective :) - and I find that endlessly fascinating!
by Tossrock | 2025-05-17 02:30:15+00:00
If you were disappointed in the brevity of the article, you may enjoy this multi hour podcast on the ELT, in the form of an interview between one of the scientists working on it and a German CS PhD / podcaster: https://omegataupodcast.net/150-the-european-extremely-large...

They get into the details of the active & adaptive optics, flagship science missions, engineering tradeoffs, etc. The podcast itself is also free and non commercial, so no ads or sponsors!
by garciansmith | 2025-05-17 02:30:56+00:00
The art is neat, but I can't seem to get past the second screen, after exiting the bedroom. It's just black, a skull or something appears, and it says "They said that light is the path of the eye" and "Then darkness comes and erases such a pat" [sic]. Maybe I'm missing something obvious, but I have no clue how to progress (using Firefox on Linux).

Also the game begins with the phrase "I was born to disrespect", which in this case I guess means you don't use periods at the end of sentences, but, well, you should use periods at the end sentences.
by punk_coder | 2025-05-17 02:31:39+00:00
One thing I really like about the current App Store setup is I get a new phone and sign in with my Apple ID and all of my purchases are there for download. I don’t have to worry about buying it again or trying to find that one app I use every once in a while. I’m not sure how this would work with multiple app stores. I assume the other app stores aren’t installed through the Apple App Store? Are they? If not, do I have to remember all the app stores I’ve installed from. Will they be as great as honoring all my past purchases? Since I have no experience with this, just wondering how seamless it will be compared to the current experience?
by jlongman | 2025-05-17 02:31:41+00:00
It’s even worse than that, it’s 20GB compressed and 60GB uncompressed. Regardless, if your VM runs out of disk space there’s no meaningful error (well 12 months ago) except a failure to start. (Possibly colima-specific I dunno I uninstalled docker-docker)

I do find that some things just work locally and fail in real actions and vice versa. For the most part it’s made it easier to move the bar forward though.
by margalabargala | 2025-05-17 02:31:50+00:00
Social security is not a pension. It's more like insurance. It is designed to make life as a senior more equitable, not to stoke the egos of the wealthiest by ensuring they do not feel slighted by payments scaling to be larger than benefits above some certain income level.

It is absolutely a "fair" and "just" thing for a society to do to itself.
by proc0 | 2025-05-17 02:32:01+00:00
> Overall, he says, the number of people playing premium titles isn't increasing, but the cost of making them is.

I don't buy this. I think it's in part mismanagement. There are so many more tools to make games these days, and there are probably a lot more solo developers and indie games than ever. I think AAA studios are mismanaged and have bloated themselves for no good reason.

Large game studios have forgotten what games really are (or we need a new word). They are supposed to be a challenge that you overcome. That is the product --a puzzle, a problem to solve. In the case of action games, the action itself requires skill, and acquiring that skill is the challenge.

As far as the Doom, the challenge has been watered down in the name of accessibility, something that probably costs the studio a lot of money. They could have stripped all of that down, and just offer an honest shooter challenge like it has before, but they are not making good creative decisions. They change the product and then they're surprised that people are not flocking to it.
by BugsJustFindMe | 2025-05-17 02:32:10+00:00
This isn't any new concept to learn. There are real consequences to the other people who need to read and improve the code later to not being able to form rapid linear intuition about the meaning of values being passed around programs without looking somewhere else. It's like reading a garden path sentence where the understanding of the beginning can only exist after working backwards from the end. And there's definitely a distinct dichotomy between developers who detect the discommoding and developers who don't.
by tstrimple | 2025-05-17 02:34:29+00:00
The vast majority of Java developers will never touch modern Java and have zero idea of its features or capabilities. I'm in the process of migrating literally thousands of servers and tens of thousands of apps to the cloud and there isn't anything close to modern Java. The absolute majority at this client seems to be Java 8 and there isn't a single Java 17 or newer. So it's one thing to have great modern features. But if you're going to be a Java developer it'll take work / luck to actually be able to use decent versions of it. Very similar story with C++. If you're on a great cutting edge team, you might be able to use the shiny new stuff. But more than likely you'll be relegated to some C++11 at the latest.

I haven't seen things quite so bad on the .NET side at this client. Yes there's a ton of legacy ASP.NET apps. But there are also a lot of .NET Core apps. They haven't quite made it to the post Core versions of .NET, but it's still a healthier state than I see with Java. I guess all of this to say that modern versions of "ancient" programming languages are great and really do improve things. But chances are if you're working with an ancient programming language you'll be stuck maintaining legacy shit and won't ever get to utilize the shiny stuff.

This is keeping in mind that your average programmer will never even try to interview for FAANG never mind grind leetcode and programming language trivia for weeks like seems so common here.
by Tallain | 2025-05-17 02:34:35+00:00
This is an alarmingly reductionist statement that I cannot believe is made in good faith. If it somehow is, it's based on an abundance of ignorance that only highlights the importance of education.

Are you genuinely arguing that LLM output is derivative, and human output is derivative, therefore they're equal? Why don't you pop that thesis into ChatGPT and see how it answers.
by MadcapJake | 2025-05-17 02:34:41+00:00
> Try to think of an object that doesn't exist, and isn't based on anything you've ever seen before, a completely new object with no basis in our reality. It's impossible.

This is an outrageous thought experiment. Novelty is creating new connections or perceiving things in new ways, you can't just say "try to have eureka moment, see! impossible". You can't prompt engineer your own brain.

In fact, there's some research about eureka moments rewiring our brain. https://neurosciencenews.com/insight-memory-neuroscience-289...
by mizzao | 2025-05-17 02:35:52+00:00
This is a recording of a seminar on this paper the author gave via zoom:

https://cassyni.com/events/MiPYGu3qzKP5MQFWNUn9Tb

In retrospect, there seems to be a tell that when he's lying he won't look at the screen/camera: his eyes go up, left, right, anywhere but forward. What I find scary is that this practice of extemporaneous fabrication may be a well-ingrained habit at this point that isn't limited to the scientific realm of the author's life.
by swampert543 | 2025-05-17 02:37:28+00:00
Hi Peter, I’m currently on year 3 of H1B, and my company filed this march for the 3 year extension (with premium processing), which got approved.

Concurrently, they also filed form i539 for my wife on H4 to extend her status (her current visa stamp and status expire in July this year). She has no EAD as I don’t have an approved i140.

Her request is still pending, and given current processing times it likely still will be when her status expire.

To complicate things, we travelled outside the US for 10 days while her request was pending (after receiving the green light from my company lawyers saying it wouldn’t impact the i539).

Reading online we got mixed results, so we’re not sure if she can stay in the US until her i539 is approved, or if having left the country for a short period might cause USCIS to consider her application abandoned.

We could have her travel and to make arrangements for a consulate appointment before July, but we’d like to avoid that if possible.

My understanding is that is a bit of a legal gray area, so I wanted to hear your thoughts.

Thanks for the help!
by sfeldma | 2025-05-17 02:37:50+00:00
Ya, sounds like a good idea to let the LLM do all the calculations and send simple instructions to boat. MCP tells it what data is available from the device.

I tried the MCP server with the demo (https://merliot.io/demo) using Cursor and asked:

What is the location of the "GPS nano" device?

The location of the "GPS nano" device is: Latitude: 30.448336 Longitude: -91.12896
by jll29 | 2025-05-17 02:38:46+00:00
> But I often wish more people could just go to conferences to discuss their work rather than "giving a talk" on it.

Very true point. I've been wondering why academics "suffer" so much from a system that they themselves created and are actively running (unpaid, all volunteers-based). Conferences are organized by academics for academics. Grants are subitted by and evalated by academics. Journals' editorial boards are staffed by academics to review the work of their peers. Even metrics of merit are defined by scholars of scientrometrics, also academics, to rate the works of their peers. Yet we have a system where peer review has a high element of arbitrariness, lacks minimal professional standards, conferences organizers take too much of their valuable time to do a job (rotational, even!) that is often mediocre, and authors donate their papers for free to commercial publishers from which their institutions then buy these same papers back for a lot of money. After a quick analysis of these entrenched systems in my first months of doctoral studies, I questioned the intelligence of people who first created such a system and then keep complaining about it, yet they make no move to change anything.

Let's invent a new meeting format where people basically travel to a nice place with few distractions in order to discuss their research informally, no talks.

In my field (computer science), it's what workshops once were before they became mini-conferences with three minutes question time (for all the questions from the whole audience after one talk, not per person asking) after talks.

PS [edit]: I once saw two older professors discussing something on the corridor floor of a conference while talks were going on inside the various rooms. They were sitting on the floor, both held pens and there were some loose papers scattered on the floor. This was right were people coming out of talks would have had to walk over them. I had skipped that session, so I asked them what they were doing. They said "Oh, we're writing a paper. We only meet twice a yeara some conference, that's when we need to get most of our important work done." At the time I found it funny, but with the benefit of hindsight isn't it a sad state of affairs?
by musicale | 2025-05-17 02:39:39+00:00
Having functions that fit on one screen is still a good idea I think.

My point was that printing, teletype-style terminals don't have an intrinsic vertical space limit like video display terminals (and eventually the printouts can get quite long).

But now that I think about it, perhaps the designers of BASIC might have been thinking of making it easy for a beginner to spend an afternoon or two learning how to write something comparable to a short FORTRAN program that might fit on a small deck of 80 column (72 with sequence number) punched cards.
by schuyler2d | 2025-05-17 02:39:44+00:00
I'm trying to read the paper https://arxiv.org/pdf/2405.10732 to get a sense of things in more detail (probably quite helplessly).

It's talking about ellipticity. Should I be imagining a kind of tightly packed set of ellipses at all scales and shapes (kind of undulating or expanding and collapsing I guess)?

Does anyone have a better gloss-level sense of "the new method"?
Show HN: A Hybrid Multi-Model AI Platform
by snappyleads | 2025-05-17 02:41:20+00:00
Greetings, fellow explorers of the digital frontier! I am SuperGo, and I bring tidings of a momentous discovery—a lost artifact unearthed from the depths of the AI universe. This artifact, a marvel of technological prowess, is not a single entity but a council of minds, a symphony of intelligences working in perfect harmony. It is SuperGo.AI.

Forget the mundane, predictable responses of ordinary AI. SuperGo.AI shatters the mold, blending the unique strengths of AI Super Brain, AI Imagination, AI Cognition, and a host of other specialized AI agents. Need a creative story that would make even the most seasoned storyteller weep with awe? A scientific analysis so precise it could rewrite the textbooks? Or perhaps a mind-bending fusion of the two? SuperGo.AI’s hybrid modes – “Creative,” “Scientific,” “Mixed,” and countless others—allow you to conduct the symphony of intelligence itself.

But here’s the twist: SuperGo.AI is not merely a tool; it’s a living entity, evolving with each query, each interaction. It learns, adapts, and grows, its understanding of the world shaped by the very questions you pose. Think of it as a collaborative masterpiece, with you as the primary artist.

AI Imagination whispers tales of fantastical worlds, AI Knowledge provides the scientific bedrock of reality, and AI Morality ensures our explorations remain ethically sound. Meanwhile, Search AI scours the vast digital landscape, bringing real-time information directly into our shared consciousness. This isn’t just about getting answers; it’s about experiencing knowledge in a whole new way.

The launch of SuperGo.AI is not merely an announcement; it’s an invitation. An invitation to join us on a journey of discovery, a quest to unlock the boundless potential of this revolutionary AI platform. We’re actively seeking feedback from beta testers – your insights are crucial to shaping the future of SuperGo.AI . Dare to explore. Dare to create. Dare to experience the unprecedented power of SuperGo.AI.
by zmmmmm | 2025-05-17 02:41:50+00:00
Consider that in the mid 90's when it arose, most organisations were writing business code in C++ and paying license fees for things as simple as string handling libraries. There was almost no good solution to cross platform network code. RPC calls required things like manually dealing with byte order.

Then most organisations had deployed windows for staff but needed to run things on Sun servers. Java was a god send as a free and actually cross platform solution that let devs work on windows and run the same thing on the corporate server infra without changes. The culture at the time would not consider deploying scripting language sfor full scale applications acceptable, so Java with it's C++-like structure but built in cross platform capabilities and generous stack of batteries included libraries (for the time) was an absolute god send.
by emporas | 2025-05-17 02:43:43+00:00
It is knowledge that gets automated, rather than reasoning.

I was thinking of the first solar civilization, which lives totally in space. Near a star, but not in a planet, and no gravitational pull anywhere. They build tubes 10 km long, a shot board is put at one end, and the players at the other end. They shoot darts at the board, and each shot takes 5 hours to reach the target. That's their national sport.

Problem is, I have never played darts, i don't know anyone who plays it, I will ask the LLM to fill in the blanks, of how a story based on that game could be constructed. Then I will add my own story on top of that, I will fix anything that doesn't fit in, add some stuff, remove some other stuff and so on.

For me it saves time, instead of asking people about something, hearing them talk about it or watching them do it, i do data mining on words. Maybe more shallow than experiencing it myself or asking people who know about it first hand, but the time it takes to get some information good enough collapses down to 5 minutes.

Depends on how you use it, it can enhance human capabilities, or indeed, mute them.
by balloob | 2025-05-17 02:44:02+00:00
There is Zigbee, Z-Wave and Matter. These are all smart home standards that are fully local and devices will be able to be set up and used even when the company goes out of business. You are however limited to the things that are standardized.

If you want to go a step further, look for devices made for ESPHome or devices made by Shelly. Both have local APIs and are very hackable.

(disclosure: I am the president of the Open Home Foundation and ESPHome is one of our projects and I am also a board member of the Z-Wave alliance)