skysight-inc/HackerNews huggingface dataset:
Bit late to the party and I'm not into the AI scene, but from glossing over the three key papers they cite to describe their model, my take is as follows.

The idea from LoRA[1] is to take pre-trained, dense weights W_0 for a model and adapt them to new training data by using the weights W = W_0 + BA for inference. The key is that the matrices A and B have a very low rank[2] compared to W_0. Training is then done by treating W_0 as constant, and only updating the A and B matrices.

The idea from MoE[3] is to pick just a few "experts" from a large number using Softmax, and insert them between other layers in a neural network. The "experts" can be just some simple matrices or neural networks in their own right.

The Lamini model seems to combine these ideas, where they use several "experts" layered between the BA matrices. However instead of just a simple Softmax to select the "experts" they use (chunked?) cross-attention[4], and a much larger number of "experts" compared to the MoE paper. From what I gather the cross-attention allows the expert selection to react to the context, unlike the more naive plain Softmax gating approach.

Similarly to LoRA, they train the Lamini model by keeping the pre-trained LLM weights constant. From what I can gather they do a bit of training on the cross-attention layer but then freeze that too, to avoid the cross-attention layer favoring the same "experts" all the time.

The idea then is to train the "experts" and the LoRA layer on facts until the combined model (W above) gets each fact correct (zero loss).

Thus when the model "sees" a keyword in a sentence, a set of "experts" will steer/adjust the output of the pre-trained LLM to output the correct fact. Or at least that's how I imagine it works.

What's less clear to me is what exactly the "experts" are and how they are combined.

Since they're used to adjust the weights of the combined model, I it makes the most sense to my un-trained eye that they're simple matrices as mentioned in the MoE paper. Given they're layered between the low-rank portions of the LoRA section, they're necessarily relatively small matrices, so having millions of these "expert" matrices doesn't add too many parameters overall.

And while they're portrayed as stacked in the Lamini paper, suggesting matrix multiplication, matrices are generally not commutative[5]. So to the un-trained eye it seems likely the "experts" are simply added like in the MoE paper.

But yeah, I'm very much not an expert and the paper was more like a conference poster at best, lacking a lot of detail, so this might be all gibberish and I'd appreciate being corrected.

[1]: https://arxiv.org/abs/2106.09685

[2]: https://en.wikipedia.org/wiki/Rank_factorization

[3]: https://arxiv.org/abs/1701.06538

[4]: https://arxiv.org/abs/2112.04426

[5]: https://en.wikipedia.org/wiki/Commuting_matrices
Car Maker plans to kill chrome on cars over toxicity
Very true - but I drive cars until they die - and have never had a car issue because of engine braking - it is usually another part of the car that goes before whatever damage I am adding to the engine, becomes an issue. So engine brake away!
I really like that idea, especially suggesting to put in your own cooker setup etc. I can certainly work on something along those lines. Thank's so much for taking the time to check it out!

The input is just an input as apposed to a text area so it won't expand. I didn't really think that was an issue but perhaps it should at least have some height to it so the user can edit their input easily. Thanks!
Total random comment, but for posterity's sake -- apparently, Agnikul is organized using a free and open source ERP called ERPNext. There's not been much discussion on it, but I'm doing my best to get my foot in the door using ERPNext and Frappe Framework (what it's built on) in North America.
>Aren't warps already architectural elements of nvidia graphics cards?

Architectural elements of _all_ graphics cards.
the lengths that people go to to defend them is obviously agenda-driven and a result of emotions
Cyanobacteria might be the closest we’ve come.
Refuse? Or tried and it was so complicated it didn’t work?
Gemini has on device
Veganism = not eating meat + caring for animal well-being + not wearing leather

That's it. That's the unexpected "mind blowing" [sic] discovery.

>Veganism is the practice of abstaining from the use of animal products—particularly in diet—and an associated philosophy that rejects the commodity status of animals.[

Source: https://en.wikipedia.org/wiki/Veganism
I think an insolvent renter is probably a smaller risk than an insolvent loanee, at least with certain assumptions. I'm not defending it, and have no background in it, but it seems possible.
Ah, Nerd Sniping: https://xkcd.com/356/
TempleOS Reverse Engineering
I think the next thing is adding the ability to download all your data, so you could switch to a different service. There are many advantages in having companies manage your data and software over time. The pernicious part is when they make it "sticky" by preventing you from accessing the data you have created with their service. If you're able to access your data, you at least have the option of downloading it at any time and canceling the service. Whether you can use it or not in another service is a big unsolved problem. However, it is not unsolvable. Another set of companies could easily evolve that provide transfer services.
https://news.ycombinator.com/item?id=40179566 - PySheets – Spreadsheet UI for Python (pysheets.app) - 287 points - 47 days ago - 74 comments
I had to put them in quotes because some don't really see it as a hassle... And it also depends on the situation. I for one live 500 meters away from a gym, so that takes away a lot of the normal friction. :-)
> The European Commission has determined that the iPhone maker is not complying with obligations to allow app developers to “steer” users to offers outside its App Store without imposing fees on them, according to three people with close knowledge of its investigation.

I think that's a fair assessment based on the bizarre fees and hoops Apple has created under the guise of malicious compliance. There was even a brief moment where they blocked PWAs.
Overcoming pitfalls of Postgres logical decoding
Show HN: React input with IntelliSense and Syntax Highlighting for custom DSL
How gamification took over the world
OP here. True, I oversimplified. What I meant was, there are two parts to the dynamics, the rocket equation and gravity. They add linearly, so any extra velocity that comes from gravity needs to be eliminated by increasing the delta V from the rocket equation. The gravity delta V is just acceleration of gravity times time, so you want to minimize the time. Surprisingly (to me), in the rocket equation, it doesn't matter how long it takes, or what sequence of burns you use, or whether you burn at a constant rate all the way through vs short strong bursts, etc. So to land with zero velocity using the least fuel, you just need to land in the shortest amount of time.
I think it depends on many factors actually. While there are other methods that can be used to defer / delay loading of images (and videos and others) - and there are methods to 'preload fonts' and tricks like font-swap css..

I do believe that deferring the loading of large or many images and other assets can increase the speed to which the browser shows things on the screen, and 'time to interactive'; how long before you can scroll or click.

So depending on how a page is built, not doing anything to defer the loading of many images / other assets (that are not to be displayed 'above the fold' ) can increase or decrease the time it takes to render the text on the initial screen.

"Lazy loading images and video reduces initial page load time, initial page weight, and system resource usage, all of which have positive impacts on performance." - [1]

You may not notice this often if you have a fast internet connection, someone with a limited bandwidth, limited phone memory and the like may experience the issues more.

I believe this is aggravated with layout shifts do to fonts loading late / changing and image height / width not being known until after loading..

I spend a not-so-insignificant amount of time using google's pagespeed testing
(https://pagespeed.web.dev/analysis/https-www-netmeister-org-... )
and other tools to find issues that can be enhanced to fix page load speed, and time to interact, etc.. in order to fix these issues for site pages that others may not notice using a fast connection or benefiting from cached imagery.

"Lazy loading is a strategy to identify resources as non-blocking (non-critical) and load these only when needed. It's a way to shorten the length of the critical rendering path, which translates into reduced page load times." - [2]

[1] https://web.dev/articles/lazy-loading

[2] https://developer.mozilla.org/en-US/docs/Web/Performance/Laz...
Do we really want broken down petroleum flowing through us and getting filtered by our kidneys and liver?
and we know how well users opt-out of things like this or understand / care enough to opt-out / opt-in
I'll save you the trouble of reading the entire court opinion. It basically comes down to the legal definition of "function of the trigger".

The majority believes "function of the trigger" refers to the action of the gun itself - whether one movement of the trigger releases more than one bullet.

The minority argued that if you are exerting constant pressure backwards, that constitutes "a single function of the trigger" and if the gun does a bunch of bouncing around or trickery to turn that into multiple shots it becomes a machine gun.

Both arguments are pretty pedantic, but I am going to side with the majority on this one - as both sides point out, anyone is capable of bump firing guns or shooting rapidly without the aid of novelty devices. And the minority argument that any gun can be a machine gun if you fire it rapidly enough seems like a blank check for the legal system.

If congress wants to ban bump stocks, they need to actually pass a bill and not let the ATF rely on a loose legal interpretation.
I have no issue with the author's points but I just don't see these two as solving the same problem.

Zig, to me, is a better C (as the author notes). It seems like it's designed so you can combine easily with a C code base and incrementally migrate it. That's a great application. I'm not expert enough to speak on the merits of comptime (which the author talks about). But isn't comptime somewhat equivalent to constexpr and similar compile-time constructs?

Rust, to me, fills a niche as a better C++. Macros are better templates. Compile-time ownership checking is better than a C++ runtime smart pointer. There is legacy in C++ that you can never escape eg someone just calling .get() on your smart pointer and doing God knows what with it.

Rust treats memory safety as being of paramount importance and aims to do that with zero runtime cost. That's a great goal but it's also fundamentally different to Zig's goals.
> "Apple Configurator" for Mac ... way better than the parental controls / screen time options

Ok, so this sounds very interesting & useful. I'll be reading up on this, but if you have time to pass along any pointers or tips around using this for personal/household use it'd be much appreciated.
Python is the most popular language for data analysis with a rich ecosystem of existing libraries for that task.

Incidentally I've worked on many products in the past, and I've never seen anything that approaches the level of product-market-fit that this feature has.

Also, this is the work of many people at the company. To them go the real credit of shipping and getting it out the door to customers.
indeed, it just sounds like they're complaining they don't have a seat at the table...
None of them can profitably make electric cars.
Twitter still allows you to mute/block any advertiser… I’ve seen fewer big companies that make a million throwaway accounts for advertising to make it hard to mute. Any ad account I notice more than a couple times gets muted, Twitter asks me if I want to upgrade to paid and I ignore that.
> Traces are inherently sampled unless you're lighting all your money on fire

You can burn a lot of money with logs and metrics too. The question is how much value you get for the money you throw on the burning pile of monitoring. My personal belief is that well instrumented distributed tracing is more actionable than logs and metrics. Even if sampled.

(Disclaimer: I work at sentry)
Trains have brakes, too. And horses... well, I guess we can handle cholera these days.
My question is: what could possibly be so important that you want to take it with you to have your hands full in an emergency potential life-or-death situation?
Thanks! Appreciate the digital push. :-) I'm just nursing a tennis elbow right now, so I'll probably try again before or by end of July.
With all due respect, you don't seem to understand what POSIX is.
For me, I found Zig to be really un-ergonomic especially when trying to hack something together quickly. Do I know that printing to stdout could fail? Sure. Do I want to explicitly handle that potential failure every single time I want to print something to the screen? No.
> Attention awareness does not stop alarms, and it requires your eyes to be open and looking at the phone.

Attention awareness silences/drasticly reduces the volume of alarms, that's how it is designed.

If they have a bug in the attention awareness feature it stands to reason that it could not require your eyes to be open or looking at the device in question at the time.
How the Kubernetes Community Celebrated Its 10th Anniversary
Oh absolutely,

But that isn't how I was using the term “magic”, I was using it as a generic descriptor similar to how the Zig language refers to things that are done in the background, or hidden, without control from the user. I prefer knowing everything a file requires, that way I never double up, or have too many deps without my knowledge of everything that is in a system.
The Core Technology Fee was such a mistake, on Apple's part. Presumably it's their attempt at creating a defensible position ("well it's not the App Store but our core technology now"), but it also relocates a relatively volatile discussion from just the App Store to the iPhone itself.

Apple knows what they're doing, they even retroactively added a Free software carveout to the policy in an attempt to offer an olive branch. The longer they spend trying to reinvent the same racket though, the more obvious their market damages become. And if the EU lets them get away with this reconfiguration, they'll let them get away with anything. The US suit ought to bring the hammer down, and threaten Apple with a breakup if they can't find a way to compete with third-parties naturally.
Investigation underway into rare, unsafe roll experienced by a Boeing 737 MAX
What I've Learned from Getting Fired Six Times
Would you mind explaining in more detail what your custom library enabled?
Personally, I like OpenTelemetry, nice standardised approach. I just wished the vendors would have better support for the semantic conventions defined for a wide variety of traces.

I quite like the idea of only need to change one small piece of the code to switch otel exporters instead of swapping out a vendor trace sdk.

My main gripe with OpenTelemetry I don't fully understand what the exact difference is between (trace) events and log records.
A motivation slide can be useful if you are giving a presentation to people who are more experienced than you (which, for any given audience, there ought to be some). It tells them what built in assumptions you made without being aware of.
Other countries in some cases seem to have much less enforcement of anti fraud. In the US if a company is knowingly selling fraudulent material, I’m guessing they can get in legal trouble for fraud? Does that happen in e.g. China?
EDIT Personally, for clarification, I do think the code is impressive, but the above back-and-forth doesn't really explain why.

---

That explanation still wouldn't mean support the assertion that writing the lander game is the part that's "impressive for a high school senior in 1967."

If anything, all this explanation would show is that their having access to a computer is the "impressive" part.
It breaks down to a primitive of repeating key xor.

If you never had a plaintext you could potentially (depending on the content) collect enough ciphertexts to do frequency analysis on it. You'd recover the keystream at least partially, and then guess based on context to fill out the rest.
Burning pure wood doesn’t produce anything terribly exotic. We know what most of the byproducts do because they occur naturally and we’ve already studied their effects. Namely H2O, CO2, CO, and solid carbon with traces of nitrogen and sulfur oxides, along with metallic micronutrients (at a very small scale).

We already know how the major byproducts interact, I think it would be a question of modeling what happens when we start adding them to the mesosphere. Models aren’t perfect, but it’s not like we have absolutely no idea how the components interact.
Please add something to the conversation.
There have been scientists with far more accreditation in this field than a comedian who've been researching this exact thing for decades.
In a previous life where I did a lot of presentations to Bill Gates, I had the opposite problem. He insisted on having the presentation printed out for him ahead of time, and he would usually have read and understood them (no idea when he would have time to do that). So you’d be on slide 2 going through your careful introduction, and he would ask an uncomfortable question about something on slide 12!

The Amazon method of starting with quiet reading may be the only solution…
Intersting. How long till we have universal translators and/or can figure out the Voynich manuscript?
That looks pretty cool! OpenTelemetry Collector configuration files are pretty confusing. Do like the collector, though. Makes it easy to sent a subset of your telemetry to trusted partners.
Expiration is still a form of rotation. Also, GitHub doesn't provide never-expiring tokens, all of their tokens have expiration policies and need regular rotation. That doesn't mean that there aren't good reasons (such as in this case vulnerable applications) to manually rotate even before the expiration date.
Yes, the subtitle of the article is "AKA in media res"
Chemotherapy is rough on the body because it's specifically targeted to disrupt the process of growing new cells, destroying them when they form. Your body produces new cells much slower than cancer does (by definition), so it can weather the poison longer (in theory).

There's no reason to expect this to be the analogy to hold for reactive chemicals capable of decomposing organic polymers, which are generally tougher to decompose than our also-organic cells.
Are governments really protecting our land borders in that situation though, or protecting their monopoly such that they are the only ones who can take it from us? Governments can absolutely protect our borders, my only issue is that it should be universal and governments should also be ensuring that even they can't strip us of land that we own based on the existing laws and social contracts that are fundamental to our society.

I totally agree that land ownership is propped up on by social contracts, and that we have institutions meant to enforce those contract. I'd be okay with getting rid of land ownership entirely if it also meant getting rid of all those centralized powers that are supposed to defend it but sometimes do the opposite.
One Line Fast Fuzzy Find for Git Worktree
Sure, there's plenty good reasons from the service provider's perspective. However, there's not a lot of good reasons from my perspective.
When humans make the same types of new material discoveries it takes 3-10 years or more to commercialize them and most end up not being commercializable for various reasons.

So I’d say about 3-10 years or more and most won’t be commercializable.
Not just the algorithm. If a new entry is added that ranks higher for a short URL then you will break the old URL.
Yeah it’s not really free if you require me to give you things in exchange is it.
First Look at Messages via Satellite in iOS 18
Is there actually a compelling reason to use Zig over Rust?
Yes, that's what I understood too. The article seems to exaggerate some points, and this is one of them.

It's like creating an attack called "GOLDEN ADMIN". If you have admin credentials, you can log in as the admin and do anything you want! Wow!

(I know that letting attackers authenticate to anywhere without generating logs is bad, but still... i agree with the parent reply)
Leaf Node Monitoring v2024.01 released, better notifications and history
I actually take the opposite approach. In my experience, well instrumented metrics and finely tuned logs are more actionable than distributed traces! Interesting how that works out.
Well said. Though it'd be sorta neat IMO if we could use just one language here, and the memory unsafe aspect could somehow be toggled off or on, gaining all the pros or cons of Zig vs Rust as needed.
> Another example, here’s a library implementing a subset of ffmpeg for ARM Linux in memory-safe C#

What's with all those "unsafe" keywords then? https://github.com/search?q=repo%3AConst-me%2FVrmac+unsafe&t...
Dark fibre
Or, you know, just do it beforehand?
I think you are more talking about RUM which isn't yet supported by OpenTelemetry. I think they are working on it.

I am not sure if it will support session replays like some vendors like Sentry or New Relic offer. Technically, I think session replays (rrweb etc) is pretty cool but as a web visitor I am not a fan.
If you're "far from a free speech absolutist," then by definition you accept that free speech should have consequences. And even most self-described free speech absolutists agree on some acceptable consequences, like incitement to violence, perjury and slander.

And not all consequences are legal. Human beings are social animals and consequences have always existed for violating common norms and taboos. Go into a synagogue and start handing out copies of Mein Kampf and see what happens.
zig is just a temporary resting place for HN language hipsters

in four months you will be moving on to Swift6

then either Gleam or Roc, that should take us to 2025

oh look, Mojo hit 1.0, time to make the jump!

at that point you will throw your hands up and try Perl
Vitamin B6: New compound could delay degradation
Tesla is profitable, lots of cash in the bank and little debt. Tesla will be fine.

Tesla share price might not be, but the company itself is fine.
Apple's hope is probably EU backepdaling or something but as Microsoft vs USA demonstrated, the government machine can be very slow but if it wants to - it will get the things done.
Yes, people make mistakes, especially when common usage of a word like "fine" doesn't align precisely with legal use. In my opinion it's getting upset about not everyone having a concrete understanding of the legal system that there's no need for.
Come work with Writer, the full-stack generative AI platform delivering transformative ROI for the world’s leading enterprises. More info on us and our most recent product launch here: https://writer.com/blog/ai-studio/

We're looking for talented backend engineers who are skilled in functional programming in scala. This role is hybrid in SF, NYC, or London. DM me or email me directly at eliot.goldstein@writer.com if you're interested!

rest of tech stack: cats effect (2 and 3), scala 2.12 -3, http4s, fs2

Links to job descriptions:
https://jobs.ashbyhq.com/writer/aa68721e-07bc-4ebc-a06d-0774...
https://jobs.ashbyhq.com/writer/5d18c7fe-47b4-41d1-825b-16da...