skysight-inc/HackerNews huggingface dataset:
> Otherwise, you're giving companies building AI extra permission to ignore Open Source licenses and small copyright holders (e.g. independent artists, authors of stories/comments/text on the Internet), which is an asymmetry in favor of companies with the resources to train huge models.

From my experience this is incorrect; it's not an asymmetry in favor of companies; if anything it's an asymmetry in favor of small players.

How do I know? Because I myself am one of those small players, and because I train machine learning models myself. Not huge ones of course, but ones which need data in the range of e.g. 10~25GB range. As an individual it would be completely impossible to explicitly license this data for training (most of which is owned, mind you, by huge corporations!), while a corporation wouldn't have a problem with it.

> What I'm against here is the asymmetry of keeping all the harms of copyright around while letting AI training violate it.

This is fair enough. But please beware that the blast radius of entities your proposal would harm is not limited to huge corporations. I would prefer to fundamentally reduce the scope of copyright too instead of carving out special cases for AI training, but we both know that isn't going to happen.
I agree, but as a counterpoint, I don't think that deep sea submersibles should feel safe.
I'm not making an analogy. It's a literal question.

If I crank noise through a bunch of matrices and churn out the Mona Lisa because the Mona Lisa was in the training data, I've not painted the Mona Lisa. I've reproduced someone else's work through a fairly tortuous mathematical route.

The matrices don't have agency, they can't lay claim to anything.

Although I should probably say, for completeness: the matrices don't have agency yet.
From 0 to glTF with WebGPU: Rendering the Full glTF Scene
My apologies, I didnt intend to be rude..

Any discovery is a step forward (whether it is news or not)..
Logistic Regression is simple to implement, supports binomial, multinomial, and ordinal classification, and is a key layer in NN, as it's often used as an actuator that sorts a probability into a discrete category. Very good for specialized problems, and easily trainable to sort unknown or nonsensical inputs into a noncategory.

Linear Regression is great for projections, and can even be fit to time series data using lagging.
https://hyperboleandahalf.blogspot.com/2010/04/alot-is-bette...
I read the defense minister resigned in a deal negotiated by Lukashenko, and charges dropped against Prigozhin

That’s an absolute win, for Prigozhin, since that was the original goal

this internal issue has nothing to do with anyone outside of that region

thats a pretty big shakeup. “I dont like this guy and there is no political process to remove him so I brought in my private army, the President fleed and he resigned in 10 hours”
There is a lot of plausible deniability on the destruction of the dam. In the case of a nuke in your own territory that's more unequivocal
ALGOL was supposed to be this, but then people kept on making extensions to make it compilable.
Yep. We are in the very early innings of capital being deployed to all this.
The things you describe were already known before, so I assume there needs to be something else.

Maybe he thought more parts of the army would back him?
Eat less.

Eat fewer carbs.

Eliminate sugar and wheat as much as possible.

Eat fruit instead of juice.

Exercise, mainly to avoid losing muscle mass while losing weight.
One of the FAANGs has/had exclusive deal with Oracle for Oracle Enterprise Linux, as Oracle charges a way less than Redhat does. Redhat/IBM figured out how many large enterprises use Oracle Linux; now they want to go after those enterprise customers to show more return on investment, as IBM paid $34B to acquire Redhat.
so gpt is in for you, right?
Your kidding right, I mean teams is not great, but compared to the UI rubbish of zoom and slack?

Take for example the whole business of screensharing, if you share a single screen in zoom you get black blocks for all the zoom windows. Yes it makes sense that I don't share the window with participants, but at least let me freaking close it. Similarly moving the controls from bottom to top of the screen reliably confuses early (and even more advanced users).

And don't get me started on quoting text or including math in slack and what is the whole threads section?!
I’ve still wondered if anyone has tried training with a large dataset of published books, like something from library genesis, or in the case of google using the full text from google books. There’s all this talk of finding quality text and I’ve not heard of text from print books being a major source beyond this textbooks paper?
> we know it was one or the other

Well we don't really, and to me that's part of the problem. Until we know, we don't know.

> And all of the effort debating lab leak or not just distracts time and attention from actual efforts to prevent it from happening again.

In America perhaps, and other polarized polities. As a scientist, again, I cannot comprehend how anyone can see this as a waste of time. We will surely learn a lot from tracking it through time.

I see that the polarising labels got stuck to this issue, and it's unfortunate, but it is in no way inherent to the question.
I use type guards and the `io-ts` package to get both compile-time and runtime type checking:

import * as t from 'io-ts';

/* -------- Runtime type definitions -------- */

export const FooSchema = t.type({
someStringKey: t.string,
someNumericKey: t.number,
someLiteralKey: t.union([t.literal(1), t.literal(8675309)])
someOtherType: t.type({
anotherNumber: t.number,
yetAnotherType: BarSchema
})
})

export const BarSchema = t.type({
...
})

/* ---- Run-of-the-mill Typescript types ---- */

export type Foo = t.Typeof<typeof FooSchema>;
export type Bar = t.Typeof<typeof BarSchema>;

// Static usage
export const Baz: Foo = { someStringKey: 5 } // Compile error! Missing keys/etc

// Runtime usage
export const isFooType = (input: any): input is Foo =>
FooSchema.validate(input)

if (!isFooType(someUserInput)) return server.send(404);

You can enforce exact type shape, or just ignore excess keys, etc. It's pretty handy, and saves me so much work maintaining two type systems, a static one for development and a runtime one for production.

All of the typical caveats apply: consider runtime performance cost, recognize that deep/nuanced types will require a deeper/nuanced understanding of io-ts, there are limitations, alternative libraries with different tradeoffs, and so on.

I like it. :)
The author of that article grew up in China and likely has familial ties there, one could argue that those factors discourage them from honest criticism
I think it is wise to use Nix for a bit before trying to manage all your user configs with it. Using `nix-shell` for project dependencies is a good starting point. You can't really make any costly mistakes here since the scope of any given project is likely much less than all your system and user configurations.

Nix shell plus something like direnv using flakes or nix expressions (non-flake approach) would give you a chance to learn the language and ecosystem. Once you feel comfortable with this, home-manager should be much more approachable.
Agree - Rider has provided a much more enjoyable programming experience for me as well. It does lag behind in supporting some things though, such as early Blazor, but I think it is mostly caught up now.
Let's not rule out that I may just be wrong. However e-graphs are not really a general purpose thing, they're a bespoke creation for partially solving phase ordering in compilers, intermixed with the DAG tiling problem from instruction selection.

Specifically, e-graphs are used with respect to an ISA from which the cost model is derived. My intuition is that this constrains the structure sufficiently that polynomial solutions can be found. Probably involving a partial order calculated ahead of time.

For me, whether the result in the opening post is applicable to uses of e-graphs in compilers has a strong influence over whether I need to worry about it or not. I'm on the fence about e-graphs as a model. If rolling one into production means I'll occasionally hit exponential increases in running time as heuristics fall over, that's an argument against. If those cliffs are unreachable for a given ISA, they don't matter.
Thanks. I'm learning about this today and I'm beginning to suspect all the extra isolation software is not really useful if you configure AppArmor and SystemD properly per service.

The space between "full virtual machine" and "unix permission model" is vast and confusing.

I would have thought that because everything is hashed on nix, it would be trivial to spin up full "virtual machines" without consuming mountains of disk space, but that does not seem to be an option.
so gpt in the realm of text is in right? only sense it was given (excluding multi modal)
The article says that it is because of structural typing, but actually it is because in TS object subtype automatically.

It has little to do with structural typing per se; you would have the same behaviour with nominal classes* and inheritance.

* this is likely why OOP languages have _final_ classes
Both were important, as well as many others, like Kurt Gödel.

Science is about growing the frontier of knowledge, akin to making a cake larger, not dividing up a cake.
> would have been very easy for a couple of MIGs to smoke them like the US Air Force did in 1991 in Iraq's Highway to Hell.

There were videos on Twitter of the Wagner columns using pretty serious short & medium range air defences.

It’s hard to infer exactly how much air defence Wagner has, but even a couple of Pantsirs would make air strikes very dangerous for non stealth aircraft.
To the outsider it might seem that the only thing we've been doing is scaling up the neural networks, but that's not true. A lot of innovation and changes happened, some enabled us to scale up more and others just improved performance. I am quite confident that innovation will continue.
You're absolutely right about British newspapers using double quotes nowadays, but British books still use single quotes, as far as I can tell.

An interesting question to ask, and a harder one to answer is: what kind of quotation marks did people use in handwriting at different points in history? I'm not totally sure about this, but I think there's a long tradition of people in Britain using double quotation marks in hardwriting, in particular, for school. So I suspect that there is a long tradition of the choice of quotation mark being context-dependent. So using single marks in books but double marks in newspapers isn't as strange as it might seem.
It's spelled mastodon.
Even if you trust Apple and Google not abusing their capabilities (which is somewhat reasonable in this context), both are still US companies - I imagine they could be ordered by the US government to pull your E2EE messages from device memory.
Ask HN: Thought experiment – Most compact supercomputer?
What's the most compact supercomputer you could build that could make it onto the TOP500 list?

I'm interested in all the different ways you could assemble existing COTS hardware to build a HPC cluster but optimize the design for compactness or cost.

SO, what's the best machine to build as a DIY'er that could make it onto the list? What choices would you make?
Decker Fantasy Camp 2023
Why you don’t recommend it to anyone? May be
a proper recommendation is what I need to really
be engaged with it ? The same for Nix.

Please more details about the practical benefits
because I kind of see in general why it can be good
but there is still certain lack of the real practical demonstrations from those who use it daily.
what else is there? nato weapon delivery?
Prigozhin was exiled to Belarus: https://www.businessinsider.com/wagner-leader-prigozhin-exil...

Seems like a terrible outcome for Putin. He looks really weak and presumably just lost most if not all of Wagner, who were his most effective troops. He might have Prigozhin poisoned, but that would probably cause further instability internally as it causes more of his leadership to realize he'll clearly betray anybody and his word isn't worth anything.
Reminds me of "Hover!"
I agree that there should be universal undo, but I think by contrast the (informally) transactionality of the "try" model can be a big deal if your system is concurrent.

If you do a thing, find out it isn't what you wanted, and then undo it, while at the same some other process is observing the mutated state, that's potentially a much trickier mental model. If you undo a configuration change and in the meantime a background process has acted on the new configuration, how do you roll that back? Rewinding the timeline is one thing, but maybe throwing out all the work that happened with the wrong configuration is even worse than the status quo.

From the top of my head I am thinking about accidentally changing retention windows or bash history max size where the data loss is super indirect and you'd have to hunt down the undo button for a completely different process, or changing a log format so you end up with a file that's mixed json and plain text logs.

(Of course, "try" presumably applying the changes in a completely synthetic way after the fact could be its entire own can of worms in a very dynamic system if there's a risk changes are applied in the wrong order or skipping some atomicity dance.)
Yes, I am sure. Read the rest of the article. None of the disagreement is about sexual orientation being part of personality.
> But if all you have demonstrated is 5th percentile skill (high school diploma threshold), unsurprisingly only McDonalds will hire you.

I guess neurodivergent people don't exist. Because passing high school is soooo easy when it completely disagrees with how your brain actually functions.

But surprise surprise, people who can't finish school may still be capable of other things.
As with OpenBSD, there has been discussion for ages about moving NetBSD from CVS to something else. However, nobody has slimmed down any of the considered VCS to be small enough to add to NetBSD's base. I think Got is worth considering. I'm looking forward to reading more and trying it out myself. Thanks!
From my cursory understanding (based solely on the README), it seems that `try`s are just directories, so that they can automatically be slung around, without any need for a backing database:

> Sometimes, you might want to pre-execute a command and commit its result at a later time. Invoking try with the -n flag will return the overlay directory, without committing the result.

Also:

> curl install tries

… my brain instantly translated that to "curly fries". Built-in auto-correct!
There are two problems with using Rust for web servers:

1. The only production-ready Rust web servers require writing async request handlers. Async Rust is not fun.

2. The only good Postgres client library is async: https://crates.io/crates/sqlx

I'm trying to remedy the first problem with https://crates.io/crates/servlin .

Solving the second problem will be another project. I hope someone else does it. There is https://crates.io/crates/diesel but it has the same problem as async Rust: incomprehensible build errors.
Is Modern Science a Problem for Living as a Pyrrhonist Today? (2020)
Things don't even actually touch each other though. At no point does an atom of my stuff make contact with an atom of your stuff, right? things can be uncomfortably close to each other but the Van der Waals forces mean it'll never actually touch. to be pedantic.
Very cool, would be nice to be able to somehow open all links from hn directly with the side-loaded comments!
I can only imagine what it’s going to be like in a few countries’ intelligence departments as well. Several countries with well-regarded intelligence operations have functionally signaled, “Well, we didn’t expect this!”

The rest of the planet really didn’t see this coming on Friday. It was borderline late 1990s military-espionage-themed Hollywood action movie stuff.

There’s likely a couple of intelligence orgs that aren’t happy they ended up flat-footed, and didn’t see this coming when it did.
Yeah it seems like he smartly sold at the top here. He wasn’t going to have any more advantageous of a position and he cashed it in at the perfect time.
It had already been fixed in the kernel. Linus tends to agree with it being a bug.
It comes in handy sometimes. It's most useful when you know what algorithm you want to implement, but have to do it in a language you don't know too well. Like if I have to do something in Rust or JavaScript.
Is it just me, or is that page loading much quicker compared to others?
That’s how OpenAI was (is) doing it. Books downloaded from the Internet is a part of the dataset as per GPT3 model card. Right to read.
> The alternative would be, for example, to request ID verification when signing up for a freaking TikTok account

What's wrong with this? When I buy booze in Germany on Amazon for example this is already how it works, you verify your age with your national ID (which has support for a "eID" schema).

The big advantage is that the dedicated company doing the processing is by law required to delete all data after verification, so no commercial third party actually ever gets or can sell your identification data. That's way more secure and private than handing TikTok or other foreign companies your means of identification.

We would be living in a vastly more secure world if random companies only ever got a yes/no that you initiate by a dedicated, audited actor on your soil. And it basically eliminates fraud as well.
Do You Want to Get Involved in Office Politics?
It does not tell me not to moralize. It just tells me to not take any other rules into account that might exist, i.e. to not construct a legalistic argument.

But I don’t need to to allow ambulances. I think this is the core of what many engineers fundamentally don’t get about rules and laws in society?

The framing of the rules clearly places this rule firmly in the real world, in a real park.
It says "restrict the use". And does not provide a qualification.
> using the “show the model the data only once“ approach which is just wasteful.

According to the InstructGPT paper, that is not the case, showing the data multiple times results in overfitting.
Another signal - a sparsely equipped army of a few thousand can march in from Ukraine and take Moscow in a matter of hours, facing minimal resistance. Regardless of the outcome I’m sure NATO has been taking detailed notes.
It really irks me how people "misuse" quotation marks
Bingo. I've been beating this drum since the initial GPT-3 awe.. The future of AI is bespoke, purpose-driven models trained on a combination of public and (importantly) proprietary data.

Data is still king.
> This whole war in Ukraine is very bizarre, no Navy, no Air Force, just ground war and drones, it's like the really expensive pieces of equipment are too costly to be risked for Ukraine.

Russia's air force is supposedly a major problem for the Ukrainians during the current offensive, that's why Zelensky is so adamant about getting fighter jets ASAP.
We like to think that ‘the government’ is in any way any combination of sane, shrewd, or smart. As if it’s this entity that has its own mind.

I’ve worked with various Australian federal government agencies for ten years now. Three years ago we moved to the capital, Canberra.

It turns out ‘the government’ is just a bunch of people who happen to live in this one city. They’re as average as the rest of us. They were born here because their parents live here and these are the jobs here so that’s what they do.

In fact few outsiders come here because the city is famously boring. [0]

The mystery is why we would think that this group of people were any different from the rest of us.

[0]: Actually it’s a charming little town. Don’t tell anybody.
Every year we emit more, and yet somehow we don't see the total fall. It's as if we're not doing enough. But we are talking about it. What more does physics want than heartfelt commitments to do nothing now?!
> What forms your everyone has a bad experience idea? Just something you noticed?

Locally: everyone I remember talking to played a variant of the game as a kid, and didn't like it. Matches my experience too. Hell, the most fun I had with this game as a kid was grabbing the box and spending half a day alone role-playing with the little plastic houses.

Globally: the game has meme status for what I described. Things that get to the point of being memes tend to be broadly representative.
And some people who didn’t follow that logic allowed millions of people to be killed.

This all ain’t easy.
Here is something else. During the pandemic, I went through MacDonald's drive-in on bicycle, because you couldn't go into the restaurant.

I was refused service because I was not a vehicle, and since only the drive-in was operating, I was absolutely refused service.

They claimed it was for safety.

Though technically it is true that a bicycle is not a vehicle according to the BC Motor Vehicle Act, the Act also says:

"a person operating a cycle on a highway has the same rights and duties as a driver of a vehicle"

The drive-through road constitutes a highway, according to the definition, which includes

"every road, street, lane or right of way designed or intended for or used by the general public for the passage of vehicles, ..."

and

"every private place or passageway to which the public, for the purpose of the parking or servicing of vehicles, has access or is invited"

By a kind of stretch "rights" should include being treated the same by a drive-in for vehicles. :)

I actually cited this to them, but in the end it was come back with a car or no service.
Are you kidding me? Who wouldn’t want to emulate an OS or play games directly from their text editor?
The Putin's setup theory is the most convincing I've heard so far.

One thing that doesn't make sense to me is that Prigozhin used an alleged Russian missile attack on a wagner base as justification to start this charade. If the Russian government really wanted to neutralize Wagner, one can only think they would have taken more effective and quick measures to do so, rather than a half-hassed missile attack. There's no logic behind it, some piece of the puzzle is missing.
Based on the title I expected a well performing edge model available to run on a Raspberry Pi.

This is clearly not that.
When I was first working on distributed "semantic" Web+HCI+AI stuff, in the late '90s, nobody was concerned with monetizing -- you just did useful or interesting things, and the money will be figured out eventually.

Today, the first thoughts that comes to my mind aren't what my work could do with this information, but more about sustainability, accuracy, and power.

A bunch of huge companies are going to hoover up all the data you've compiled, and use it in such a way that most people using it will never see your Web site.

So won't be prompted to contribute back wiki-style, won't get all the benefit of your quality control, won't see your donation appeals, won't know you exist, won't see the other things that you would like to see, won't give you analytics on your impact, won't fund you with ad impressions, etc.

Which might all be OK for your use case, but over time it could break most of the current useful percentage of the Web.
It's not the "environmental left" that's holding back carbon taxes.

In fact, most of the world has embraced carbon taxes, including China, California, Washington, Canada, EU and so on.

The USA is a bit of an outlier here, and it's not because the environmental left are in control there.
Ah, pretty cool!

I use Telegram for notes/journals too but it doesn't support markdown and that's how I got the idea for writedown haha.