skysight-inc/HackerNews huggingface dataset:
S3 is not even files, and definitely not a filesystem.

The thing I would expect from a file abstraction is mutability. I should be able to edit pieces of a file, grow it, shrink it, read and write at random offsets. I shouldn't have to go back up to the root, or a higher level concept once I have the file in hand. S3 provides a mutable listing of immutable objects, if I want to do any of the mutability business, I need to make a copy and re-upload. As originally conceived, the file abstraction finds some sectors on disk, and presents them to the client as a contiguous buffer. S3 solves a different problem.

Many people misinterpret the Good Idea from UNIX "everything is a file" to mean that everything should look like a contiguous virtual buffer. That's not what the real Good Idea is. Really: everything can be listed in a directory, including directories. There will be base leaves, which could be files, or any object the system wants to present to a process, and there will be recursive trees (which are directories). The directories are what make the filesystem, not the type of a particular leaf. Adding a new type of leaf, like a socket or a frame buffer, or whatever, is almost boring, and doesn't erode the integrity of the real good idea. Adding a different kind of container like a list, would make the structure of the filesystem more complex, and that would erode the conceptual integrity.

S3 doesn't do any of these things, and that's fine. I just want a place to put things that won't fit in the database, and know they won't bitrot when I'm not looking. The desire to make S3 look more like a filesystem comes from client misunderstanding of what it's good at/for, and poor product management indulging that misunderstanding instead of guarding the system from it.
EFS is ridiculously slow though. Almost to the point where I fail to see how it’s actually useful for any of the traditional use cases for NFS.
Do you have any specific feedback about why it's unusable? I'd like to get better at this.
WebGPU Embedding Benchmark (vs WASM)
Lying to your lawyer is one of the worst things you can possibly do. If anyone finds out it fucks up EVERYTHING
When an equivalent MR would be issued to linux kernel, and it would be closed with wording "become a platinum supporter", will the reaction be the same?

Something like this happened in the past with android fork and subsequent merge back.

I think the answer "we already implemented this the way we wanted, it is in paid version, supported, by us, so pay us" is good leadership of the project, ensuring it's long term health.
On many more efficient linux distros you can get away with a reduced or eliminated swap file. When SSDs first became popular capacities were relatively small, and I do remember not wanting to give up 8gb of a 120gb drive to swap that would be unused on a system with 8gb of memory. I setup a few systems that way and never had an issue. That said, you are setting yourself up for instability so I wouldn't ever do this on anything mission critical. Also, the balance of storage to memory is not the same in 2024 as it was 12 years ago.
That’s not collusion that’s just optimizing price for profit. You can have ‘collusion in effect’ with price matching on a market leader where multiple companies can price as if they were a single company monopoly without explicit coordination.

There are many situations that are not considered true monopolies that I think should be, such a geographical monopolies that occur when there is a tacit agreement for companies not to enter each other’s areas of operations.
01, like from the Animatrix ?
In theory couldn’t you download the application but then it just makes API calls to OpenAI?

I am trying to use HuggingFace and suspect I will get similar answers to GPT-4. Can someone who knows how to download it ask for example which country Justin Trudeau is the president of?
> Any concerns or suggestions to improve privacy

Where's the privacy policy? Where is data stored and by whom in which juristiction, what data gets shared?

I was able to acces your website's user list by adding your website's token to the url. As proof I added a new (pending) admin user. It's mostly test data but that's a huge open security issue.
I LOVE the new twitter functionality where others put "bad information" into context. Almost as good as the HN 'flag' button. Something like this should become standard everywhere.
Site is broken in mobile safari. Can't scroll at all.
> The purpose of incarceration isn't to coddle murderers,

Unfortunatly in the real world your criminal justice ethics will have to accommodate crimes that are not murder, so you might need to think about some prisoners eventually getting released, who might then go on and do more criming.

> it's great if they change their life but ultimately it's to extract murderers from society

In that case, there is no need to make prisons particularly cruel. Cost can be debated, but surely as a society, we can put a value on humaneness. Even if not, if say I, a billionaire, wanted prisoners eat caviar every night and am willing to fund it, surely this should be allowed.
> instead focus on how googlers are or arent complicit in powering genocide in t he e project presentation interrupted

Yes, and Googlers who are against that can put a stop that by quitting their jobs in protest. You can't go around and publicly slander your company calling them genocidal, while still being employed there, just because they don't do what you'd want them to do, without expecting repercussions when you don't follow your contractual agreement.

You are free to do that after you resign and no longer have the responsibility to follow your contract, which probably stated your job is to be a coding cog, not a PR public speaker for the company policies.

Even in Europe(the German speaking countries), if you publicly accuse your employer of causing genocide, you'd better bring some hard proof to back that up(other than your emotional feelings), otherwise you can not only get fired on the spot but also sued for libel/slander and have to pay defamation damages.
Ok, what's your policy preferences? You sound like a social contract kind of guy, which I obviously don't agree with. I would be more of a Rawlsian for legal system fairness and coercion minimization for social service provision (basically attempting to provide services that provide enough network effect benefit to the tax payer that the only coercion of the tax payer is for free loading avoidance rather than coercing tax payers into paying for things that are actively bad for them or negative value at current cost of provision)
This is dumb. Ukrainians are not helped by denying them access to Russian culture. Putin is responsible for the invasion, not Pushkin, Dostoevsky, or Tolstoy.
I value diversity of thought
On the one side, we have a group of people who have poured untold hours and cash into a project that provides almost no benefit to themselves, on the other side we have a group of people that stumble across said project and say "wah you should do things the way I want."

Which side seems childish?
> It takes too much work to verify everything in every field personally, you wouldn't be able to move at all.

Does it? The rate of paper production is so high that it has become a logistical problem in and of itself and wild goose chases are common. Surely some of that energy could be profitably redirected into replication and consolidation.

The black mark system could work but seems like a recipe for some nasty politics. I tend to think that baking replication into the culture might be a better approach -- science advanced beyond secret-hoarding when information sharing became institutionally valued, and I believe that it could advance beyond p-hacking if replication became institutionally valued. Fund & cite replication efforts and the rest will follow.
> Continuously make fun of superficial attributes and mannerisms

> Push said narrative with ad hominem attacks and jokes about someones' appearance

> Look at the episodes he did about Trump in 2016, the host spends half the time making fun of small hands, when you could fill hours with Trump's fascism.

It is foremost a comedy show yes, and they present things in a light hearted way. For an American show that means stuff like that. Mind you the jokes about Trumps' hands are more about something that Trump brings up constantly, a weird public insecurity about the size of them.

> Selectively present a biased narrative without opposition

I mean. I didn't say it doesn't pick a side. But it does go in depth, and it does present opposing arguments reasonably faithfully (even if it immediately rebuts them) (in my opinion!)
From your list, I think only Kubernetes and Postgres fit my contraints and they don't have (mostly) a SaaS feel.
Resolving random file system paths still gets slower proportional to their depth, which is not the case for S3, where the prefix is on the entire object key and not just the "basename" part of it, like in a filesystem.
"We cannot read or give anyone else access to your emails." is completely false, Proton can read emails sent or received from non-proton infrastructure. They have to.

I mean just look at the end-to-end encryption block, it's such an obvious dark pattern to make people believe they're getting end to end encryption, but when you actually read it they don't claim it at all, but how is someone who doesn't understand technobabble supposed to know that? They're just trying to pretend it's the same thing.

If Proton was an American company they would have been fined into the ground for this stunt. Google wasn't even safe from the Incognito mode lawsuit.
Ask HN: Is there a tutorial avaible for Deep Learning based Upscaling
There are plenty of tutorials for Deep Learning available, https://pytorch.org/tutorials/. Does anyone know of a tutorial or example of Image Upscaling in a similar vain to Nvidia's DLSS?
Seeing models like this work so well gives me hope that mobile first LLMs for things like better voice to text and typing prediction will not just 'work' in 2-3 years but actually not kill your battery too.
How do you make sure you are using WAL mode? Is it a configuration when you new up a client or something?
I’m sorry, but you really need to read up on the fundamentals of what a model is, how weights work, and so on before making comments like this. No, the model weights are not secretly making calls to the OpenAI API.
I think there are two related questions that aren't strictly "swap". To discuss the question, you need to generalize beyond "swap" to all file-backed pages. Under pressure to reclaim space the kernel might evict any page that is backed by a file, but people who want to "disable swap" don't want this either. So if you are against swap you need to make sure that anything that came from a file including your programs and libraries are locked into memory and can't be evicted for reclaim.

The other related issue is whether mmap is obsolete. It is, but most application authors haven't gotten the message yet. Extending your address space over a bunch of files and making the kernel figure it out doesn't work optimally on modern hardware.
https://archive.ph/G9SMH
Do you think the "blue-haired fairy gang" is pro-Zionist or anti-Zionist?
Their code is open source you can fork it and patch it - idk what you mean by "really" open source lol. It just - is open source, there's the code there's the license. A blimp isn't not a blimp because it's got a different color of paint
Banning Open Weight Models Would Be a Disaster
Probably DeepMind considering the accomplishments of alphafold.
> A new attempt (with a new seed) is going to give a totally different answer

Totally different...I'd posit 5% different, and mostly in trivialities.

It's worth doing an experiment and prompting an LLM with a coding question twice, then seeing how different it is.

For, say, a K-Means clustering algorithm, you're absolutely correct. The initial state is _completely_ dependent on the choice of seed.

With LLMs, the initial state is your prompt + a seed. The prompt massively overwhelms the seed. Then, the nature of the model, predicting probabilities, then the nature of sampling, attempting to minimize surprise, means there's a powerful forcing function towards answers that share much in common. This is both in theory, and I think you'll see, in practice.
I've worked on medical devices. As a techie, what surprised me more is not the lack of trials for new devices. It's that for software (and other kinds of components), it's often acceptable to have black box testing to certify a component as functional.

This means basically saying "I pressed a button and the thing did X". That's the test. No need to understand how that works, or provide any more technical documentation or specs, or record system state or variables, or do anything else. Press button, it does X. That's good enough to be certified.

The reason for this is simple enough: sometimes the thing you're using is proprietary and its manufacturer/vendor simply won't give you anything else to certify it. But this black box testing is even used for open source software and components. It's like a short cut you can use to cut through a lot of the testing you could have done. I imagine this will remain standard practice as the "AI" companies push their hallucinating dreck and unexplainable magic into the medical device space.
A related point is made in Michael Huemer's _In Praise of Passivity_, where it is used to argue that almost everyone would be better off simply not getting involved in political processes like voting at all. [1] I think it generalizes to most domains.

Rigorous knowledge in any domain is both difficult to obtain, and it usually commands a small premium compared to the other things you could have sunk your time and attention into. I see at least two options for getting around this:

- Wirehead yourself into thinking truth is beauty and beauty truth, and then tilt at what many others will consider windmills (the fools!). At its best this is probably what folks like Isaac Newton were up to.

- Go all in on the profit motive, embrace competition as a refining fire to force you to be more rigorous or go broke trying. This reduces the problem to knowledge being "just" really hard to obtain.

There may well be more, those are just the two most obvious ones to my eyes.

[1]: https://bazhum.muzhp.pl/media/files/Studia_Humana/Studia_Hum...
Imho: if you 'need' swap, you're running the wrong software.

If an OS+apps' working set exceeds RAM, performance will slow to a crawl in any case.

Best (and only?) argument I've seen for having swap, is that in a gradually building out-of-memory situation (say, a memory leak), swap buys the admin more time to respond / diagnose the problem.

That is a valid reason. Use swap where it applies.

But for eg. desktop systems: pointless. Some app eating all the RAM? Crash right now, please! Then it's usually obvious which app was the culprit. As opposed to slowing everything to a crawl slowly over time & leaving the user to wonder what's going on.
This doesn’t make any sense – the government spent money in no small part due to enormous demand from businesses for assistance, company profit margins are public data, and your vague “they” is conflating the government, academics, and journalists as a single group coordinating for political reasons despite obvious differences between and within those groups. Study after study has found that profit taking is a considerable cost driver:

https://finance.yahoo.com/news/greedflation-caused-more-half...
If I made a font with dots it would obviously work, no reverse engineering needed.
Automatic landing is doable these days.
A few typos:

> I'll have to infer, assume and hypothesis.

*hypothesize

> No transactions, not indices, nearly no constraints

*no indices

---

Also I would be surprised if Snowflake documentation at this introductory level does not exist.

there are a few levels of "certification" that Snowflake offers for professionals who are expected to understand how Snowflake works at a fairly detailed level -- and I am sure official documentation exists to cater to this group starting with a technical introduction/overview of capabilities etc.
I watched this on a 48" 4K display and (for about ten seconds) thought: wow, I should do this 20" iMac G4 Display hack for my computer...

Very cool restomod, the new logic board designers ought'a be proud.
The repo source code is Apache 2.0 licensed, but the weights are not.

Just in case anybody else is excited then misled by their tagline "Building the Next Generation of Open-Source and Bilingual LLMs".
The symbol has existed for some good 2/3 of the time international standards existed as a concept.

As the articles says on the end, we don't know how old non-standardized versions of it are.
How do read-only filesystems align with your definition?
That’s U+26D4: https://www.compart.com/en/unicode/U+26D4

U+1F6AB is for roundtrip compatibility with the Japanese KDDI emoji set (#31 here: http://emoji.digital/kddi-au/).
This line of thinking makes no sense. Dare we upset the corporate overlords with unionizing or they outsource our jobs!

The reality is, if it was cheaper, it would have been done yesterday. You are not saying anything.
This is an actual sign of the end times. Look it up, and please don't try to resurrect clippy again.
This was the moment many former Sun people identify as the 'death of original Sun'.

Sun wanted to make SMP work, so Solaris was a huge amount of work and was incredibly buggy for a long time. Sun effectively lost a huge amount of time going threw this transition and it took years to be back to the same amount of stability. Bryan Cantril talkes about this in LISA11 - Fork Yeah! The Rise and Development of illumos [1]

But not everybody agree, if you read 'Sunburst: The Ascent of Sun Microsystems' that was written in 1991, they are very pro the AT&T deal and explicitly call out the BSD people as 'anti-Standard' and thus anti-Sun.

The real difference there is the argument about what a Standard is. Their approach is basically Unix belongs to AT&T and therefore they are the standard. While the (in my opinion) more correct argument was that BSD/Sun had the most software and they were the defacto standard and being more open, continuing be the standard was what Sun should have done.

Another incredibly important battle was over X vs NeWS. NeWS was arguably technically superior. There is a nice talk by James Gosling about it [2]. It still had technical problems but it would have been a great base to build off. But because some companies, lead by Dec made X open(ish) and many embraced it, X became 'the standard' and thus many at Sun basically said 'Well X is the standard, so therefore we have to switch to X'. Instead of saying, lets make NeWS open and try to be the Standard.

The Sun transition also hurt their costumers. In "LIFE UNDER THE SUN: My 20-Year Journey at Sun Microsystems" David Yen mentions costumers bitterly complaining about it. They made the transition very, very aggressively basically telling costumers to STFU. David Yen loved the aggressive approach because he was selling massive SMP servers that need Solaris. SMP servers where clearly where Sun saw the future.

If Sun had embraced BSD, open sourced NeWS and made the SMP transition in the open, Unix might have gone into the 90s being an unstable juggernaut.

[1] https://www.youtube.com/watch?v=-zRN7XLCRhc

[2] https://www.youtube.com/watch?v=4zG0uecYSMA
It is not an application, it's a model.

It claims to be llama-compatible, so you can reuse the same ecosystem, like ollama for inference.

It will not run random code on your behalf and call OpenAI API like you fear.
“we attribute the performance of Yi models primarily to its data quality resulting from our data-engineering efforts”

Data work is rarely sexy, but (almost) always useful.

Did they release the corpus?
Yes, but rust's quoting does not match shell's quoting. Imagine a path like:

$(rm -rf /*; echo /)

That's a valid Unix path, but rust's quoting does nothing to stop it: https://play.rust-lang.org/?version=stable&mode=debug&editio...
Occam's razor seems appropriate here.

Some of the ideas you raise — I wonder, why aren't non-government individuals finding these objects, parading them around? We have amateur astronomers tracking spy satellites for kicks.

And we all know people in government leak — we've had 60+years for troves of classified documents to have been leaked. Instead we get surgery on an alien puppet with grainy After Effects.

To be sure, I Want To Believe, but I also try not be a butterfly to my fantasies.
That’s the corporate profit-taking at work. If you buy from farmers or Costco prices have been stable.
Serving Astro with Rust
One way to do it : After every token inputted by the user (more on that later), you feed it immediately to the LLM which try to predict the next token. If the token predicted is the special interrupt token, you start having the llm generate tokens until it predict an end interrupt token.

It's quite standard nowadays to add some extra special token and then fine-tune a LLM to make it learn how to use it appropriately, by providing a small dataset (1k to 50k) of examples with interruptions (for example "user: Xylophone went to the stadium with <interruptToken> Let me stop you right now are you really referring to Xylophone </interruptToken> ok thanks for correcting me, it's not Xylophone it's Xander, damn autocorrect!").

llama.cpp has the opposite : an interactive mode where as a human you can interrupt the conversation that the llm is currently generating. But if you interrupt it badly it can make the llm conversation go off-rails.

One problem that result from the usage of tokens is that the user is usually not inputting token but rather characters so you must somehow only process when the characters have stabilized into tokens (for example at word boundaries if your tokeniser has a preprocessing that split on spaces before doing the byte pair encoding). (If you want to process each character on the fly it's getting really tricky because even if at inference you can rewrite the last token in your kv cache, you must somehow create a finetuning dataset to properly learn how to interject based on these partial tokens)
I had implemented something like this before, back when GPT-2 was the go-to. It wasn't too complicated. All you need to do is calculate the probability of the AI responding. So in my case, given an input "Joe: Hey how are you, Bob?", calculate the probability that "\nBob:" will come next. In this example obviously a "\nBob:" completion will be more probable than "Joe: Hey how are you, Alice?". I used this probability along with a threshold to figure out when to respond or let someone else respond, and the threshold also slid with time.

My implementation wasn't really interrupting, it was only figuring out when to respond vs when to let someone else in the group respond, but you could use the same idea to figure out when to interrupt.
Is there a way to send money on TikTok? Congresspeople do like money. Lots of it.

I haven't found a way to phone, email or TikTok a motor home.
"They" refers to web developers. "Us" refers to users. We are the owners of the machines where their code will run.

They have complete freedom on their servers. On my computer, I make the rules. They are lucky if I allow their code to run at all.