skysight-inc/HackerNews huggingface dataset:
I think the tools people actually use are rarely that old.

Almost all new tools support gzip by default, because almost all public data is gzip-compressed. Developers often don't bother adding zstd support, because there is little zstd-compressed data around. Because the labs developing new tools are rarely the ones that have to store petabytes of data, they don't benefit from zstd directly. And once the active development is over, most tools receive only minimal support, because nobody wants to pay for maintaining the long tail of average tools.

Also, zstd is the latest reason why gzip is still widely used. Every time someone releases a new general-purpose data compressor that becomes popular, gzip gains a few more years. Because there have been too many gzip replacements over the years, none of them has managed to become popular enough to actually replace gzip before the attention moves to the next state-of-the art compressor. If people agreed this time that zstd is what everyone will be using for the next 20 years, bioinformatics would probably move to it in a few years.
i was thinking 2 is more like Redux, btw :)

ive never honestly used sessionStorage as it's not intuitive to me (if i want it clientside i should probably track it serverside, and at that point server is my source of truth)
Related ongoing thread:

How to store your app's entire state in the url - https://news.ycombinator.com/item?id=34312546 - Jan 2023 (88 comments)
https://www.youtube.com/watch?v=HLRdruqQfRk (Uppestcase and Lowestcase Letters [advances in derp learning])

Is pure gold. I don't wanna spoil it, it just keeps getting better and better as the video progresses. I laughed so hard.

If by some freak chance I ever become wealthy, I want to sponsor this sort of research.
The DMCA doesn't really care about what you do after. The "DRM" has to directly protect a copyrighted work. By your logic, a CFAA violation is also a DMCA violation.
And that makes the rest of the thread irrelevant? Here's Nord Stream AG directly saying they provided funding for WWF and BUND.

https://www.nord-stream.com/press-info/press-releases/conser...
"So why is reading books any better than reading tweets or wall posts? Well, sometimes it isn’t. Sometimes, you need to put down your book, if only to think about what you’re reading, what you think about what you’re reading. But a book has two advantages over a tweet. First, the person who wrote it thought about it a lot more carefully. The book is the result of his solitude, his attempt to think for himself.

Second, most books are old. This is not a disadvantage: this is precisely what makes them valuable. They stand against the conventional wisdom of today simply because they’re not from today."

Thank you for reminding me of this excellent essay.

https://theamericanscholar.org/solitude-and-leadership/
ZFS was made by Sun Microsystems, which was a dear, awesome company that educated, fed, clothed and put bread on the table for an entire generation of computer professionals outside of Sun Microsystems, not to mention paid millions out of their own coffers to open source a reference implementation of a System V Release 4.0 UNIX. And to top it all off, Sun Microsystems made awesome hardware.

Sun kicked butt
had fun
didn't cheat
loved their customers
changed computing forever.
Oh, really? Care to explain? Seems pretty toxic from everything I have seen.

I also don't find paying (currently) over half a billion dollars a year in storage costs efficient. Usually not even factored into the costs of this "clean" energy.

https://earth.stanford.edu/news/steep-costs-nuclear-waste-us
Its simply because both Japan and the U.S. are far behind Korea, who has been shipping reactors all over the world after Fukushima, and they are the only country to increase installations since.
I right-clicked commits not reachable from `HEAD` and the Edit Commit Message option was disabled, so I'm assuming it can only reword commits reachable from `HEAD`.
I’m a big fan of learning through practice vs learning all the theory up front, and for anyone else who feels the same, the Fast AI course and book are very good: https://fast.ai

The authors are working on a new course that’ll dive deep into the modern Stable Diffusion stuff too, which I’m looking forward to.
Would you recommend using it in production?
Since you're using JavaScript, you can implement anchors in the way you want.
It is also possible that the inability to pay back would negative effect the friend's ability to maintain the friendship. Between feeling they let the loaner down, or feeling guilty they couldn't repay it. Even if the loaner set no expectations, it could create enough negativity to sour the friendship. This doesn't have to be logical or rational, it could be an entirely irrational emotional reaction.
Russian trolls on Twitter had little influence on 2016 voters
>Many people didn't contribute purely because they just didn't want to deal with Drepper.

I have no numbers to be able to confirm or deny this, but...

>Debian found it necessarily to fork GNU libc because of Drepper.

... Debian created eglibc because they needed glibc to support their use case and Drepper didn't. Even if Drepper had been the nicest person in the world, if he rejected patches to run glibc on non-x86 then forking was unavoidable.
On the Nord Stream website.

https://www.nord-stream.com/press-info/press-releases/conser...
Impressive!

Will work stop on MiniVM as result of Web49?
Great point too. At least you can count on being able to send over email.

But yeah, the length will get long and even if the browser can handle it do you really want to be passing around that much text at once?

I'm also curious what various OS clipboard size limits are.
Where do you live that a police station seems like a safe place?
Thanks! I always suspected the internet hivemind about thorium sounded too straightforward.
Making the Case for Solana: Fighting the FUD
Crucial insight.

Everyone has to agree to use the right tools for the same nature of things. One possible lineup among many:

Email - external interactions, basically

Team groups / channels: team-scoped information of value, should be associated with a ...

... Team-scoped file store: Teams does this well, as the File tab are Sharepoint subsites which can also be seamlessly used via OneDrive, importantly allowing live doc editing during meetings instead of screen sharing documents

Ad-hoc chats: one or many person conversations that take the place of most meetings, can be ongoing, but the information isn't usually needed by a future team member (action items are not here, they go in P below)

KB store (Notion, Confluence, whatever*): See PARA (Projects, Areas of Responsibility, Reference, Archives) but only meta information about a project or product goes here, the actual work goes in ...

Kanban/Task manager (Trello, Linear, Monday, Asana, Jira): Everything about the P in projects or products that structurally fits

Live meetings : workshop with tangible outcomes (decisions, priorities, etc.) captured as artifacts created by meeting participants during the meeting (likely requires using tools during the meeting, to avoid double-do)

* I say whatever, but I prefer knowledge capture that's a KB site, and live editable, with per user cursors and comments, preferably using Markdown so sections can be published by almost any doc/site gen tool these days
Make one that matches zstd performance then, and get back to us.

Doing this kind of thing requires a shitload of time and money.
That 4GB figure is for a repo at git.lubar.me, a self-hosted git repo where – quoting the person running it – "I am the only person in the world using this Go module".

In this context, that seems like a lot. Of course the module mirror can't know about this context, but there are certainly a lot of scenarios where this is comparatively a lot of bandwidth. Not everyone is running beefy servers.

Seems like an exceedingly poor and unreasonable default, and it doesn't take much imagination to see how this could be improved fairly easily (e.g. scale to number of actual go gets would already be an improvement).
This is the thing that made NNs "click" for me, I think it was very good. Before this I did Andrew Ng's old ML course on coursera, so I thought that was a good intro to old ML approaches, common terms/techniques and flowed nicely into NNs.

But there's are both kinda old now, so there must be something newer that'll give you an equally good intro to transformers, etc.
This review of Wildberger's book at https://philarchive.org/archive/FRADPR says the point isn't that the PhD mathematician finds trig hard, but rather to beginners:

> ... very becoming-numerate generation invests enormous effort in the painful calculation of the lengths and angles of complicated figures. Surveying, navigation and computer graphics are intensive users of the results. Much of that effort is wasted, Wildberger argues. The concentration on angles, especially, is a result of the historical accident that serious study of the subject began with spherical trigonometry for astronomy and long-range navigation, which meant there was altogether too much attention given to circles. ...

> Having things done better is one major payoff, but equally important would be a removal of a substantial blockage to the education of young mathematicians, the waterless badlands of traditional trigonometry that youth eager to reach the delights of higher mathematics must spend painful years crossing

Whether that's correct is different. https://handwiki.org/wiki/Rational_trigonometry seems to give a good description of opposing views.
Zstd isn’t a product. Facebook isn’t getting anything out of anybody using it. So it isn’t a product.
You seem to be getting caught up with the implementation details. The whole point is that programs shouldn't be given overly broad access to the system. Access can be granted to programs by giving them capabilities. Whether that be from tokens or something else it doesn't matter.

Please remember from the first commented:

>Alas, we're in the timeline without capability based security. where users can't just give a file to a program at runtime using a (powerbox) dialog.

This is literally how Android already works today. An app can not read a random file from the system. It has to open a file selector and you have to select a file before an app is able to read it.
requirements evolve over time. and they tend to go up in terms of persistence/auth/sharability needs. it would be nice to make that easy; and conversely when they arent needed anymore it'd be nice to take the state persistence level down with just a few character changes rather than switching state systems entirely
Are you even a developer?

https://bugs.webkit.org/ is full of bugs which are never fixed or will take years.

You will never know where new iOS release breaks rendering engine again and new bugs appear out of nowhere.

And it is almost impossible to debug them, because macOS safari is different than safari on iphone or ipad...

And what about bug in webview in some app or firefox/chrome/edge on iOS...
>>> I think it's the whole push to "decamp" the comic books when getting them to the big screen. It just makes them so much less interesting than source material.

>> My theory is that Iron Man demonstrated that super hero movies are a lot more profitable than comic book movies.

> What does that mean? Iron Man is a super hero from a comic book.

I'm not the OP, but I think he meant that "superhero characters" and "campy elements" are distinct characteristics, and the Iron Man movie demonstrated that dropping the latter make a film more appealing to a wider audience.
Always this brain wave BS. Do you know what the easiest way is to make your EEG show alpha waves? Close your eyes. This article is just rehashing neuro-inspired self-help nonsense for facebook pages.
Be careful with this. This is only supposed to be used on the client side. Many HTTP server implementations (and infrastructure you run on) will not let you use the URI fragment even if it does hit the wire, or things like caching will break - you almost certainly want use query parameters for anything backend related
Just do not. That or alternatively a hidden field is how asp.net WebForms did it state management 20 years ago. Worst possible idea ever.

Good for small scale unimportant external state management but not for your everyday web app.
> Only 1:1 locking is of any interest here.

Agreed, what matters is what percentage of these planets are 1:1 locked.

> All these exoplanets are certainly so locked.

How do you know? Just citing moons in our system isn't enough.
This isn't true. Sourcehut reported a bug, and since the bug is somewhat involved to fix entirely, we asked what the impact of the bug is to them and offered to make a custom change for the site in the interim. The impact matters: the appropriate response is different for "I saw this in my logs and it looks weird but it's not bothering me" versus "this is causing serious problems for my site". We have been getting mixed signals about which it is, as I noted, but since Sourcehut told us explicitly not to put in a special case, we haven't.
If they go to California places like the DMV will provide them a free Korean-English translator service. Under AB 60 an undocumented Korean could get a driver license and a free translator service to obtain it. If I am an undocumented immigrant in Korea will they provide a translator for me to get state ID as an "illegal" immigrant?

Honestly I would be shocked if you could point me anywhere else in the world where a Korean could be illegally staying, go to the motor bureau and not only get a free translator but get an official state ID and driver license.

https://www.dmv.ca.gov/portal/customer-service/interpreter-s...
If AT&T still controlled C compilers and the C standard and and contributions to the C compiler everyone uses was gated behind AT&T I might strongly have considered avoiding C.

If a good non-Facebook implementation of ZSTD shows up, I might strongly consider using (that implementation of) ZSTD.
https://archive.ph/PNyh1
> For their research, the scientists looked at two groups of mice.
Tell HN: Bioinformatics Discord Server
In my experience there has been a general lack of community platforms for bioinformatics on a wider scale. I was thus glad to see that a Discord server was just created.

The link goes to Luca's (the creator) announcement on Mastodon.

For a direct discord invite, you can use: https://discord.com/invite/arPBahn8N6
In most cases* the raw data can be recreated from the aligned BAM/CRAM file, so it's often sensible to toss the raw FASTQs after alignment. But yeah, I go back to 10+ year old genome sequences more than some might expect.

*In the absence of read trimming or discarding unmapped reads
I seem to remember a proverb, something to the effect of, "if you lend money to a friend, be prepared to lose either or both of them".
At least in webpack, tree shaking and minimization are distinct, but BOTH include dead code elimination.

For webpack tree shaking is the removal the declarations of exported values that are never imported. Further, imported values that were used used in functions such exported can be removed (although removing the last import from a file entirely requires knowing the imported file has no side effects).

Separately to that the minimizer (terser) has its own dead code elimination process, that performs more in depth analysis. Terser cannot do the tree shaking part itself because of how webpack structures modules that Webpack was unable to concatenate, and because code slitting might make that live in a different file. But if webpack can eliminate unused exports and ensure that split files only access each other via exports, then terser can handleremaining dead code elimination within each module.
Other organizations have them as well, though they are still difficult to get to — most professional and many college concert halls, theaters (especially, perhaps, those restored to their movie palace glory).
Gotta love how this article does not elaborate how the Trump admin and Trump himself purposely blocked attempts to oversee and audit the program, and how democrats at the time openly called attention to this situation and complained that they were being prevented from doing any fraud prevention or any real auditing of where the money was going.

Of course, it also doesn't seem to talk about how plenty of PPP money went to Trump and Trump affiliated businesses.
And if you punch me in the face I'll shoot you because I feared for my life. 'Merica!
Sounds good. I will reach out over email. Thanks.
I don't have an opinion on this but do want to mention that LastPass does not (currently) encrypt the URL portion of its entries in the secure vault. Something to keep in mind!
Tanstack is working on a router that purports to solve a lot of this.

https://tanstack.com/router/v1
Related from last 12 months

"Ask HN: What book changed your life?" https://news.ycombinator.com/item?id=30734709 (522 comments)

"Ask HN: What is the best book you have read with the greatest impact on you?" https://news.ycombinator.com/item?id=31728760 (48 comments)

"Ask HN: Name 3-5 books that had the most impact on your career and knowledge?" https://news.ycombinator.com/item?id=32896299 (87 comments)
Yeah, it could burn a lot of goodwill. The other option is to tell existing customers that we're trying out something new and pausing everyone's subscription for 3 months while we see what kind of growth we can get as a free tool. That would incentivize people to spread the word a lot, and if it does go well then we would feel comfortable cutting off the B2C revenue. But it would be weird messaging to hear from a company, which could just be confusing to people.
That is exactly what I mean. There is virtually no public support for invading your peaceful neighbor, and no amount of misinformation is going to fundamentally change that. Support for building nuclear power plants is a contentious issue. Of course Russia wants to nudge the outcome in their favor, but saying Russian misinformation is mostly responsible for the anti-nuclear sentiment is crazy.
in iOS you can grant apps access to a limited set of photos though the process is multi-step and most users probably just default to "allow all".
Instagram is kicking the shopping tab out of the home feed
Those assets are not Binance's to "lose".
It is one thing to make a case for the continued maintenance of PGP, or even to say that it has a place in modern cryptography (that's an outré thing to say among cryptography engineers, but, whatever).

It's another thing entirely to say that any cryptography engineer critical of PGP must have a weird personal vendetta against it, as you did upthread.

Harsh criticism of the failings of PGP is practically an orthodoxy among cryptography engineers. It is not a good design by modern standards, and lots of cryptographers would dearly love to be rid of it. Push back on them because you don't think it's worth the time for Debian to switch to minisign, fine, but don't slander people while you're doing it.
Something to be careful about here is that browsers/proxies/etc have arbitrary length limits on URLs, and they can vary by quite a lot

We did this once with a web-based REPL, where you could click a button to copy a link to something you'd previously eval'd and then send that to someone else and their buffer would be preloaded with it. It was super nifty, until someone tried it with a buffer that was a few hundred lines long and at least one browser just said "nope". It sounds like OP is doing some smart stuff to minimize URL length, which should help, but there's still a limit somewhere
It’s not about the amount, it’s rather about how the borrower handles the payback.

If you promised to payback $1 that I lent you, and you don’t despite having it, I’ll equally judge you as if it were $1 million dollars.
One useful perspective to consider is the costs of computation compared to the costs of the experiment.

Considering sequencing costs alone (ignoring costs of obtaining & processing a biological sample), Illumina's current cheapest sequencing kits - Novaseq S4 300 cycles - cost ~$15k for 3000 Gbases of data (whole-genome sequencing for about 24 people). As gziped fastqs, that data will occupy about 1.3TB of space.

Extremely high-volume purchasers may be able knock that sequencing price down some, but the storage challenge starts to seem less intimidating when you realize spending 5% of your sequencing budget on storage would give you a budget of $750/TB of data.
Just be careful and don't accidentally mash :X<junk><CR> otherwise you'd have encrypted the file and thrown away the key :)
Author here, will publish my vlang take on it in the next couple of days.
That would be true for FASTA compression but FASTQ files contain other data. With a MiSeq, for example, 1/3 of the data is the DNA sequences, 1/3 is a quality score (0-37) and 1/3 is a header which includes things like flow cell ID but also a lot of info on the physical registration address of the cluster on the flow cell. In some applications this info is not required, but is from a scientific/data integrity perspective
Looks pretty cool, thanks for sharing!
Pity that people still argue as though "feature rich" is some unmitigated good. :)
I really like the vision this post lays out!

I'm building out a similar system at my job right now, and as the next level of sophistication of that is on the horizon in the next few months, I'm wondering how difficult it would be to adopt Dagster.

Looking at the documentation Dagster looks incredibly Python focused. Is there any way to use it without having to write a single line of Python, and rather generating declaration files of a fixed schema via other languages and using the dagster server as a black box?
Von Neumann's First Computer Program (1970)
Let's think about slowing down AI
The vast differences in lending experiences in my youth (18) led to me using it as a measure of a person's integrity and perhaps how I view them overall -- for better or worse.

I lent one friend money to help pay for a video card and he paid me back exactly on time when he said he would. I respect him to this day. I lent another friend money to pay for some car parts and he did the whole dodging, partial payment, and then forgetfulness thing. I ended up giving up trying to get payment but wrote him off and never had a meaningful interaction with him again.

In some ways its crappy, judging an adult by something in their youth but I've yet to find a case where someone's character changes appreciably in this regard. You're either responsible and pay your debts or you're not.
This is the more interesting link outlining the actual problem:

https://secondegress.ca/A-Wicked-Problem
Should add that log messages should answer questions like:

- What happened
- When it happened?
- Where it happened?
- Why it happened?
- What's the next step?

If your log doesn't answer at least the first 3 questions, then it's useless. If you don't answer "why", then you should think harder whether that is useful or not.

If I had a cent for every time I see "Something went wrong" optionally followed by stack trace that is nearly entirely in 3rd party code with zero information to correlate it with anything - I would have retired to homestead ages ago.
Since the gzip’ed file is larger, it might well be slower since more IO is required. Depends on the case in question, obviously.
Using Up America’s Oil Reserve Was Easy. Refilling It Won’t Be
They faced Origin and won. I'm not sure about Ubisoft, but I think some of their games are available without using a non-steam launcher. Doesn't mean they'll win but their record is pretty good.