skysight-inc/HackerNews huggingface dataset:
Thanks for the corrections! I’m very much not an expert on LLM usage in the real world. But I’m a bit confused:

does go through a pretraining phase using the redpajama dataset, and then an SFT phase with a different objective

Isn’t that equivalent to what I said, since “SFT” seems to stand for “supervised fine-tuning”? That it starts with a pre trained model, and then modifies that model according to your corpus?

Perhaps the confusion here is my ambiguity with “model”; I now see that there’s really two models-one for generating a draft + clues and one for constructing the final output—and this library only concerns/modifies the former. Maybe?
I have a couple projects running on GnuCash, but it doesn't support dimensional accounting. Netsuite would work, but anything Oracle is a hard sell in my space.

Do you recommend any resources for implementing dimensional accounting? Articles? Example schemas?
Peter Miller addressed this in the Rootclaim debate[1] so I'll quote from there:

> Even if WIV did try to create COVID, they couldn’t have. As Yuri said, COVID looks like BANAL-52 plus a furin cleavage site. But WIV didn’t have BANAL-52. It wasn’t discovered until after the COVID pandemic started, when scientists scoured the area for potential COVID relatives. WIV had a more distant COVID relative, RATG-13. But you can’t create COVID from RATG-13; they’re too different. You would need BANAL-52, or some as-yet-undiscovered extremely close relative. WIV had neither.

> Are we sure they had neither? Yes. Remember, WIV’s whole job was looking for new coronaviruses. They published lists of which ones they had found pretty regularly. They published their last list in mid-2019, just a few months before the pandemic. Although lab leak proponents claimed these lists showed weird discrepancies, this was just their inability to keep names consistent, and all the lists showed basically the same viruses (plus a few extra on the later ones, as they kept discovering more). The lists didn’t include BANAL-52 or any other suitable COVID relatives - only RATG-13, which isn’t close enough to work.

> Could they have been keeping their discovery of BANAL-52 secret? No. Pre-pandemic, there was nothing interesting about it; our understanding of virology wasn’t good enough to point this out as a potential pandemic candidate. WIV did its gain-of-function research openly and proudly (before the pandemic, gain-of-function wasn’t as unpopular as it is now) so it’s not like they wanted to keep it secret because they might gain-of-function it later. Their lists very clearly showed they had no virus they could create COVID from, and they had no reason to hide it if they did.

> COVID’s furin cleavage site is admittedly unusual. But it’s unusual in a way that looks natural rather than man-made. Labs don’t usually add furin cleavage sites through nucleotide insertions (they usually mutate what’s already there). On the other hand, viruses get weird insertions of 12+ nucleotides in nature. For example, HKU1 is another emergent Chinese coronavirus that caused a small outbreak of pneumonia in 2004. It had a 15 nucleotide insertion right next to its furin cleavage site. Later strains of COVID got further 12 - 15 nucleotide insertions. Plenty of flus have 12 to 15 nucleotide insertions compared to other earlier flu strains.

Peter goes further into it in the link. Those interested can dig in further.

[1]=https://www.astralcodexten.com/p/practically-a-book-review-r...
What Lies Beneath Canada's Former Indigenous School Sites Fuels a Debate
https://archive.md/rcen1
Taking accountability can and should include admitting you're the wrong person for the job and resigning.
> SARS-CoV-2 has continued to evolve as it moves through the population, and we have learned more about its pathogenicity and transmission determinants. As previously commented in The Lancet Microbe, one of these determinants is the unusual furin cleavage site (FCS) on its spike protein.1 While it has been proposed that the FCS might have been engineered, it is becoming clearer that natural selection is, in fact, the driving factor in its acquisition and functionality, through recombination and epistasis. [1]

I’m hardly qualified to evaluate the evidence for either argument but it seems that it’s hardly a clear cut case of engineering.

[1] https://www.thelancet.com/journals/lanmic/article/PIIS2666-5...
With due respect, this has to be one of the most ignorant takes on robotics I have read in a while. Yes, you can always slap serialization and ZMQ on your framework. That doesn't make it an OS.

And no, the usual robotics stack is not going away anytime soon. Maybe develop some actual useful robots before posting like an expert on robotics topics.
All wholeheartedly agreed, but why shoot one arrow when you can shoot a whole quiver?

In addition to mandating upzoning (without allowing local municipalities to overrule or delay), increasing the cost of hoarding property without use would also help, by incentivizing selling or lowering rents.

And because it would be a punitive tax (primary good created simply by existing), there's no reason you couldn't roll the proceeds into programs to facilitate densification. E.g. tax credits for rebuilding existing properties with more units
> they have some long-context "Memory Model" (whose details I've yet to fully understand)

Section 2.2 of the paper[1] goes into this in more detail. They pretrain the draft model using the redpajama dataset, followed by a supervised fine-tuning step. The training objective "aims to maximize the generation probability of the next token given the KV cache of the previous memory tokens".

This suggests that any model with long context and good retrieval performance could do the same job (and maybe better in the case of the SOTA frontier models).

[1] https://arxiv.org/pdf/2409.05591
> there is nothing inherent to crypto that prevents legal authorities from pursuing those who perpetrate fraud and bringing them to justice.

I will happy to be corrected here, but my understanding is that the foundationally key aspect of crypto that makes it worth anything at all, is that people can use it to circumvent traditional financial tracking of transfers and how they are associated with the individuals who made them. So in order for legal authorities to go after fraudsters, wouldn't they need these tools - the very ones crypto circumvent by design?
No mention of how this works..

It's called "birefringence":

> The recently developed 5D optical storage technique uses birefringence as an extra degree of freedom – the property of a medium whereby its refractive index varies depending on the polarization and direction of incident light. Birefringence generated by the orientation and size of optical nano-gratings offers two extra dimensions, providing much higher storage capacities.

from https://www.5dmemorycrystal.com/technology
yes, i agree that it's reasonable to talk about the typical weight of cars. that is because they vary over many fewer orders of magnitude than the weights of objects made out of atoms or the bandwidths of submillimeter-wave signals, so it makes sense to talk about 'outliers' and edge cases such as golf carts and tanks. by contrast, there is no sense in which that is true of the bandwidths of submillimeter-wave signals, in part because they are mostly not of human origin, so your implied analogy is invalid

but, as i explained, that's not the only dimension along which the statement is nonsense; millimeter waves also don't deliver any hertz of bandwidth. it's a really multifaceted gem of cluelessness

the implication of the last line of your comment seems to be that you think i am not familiar with the site's guidelines, but it is unclear why. perhaps you think criticism of the ieee's editorial and human resources choices runs counter to the guidelines? perhaps you think there is nothing to be learned from my criticism? you'll have to be more specific if you want to have a substantive conversation
GPU Acceleration with Polars
Models already know when they are going off the rails.
https://news.ycombinator.com/item?id=41504226.
That's not the problem. The problem is that they don't care to tell you.
I never said that consumers would verify the firmware. They can however freely choose a third party only in case of FLOSS.
And a gargantuan amount of RAM.
The Netherlands Returns Hundreds of Cultural Artifacts to Indonesia
https://archive.md/lJ6t4
An app which backs up your photos should support incremental backup, or even background backup. Hell: Google's own app is designed around the premise that it can iterate and automatically upload all of the photos on your mobile phone, not just ones it created or ones manually chosen! Imagine if Apple decided to simply entirely remove the ability to grant an app access to your photo library (as opposed to merely providing alternative options to limit what photos are visible, as they do)... clearly Google should "re-evaluate" their app as well :/.
It's cute but I just can't focus on the article knowing the cat is gonna move every time I move my mouse or scroll. I popped open my console and deleted him. Sorry, kitty
Presumably that's all CDNed and therefore a lot cheaper to serve.
Good idea..for huge caves. I've been caving for 30+ years and I can tell you that a skilled and well equipped human will be able to explore more than one of these airships. Sometimes passages are obstructed by ceiling collapses. ( after water drains from the cave due to the lowering of the base level rock will fall off the ceiling due to the loss in buoyancy). Sometimes one needs to move a few rocks to get by. Sometimes you just need to squeeze and contort to get through. Sometimes you need you dig a bit of sediment because it fills a passage to the point of preventing preventing access.

Having said all that, the one time when this would be helpful is when you enter a space with an extremely high ceiling. One can bolt up the wall see see what's there. But the better/easier way is to use a drone to do recon first.
This is really inconvenient for me as well.

It seems like it will affect gphotos-sync, which I have been using reliably for years to backup all my photos...

https://github.com/gilesknap/gphotos-sync

Does anybody have good alternatives? I'm quite used to taking photos on my phone and feeling confident they will be backed up from Google Photos. This convenience is one of the few reasons why I still use Google stuff. I even ditched Gmail years ago.
They really should have no problem with providing a recent valuation. You should say that you’re trying to plan out your tax liability, because depending on your jurisdiction it’s going to be taxed. From that standpoint if it’s significant and there’s no liquidity it’s actually a liability.
Very cool! Seems to me like slip detection would work better with fingerprint-like ridges molded into the surface. Maybe also combined with an accelerometer or mems microphone to sense vibration.
It’s always the travel agent.
"If your app relies on accessing the user's entire library, you may need to re-evaluate your app or consider alternative approaches."

in other words, no possible way to create third party gallery apps.
The issue is not about supporting engineers, this isn’t a pile-on to some poor engineer. It’s about choosing secure software, and avoiding software (particularly critical and vulnerable software like a web browser) from orgs that have built severe vulnerabilities into their software by incorrectly implementing something foundational to computer security.

There are many smart engineers who I would not trust to build my web browser because they lack the domain knowledge to do so. That’s not a slight on them. But if a company hired those people to make a web browser, I wouldn’t trust that org’s software.
Go through TSA
Thank you for posting that.
How to Bypass Authentication on RushOrderTees
It is remarkable that Arc has taken billions of dollars in VC cash but makes these rookie mistakes in securing their own backend that all of their users are accessing. Where are those billions of dollars going? Is it all just in marketing?
You have it exactly backwards. Conservatives still want it to be 1950 and liberals want to continue our progress.
Wanted to see some examples of "beautiful usernames" in the readme
It's just so shitty living in an age where software gets worse and worse, where every decision is made by fuedal lords who get to revise their grants ongoingly however they want.

And any attempt to make life better for ourselves is met by felony anti;-crcumvention charges. The legal system has been stacked against humankind.
Zero. If they aren't willing to tell you what the value is, then they are hiding something, so call it worthless. Even if you disagree, you cannot get any value from them if the company is private, unless there is a liquidity event. So... Zero.
greaseweazle for CDs
> discord is unfortunately not search indexed.

Using discord, etc for any open source project discussions is really unproductive.

Get it that people like the immediacy of chat style communication. But it seems to encourage way more noise and less thoughtful dialogue. The worst aspect is that it locks away a lot of useful information. Trying to dig through chat histories for information is a horrible experience.
What happened wasn't primarily due to her budget. It was due to a meltdown in the pension sector triggered by over-leverage, arguably caused by the BoE not doing its regulatory duties correctly.

Don't get me wrong, a budget that cuts taxes without cutting spending is no good. But the idea that what happened was a direct consequence of that doesn't make much sense as it had been telegraphed a long way in advance, giving the markets plenty of time to adjust. The central bank changed monetary policy a day before the mini-budget, and changes in that are kept secret until the moment of announcement. Additionally, UK spending has since blown through what the mini-budget would have created without any sudden market turmoil.

https://www.ft.com/content/4701b6ac-851e-43fd-a2b2-b38dd07c7...

Regulators failed to anticipate the dangers that borrowing by pension schemes posed to the stability of the UK’s financial system, according to a parliamentary report into the turmoil that hit the gilt markets following Liz Truss’s disastrous “mini” Budget in September last year.

Pension schemes suffered multibillion-pound losses after they were forced to sell assets to ensure that complex derivative-linked strategies — known as liability driven investments (LDI) — did not implode when gilt yields jumped as investors rejected the then prime minister’s economic strategy.

Also, Truss is basically correct that the UK needs more growth. Disagreeing on her tactics is reasonable, disagreeing on her goals isn't. She was unfortunately attempting to create growth from a position of weakness: in a party that didn't want to do anything hard like cutting spending, and with a fragile/over-leveraged financial sector.
Do people really care that much about scientific accuracy today?
Matt Ridley is a journalist with hardly any qualification to conduct an analysis.
> Does it merit your overwrought hysterics? "Cruel and unusual"? Absolutely laughable.

We have established that it's unusual. Only the US, NK and Eritrea demand this, and you've wisely not argued that point.

As for cruel: yes, definitively so. It causes needless hardship for many and is decidedly unfair. You agree that it's unnecessarily complex, and you seem to have given up on insisting that citizens abroad are equally represented.

So what's 'hysterical' about calling it cruel and unusual - when it clearly is? What's "laughable" about any of this?

> I don't understand how anyone who writes software for a living can be intimidated by IRS forms.

Congrats - you don't have any issues which would prevent you from having trouble with that kind of form and all the work that goes into it.

Unfortunately, you apparently lack the empathy, or theory of mind, to understand that many if not most people feel quite differently about it.

There are all sorts of reasons that people (even software programmers) can have a different view on this to you: ADD, form anxiety/aversion, math issues, lack of financial knowledge, fear of legal repercussion, record keeping difficulties, life events, language barriers and issues with legal jargon, cognitive disabilities, accessibility issues, growing up poor, empathy for others, etc.

Denying their experience to defend something so obviously exploitative, unjust and unnecessary is a really strange hill to battle on.

What would you personally lose if this situation were corrected? Absolutely nothing. What do you gain from it? Absolutely nothing. You would immediately benefit if these rules were changed. So why are you on this hill bro? What are you trying to do here?

Why is that whenever someone points out an injustice, there's always someone telling them to stop complaining? (And not politely either.) Often they'll say something like "Well if you hate our rules so much, leave!" - except in this case, I already did, and I'm still affected.
Nope, Google Chat is their newest chat app and was released in 2021 : https://www.theverge.com/2021/6/21/22538240/google-chat-allo...
What would be the benefits? Sounds like we should prioritize family, as has been tradition for the entirety of human existence. The new approach of ‘everyone has a house/dwelling and their own independent life apart from anyone’ is the experiment.
I think there is already an extension that does this, even though I can't seem to find it right now. But anyway, why would I give myself the ability to accidentally click on some of these videos? For me, the faces act as a filter to ignore them.
There's a shred of truth in every joke.
Social media? I remember people doing the lowercase thing back on IRC. It was an indicator of informality and "coolness".
> solved without constraints on time window, msgs rates and msgs sizes

But that is not what I am claiming.
What’s the penalty if their budget isn’t balanced, and who pays it?
There's something glorious about the optics of using one toxic disaster to power another.
I wrote an experimental make replacement some years ago that understands that not every target is a file. eg. You can have targets be a remote URL (for an action of uploading to a fileserver).

http://git.annexia.org/?p=goals.git;a=summary

http://oirase.annexia.org/2020-02-rjones-goals-tech-talk.mp4
Those studies of coal plant deaths are basically only counting people who died in mining disasters or were killed while operating the power plant. If you add in climate change effects, air pollution including radiation from flyash, and groundwater pollution the figure is almost certainly much worse; but also very hard to calculate with any certainty.
I've written safety-critical firmware. You'd be surprised :D
I grew up in Manchester, NH where the Manchester Union Leader was run by a right wing fanatic

https://en.wikipedia.org/wiki/William_Loeb_III

and then his wife Nackey (Larouchites learned to rue leaving a dead cat on her doorstep) and then by the McQuaid family which was another old rich family long associated with the paper. My understanding is that it is still a stable business and that the folks involved have some spunk and integrity (they are still conservatives but the backed Gary Johnson in 2016 and Biden in 2020 because they don't think Trump is conservative)

I live close to Ithaca, NY now where the Ithaca Journal has been run by Gannett for more than a century, frequently the headlines have nothing to do with our community and people might laugh at you if they see you with a paper because the paper seems to be a page shorter every time you see it. It used to be you'd see local election results in the Journal the next morning, but the Journal didn't post them until 2:30 pm the next day and got scooped by all the weekly papers. There's a movement to get the legal filings out of the Journal because it is doing much less for the community than the weeklies.
This is super-fun. Kinda makes me want to do the following: set up a camera to take regular photos of a greenspace near my house. Record couldcover data and date stamps alongside the images, and then then show the most similar image to the current forecast as a background, maybe on my laptop. Wouldn't convey as much information as this project, but it could be very satisfying.
"system private window picker" refers to https://developer.apple.com/documentation/screencapturekit/s... .

Any material use of ScreenCaptureKit that doesn't involve that content sharing picker specifically will trigger this prompt. That means asking for SCShareableContent, or a couple other generic uses I forget.
UK was actually reducing their debt as percentage of GDP throughout 1960s. It went down below 100% in 1961 and kept going down all the way to 1990 or so. The debt had originally climbed to over 250% as a result of financing the two world wars.
Ehhh, it's the decompressor that's specified, and there's considerable wiggle room a'la Trellis modulation in radio line coding, due to the interplay of the dictionary coder with the entropy coder.
Basically, there are many moments the dictionary coder has to make non-obvious decisions about how to code a sequence, and what matters is that the whole content overall has the least entropy, not the least length when fed to the entropy coder.

For simple codings like the TLV bitstream in QR codes (the L field bit length depends on the T and the QR code size (i.e., the max bitstream length possible))[0], you can afford to solve for all possibilities via e.g. dynamic programming with some mild heuristics to terminate search branches that can't possibly code shorter due to the TL overhead.

But with an entropy coder like zstd's fst/tANS, that's not remotely as trivial.
Making a choice will change the symbol/byte histogram for the entropy coder's input sequence, which, if after quantization by tANS still different, can change the length of the coded bitstream.
The problem is the non-local effect on a symbol's coding size from making any individual residency coding decision.

BTW, friendly reminder that all-caps URLs will code shorter into QR codes, so the code will have larger pixels or be smaller.

[0]: there are 5 main modes (i.e., T values): ([0-9])+ coded by stuffing 3 digits into 10 bit and trailing 2/1 digits into 7/4 bits, respectively; ([0-9]|[A-Z]|[:space:]|[\$\%*\+\−\/\.,\:])+ coded by stuffing 2 characters into 11 bits; ISO-8859-1 coded by stuffing one character into 8 bits; Kanji by stuffing each into 13 bits; and a ECI mode for iirc generic Unicode codepoints. I think the other 3 code points in T are used for legacy barcode FNC1 and FNC2, as well as an end-of-content marker.
Users are flagging your posts, and correctly so because you've been breaking the site guidelines. If you could please review https://news.ycombinator.com/newsguidelines.html and stop doing this, we'd appreciate it.

HN is not a free-for-all site—it has a specific mandate, and users here need to abide by it. That means, among other things, not using the site for flamewar or for political or ideological battle. There's room to discuss topics with political aspects (see https://hn.algolia.com/?dateRange=all&page=0&prefix=false&so... for past explanations), but only if the primary spirit of the discussion is intellectual curiosity and thoughtful exchange.