skysight-inc/HackerNews huggingface dataset:
There are two reasons I can think of why someone might reuse a tokeniser:

1. They want to continue pretraining a model instead of starting from scratch. But actually people might not know that you can pretty easily reuse model weights even when training with a new tokeniser (I’ve got a blog post on how to do that: https://umarbutler.com/how-to-reuse-model-weights-when-train... ).

2. Because it’s convenient for end users. Tokenising and chunking really large corpora can take a long time and it’s nice that I can use the GPT2 tokeniser and then train a bunch of different models on that data without having to retokenise everything.
Why does a farmer need GPS to plow a field ?

>These automated systems have become critical to modern farming (often called “precision agriculture”), with farmers using increasingly automated tractors to plant crops in perfectly straight lines with uniform spacing. Precision agriculture has greatly increased the yield of farms

I guess this is why, but is the increased yield really worth all the issues I hear about these tractors ?
> HackerNews should BAN archive links like this that go around the paywall, and any mention of tools that allow users to bypass paywalls or ad-like content.

Paywalled articles are generally against HN Guidelines actually, and dang has commented that the exception are articles that have a non-paywalled version available, and in that spirit dang has tacitly acknowledged that HN users do tend to post gift links and archive links and other workarounds in the comments, so that paywalled links that would otherwise be disallowed are then therefore acceptable under the guidelines.

So, you’re right personally to want to support journalism and publications that you enjoy, and please continue to do so. Try not to nerd snipe other HN users, cos we’re all on the same team, and we’re all trying to learn and by doing, to build and grow an open, collaborative community by being nice and good to each other.

I don’t represent HN in any capacity, just a user like you, so please take this as just one person’s opinion and perspective.
Once you start getting social security, you keep getting it until you die. Some people take out more than they put in.
Roger Corman, Producer of Low-Budget Horror Films, Dies at 98
Astronomers Can See the Impact Site Where an Asteroid Crashed into a White Dwarf
Hm, we've had different experiences then. My experience with languages like JS/Ruby is that exceptions are often obfuscated (for js) and will frequently be meaningless type errors like "foo is not an object". I didn't use C# but I'd guess it's similar to Java. After all, here's an exception factory library for C# (https://github.com/scionwest/ExceptionFactory).

What most people seem to complain about when they say "Java" is actually dependency injection frameworks, not the language or even regular libraries (which typically don't use them). I also don't like Guice so can sympathise, but DI frameworks vary in quality a lot, and you don't have to abuse them. Modern frameworks are based on code generation and check much more at compile time. My app uses a compile time DI framework to set up the build task graph, but doesn't have a factory bean anywhere and has never yielded strange errors about factories that were hard to debug.
It's a far-left news source

https://www.influencewatch.org/non-profit/common-dreams/
"Scary" is actually something of an understatement. They weren't kidding when they said it was one of the most shark infested areas of programming.

My lisp's garbage collector works by scanning the stack for pointers. I neglected to spill the registers onto the stack and it led to such nonsensical problems that I'm not even sure how I debugged it. I think my mind has blocked out the experience as a bad memory. I've gotten into the habit of hacking in a call into the garbage collector directly into the eval and cons of debug builds just to stress the garbage collector as much as possible and try to find corruptions near their sources.
>We designed a system that's actively hostile to life and well being to profit the top 0.1%

And your proposed solution is to personally be actively hostile to the well being of those around you for your own benefit?
It's all interdependent, investors without workers and customers would never make money, workers without someone with capital injection to start the business would not have places to be employed at.

Most of the value was generated by labour though, not by investments, do you agree? There's no value generated by a pile of cash somewhere, you need someone to do something so it can increase in value somehow.
You forgot corporate espionage.

China is really really good at that.
Yes, extractive QA is one of the improvements beyond the "minimalist implementation" from the article. In our lingo, we'd say that's another way to create a deterministic quotation.

So far, we haven't found extractive QA (or any other technique) to significantly improve overall answer quality when compared to matching sub-string similarity. (I'd be interested to hear if you have different experience!)

There aren't a lot of applications can purely be solved with substrings of source documentation, so having both LLM prose and quotations in the answer provides benefit (eg ability to quote multiple passages). Now, we can modify the constrained generation side of things to allow for these but that gets complicated. Or, it can be done with recursive calls to the LLM, but that again requires some kind of DQ check on top.

Ultimately, both styles seem to perform similarly - and suffer from the same downsides (choosing the wrong quote and occasionally omitting useful quotes).

(Good writeup by the way, I've forwarded it to my team, thanks!)
That explains it, the class was BR (Before Reagan).

That guy really planted the seeds of all the issues we are having now.
If your good times cause a crisis with long lasting consequences, that isn’t exactly a good thing. I could list a hundred example situations but there’s no need, is there?
Discussion on misuse of "open source" by dokploy closed without comment
I would argue that artificial scarcity like copyright is "un-capitalism" and "evil" :)
How 401(k) Drives Inequality
Why is that an issue? Training the tokenizer seems much more straightforward than training the model as it is based on the statistics of the input data. I guess it may take a while for massive datasets, but is calculating the frequencies impossible to be done on a bigger scale?
That's certainly true, but the grandparent was suggesting that there was little demand elasticity. My personal micro-economic experience leads me to think otherwise.
Thanks for the correction. It was the Senate that didn’t confirm the appointments, I misremembered as House. Which is also pretty supportive of Dems not having control for most of the last 30 years.
Link Taxes Backfire: Canadian News Outlets Lose Out, Meta Unscathed
The C runtime is pretty much all OS-interaction support components.

IIRC, none of the actual ANSI CL code is implemented in C - in fact, it would break one of the core design ideas of SBCL, which is "Sanely Bootstrappable" - SBCL can compile itself on any "complete enough" ANSI CL system - it doesn't even have to implement everything - then uses itself and its own standard library to compile itself again but into actual native code.

Out of memory, the C based runtime in SBCL has the garbage collector, low-level memory interfaces to OS (how to acquire memory, how to release memory, setting memory protection flags), some core FFI to OS which are called pretty deep from standard library (i/o, threads, processes), basic FFI supports (manipulating linkage tables, for example) setting CPU contexts, etc.

On the non-OS-specific side, there's core loading, which is a distant ancestor of Mach dynamic linker.

Some of it is C-side implementation of basic SBCL datatypes which allows both GC and runtime to interact with them safely, but usually the CL code does not call into those.

Some of the low-level manipulation is actually assembler.
I'd like to add using tracing when the references might cause a cycle (statically analyzed?).
Hmm. This appears to indicate v8? https://browser.geekbench.com/v5/cpu/20697689

Would be amazing if v9 version available somewhere, need it for a project I'm working on.
People who are nonverbal can still communicate. I did not mean hear in a literal sense.

Here is some literature for you to learn more about autism, particularly how to communicate with nonverbal people: https://www.healthpolicypartnership.com/reimagining-communic...
It Only Takes Two Weeks [video]
> NullPointerException became a meme

quite literally; https://danbooru.donmai.us/posts/947012?q=parent%3A947012
I would agree at least that “entrepreneur” connoted something pretty different to me before I became familiar with its usage in tech startup culture. I’d not have included “solo-preneur” or businesses that just operate things (“I own a lot of vending machines”) or a restaurant, say. It implied employees and a market that leans more industrial, and that produces something (even if it’s software, I suppose). I’d not have classed a small tech agency or a dry cleaning business as “entrepreneurship”—which takes nothing away from them, it’s just that the term meant something more-specific to me.

Looking at older dictionaries, this does seem to be more in-line with what the term used to mean, and probably still does in some circles.
A comment from an alternative reality where code patterns, crazy code generation frameworks, and crazy systems entirely based on dependency injection do not exist...
This turned out to be an excellent demonstration.
I think nerd sniping is when you dangle a super intriguing problem in front of someone, and they can't help but dive into the problem.
I disagree. Granted, they are less likely to earn money on OnlyFans etc., but apart from that they can do the same things: they can be artists and do low paying jobs that they like.

What I agree though is that if they do chose a low-paying job, it might be more difficult for them to find a partner, which is not necessarily true for women. We are still by and large living in cultures where the male has to bring home the bacon ("a real man knows how to take care of his family") and it will take decades for it to change, if ever.
Freeware versus open source is a good point. But freeware typically can't be modified by the recipient, whereas downloadable models and open source code can. So I think there's still a need for a different term, neither open source nor freeware...
I laughed when they called it evil. How absurd!
Related throwback:

Chuck E. Cheese still uses floppy disks in 2023, but not for long

https://arstechnica.com/information-technology/2023/01/chuck...

(On that floppy disk tip from other article around this week https://news.ycombinator.com/item?id=40327307)
For one of the worst solar storms of the modern technological era and the worst in 20+ years, I have been pleasantly surprised by the limited number of issues like this that have actually popped up.
Static analysis isn't easy, though.
They were never supposed to be a financial investment. Modern American capitalism has ensured that green tint is all anyone ever sees
Oracle had employees called Java Evangelists for a while but I think that was more than a decade ago. You never know when somebody gets their stereotypes though.

My memory is hazy but I think there may have been more of a cult of Java when Sun was in charge of things. They knew now to inspire a following.
> properly signed packet

How would an adversary do this without the private key?

Wireguard uses ChaCha20Poly1305, an AEAD scheme. The first A stands for Authenticated.
I think men are looked down on if they go back to study, take an unpaid internship, become house-husbands (IE; non-breadwinners), exclusively attempt a creative endeavour (high risk enjoyable pursuits are seen as self-indulgent and lazy) or if they change career later in life (after 28~).

If I think the same of women, I do not believe that we would typically look down on them or consider them bad people in the same way for being somehow deficient in capability (IE; "a loser") or shirking responsibility if they decided to do those things.

In this sense, those opportunities can be considered effectively closed to them.
Years ago I experimented with this really cheap GPS. Pixi or something like that. It had poor ergonomics and as difficult to establish a connection. But once it worked it was accurate. Was like 1/10th the cost.

Also there’s VRS RTK without a base station (but you need internet and a subscription) for some reasons. Works just as well. It’s basically turn key.
I had a discussion with an engineer from John Deer, I'm not a farmer and don't have direct experience with it so I am taking his word but he told me in most cases the person in the tractor is just there to monitor what's going on for safety. I imagine this frees up people for other work if someone maybe less qualified can be in the tractor, or just takes the load off so they can work longer, allow them to do more in less time, etc.
> If you were serious, you would be capable of making much better arguments,

The argument I made, viz user's needs from a product are quite different to what you imagine their needs are, is enough. It's actually a self-evident assertion in many contexts.

All the successful products from that time paid little to no attention to security. Phones, operating systems, ERP software, instant messaging. I don't see how PHP was different in this regard.

Nothing and no one was paying attention to security: you could (and I did) send email by simply telnetting to a server and talking SMTP to it. The internet was not a place where security was a large consideration. The only secure thing was https, which few places used.

You, on the other hand, are quick to call someone a shill, quick to impugn someone else to make your argument look stronger and ignore any arguments made in favour of what your emotions tell you.

We're both talking here under our real names.
The dislike started earlier than the rise of pervasive threading. As another poster said, every read turns into a write, meaning, everytime you pass a reference into a function you have to increment the counter, and decrement when the function exits. It turns out, the vast majority of of inc/dec ops are pointless ones like this, which is considerable overhead for literally no benefit.

You can elide some of them using a sort of borrow analysis. But borrowed refs can only be used in certain ways, and so this analysis isn't perfect and can't eliminate all of the unnecessary overhead. This was all hashed out in the 80s and 90s IIRC, before multithreading even became a big issue.

The complex analyses needed to make RC perform well end up destroying the simplicity argument, and even after they still aren't competitive with tracing.
https://web.archive.org/web/20240128234227/https://www.nytim...
I guess we'll find out
Latitude: Open-source framework for embedded analytics
Although worth noting that more recent techniques (eg, Transformers) need stop words for context.
I think the opposite, the developers see people willing to pay 100s for Plex lifetime and probably willing to pay 100s more when they have to jump ship as Plex layers shit ontop of just works, while not meaningfully making things work better. Jellyfin is definitely not there yet, but I'm open to moving away from Plex, after spending $$ on lifetime pass.
What are you on about? People demand data and statistics in order to verify claims.

>a lot of x often involves y

is a broad claim which warrants more than a few anecdotes. GP may have an unpleasant tone but they're not wrong for asking that a sweeping generalisation come with something more solid than 1 person's perspective.
You don't have to test unrelated components if you tweak a monolith either. I suspect the feeling that microservices let you deploy faster come from the fact that such designs often conflate other things together, e.g. the CI system runs the entire test suite for everything regardless of what changed (due to transient CI workers losing their caches), there's one branch into which every change gets merged so you can't control when core library changes affect you, etc. But it doesn't have to be setup that way.

Ensuring implementation details don't get mixed up is indeed nice in some ways, but cuts both ways: it makes upgrading core libraries harder in case of security issues and such.
Could be a Geekbench thing.

The official specs say v9 https://www.alibabacloud.com/en/product/ecs/g8y
It’s really an editor problem. Theoretically there could be a world where all code is in one file, and that’s ok because the editor allows you to effortlessly navigate your code via a variety of means. For some this might be using a keyboard, for others more visually inclined, perhaps in Java there is a browsable visual model.

I’m honestly surprised there doesn’t have exist an editor/language that abstracts away the concept of source code files completely. I assume that there is a good chance that in 50 years time we won’t be coding using collections of text files.
Holy shit that’s insane.
I think that's partly a generational thing. The younger generations tend to be willing to spend more to ensure a "clean" supply chain--where clean means things like no slavery, family owned business, etc. The older generation tends to do what you're talking about. This is true in my family, but I've also read studies somewhere that illustrate that this is a pretty strong correlation between generations.
I had a minor procedure a while back - enough that I had to be put under - and asked my nurse if she was happy with her job. She said yeah, she loved it, but she made more money as a barkeep! I was completely shocked, especially considering the hours nurses are expected to work. This was a real nurse, not an aide. I think healthcare is a not-so-great career anymore, again because corporate profits are all that matter.
It wasn't unkind, and it wasn't snarky. If you think it was, that's because you are reading that into it. Read it a different way.
Thanks, that’s very helpful! I wish people would write detailed implementation books about these things as it is very hard to get into when just jumping in the deep even for experienced C and Lisp programmers. I guess I need to jump in!
I think this is referring to using a single cosine similarity metric for a given piece of text.

The similarity between the strings “dog” and “cat” is qualitatively different from (and substantially more meaningful than) the similarity between the full contents of War and Peace and Anna Karenina, despite both being described by a single value.

In practice, you would never try to calculate the similarity between such long texts. You would use a chunking strategy to break them into pieces more likely to yield meaningful similarity values.
I think modern farming is heavily about optimization.
I think it's well understood yes. When an option is only available to 1% of the population I believe it is fair to say that it's not really an option.
> Reference counters don't have predictable latency: a single reference decrement can lead to an arbitrary amount of follow up work, like more decrements and deallocations.

You can push the cleanup work on a queue to do it asynchronously, to bound the amount of work per deref / to even the work out.
What LLM will we check those against? How do we trust that its source materials are accurate and correct?
The world won't get "off plastics", it is one of the most useful materials to exist and many things are near unthinkable without it.
Perhaps to use it as a jump host. Oftentimes running ssh via ssh is not that good performance wise.
In first month of operation, ride-hailing services used more than taxis in Tokyo
It really shouldn't, considering they have a rule about not using primary sources.
Rust ownership works because it runs entirely at compile time. Rust has infrastructure for runtime inference counting, but you need to actively use it, and it's complicated.

Also, every time you read a pointer you are creating a new reference. That's what turns "every read into a write". You are correct that it's not actually every read, it's just that every small block that reads the value will also write over it.
The continuing financial fragility of banks
The article is about the US, so I'm limiting my scope to that market. I would need to do more research to competently talk about the rest of the world.

There is definitely inertia in construction; it takes many years to design, permit, build, interconnect anything. Stuff coming online now was conceived years ago, often more than a decade. So if you want to see what the economics favors going forward, you look to the interconnection queue rather than what's booting up.

Right now in the US, the interconnection queue is completely dominated by wind, solar, and batteries. Gas is significant, but tailing off. Everything else is ~noise:
https://emp.lbl.gov/queues
I'm here to argue that anything that concentrates farming and decreases required land use (and thus habitat destruction for wildlife) seems like a good thing. I'm sure there's plenty of externalities and second-order effects to consider, but I'm just a guy who loves to hear the birds sing.
E to the pi I for dummies (2015) [video]
There are a few:

- https://www.jetbrains.com/mps/

- https://squeak.org/
> Please keep in mind that women seem to be disproportionately disadvantaged after having children

That’s because children are a full time job — the hours, the energy required, but especially the cognitive load. If the woman takes on some or most of that responsibility, then any other job she has becomes a second job.
Skimmed through much of it, I don't see anything explicit about which philosophy of science is applied. It seems more like automated information processing, similar to what quant finance and similar is up to.

Do you belong to some popperian philosophy? It can't be feyerabendian, since his thinking put virtue as foundational for science. Do you agree with the large journal publishers, that the essence of science is to increase their profits?

Not sure why you think you've earned my respect, and it would be very hard for me to violate your rights since we communicate by text alone.
Interesting and makes sense. This is a pretty standard procedure now so if you want experience and training in it you want to go to where the cases are legal and common.
Do you come across homeless people directly impacted by or even upset about Google’s mass layoffs?