skysight-inc/HackerNews huggingface dataset:
https://github.com/danluu/post-mortems is a fun read and has been around for a while.
I can already run Vicuna(llama) 7B on my 2020, 14" PC laptop at ~3.5 tokens/sec, and more speed can definitely be squeezed out.

Most future laptops and phones will ship with NPUs next to the CPU silicon. Once they get enabled in software, that means a 16GB machine can run a 13B model, or a 7B model with room for other heavy apps.

As for the benefits of batching and centralization, that is true, but its somewhat countered by the high cost of server accelerators and the high profit margins of cloud services.
How possible is it that every other model suffers from dataset contamination and this model is being unfairly penalized for having properly sanitized training data?
LlamaAcademy: Teach GPTs to understand API documentation with LoRA
The satellite appear to have lights on - or is this just reflections from the Sun ?
Some people get addicted to the tools of a hobby and not the hobby itself. Sometimes thinking they need the best of the best in order to produce the best.
I wasn't aware of the issue but after reading some news articles, it fully aligns with my impression of Norwegian living standards.
>By short term particle pollution

>#11 Yakima

>https://en.m.wikipedia.org/wiki/1980_eruption_of_Mount_St._H...
Also on 5)

> Whether or not money can buy happiness, it can buy freedom

This is true outside of your work but not so much during it:

- when you makes lots of money you feel less free to resign than for a shitty interchangeable job. It’s even more true as the shitty job has less chance to be intellectually interesting

- building your own business usually means you’re even less free mentally as you got more responsibilities

- if you’re got employee it’s even worse : you’ve got more legal obligations and probably moral implications.

Money can buy a lots of thinks but certainly not freedom.
Of course they are 'limited functionality' kiosks, they exist to print boarding passes!
> You don't intentionally design peerage into a system of government.

Says who?

From Red Roulette:

> The struggle pitted Xi Jinping against an official named Bo Xilai. Both were sons of Communist "immortals", veterans of Mao's revolution. And both owed their careers to a Party decision made in 1981 and pushed by a high-ranking Communist named Chen Yun to establish a special office in the Party's personnel department called the Young Cadres Section. That section's purpose was to ensure that the sons and daughters of senior Party members were given good positions in the government and the Party. "If our sons and daughters succeed us," Chen Yun declared, "they won't dig up our graves."

> The Tiananmen Square crackdown of 1989 gave this work added urgency. A key lesson that the red aristocracy drew from that turmoil was that, as the saying went, "you can best depend on your own kids." Each leading family chose an heir to be groomed for political leadership. Nominated by their fathers, Xi and Bo rose through the Party ranks.
But how does that make it not perfectionism? Having the wrong priorities is in no way inconsistent with perfectionism.

I also don’t think that analogy works because the things he mentioned mostly do need to be touched to develop the core game loop. The problem he has is that once he touches something he can’t leave it dirty. That’s the way in which it’s perfectionism.
How would you well-define the "typical" usage of "size". The bijective mapping is completely consistent with our daily understanding for finite quantities, it's only in the infinite realm where it "feels weird" but those are just feels man.
you can redirect any domain you own to any other domain
And yet Poverty Row produced Detour, one of the best noirs ever made. The intentions aren’t the only thing that matter here; the art does.

Further, it’s not purely about entertainment value. I recently watched Les Vampires, a 1916 serial from France. It’s true that the theatrical conventions aren’t the ones we know today, but it was fascinating watching Louis Feuillade figure out how to make a thriller on the fly, and some of the ideas he came up with created our current theatrical conventions. That historical understanding is important.
> But the I in API stands for interface. A good interface can survive rewrites of what's underneath.

Absolutely!

But a good interface is also a really difficult thing to engineer, in part because it seems like a relatively easy thing. The gotchas don't become apparent until long after you ship.

Sometimes I wonder if some of this is just cost-cutting. A difficult task is an expensive task. Other times, I wonder if it's because API design is an actual specialty, and there are too many devs doing it who don't have the chops for it.
How AI Could Take over the World
...and bring an end to human civilization
The Yuan has lost 7% of it's value against the Dollar in the last 3 months. The fact is the Dollar is incredibly strong, it's up over 6% on a year ago. Yes trade in marginal currencies like the Yuan is up because Russia is desperate, they will trade in anything right now, but this is all small change. It's easy to double transactions when they start from such a pitifully small level to start with. Demand for dollars is as high today as ever.
I think it’s far, far worse than this. Have you ever been inconvenienced because of a software bug? Now imagine you’re in jail for child sexual exploitation.

Have you ever tried to contact one of these big service providers to get something fixed? Would you like Google tech support (snort) be the last thing standing between you and a prison sentence?

I think the absolute last place we want to be is in a world where we can’t make money to eat without our portable computer/phone that runs broken software made by some scammy dot com whose salient feature is that if we don’t stay ahead of it, it will imprison the user.
installing it is a nightmare
The reals are a superset of the integers, and a bijective mapping cannot be formed between the two, thus there are "more" elements in the set of reals than the set of integers.
> The theatrical world takes an intermediate approach, where they use the terms "stage left / stage right",

The opposite of that, rarely used but still out there, is house left/house right.
My 6yo daughter had to create a login for various online things recently (e.g., code.org to keep track of her progress). I don't exactly when or where they taught her this at school, but she absolutely refused to share any of her personal information in any way. She spent a good 30 minutes trying to make up a handle to use that she liked but didn't include any reference to her name, her initials, anything about her birth month or day (I'd suggesting adding the day of the month she was born as a suffix so she'd remember it given all her initial name preferences seems to be taken already), etc.

I was very impressed that they seem to have this conditioned into them so young, and to a level of importance that exceeded even my own paranoia about doing it properly.
This certainly led me on a Wikipedia rabbithole into extinct arthopods. My favorite used to be Anomalocaris (anomalous shrimp), until I discovered https://en.wikipedia.org/wiki/Innovatiocaris, the "Innovation Crab"
I'm not following your analogy at all. Ireland is 32k square miles, Washington state is 72k square miles. Washington State has about 16% more people with about 2.25 times the land area.
Google had every opportunity to capitalize on the architectural innovation and failed tremendously.
> cause 99% of news and content websites are not the NYT or have the same constraints and reputation to uphold.

Ok, show me one meaningful publication doing this, that's what I'm getting at. I used NYT as my original example to illustrate you can't just fire a news room and replace it with a GPT bot. What business can you do this with, where writing is the core competency?

How about graphic design? Is there an example of a graphic design firm that has fired its designers and replaced them with Stable Diffusion et al and a single PM to achieve the same output? Or even reduced their head count because these AI tools have so dramatically improved productivity that one designer can now do the work of 2 or 3 or 10?

> It can still replace them where graphic design is not the core competency (small time web designers, logo makers, etc. working for small businesses, individuals, and so on.)

Let's work with a concrete example here. I'm going to work under the assumption that there is a self-employed web designer out there who, despite the existence of hundreds of template web app creators (such as Wordpress, Webflow, Wix, etc), no-code tools like IFTTT and Fiverr contractors on demand, has managed to carve out a full-time job for themselves designing websites.

In order to carve out that niche in the presence of already existing WYSIWYG tools and outsourcing services, they are already doing something different than just boiler plate web design. Before bots come for this web designer's business, these bots would first have to make these tools completely obsolete. And yet, I know of no one today suggesting that an ordinary small business bypass Webflow for ChatGPT + Stable Diffusion to create their web site.

If ChatGPT + Stable Diffusion is really the dangerous job-killing combination that everyone thinks it is, it first has to replace the boiler plate tooling and the Fiverr contractors. Then AI's capabilities need to expand to accommodate long-term client relationships, long term contextual awareness of client needs, realtime integration of marketplace demands, institutional expertise and deep product knowledge and awareness about many implicit things not explicitly documented for any GPT to consume (and not necessarily possible to document, either). It would need to have wisdom to understand when it shouldn't, in the context of often incredibly vague product requirements. It would need to be able to sometimes even forcefully push back against client demands and recommend an alternative path altogether.

These are the qualities of a good web designer (and indeed, any creative worker), and they're just a small sampling of the reason why the already existing boiler plate services haven't replaced the need for good people.
Is it? Often the people featured in films were.. basically only the wealthy classes. We have ample example of how they lived.

Also, often movies today do not depict an average person, they depict an idealized version of that. We have stills of the real thing, lots of them.

Bear in mind I'm not arguing against preservation - but its a limited resource, I'd prioritize early home movies and industrial films (what little there was) over the traditional A or B picture studio output.
Ask HN: LLM Enhanced OCR
Has anyone tried experimenting with using LLM to enhance the results OCR. OCR software may produce results that are full of noises (nonsence chars). It's very hard to pattern matching the generated results since the noises are high unpredictable. Does LLM help to "de-noise" the results since they tend to take in char level information and might recognize what are useless information?
SEO was affecting search long before 2010
Do you have javascript disabled? That is Latex which should be converted to images (or svg) dynamically after the page loads.
2 can be mitigated by squeezing the top two buttons of the phone until it vibrates. Any attempt to go to the emergency contact/power off screen disables Face ID/Touch ID until after the next passcode use. (You don't have to entirely reboot.)
its not alway about the size, but yeah its really good!
https://github.com/tatsu-lab/stanford_alpaca
I think we have different understandings of perfectionism. I don’t think perfectionism means you do something perfectly. Most of the time I think it’s not being able to trade good enough for best. Often this leads to unfinished work. Perfectionism by no means only comes into play after you have something shippable - you’d likely never get that far.
Everyone replaces `assert(isTrue: boolean)` with more specific assertions so that failures can produce helpful and specific error messages; something like assert.isEqual(a, b) can at least print a and b, but ideally can print the difference between a and b (which Jest does) -- where all `assert(a == b)` can produce is "Oops, assertion failed at line XYZ".

If you expect `assert(...)` to be magic enough to provide diffing and smart error messages because it's actually some kind of macro... then I guess we have different views on magic.

My point about completion is that if you do expect(a).<tab> with a smart library, the library can complete the list of assertions that apply to the type of `a`. Eg, if `a` is an Iterable, a good assertion library could complete `expect(a).toInclude(`. Jest doesn't do type-narrowed assertions (sad) but it could.
So.... if I wrote a book manuscript, and wanted an LLM to help me track plot holes by asking it questions about it, I can't do that with token limits (aside from various summarization tricks people use with ChatGPT), but I could somehow parse/train a system to represent the manuscript in the vector database and hook that up with my LLM?
Yes, implementing this kind of advice is much harder than merely reading it.
I understand that line of thinking, but what land are they grabbing? They already possess all of it through npm and GitHub.

Do you think they intend to exclude caches like yarnpkg.com as insecure? I don't see how they would do that, since (1) your cache is a local config variable, not part of package.json, so there's no static analysis that could mark packages downloaded through Yarn as insecure, and (2) all of the key signature metadata is publicly available, so any cache or alternative package manager can implement the same provenance features as npm.

Or are you worried about EEE of the upstream source repositories and CI runners, eg "only packages built through GHA platform can contribute provenance data to npm registry?" I guess I could see that as a more reasonable fear, but as someone else explained to you, it's also unfounded (at least for now - which is maybe your argument), and GitLab is currently working on their own implementation. But even if they tried that, then you could still publish and consume packages from another registry if you wanted to. And I'd like to think that if Microsoft made a hostile move like that, we could count on package managers like yarn to pull provenance data from other sources.
I appreciate that whatbadgerseat.com still redirects to fox.com. I wonder if their ops teams even know why they do that or are just afraid to get rid of it.
I have been wondering the same thing. So many OCR engines spit out results that are obviously wrong, and I don't want them to get too clever but a little but of smarts would go a long way.
Ah, very interesting! It seems like some people are making noise about the issue again, so will be watching that closely. Here in BC, there was some attempt a little while back, but it did not gain sufficient support this time around.
None of the engine manufacturers are interested. That's what killed the A380--Rolls Royce pulled out of a re-engine deal that would've brought A380 engines into the 21st century. "Green" concept showcases notwithstanding, all the engine manufactures seem to have decided to cut back on investment and coast for awhile. Something will need to change to spur competition in the engine space, and then we might see hungrier competitors. But the shelving of the A380 supply chain means there'll still be a steep hill to an A380 derivative.
Vicuna (LLama) 13B is pretty good IMO. A 20B model can definitely fit in RAM on future devices.
He borrowed $billions from banks for the deal, but the collateral was Tesla stock, so not paying this debt would not go well for him.
Access control refers to the practice of limiting access to a physical space or digital resource, such as a digital file or building or a room, to authorized users only. Access control is achieved through various means, from traditional lock and key systems to modern smart locks and multi-door access systems.

This four part series guide provides a comprehensive introduction of how access control is achieved. The first post by introducing access control key terminology and then dives into the different types of systems and credentials, as well as how those can be remotely controlled through Seam’s products. Subsequent posts cover Smart Locks, Access Control Systems and Intercoms.
>If you can keep an a380 full, it's a great plane.

This goes for just about every largest of its kind piece of commercial cargo moving equipment.
and also easy to deploy
My chromebook together with crouton was excellent until Google obsoleted it. I'll never buy another one.
There's a Twitter account https://twitter.com/justsaysinmice who simply links to articles whose titles could use a good "IN MICE"
The fact that Nestle still exists should be proof enough for anyone that it literally doesn't matter how horrible a large corporation is. There is no activism route to correcting these companies behavior. Only legislation with teeth will work. That we'll all collectively decide to stop doing business with bad companies is nothing but a libertarian fantasy.
No worries, mate.
Why mortality for young Americans is increasing at an alarming rate
This should really have "in mice" added at the end of the title, even if the publication itself omits this because it's in the abstract. As published, this has effectively nothing to do with what people think it has anything to do with yet.
Price Increases for Developer Tools
Replying to myself as it's too late to edit.

A more succinct explanation came to mind while just doing some yard work:

We've all heard and understood the wisdom of "premature optimization is the root of all evil", right?

What's being conflated here as perfectionism is a variant of premature optimization.

Perhaps we need an idiom like "Premature polishing is the root of all unfinished games".
Imgur to Ban Nudity or Sexually Explicit Content Next Month
The tax-advantaged status of your primary residence is also a major driver of the housing bubble in Canada as well.
>Yet it happened in the era without social networks and Internet news, so few people remember about it.

And the public's opinion of the air travel industry was different so hand wringing over it wasn't so fashionable.
I think in most cases this isn't true (who cares how niche your hobbies or style are), but when it comes to internet mental health discussion communities there definitely is a double edged sword IMO. Depends on the community and person, but I suspect you're right in the case of e.g. finding others who are depressed, there's a lot of overshoot in the reaction to stigma in some of these groups, to the point it encourages giving into some pretty bad lifestyle loops.
More like millions of years
The M2 and the 4090 are both very general purpose. In fact, the 4090 allocates proportionally more silicon area to the tensor cores than Apple allocates to the neural engine.

The M series is basically the only "big" SoC with a functional, flexible NPU and big GPU right now, which is why it seems so good at ML. But you can bet actual ML focused designs are in the pipe.
You do realize in the subcontinent that transpeople interact with kids all the time in the street? I remember meeting them in my family’s neighborhood in Karachi when I was 7 or 8. You might want to ask your dad about this if you don’t believe me.
Those are so it can see where it's going
Hell, just this youtuber is a good example of what you are saying. This guy, 'DistroTube', has a ton of entry level videos about seemingly niche linux topics. Even the video you posted has a little command line tutorial embedded into it.

I come across him whenever I am trying to figure out what a specific distro or tool _looks and feels_ like. If you search any distro name plus "distrotube" there is probably a video of him setting it up and playing around with it.

I have wondered about this guys background before and finally looked it up tonight.

> Despite the geekiness of my content, I have never actually worked in IT or a computer-related industry. Although Linux and technology have always been my hobby, I worked in the retail industry until recently. In 2020, with the pandemic and the subsequent shutdown, I lost the job that I had at the time. The retailer that I worked for went bankrupt and cut most of their supervisory positions (including mine). Thankfully, I already had a side job of sorts—making YouTube videos! So since the pandemic started, my full-time job has been making video content.

> I have been strictly a Linux user since 2008. The distro that I currently run is ArcoLinux with the xmonad window manager. Some of the software that I use daily includes GIMP (for graphics), Kdenlive (video editing), Audacity (audio editing), and OBS (for recording/streaming video). I also use a distribution of Emacs called Doom Emacs. It is my preferred text editor, although I often use Vim as well, especially if I am already in a terminal.

from https://people.zsa.io/derek-taylor/

Which still leaves a lot of mystery to the "how did he get into this" question.
It's not the JPG data you can copyright, but the recognisable image it produces. Every time you re-save or resize the image, the data changes, but the recognizable image remains.

It's not clear how this process applies to model weights. Once you run another training epoch on them, the data has changed. What is the essential copyrightable, trademarkable or patentable thing that remains? A legally untested question for sure.
The Pile
Demonstrating GUI text editing on the 1970s Xerox Alto (2017) [video]
Isn't that more like first-year material in mathematics and in more theoretically oriented CS programs? Once you start talking about injections, surjections, and bijections, you may as well prove some basic results about the sizes of sets of numbers.
This has been around for GPT models for a while in the form of "soft prompts", which are rather approximate to textual inversion in the Stable Diffusion space.
There are also Twitter's algorithms for replying to people's tweets, such as comment rankings and filters. I have seen much less information about those algorithms.
So that the over-fitting of star wars to perceived social trends can stop I assume.
>For any infinite set, you could select unique values out of them indefinitely.

Yes, but if you have a bijection between elements of that set and another, they're still the same size. Consider the strictly positive integers and the strictly negative integers: for any x, there's exactly one corresponding -x. Both sets are infinite, but they're the same size. Contrast that with, for example, the reals and the natural numbers: for each natural number n, there's not a corresponding real number but rather an infinite number of reals in [n, n+1). The sets are not the same size.
Yep, encrypt and destroy. Even encrypted data is at risk of having the key leaked at some point.
I don't know about other countries but in Mexico they gave out Cansino and Sinovac among many others.

I count myself fortunate to live in an area where they were administering A-Z.
I like it for some stuff. The UI is certainly faster than ChatGPT, and seems to be more reliable at this stage. I suspect that its training has benefited from the unique corpus access relationships Google has accumulated since it's pre-IPO heyday. Think of the data connections they were establishing around 2005 with the establishment of Google Video and Google Books.
It's like combining the advise of Schwarzenegger, Dr Phil, Yoda, a random tech bro's substack, life-hack Youtube stars, and more.

None of the advise is incorrect of course, it's just that the sum is unattainable and at times contradicting. It basically says: here's 20 balls. Now juggle them up in the air, don't let any of them drop.

That being said, your 20s are special. It's indeed the decade where you have the most energy versus the least responsibilities. Don't take your 20s in slow or tame mode.