skysight-inc/HackerNews huggingface dataset:
Show HN: Visual intuitive explanations of LLM concepts (LLM University)
Hi HN,

We've just published a lot of original, visual, and intuitive explanations of concepts to introduce people to large language models.

It's available for free with no sign-up needed and it includes text articles, some video explanations, and code examples/notebooks as well. And we're available to answer your questions in a dedicated Discord channel.

You can find it here: https://llm.university/

Having written https://jalammar.github.io/illustrated-transformer/, I've been thinking about these topics and how best to communicate them for half a decade. But this project is extra special to me because I got to collaborate on it with two of who I think of as some of the best ML educators out there. Luis Serrano of https://www.youtube.com/@SerranoAcademy and Meor Amer, author of "A Visual Introduction to Deep Learning" https://kdimensions.gumroad.com/l/visualdl

We're planning to roll out more content to it (let us know what concepts interest you). But as of now, it has the following structure (With some links for highlighted articles for you to audit):

---

Module 1: What are Large Language Models

- Text Embeddings (https://docs.cohere.com/docs/text-embeddings)

- Similarity between words and sentences (https://docs.cohere.com/docs/similarity-between-words-and-sentences)

- The attention mechanism

- Transformer models (https://docs.cohere.com/docs/transformer-models HN Discussion: https://news.ycombinator.com/item?id=35576918)

- Semantic search

---

Module 2: Text representation

- Classification models (https://docs.cohere.com/docs/classification-models)

- Classification Evaluation metrics (https://docs.cohere.com/docs/evaluation-metrics)

- Classification / Embedding API endpoints

- Semantic search

- Text clustering

- Topic modeling (goes over clustering Ask HN posts https://docs.cohere.com/docs/clustering-hacker-news-posts)

- Multilingual semantic search

- Multilingual sentiment analysis

---

Module 3: Text generation

- Prompt engineering (https://docs.cohere.com/docs/model-prompting)

- Use case ideation

- Chaining prompts

---

A lot of the content originates from common questions we get from users of the LLMs we serve at Cohere. So the focus is more on application of LLMs than theory or training LLMs.

Hope you enjoy it, open to all feedback and suggestions!
FYI, Google maps works without you needing to sign in (iirc it doesn't even need Play services, so it works with de-googled custom ROMs). Though this is an exception rather than the norm.
Porn is a major reason that people train loras. The beauty of them is that people can pick and choose multiple loras to build truly custom ai
Not that familiar with the US, but presumably (just because it seems reasonable, and is the case here) they don't have to serve you at all (err, as long as it's not discriminating on grounds of a protected characteristic) so it would be weird for the law to require accepting cash when it also allowed them to nominally comply with that but then refuse to serve anyone who wouldn't pay by card?
(I'm a dev.) Not everyone has macOS, and running a DL model in your browser is not exactly mainstream. Which is why segment leader remove.bg gets an estimated 35M in monthly organic traffic. Also, we believe our results are significantly better than those offered by the open-source models we've seen.
No one is trying to claim organized crime does not exist. They are claiming that the harms from organized crime may not be as bad on the whole as the harms from some of these laws intended (at least in part) to combat it.

This does not, of course, mean that the harms to certain individuals from organized crime aren't worse. But governing based on a small number of emotional anecdotes, and ignoring the broader harms being perpetrated to placate that vocal minority, is deeply irresponsible.
Looking at Fig. 2 of the original study [1], I can't see any significant effect of the studied variables (RGL1, RGL2, RGL3, E1, E2, and E3). Am I missing something, or is the standard for significance insanely low in this field?

[1] https://www.sciencedirect.com/science/article/pii/S019188692...
It seems to me that there are two cases here.

In the first case, the community is healthy. In that case, someone spouting lies about someone who isn't even there anymore is going to look rather odd, especially if you had a history and a track record there. It has a good chance of not getting much traction, and it might get some pushback from the community. In this case you have a fair chance of being able to successfully leave your reputation in the community's hands.

In the second case, the community is toxic. The lies are believed, and even amplified by others. Your reputation there is toast. You could go back and fight for your reputation, but if you did, you'd be likely to lose, and the attempt would eat up your time and emotional stability.

In either case, just walking away and ignoring it is about as good a strategy as you can find.

Note well: I am a random nobody on the net. I don't have a reputation online, except under pseudonyms, so I am talking about what I do not actually know. (Yes, I am aware of one person online who defamed my real-life identity. They were obscure enough, and their rant was obviously unhinged enough, that I felt no actual harm from just ignoring it.)
It also kind of hard not to look at the chart below and not wonder which was better for the debt "The New Deal" or "Reaganomics"

https://www.longtermtrends.net/us-debt-to-gdp/
I think the're called Jesus Christ in Costa Rica.

It's really funny to see them run on water or on land, they almost look like they are on a bicycle.
Does Intel bundle all the userland tools?
TLDR: A direct link to the interesting technical information:
https://salt.security/blog/a-new-oauth-vulnerability-that-ma...
But the drives that are doing writing... Either they are writing onto an entirely new tape, or they're writing over an existing tape. If it's an existing tape, you need to make sure that everything on the tape is not needed anymore. Yet commonly 75% of the data on the tape isn't needed anymore (retention period expired), but some might still be needed. Unless you have a hard drive somewhere with another copy of the data, you need to read every tape before rewriting it.

I suspect your use case is strictly for backups, whereas my use case is more archival (where all copies of the data are on tape, and there are no copies on hard drives).
That's one of the most bitter "articles" I've read. Did someone steal his lollipop?

It feels odd to read a political text where he wants "everyone to be happy" and "join us" and at the same time telling all the voters are idiots, should be punished from voting incorrectly and should be subjugated under his idealism.

What kind of logic is that?
I'm happy to be proven wrong, but my understanding is that the atmosphere itself doesn't really care about "per capita", absolute numbers are what matters.

I'd imagine Vatican City has an even higher emission per capita than nearly anywhere else, but it would be silly to pretend that's where we should prioritize policy change.

As it stands, the one country produces more CO2 than the following 7 combined. That number is only set to increase. If our goal is a global reduction, should that not be where we focus the majority of our political energy? If Luxembourg went down to net 0 emissions, my understanding is effectively no difference would be made on a global scale.
MS lawyers have a good track record at sending out those scary cease&desist letters
One of the best things anyone ever told me, one of my old bosses once said to me, when I was frustrated and angry about a bug I created, “There are two kinds of experiences in life, winning experiences and learning experiences. And what you’re having right now is a losing experience.”

I subsequently learned to keep my perfectionism in check. As others here have said, honesty is the prerequisite to solving any problem, so please count your self-awareness in this area as a big win. Take your learning experiences in stride.
The evaluation prompts I saw ( https://colab.research.google.com/drive/1kK6xasHiav9nhiRUJjP... ) were all "encyclopedia-style", asking for summaries of information that would have occurred many times in the training data (e.g. "How can I improve my time management skills?") and hence probably reflect ability to retrieve and summarise trained information as opposed to novel problem solving.

Or in the programming questions the ones I saw are also certainly in the training data (e.g. "Implement a Python function to find the longest common subsequence of two input strings using dynamic programming.")
Because you will be paying in some other way, for instance because your data is sold out the backdoor. Ryan J Shaw always orders from these two addresses, that means he's probably living there, he orders a lot of fancy food so we can enrich his profile and sell it to the highest bidder. Any app that you install should be reviewed as to what permissions it requires and you should be very careful with anything that wants to have your location, especially if it is on a regular basis. And location is something that can be inferred from many things, that QR code that you just scanned doesn't look like it is location data but it may have location attached to it which gets recovered when you scan it. So completely invisible to you you just allowed your lat/long pair+timestamp to be sent to a bunch of servers outside of your control, and with a bit of luck with your device ID or other identifying info added to it. As well as which cell phone provider you are using, what make and model phone you've got etc.
Karma per account is a power law distribution. You can see the top 100 accounts here:

https://news.ycombinator.com/leaders

Everyone else has less karma than these folks… the long tail.

I haven’t graphed it, but my subjective sense is that my karma per comment is distributed similarly. Most comments get approximately 1 karma point, but occasionally one comment will get dozens or even hundreds of upvotes.
1/2) “Just because you are right does not mean I am wrong”

There is a meme gif that sums this up perfectly

The gif in question has two figures discussing a 6 on the ground which is 6 from one person’s perspective and 9 from the other person’s perspective.

2/2) “I never make predictions, especially about the future” aka Acceptable choices at the time

If you did good work, and operated with as many of the facts that you had at the time, then that is a great outcome.

Not all the facts are known. Even when all the facts are known the choices may be a coin toss. Do not beat yourself up if a choice did not work out
Tres commas: https://youtu.be/2XxwhMcUjYU?
> 2. Try self-derision. "Oh man, I must have had too much to drink that night!!!!" or "yeah I got pretty lazy there...". Always very appreciated. Especially if the comment from the co-worker is intentionally snarky.

Reminds me of my favorite code comment that I came across once…

“I burned one right before I wrote the block below. Now that I am no longer high I have no idea how it works or why, but it works.”
Debugging the Internet with AI Agents – With Itamar Friedman of AutoGPT
I did wonder what they used as placebo snacks.
How do I know it's not a hacker pretending to be a person with dementia, and the URL will take me to a malicious site?
GIMP, and probably Inkscape
OS Scheduling
I don’t take criticism of my work personally because I’m usually the one giving it.

I’m only partly being snarky here. I think constantly about how I should improve past code, why I shouldn’t have done x, etc. Self criticism is healthy and takes some of the sting from external criticism.

Beyond that, I think “lean into the punch” is an affective strategy. If someone says my code is crap I can either 1) fight them and try to explain, justify etc or 2) say “you’re absolutely right”. 2 takes less energy and deflates most reasonable people’s criticism, esp in person. Of course if the criticism is wrong then that’s harder and maybe not even appropriate. But even then, framing it as “a valid criticism, but Im balancing that against X” helps the person feel heard and likewise more likely to hear your reasoning.
Yes and no.

Someone pointed out that some of the answers are using OpenAI's famous "As an AI...". Soooo you can roughly say that RLHF might still have had an impact here through the training data that came from an RLHF model.

But what we are seeing is a revolution in picking quality demonstration data that might make RLHF an optional last step for fine-tuned models.

I'm bullish on a new technique where the quality of instruction-tuned code model output are measured and evaluated automatically by a machine. I'm calling it RL<machine>F

Code Model outputs a test harness, an implementation, and how to run the implementation for a users inputs. Have RLMF evaluate implementations against the synthetic test harness and against hidden user inputs.
Not the internal reaction, but what you do externally -- what you say, what you write -- that's generally in your control.

AIUI, CBT's primary method is to convince you to pause between feeling and acting, so that you can ask yourself if you have made an accurate assessment of reality and can plan an appropriate response.
Is something with this functionality available as a Gimp plugin?
Can someone explain why I'd want to use fine-tuning instead of a vector database (or some other way of storing data/context)?
Biochar as a negative emission technology (review paper)
Bartek from the Deno team here. We're currently missing polyfills for IPC module to be able to use `next dev` command.
No bullshit product home page
Log structured file systems solve this problem[1]. They can be extended to tape libraries in various ways. Tapes are still rewritten, but not nearly as often as once per deletion.

[1]: https://en.wikipedia.org/wiki/Log-structured_file_system
It's another issue, but it's close
For people who may not have seen it, there is a great story in South Africa how pigeon's with memory sticks had a higher bandwidth that wire.

https://www.cnet.com/tech/computing/carrier-pigeon-faster-th...
The placebo/nocebo effect of drinking a sweet tea will most likely overshadow any physiological effect by a large margin.
Firefox 2004 = 18 years, though I remember using the older version Firebird (https://en.wikipedia.org/wiki/Firefox_early_version_history) already. Thunderbird (July 2003)
Eh, I'm not convinced.

I do pay for ChatGPT, but I'm not onboard with corporate whining by spoiled CEOs from across the pond. I certainly am not a fan of US lax regulatory approach that only seem to ever favor corporations in detriment of the population with this lame excuse of not scaring away poor corporations.

If adjusting to regulation is impossible, don't do business here. It's alright.
Honestly it always depends on what "faster" means for you. For one crowd faster means "fast number crunching" (e.g. anything AI these days). There statically compiled code reigns supreme because it is mostly about how fast your very specialized code (e.g. matrix multiplications) runs and it does not hurt if you just ship a specialized, statically compiled version for all possible targets. (iirc GCC does something like that when building generic code that will utilize different code sets (SSE,AVX,etc) when they are available at runtime.

For another crowd "fast" means that the code they haphazardly thrown together in an interpreted language runs fast enough that nobody is negatively affected (which is a completely valid usecase, not judging here).

And to answer your question for examples:

An interpreter with JIT compiler might for example notice that you have a for loop that always gets run with the same number of arguments, unroll the loop and at the same time vectorize the instructions for an immediate 4x gain in execution speed.

Otoh Javas Hotspot JIT compiler tracked how often code was called and once a "hotspot" was identified compiled that part of the program.

Last example: if you are using an interpreted language (say Python) every roundtrip through "python-land" costs you ... A simple for loop that just runs a simple instruction (say: acc = 0; for x in xs: acc += x) will be orders of magnitudes slower that calling a dedicated function (numly.sum(xs)), JITing that code (e.g. with numba) will remove the roundtrip through python and achieve similar speeds.
Sorry, I was late. Mu4e and slrn can acces your cached your remote imap and nntp folders with an mbsync (isync pkg) maildir and a news spool (slrnpull setup) respectively, so the access is ultrafast compared to the crawling GNUs, even when used with fiber connections.
Right; and in communities where bad intentions are not the norm, usually there's some sort of moderation/escalation path/group of people you can go to for a second opinion, to ask "am I misreading this, or is this person being unnecessarily combative/abusive/whatever?". Those people can then look at it from a neutral point of view and tell the other person "hey, knock it off/tone it down a bit/whatever", which is usually all you need if it is a "just having a bad day" scenario. Or if there's a developing pattern of bad behaviour they can take further measures.
Don’t you know, it’s 2023 and we’ve decided words don’t mean anything?
Yet another nutrition study.

here's a counterpoint:

> Nutrition has made no progress. It has discovered no stable facts. Everything nutritionists have said, they have said the opposite ten or twenty years later (if not much sooner). They literally know nothing. After a century of countless experiments, the most common, most basic problem they’ve addressed—the optimal ratio of fat, protein, and carbohydrate—is completely unsolved. If they can’t figure that out, anything more sophisticated seems hopeless.

https://metarationality.com/nutrition
VPS with Integrated GPT-4
I like this series a lot, wish it was complete.

I actually like that the code is in turbo pascal and that it targets M68k assembly, because that way the modern reader is encouraged to pick their own implementation language and target ISA, and you have to make sure you understand the code snippets well enough to translate the logic into your chosen language instead of just copying.
The code is not yours. You are a hired gun and should do what you are told. I have a different opinion all the time about PR comments but I always do the "thumbs up" and change it if it is functionally the same.

The main criteria for code is does it work and some try hard will always want you to over engineer the simplest of tasks, let them have it, who cares. You should not let your job define you and be your whole identity.

Be passionate about your own projects, don't hang out with coworkers in your spare time and never attend a christmas party without overtime pay.

You are not your job so why care about PR comments.
I find myself really sleepy after lunch and I'm trying to trace the problem by experimenting with my diet. But when I'm no longer able to function I reach for a ridiculous donut or similar and get the problem solved.

(Yes, I might have narcolepsy, possibly induced by night-time medication that's still hanging around; I take morning modafinil at fairly high dosages and try to take breaks to interrupt the tolerance process. I'm also experimenting with yerba mate, but the overall effect of that seems more suited for late-night social situations than getting amped for work.)
Been there, done that.

And still doing it :-)

The mix of (sometimes hard) physical and brain work is optimal for body & brain.
The keto flu lasts 1 or 2 week maximum if you do everything wrong. And it's pretty easy to fix.
> The common thread between the two is calling consumerism an "experience."

That is your interpretation, and tbh I expressed myself poorly. In Europe working in a restaurant earns at least minimum wage and likely more now, since the pandemic led to worker shortage. I am talking social in reference to experience. The waiter being a real person you talk to, who can inform you on menu choices. A restaurant isn't a McDonald's factory that serves calories at minimum cost price and maximum productivity. The automation trend will see people lose their jobs.
Oh wow, this is really cool. I've seen the exact patterns under 'thin film buckling' (Ziebert et al., “Strongly buckled square micromachined membranes,” J MEMS 8 423-432, 1999) when fabricating ~25nm x50umx50um thick, edge-supported, square membranes of SiN. It always seemed a little crazy that something so delicate could distort that much and remain intact.
Neat a canvas lib that has support for fonts, clipboard, and printing:

https://www.tecgraf.puc-rio.br/cd/

example:

https://www.tecgraf.puc-rio.br/cd/
These modules can be included but currently there's no way to use them - that's because they need to be present on disk to load them as dynamic libraries.

We're debating how to best tackle that. If you have a specific use case in mind I would appreciate opening a feature request in our issue tracker.
I think they are saying that a person embraces and lives with complex priorities rather than hyper focusing on one at the expense of others. Nothing wrong with that.

Conversely, I suspect you're envisioning the kind of person who tries to put all those focuses on their LinkedIn profile, and I agree that person is a bit annoying and totally unnecessary.
> And there's no screenshot on the main page or the overview tab

On the overview page there is a link called "Screenshots" and I clicked on it and it does really show screenshots.
white nose is scary. I’d imagine this happens to the bats a lot. they live so densely that these kinds of epidemics are almost inevitable. looks like this time it was cross-oceanic human contact that kicked it off though
Ask HN: What if Small business loans were easier to get than credit cards
What does it have to do with cardinality of continuum, with several proofs since Cantor?
Must be payback for the every time I intentionally misidentify the objects in the images.
It’s not business. It’s restaurants. If there’s one thing restaurants are awful are, it’s technology. They have no time, interest or margin for anything sophisticated.

And that’s why they get ripped off by ubereats and other delivery services. They will outsource their whole ordering process and lose almost 30% of their margin because they can’t be bothered to have their own app or a proper website.

Restaurants are just not tech savvy. It’s just a common industry trend. Sure you’ll find exceptions and may be someone will track you with a QR code. The reality is that they won’t.

They’d get a lot more info from you if they had a free wifi anyway.
> ..the most notable achievement is the fact that these three patients had complete spinal cord injury, instead of a partial one as with the 2018 patients.

Patients with “complete” spinal cord injury have been successfully treated as well:

https://english.elpais.com/science-tech/2022-02-08/three-par...
QR codes are conducive to dining use cases where automation is desirable. For instance, QR codes would fit in with the old automat model [1]. A more modern example might be Chinese restaurants, where the food (i.e. temperature, taste, price) is more important than the experience (e.g. rude but fast waiters are fine).

In use cases where the experience is an important component, such as the steakhouse example from the article, QR codes can be a net negative. Automation might not be desirable there.

[1] https://en.wikipedia.org/wiki/Automat
First reason that comes to mind is you can make much smaller models, which helps with latency, cost and may enable you to run the model locally.
Same for the National Library of France:

https://gallica.bnf.fr/accueil/en/content/accueil-en

https://gallica-bnf-fr.translate.goog/blog/11122015/des-tira...
What’s people’s opinion on Eclipse’s SWT? It is probably the most commonly used API that just wraps native controls.
This is like the fundamental attribution error but applied to the self.

You wrote some bad code. You are not a bad code writer.