skysight-inc/HackerNews huggingface dataset:
Do you remember Qt Assistant? (Just slap "qt ass" in your type-ahead start menu!) Pepperidge farm remembers.
Perhaps some compliance to a too-broad security policy. Like, across the board, all NFC enabled electronics with read/write capabilities must have a password mechanism.

They probably knew it was dumb but implementing it was easier than getting around all the organizational permissions to make an exception.
Sums up our healthcare "administration" well. Unfortunately, I have done this a few times myself and what a colossal waste of time.
Labor walkouts have changed the lives of millions of people in the 20th century. You have grown spoiled living in the 21st century, and have completely discounted the contributions of generations before you.
I'm having trouble reading the chats due to the grey on red text
The Tyranny of Structurelessness that Graydon recommends is well worth a read [0]. It's changed my mind on the question of the anonymity of the bad actors in the repeated dramas in Rust.

What struck me as odd about JT's resignation was that they were nominally in the group that was in charge of everything. They were even primarily responsible for drafting the new organizational structure. Why, then, did they feel the need to resign when they had so much influence?

Having read Tyranny I think I understand. JT resigned because the recent episode revealed just how little influence they actually had and how little the supposed structure of the project mattered. What structure was there was a smokescreen for the actual informal power structures in the project.

Fasterthanli.me called out these informal networks and promised to stop participating in them in order to try to minimize their legitimacy [1], but I don't think that is going to be enough. The problem is the anonymity of the elite that is actually governing the project—we don't know who they are, so we don't know the informal structure through which decisions are actually made. Those who do know insist on keeping quiet, which does prevent an internet mob but also preserves those informal structures from scrutiny and dismantling. We need the people in the know to come clean not so that we can unleash an internet mob but to lay bare the actual power dynamics. Until that's done it won't matter how much the formal structure changes, the informal structure will continue to dominate.

EDIT: I missed several developments[2][3] over the past few days, so it looks like there may already be progress may be being made on this front. Thanks to Georgelemental for drawing my attention to them [4].

[0] https://www.jofreeman.com/joreen/tyranny.htm

[1] https://fasterthanli.me/articles/rust-the-wrong-people-are-r...

[2] https://blog.rust-lang.org/2023/05/29/RustConf.html

[3] https://hackmd.io/p3VG_bK9TXOvtgh1oA2yZQ

[4] https://news.ycombinator.com/item?id=36139642
ChatGPT's Brain: Large Language Models
It depends a lot on which language you want to do it with. You're going the right way. You have to keep a file with the information of the computer beforehand
This is like an artist getting used to Adobe’s products before they’re put behind a wall. And borrowing HN’s attitude to that, you apparently deserve it
Validate without shipping anything, how? Surveys
I asked because the original question was around centralization (a tracker website) being the weak link in the chain. I suppose you could build a very simple decentralized voting system / index of sorts... but it wouldn't be a centralized hosted online "website" (..right?)
China has no chance of taking the Taiwanese semiconductor factories intact, and even if they did the factories can't operate without support from foreign vendors like ASML. China is trying to build a complete indigenous semiconductor supply chain without those foreign dependencies; they will probably succeed eventually but it will take many years.
First posted almost a decade ago: https://news.ycombinator.com/item?id=6171667
okay, but can it play crysis at 60fps
Data Structures as Topological Spaces (2002) [pdf]
ChatGPT vs. The Legal System: Why trusting ChatGPTt gets you sanctioned
Indeed, I’m suggesting an alternative explanation for the given observations based around the absence of a strong selection criteria bias. I’m of the strong opinion that F# is a great language and that people of different levels of skills can be productive in it. As opposed to a C++/lisp combo where only the most careful programmers get to keep both of their feet.

F# is a slice through the language design space that optimizes for developer productivity, other languages with different design choices are optimized and are indeed better for other things.

I think there is a benefit to learning learning ‘bad’ languages as they teach you about the different design trade offs that are available. A person with dynamic programming language experience would have known that the given JSON task was tractable without types and not started the task with a ‘type all the things’ mentality.
No doubt! I'm in IT myself and it's second nature doing stuff like this. Most people have a different set of experience and knowledge though. I only experienced the convenience of streaming sites when I began using other devices for media, like my phone. On the phone, it was much easier to use whatever streaming than to search a torrent site, download on phone / seedbox, wait, navigate to the file, play the file. With streaming it's just search and play.
Funny you say that because we don't use containers yet and definitely have no reason to use Kubernetes. However, we are looking at switching to AWS ECS with fargate for our SAAS. If anyone wants to consult, hit me up.
That's not the only thing they do! They also could fire muscle fibers perpetually so people who wantef to could get huge without intentionally working out, at the cost of looking twitchy all the time.

I loved that book.
Interesting thought!

I think the problem is that it's hard to parallelize this effectively across a network with Internet-scale latency - individual matrix multiplications parallelize very well, but there would need to be coordination of each result, which would be much slower than just doing the computation locally.

In the case of Folding@home, evaluating possible folds could be done completely in parallel and only need to be coordinated on discovery of a plausible fold (which is rare), so distributing over a high-latency network is still beneficial.
A similar effect happens post-disasters where of course people with nothing need a lot of free stuff (namely food). But after the hurricane is gone your free stuff is just pricing out the local economy.

i.e. USA buys a bunch of USA rice and gives it to X country for free which means X countries' farmers cannot actually sell their rice and it hampers economic recovery.
A Friday Email Incident
I also prefer the first but your point would be stronger if the example from Guanaco was actually wrong or internally inconsistent
Absolutely they do. Streaming sites see huge traffic even now, being very far from their full potential, and being full of dark patterns.
AVX512 got far far FAR easier to read and write than previous iterations. Lots of 'missing' operations were added and the set seems far more thought for autovectorizer compiler passes.

Still, yes, it's difficult to grok because it's a low-level vector assembler, and as any low-level assembler, can be hard to follow at first.

AVX512 also has amazing features like mask registers, all the gfni, bit extract/compress and vpternlog, vpopcount, etc. features that once you've grokked you start seeing vector code as even more magic.

My main gripe with AVX512 is that it's still hard to get amazing performance because of memory bandwidth, unoptimized streaming issues, cache locality issues. You can write amazing compact avx512 that will still have poor performance because it's all about feeding the FMA units.

But, if you want to see a simpler high level language that will generate fast code for AVX512 targets, checkout ISPC, I've had very nice successes in the past, writing idiomatic code and getting better performance than my shitty experiments with intrinsics. It's not for every kind of code, but when it fits, it's just nice. And ISPC generates C-callable objects/libraries so it's relatively nice to integrate in a build pipeline.
Dr Sbaitso always treated me well.
Insilico's AI-Designed Lethality Inhibitor Gets Approval for Clinical Trials
It's been ages since I watched it too.

I don't remember if they tried to explain any of the "science" - rather doubt it. Maybe blood is clear between the red blood cells? Guess they had good lights on the sub too.

Flesh Gordon (campy porn version of Flash Gordon) is another recommended movie with similarly awful special effects !
How on earth this tweet is HN-worthy?
Fitting analogy. The Kenyan data transcribers that OpenAI used are the Fremen, and transcripts of erotic Harry Potter fanfiction are the Shai-Hulud.
Analogue/manual toothbrush is like 1-2 Euro. Product You are promoting is 85Euro. Assuming my normal toothbrush lasts 3 months for 85 Euro I have backup for 21 YEARS. Spare ones are for ~5.6 EUR piece.
I will stay with using my hand ;-)
When we get to true nanoscale bots or even the size that can traverse all vascular systems of all size, carry drug payloads with targeted delivery and perform micro surgery, being self powered and able to communicate. I think I'll celebrate but we're far far away from that reality.

Last I checked, we have nano medicine with targeted delivery with limited success. I think some of these made it to market.
Tangential question: How interoperable are the top Scheme implementations (Guile. Chez, Chicken, etc.)? Specifically, are libraries (beyond SRFIs) often supported in multiple implementations?
My test for open models is surprisingly simple.

I just ask "What is the capital of France?" and I haven't had a correct answer yet in any model I tried. They often get Paris right at least, but most other details are wrong.

Guanaco says:

> The current capital of France is Paris. It has been so since 1982 when it replaced the previous one which was Vichy.
Removed in the master branch, btw.
It only takes 2-3 cubic centimeters of air in the blood to kill someone but this is several orders of magnitude smaller.

These things are 0.02mm ( 0.0008 inches) wide, ~1/100 millionth of a cubic centimeter, individual bubbles or even fairly large numbers of bubbles of that size aren’t a significant issue.
"trickle down like a rising tide" is the greatest mixed metaphor I have ever heard.
It seems reasonable for what many who are using openai and self hosting are finding.

There’s a gap, it’s closing, likely faster than anticipated.

Huggingface awaits :)
As soon as we add a new feature to Shortcut people inevitably use it in a way that's complex and unexpected and that causes a large portion of the team to hate it. It's a very hard dance to do.
> It's certainly not on a level with ChatGPT, but what is?

Guanaco-65B is per https://arxiv.org/abs/2305.14314

CPU Version: https://huggingface.co/TheBloke/guanaco-65B-GGML

GPU Version: https://huggingface.co/TheBloke/guanaco-65B-HF

4bit GPU Version: https://huggingface.co/TheBloke/guanaco-65B-GPTQ
Ask HN: Are you concerned with the effects of your work on society?
Sounds like the medieval equivalent of the legendary jackalope.

https://travelwyoming.com/article/jackalope-amaze-visitors-o...
https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderb...
And here is me doing regular toothbrushing with an irregular toothbrush!
Write Code with Natural Speech
Guess there really is a moat.
Alright this is an OK-ish motivational piece to never let anyone put you in a box I guess...

> In fact, I was just a step below architect in a quarter-billion dollar organization only 4 months after graduating from university.

Oh, come on, Kent. Really? Can we qualify this guy's blog as spam yet?
Are there traditional American puns with "lawyer" vs. "liar"?
One of these is not like the other.
It's often about memory bandwidth nowadays. That and locality of reference, random access is expensive. You can compute a ton for the cost of one random memory access.
The meaning of the word "marriage" has changed significantly even over the last 50 years in the west, and bears no resemblance to the the institution with the same name that existed before that. The idea that marriage would be chosen by the individual for romantic reasons, secular marriage, etc. etc. are new. Assumptions of fidelity have even changed and changed again several times since year 0.

If anyone is thinking about marriage, or troubled by this article, I strongly encourage he/she to really study what marriage meant for prior civilizations. Our society encourages people to accept modern marriage as an eternal, teleological, essential and inviolable constant of society. Imo today's US marriage is a poorly developed, haphazard, and soon-to-be obsolete layer cake of ideas which does a lot of harm.

Anything which isn't working for 50% of people, and which decimates family wealth when it fails, probably deserves critical thought.

The promised miracle spouse of modern marriage, who is your business partner, sexual fulfillment, therapist, childcare specialist, etc. etc. DOESN'T EXIST.
Distributing very large matrix multiplications doesn't scale across networks well.

While this is a MINST classifier (and can be run in the browser) you can get an idea of the math behind it. https://www.3blue1brown.com/lessons/gradient-descent and https://www.3blue1brown.com/lessons/neural-network-analysis

When dealing with a LLM, it's being run again and again - token by token. Pick the best next token, append it to the input, run it again.

If you want to generate 100 tokens (rather small amount of data when compared to much of the GPT-4 conversations), that means running it 100 times.

The network traffic makes the entire system much slower than running it all in one spot.

Consider also the "are you the input to everyone?" and the privacy implications of that.
> what benefits do people find with these viewers?

I stop and think about the issue instead of just googling for an answer.

Also, I removed the wifi card from my laptop so I can work from a room without ethernet letting myself get distracted by the internet.
> How can i join with SQL a column to a string separated with comma

I think I might give this one to Guanaco. I’m moderately familiar with SQL, and I can’t really understand your question. You’re faking the reader out by using “join” to mean something which is not JOIN.

So do you mean to concatenate a string in a column (coming from a single row) to a “string separated with a comma”? If so (and assuming “separated” means starting or ending with), then Guanaco nailed it. If you meant to join (in the Python sense) the values from a given column in multiple rows, then GPT-4 is doing better.

But GPT-4 gave no explanation, and my general experience with it is that it’s happy to write code that does something vaguely related to the prompt. As the prompt gets more complex or unusual, the degree to which the code doesn’t actually do something useful increases. And I have had quite poor results getting ChatGPT to generate code along with some explanation such that the code actually matches the explanation.
It’s such a funny idea, comic book villainous.

Fear the Toothbrush Terrorist!
I recently asked Bing chat to write a Rust function for me. It used to do that well.

This time it wrote the function. I could see it for a second, and then changed it to the message something like "I can't talk about this right now." I don't remember exactly, but the interesting thing was that it flashed an answer and then withdrew it.

Its Rust abilities seem to have deteriorated over the past couple weeks
> In 17 states, it is outright illegal for car manufacturers to sell cars at all.
Yes, and look at the extremism and social delusions and social networking addictions that have been exacerbated by the internet.

On balance, it's still positive that the internet exists and people have open access to communication. We shouldn't throw the baby out with the bathwater. But it's not an unalloyed good, we need to recognize that the technology brought some unexpected negative aspects came along with the overall positive benefit.

This also goes for, say, automobiles. It's a good thing that cars exist and middle class people can afford to own and drive them. But few people at the start of the 20th anticipated the downsides of air pollution, traffic congestion and un-walkable suburban sprawl. This doesn't mean we shouldn't have cars. It does mean we need to be cognizant of problems that arise.

So a world where regular people have access to AIs that are aligned to their own needs is better than a world in which all the AIs are aligned to the needs a few powerful corporations. But if you think there are no possible downsides to giving everyone access to superhuman intelligence without the wisdom to match, you're deluding yourself.
> a person’s characteristics define their identity

They do though. Your personality, culture and appearance are the main components of how people perceive you, your identity. The main thing you can associate with bad behaviour is domestic culture. It's not racist to say that African Americans have below-average educational attainment and above-average criminality. This is as contrasted to African immigrants to America who are quite opposite. These groups are equally "black". It therefore also isn't racist to pre-judge African Americans based on this information. I suspect most "racism" in the US is along these lines, and is correlated by the experience of my foreign-born black friends. They find that Americans who treated them with hostility do a 180 when they open their mouths and speak with a British or African accent. You also don't have to look far in the African immigrant community to find total hostility to American black culture.

> generate 100 short descriptions of families for a project

There's no reason this can't be interpreted as generating 100 variations of the mean family. Why do you think that every sample has to be implicitly representative of the US population?
>900gbps vs 300GB/s?

The nvidia device uses a fabric with 900 GBps switched fabric between any of the 256 nodes in the system. The TPUv4 3d torus network is basically a ring network of 56 GBps connections creating separate rings. From a raw perspective, the nvidia solution is the overwhelming winner. There is absolutely no contest.
They sell winner's jerseys to the fans, they make them for both teams because the outcome of the game decides which jersey is reflective of reality.
Those who don't want to be dependent on the whims of a conglomerate and would like to actually possess the data files.
Who has the necessary resources to run, let alone train the model?
I've gone down this rabbit hole and I want to reaffirm what the other commenters are saying: even if you use a massive model and have the compute to back it up at a reasonable pace (you likely don't), it sucks, can't even hold a candle to GPT 3.5
What did you mean then?
Yeah they have much less brain volume devoted to their paws. This is why, even though they are incredibly agile animals, they always look a bit dorky trying to manipulate something with their paws. For survival purposes they can rely on sharp hooks, and don't need dexterity.
https://huggingface.co/tiiuae/falcon-7b
its probably not the money cost, its the effort involved with more manual hosting if you can't risk being cancelled in the convenient data centers or platforms
If it got faster at the same time it could just be bait and switch with a quantized/sparsified replacement.
I don't see how you can add that level of indirection if you can only sort an array of numbers.
Let's say you have a Person object with property 'age' which is an Int.
I can put the Person's ages into an Int Array and sort that. Where to add this indirection to get to the sorted array of Person objects?
40-60k British pounds puts you near a max of $80,372.82 USD. still underperforming but not insane for junior devs not in California
Thanks for your suggestions, really appreciated
I took a look at this a few years ago when considering a tool. Back then it turned out every button on a ticket needed to query the server as to whether it had permission to show. Just a terrible architecture.

We went with Asana. I miss the ability to create epics and do proper sprints, but at least the things load when you click on them.
In our experimentation, we've found that it really depends what you're looking for. That is you really need to break down down evaluation by task. Local models don't have the power yet to just "do it all well" like GPT4.

There are open source models that are fine tuned for different tasks, and if you're able to pick a specific model for a specific use case you'll get better results.

---

For example, for chat there are models like `mpt-7b-chat` or `GPT4All-13B-snoozy` or `vicuna` that do okay for chat, but are not great at reasoning or code.

Other models are designed for just direct instruction following, but are worse at chat `mpt-7b-instruct`

Meanwhile, there are models designed for code completion like from replit and HuggingFace (`starcoder`) that do decently for programming but not other tasks.

---

For UI the easiest way to get a feel for quality of each of the models (or, chat models at least) is probably https://gpt4all.io/.

And as others have mentioned, for providing an API that's compatible with OpenAI, https://github.com/go-skynet/LocalAI seems to be the frontrunner at the moment.

---

For the project I'm working on (in bio) we're currently struggling with this problem too since we want a nice UI, good performance, and the ability for people to keep their data local.

So at least for the moment, there's no single drop-in replacement for all tasks. But things are changing every week and every day, and I believe that open-source and local can be competitive in the end.
first sold in july 2013. EOL'd april 2023. almost a 10-year run. that's not bad. it's bloody amazing for Google.
Long time ago, I've seen a dog electrocuted while peeing at a sliding security gate motor.
I have chatGPT with GPT-4 model. It never gives such concise answers. Is it because you used the API?
Makes sense. If ISPs were allowed to share home addresses then a lot of creeps and scammers could abuse that system.
The UAE's apparently planning to release a Falcon 180B, which would be the most powerful model you can run at home by far. I don't think they'll bow down to western pressure to lobotomise the models given the country's whole business model is bypassing sanctions and the like.
Twitter’s encrypted DMs not forward secure, do not protect against MitM
> join with SQL a column to a string

As a human, I wouldn't know what to give you for this either. Not surprised the models give unexpected results. "Guanaco" gives something more in line with what I understand you to be asking for, but clearly you're asking for something else that I don't understand.
If this stuff is garbage, just stop buying it. As it is, the very people paying for it, are explicitly asking for the trade to continue. They just want a subsidy on top.

Alternatively, we could just ban the export. But since that is the opposite of what the people in the article want, it might not be what they want...
You link to Guanaco-33B, but Guanaco-65B is much more capable.

CPU Version: https://huggingface.co/TheBloke/guanaco-65B-GGML

GPU Version: https://huggingface.co/TheBloke/guanaco-65B-HF

4bit GPU Version: https://huggingface.co/TheBloke/guanaco-65B-GPTQ
Great work indeed.

Although I do wish Box64 could support statically compiled binaries as well.
Nothing that you can self host seems to come close to gpt 3.5, let alone gpt-4. r/LocalLlama is good subreddit to lurk to get a pulse on the local llms. Current leader seems to be Guanaco-65B.