skysight-inc/HackerNews huggingface dataset:
There's a slight difference between "the jews" and "Israel". Obviously Israel would have some bot farms, though I don't think it's reasonable that they'd form the supermajority of bots on 4chan/etc.

Also I think it's extremely generous to give this fellow the benefit of the doubt on "the jews" vs. "Israel", but that is what HN guidelines generally suggest.
I think you have to distinguish between self-hosted to run on CPU (like LLAMA), on consumer GPU or on big GPUs. I find the market currently very confusing.

I'm especially interested since the data center I'm working for is sitting on a bunch of A100 and I get daily requests of people asking for LLMs tuned to specific cases, who can't or won't use OpenAI for various reasons.
I was wondering how much GPU memory does G-65B need, and from the docs, it's "48GB".
Yeah the same Western media that fed the world the news that Iraq had Weapons of Mass Destruction, Libya needs to be attacked to install democracy, justified sanctions on most energy producers who were not much in favor of the USD such as Iran, Venezuela, Libya, Russia.

Some day you will realize the Western media is a propaganda tool wielded by the powerful arms and other lobbies to paint their targets and give the Western governments pretext to begin interfering in the matters of a non-pliable foreign government.
It's fairly common to have login credentials to business email, slack (etc) accounts.

So that can be pretty serious for senior staff, infrastructure team members, and so on.
I persons base metabolic rate doesn't vary that much. You will hear people claim to have a slow metabolism, but in reality it makes little difference.

Most people do not do enough physical activity for it to make much of a difference either.
Going through someone's comment history to find reason to engage in ad hominem attacks is exactly the type of personality of someone who I expect to frequent Reddit and reason why I switched to HN. Sadly, it appears that this malaise reached here as well.
I just got "The capital of France is Paris." from vicuna-v1-7B running entirely on my iPhone (using the MLC Chat app).
On the other hand .NET is much closer, because it supports value types and CLR was designed to be targed by C++ as well, so it supports most of the crazy C and C++ stuff (not counting UB related ones).

Likewise if you code in C, C++ or Rust with allocations everywhere, bad algorithms or data structures, being AOT won't help.
Sure, but what use is that? You will have your objects sorted by the absolute value of their pointer. I guess this means you'll have your objects sorted by the order in which they are allocated in the heap. Cool, but not very useful.
Maryland License Plates Now Inadvertently Advertising Filipino Online Casino
The new beginnings must come
Thanks! 99% of the content and all of the images. The website itself is not generated, though I did get a bit of old-fashioned help from gpt4 on some simple scripting stuff.
Ahhhh! A breath of fresh air in this world of ugly Algol-wedged hyper-utilitarianism. (I was going to say “hyper-functionalism”, but the unintended pun confused the sense.) [Although, I must admit that js is actually pretty descent, and can almost be used like Lisp if you look at it hard enough and cross-eyed.]
If you want to deep dive there Travis Downs has written an amazing thing about it https://travisdowns.github.io/blog/2020/08/19/icl-avx512-fre... and you should follow the links down to his github avx-turbo project that actually runs all sorts of 'frequency reducing' benchmarks and it's just clearer like this.

For example I noticed that on some Intel Gold 6230 processors (2000+ USD each at the time), not only avx512 did bring down frequency, but also 'dense avx2' (sequences of heavy FMA). Explained a lot about measured latencies for some real-time processes.

Can't thank Travis enough for cutting through all the vagueness there.
That's for coming in my defense. You are right. I'm not a big fan of Microsoft, but I also don't hate them.

It's pretty simple, really. I am a Linux engineer, and it is not a great investment of time and money for me to get into .NET. I knew F# was cool, but is it cool enough to want to feel a second class citizen, running it on the OS and platform it is not intended to run on? It makes no business sense at all.
Not a cat person, but I've worked with raptors. Staring at them tends to mean "I intend to eat / fight you". I understand this to be true of lots of mammals as well (e.g. you should avoid making eye contact with wild bears that you encounter). I can therefore interpret the slow blink as 'defusing' the aggressiveness / threat of a direct stare.
My point is that if China is starved of semiconductors, China is going to try to make it so for the US as well. Yes, I know the US still has Intel and Micron but TSMC is significantly more valuable.
"That's just factually wrong I'm afraid"

This kind of response is incredibly rude.

So it looks like their production has since gone up, a lot (after dropping mid last year). Profits are still down because nobody's paying full price.

https://www.euronews.com/2023/05/31/russian-oil-exports-are-...
I think we've converged on a partial agreement, but I wanted to clarify the gun analogy part.

I would also be afraid of chipmunks if I knew that 1/100 or even 1/1000 could explode me with their mind powers or something. I think AI is not like that, but the analogy is that if some can do something better, then when required, we can leverage those chosen few for a task. This connects back to the alien chess tournament as "Humans are now much harder to beat at chess because they can find a slave champion named COMPUTER who can guarantee at least a draw".
Andy800 did a better job replying, but I drew where the wire is on the photo you sent.

https://imgur.com/a/nvRbLsA

In andy800's example you can see it under the felt but I think I have seen them over the felt as well, but either wat it is very subtle and you won't notice it if you're not looking for it. I had played craps for over a decade before I read a book that mentioned it, and since then I have noticed it every time.
Haha, beat me to it by a minute! But idd, do check out our self hosted option :D
I never understood this kind of thinking. When 50-60% of humanity live in urban areas why is this an argument that people use? Should people live in cities and then move out to the country when they retire? Shouldn't the answer to this be to make these cities more affordable by building additional housing?

For housing in a city, it makes sense to me to always increase supply such that every place in the USA costs the same. This allows people to move freely, it allows people to congregate with other smart people and have "intellectual density", it allows wealthy investors to live next to struggling bohemian artists, and allows the average Joe to experience all of this just by virtue of existing in that place. I understand there are constraints on land but it's bizarre to me that people have accepted the idea that these places are just naturally "HCOL" locations and not that they have been homogenized and sanitized into this type of place.

> They chose to live in a high cost of living area.

Millions of people are born in HCOL areas and make their lives there. We shouldn't ask them to leave.
I don't appreciate the insult, especially saying I have a "low mind" whatever that means.

I am not racist. I wouldn't wager that this was race related. But I wouldn't say that someone seeing the situation, and then making the assumption that is it is race related, is out of the realm of possibility.

I would think that would be an unfortunate, but frequent, take away if the average person evaluated things at surface level.

You can disagree with me here, maybe with a Gallup poll for example, without insulting me.

Just because this is a sensitive topic doesn't mean you get to throw around insults and look down on another person.
High-end coffee shops. I’ve been lucky that two of them that I’ve gone to had a bunch of interesting regulars. They were usually foodies (and I’m not), but they have other interests (travel, data, politics, woodworking, etc.). And, if you ever need an impressive restaurant for a date or business meeting, they have great recommendations.

I believe a lot of the fostering of a “regular cwrowd” has to do with the architecture of the space. Both places had tight spaces near the staff. Also, the staff were interesting in each places, which started conversations or kept them going during slow times. So the crowd may not be at the tippy-top best coffee shop.
Air bubbles are typically not lethal until over 150cc of air. That's a massive amount, that will not be reached by those machines.
What's the result for:
How can I aggregate with SQL a column to a string separated with comma ?
Iphone and Macs are obviously huge in the enterprise market though.
Wikipedia says ArcaOS has a license from IBM. Someone needs to continue to support all those ATMs and other systems still running OS/2.
How much ram/vram required?
That's not exactly a widely held viewpoint by the younger generation. Besides, it's not like the offshore streaming sites are engaging in revisionism or dropping shows to subscribing reasons.
Authoritarianism Keeps Surging in Western “Free Democracies”
Sorting by number of seeders will probably get you a file that is fast to download because of the number of seeders, but it will rarely get you quality. Let's go take a stroll over to a popular public torrent site and search for, say, a recent superhero movie.

I see 100 (!) results for that movie's name. 49 of them have zero seeders at all. I don't know what even is the point. 29 of the results have one seeder. So already, 78% of the results are pure crap.

Let's look at the top result with 338 seeders: File is 3GB, H.264 video, 1080p, but with a crappy stereo AAC audio encoding... arrggh why??

Number 2 result with 84 seeders: 1.43GB, H.264 video, 720p, no word on the quality of the audio encoding. Even more worthless.

Number 3 result with 17 seeders: HEVC format, 2160p, audio streams include TrueHD Atmos 7.1, DTS-HD, Dolby Digital 5.1, stereo, and three non-English language streams. But, with an eye-watering download size of 61GB. Holy shit! Nice, but wow, what a download.

You have to go a few more down the list to find a good balance of high quality video and audio encoding, but with a reasonable file size. By that point you're in the single digit number of seeders.

Don't get me wrong, it's great to have a few choices and quality trade-offs. I guess there's someone out there who doesn't care about the stereo audio because they watch their movies with laptop speakers. But 100 results, with the vast majority of them either unseeded, poorly-seeded, or flawed in some way. I agree with OP: You definitely want some curation, not just search!
Not self-hosted/local but Claude by Anthropic from what I've heard is really good but the API is not publicly available. It's apparently accessible via Poe (https://poe.com)

As for open models, HuggingFace has a nice leaderboard to see which ones are decent: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderb...
System Shock: The oral history of a forward-thinking PC classic
You can check out this leaderboard to see a current state of LLM alternatives to GPT4

https://lmsys.org/blog/2023-05-25-leaderboard/

But unfortunately for now it seems there aren't any viable self-hosted options...
Magic raises $52M strategic round led by PayPal
Who said autonomous?

A robotic arm in a factory is also "a device that can be pushed around by an external field"
I was guilty of that. For my last project I just decided to build it in public over the weekend while tweeting about it. I built https://2markdown.com (convert any website into markdown, useful for LLMs/chatGPT) and it now has about 100 users since launching two weeks ago. Just ship it ;) I actually got integrated into langchain 3 days after launching. Costs: 0, revenue: > 0.

I also built newsletterify.com (newsletter reader) which I didn't launch for almost a year. No build in public, no small releases, just big things. Cost: almost 50 bucks a month, revenue: 0.
There are no viable self-hostable alternatives to GPT-4 or even to GPT3.5.

The “best” self-hostable model is a moving target. As of this writing it’s probably one of Vicuña 13B, Wizard 30B, or maybe Guanaco 65B. I’d like to say that Guanaco is wildly better than Vicuña, what with its 5x larger size. But… that seems very task dependent.

As anecdata: my experience is that none of these is as good as even GPT3.5 for summarization, extraction, sentiment analysis, or assistance with writing code. Figuring out how to run them is painful. The speed at which their unquantized variants run on any hardware I have access to is painful. Sorting through licensing is… also painful.

And again: they’re nowhere close to GPT-4.
By your logic, wouldn't EME be a good thing too, since its spec is also fully open?
Payment terminals come to mind, they brick themselves when tampered with
This is interesting. I've had both cats and dogs, and with the theory "they don't have fingers" I wonder why do dogs understand human pointing? Dogs of course communicate with a direct gaze (looks at empty food bowl, looks at human, looks back at empty food bowl) and can understand us communicating back with a directed gaze, but at the same time my dog definitely understands me pointing at something.
I used to buy clothes from a big name chain, just like basically everybody I know. After less than a year, the fabric unravels and I had to buy again. Then quality lowered even more. So as an experiment, I bought some brands I actually saw on HN (we're famous for fashion advise only in negative ways, ) . They cost twice as much or more, but they last forever and feel better too, somehow.
I have a hard time understanding the question as you phrased it. Tested with guanaco-33B and a cleaner question, looks like a much better response:

> How can I join a column with SQL in Postgres to a string separated with a comma?

You can use the `string_agg` function in PostgreSQL to concatenate columns into a string. For example, to concatenate all values from a column named "column1" into a single string separated by commas, you can run the following query:

```sql

SELECT string_agg(column1, ',') FROM table;

```

The `string_agg` function takes two arguments: the first argument is the expression to concatenate (in this case column1), and the second argument is the separator between each value (in this case a comma). The query above will return a single string containing all values from column1 separated by commas.

I generally find WizardLM 1.0, Guanaco and Manticore to be good enough for most GPT cases.
This is just a reminder that power today is largely expressed through technology. Corporations, and those who work for them, are complicit in the trend of expanding authoritarian power through the technology they vend.

Although one cannot stop bad people from using technology, we can enable good people to use it too, through free (libre) software. If you write software, please set it free and let all use it freely.
The best self hosted/local alternative to GPT-4 is a (self hosted) GPT-X variant by OpenAI.

No kidding, and I am calling it on the record right here.

OpenAI will release an 'open source' model to try and recoup their moat in the self hosted / local space.

https://www.theinformation.com/briefings/openai-readies-new-...
Reminds me of Robocop 2 when he has a thousand prime directives installed and can’t do a damned thing after.
“Trump Bucks” Scam Tricks MAGA Out of Serious Money
In small towns in Spain is very common, when the weather is good people just sit outside their houses with a chair, and im talking about houses without garden whatsoever, they just sit on the street, of-course its secondary streets where there are almost no cars. Normally people stops to chat, and the more closer neighbors also come to sit.
Is anyone using a self hosted thing to assist with parsing?
The artists that are hurt by this have neither a name nor a distinctive style, they are the ones whose work was derivative itself, who already struggled to get paid for expensive manual labor.

Then you have the artists who matter, whose work is valued because it has their name on it, regardless of what process was used to create it. AI will be just another tool they may choose to use.
See my response to Tremon but resorting to an ad hominem based on an (incorrect) assumption of how I judged the situation is both rude and a waste of time.
Do you have any sources for that?

How would making ChatGPT less likely to return a racist answer or hate speech affect its ability to return code? After a question has been classified into a coding problem, presumably ChatGPT servers could now continue to solve the problem as usual.

Maybe running ChatGPT is really expensive, and they nerfed in order to reign in costs. That would explain why the answers we get are less useful, across-the-board.

That may not be the reason after all, but my point is that it’s really hard to tell from the outside. There’s this narrative out there that “woke-ism” is ruining everything in tech, and I feel like some people here are being a little too eager to superimpose that narrative when we don’t really have insight into what openAI is doing.
That was the subject of a 1993 comic book: The Hacker Files #5 (published by DC Comics)
https://www.comics.org/issue/216963/
Having spent 7 years now building https://www.shortcut.com/ it's very clear to me that at a certain point in the life-cycle of many organizations a bunch of people get hired who can only "think in Jira" and the vast majority of feature requests are attempts to get us to add whatever feature(s) they love using.

Conversations about why it's bad for developers or product managers or attempts to show them how to get the same value in another way often fall on deaf ears (or don't happen at all) because it's the only way that they know how to work.

One of the key indicators that this is happening is when people start saying things like "this can't do Agile because it doesn't have PET_FEATURE"

Jira isn't just software, it's a way of working that's become the de facto standard, and it's hard to get out of that box for a lot of people.
I don’t think that works for the self recursion trick. It’s a logical problem more than a representation problem. Even if you had a machine to decide halting status quickly, it’d be broken; representing computation as a graph can’t help.

The inputs to a halting decider TM is an infinite set (all TMs and all inputs to them) so that’s another reason why a finite graph can’t be represented. Even something like integer addition isn’t a finite graph if you enumerate all inputs
> Mature projects have unit and screendiff test suites

Good joke.
The thing is now your codec (or libc as it was once!) is having a complex side effect. The clamping and ramping back up of the frequency is not immediate and it has an impact of overall latency on the core it's running. I even saw once funny traces on a heavily loaded machine where the avx512 code was rescheduled on other cores almost all the time, because overall the core running the avx512 code seemed to 'be more loaded' and the scheduler would find a new home for the avx512-crunching process. Kind of a 'fun' runaway process.
I haven't used Usenet since probably around 2002. It seems like everything is still the same except for the indexer. I assume that is so you don't have to sign onto a bunch of binary groups into your newsreader and then search through them for what you want (part of the fun in the old days for me)? Is that correct, does anyone know?

I also wonder if Forte' Agent still works? Does Newsguy still exist? /s

edit: found the answer to my question
If you actually try the anarchists cookbook, you will find many of the recipes don't work or work that well.
(2018)

Search for "live bindings" if you don't know what difference those make between require and import. Also explained here: https://developer.mozilla.org/en-US/docs/Web/JavaScript/Refe...
There is a mythology to Google's TPU that is not validated by real world numbers. Where we can actually test (I mean -- TPUv4 pods are available right now on their cloud) it is very good, but remains uncompetitive with the h100. I mean, Google disclaims that you shouldn't compare it, doing the classic "the h100 is on a better process node so it's unfair". People will always point at a mythical next generation that is surely way better, despite the fact that Google is currently building big supercomputers with their TPUv4. And in Google's shootout, again comparing with the last generation of nvidia hardware (the A100), Google's biggest advantage was in the connection fabric, which with this DGX GH200 nvidia not only overcame, but bested by a magnitude.

More competition would be fantastic. Better pricing at scale would be fantastic. But there is absolutely no doubt that nvidia is far ahead of Google right now. Tesla made some believably pushing claims about their own efforts with their own hardware, so who knows maybe they're the real challenger.
So if we're talking about high-end chips Intel and Samsung are both designers and manufactuerers? And Samsung seems to have mostly abandoned Exynos and is using Qualcomms SoC now. So that only leaves Intel..
It's definitely a fundamental concept of compiler theory. Wikipedia has a reasonable description: https://en.wikipedia.org/wiki/Basic_block
It's actually more than that.. Direct sales are forbidden in 22 states and restricting to only Tesla's in 11 states.

https://pro.morningconsult.com/articles/electric-vehicles-di...

There is no legitimate reason for the government to prevent a domestic manufacture from selling vehicles directly to consumers.
This is ultimately a story about a WebSockets bug and a classic JS footgun in `new DataView()`. I'm the post author: AMA.
In Search of an Antidote for Poisonous Mushrooms
Data Compression Drives the Internet. Here’s How It Works
Isn't this enabled by default? I just recently set up a new computer with someone and ran into it.
https://archive.ph/0NfpH
...which actually is not a "Firmware backdoor" but the usual "crappy Windows companion app" malware...
Constant propagation and also tracking of nonzero bits has been a huge performance improvement in QEMU. The latter helps a lot with x86's automated zero extension, because if you know the high 32 bits are zero you can use a 64-bit move instead of an AND.

But QEMU only does one basic block at a time without jumps so it's relatively easy to implement.

(I tested "7z b" and QEMU user mode emulation is about 30% for x86-on-x86, I'm curious to see how it fares for x86-on-RISCV but I don't have a board to test on).
Future-First Design Thinking
It is literally impossible with today's software engineering tools. If you want real computer security, we need to rebuild the industry from the ground up with correctness and proofs from step 1. That looks like formal analysis tools and then engineering tools built upon them. This research area has largely stagnated since the 80s & early 90s since no one actually cares about correctness because it is expensive. Without correctness guarantees, you cannot have computer security, full stop. All we have are band-aids on top of the gaping wounds upon which our entire industry was built.

So step one of your new OS engineering process is to build a whole new software engineering paradigm, and all of the engineering tools to go with it, from the ground up, based only on research from like a dozen people that mostly ended around 1990.
What's the best self hosted for ingesting a local codebase and wiki to ask questions of it? Some of the projects linked here have ingest scripts for doc, pdf files; but it'd be cool to ingest a whole git repo and wiki, have a little chat interface to ask questions about the code.
> Do the machines need to be reclaimed after they do their thing

There are mechanisms to expel so called "foreign bodies", through the details are important (how long until they are detected, ...)