skysight-inc/HackerNews huggingface dataset:
VRAM is everything.

The more VRAM you have, less aggressively you have to quantize models for inference, which in turn has huge speed/quality implications. You can run higher batch sizes, or draft models, or more caching, which increases efficiency. For LLMs specifically, you can load bigger models into VRAM in the first place. You can load more of a multimodal pipeline in VRAM without having to constantly swap everything out.

This is all 10x true for finetuning. Quality and speed is essentially determined by VRAM capacity, as long as you are not on truly ancient GPU like a P40 than't can't even do fp16.

As for architecture... TBH, many operations are heavily bandwidth bound these days. Sometimes a 3090 and a 4090 are essentially the same speed. And waiting a little longer for a finetune is no big deal vs not being able to do it at all, or doing it at low quality.

> They are graphical cards, equipped with consumer grade VRAM (instead of HBM) and IMHO it will take a very big shift before we see them being used as real AI accelerators

I think its important for users to break away from the cloud and APIs, and try to run stuff themself, lest we get locked into an OpenAI monopoly.

But setting that aside, running local is also extremely useful for prototyping and testing. You can see if something works without burning dollars every second you spend debugging on a big cloud instance. Even if that's affordable, just feeling like I am under the clock when debugging/optimizing is stressful to me.
My favorite part of watching the match was how the computer tripped everybody up with its endgame. It would have a large lead, but slowly it would concede one point after another, which no human would do. At some point someone explained that it does this because its goal is not to win by a large margin but instead to win by any margin no matter how low but with maximum probability.
Even if 100 page decks don't go away, AI can be leveraged to find the 2 or 3 pages that actually matter.

Google search has become worse and worse over the years, I could see using an AI plugin that performs a search on top of the Google search results (or aggregate all search engine results), pre-filtering SEO garbage, pre-filtering advertisements that are LARPing as information, removing the top 90% of any cooking recipe that is a diary entry about why this beef stew recipe changes the chef's life, and so on. Perhaps also the AI plugin could slightly tweak your Google search query to better align your search intent. Preferably running a local LLM plugin to do this for you so that you aren't steered towards "sponsored content".

If we do end up drowning in AI generated content then at a certain point you will probably have to use AI to combat against it, fundamentally changing how we currently use the Internet for information retrieval.

Adversarial neural networks playing out an information arms race on the Internet in a nutshell.
dangs Friday just got a lot more interesting…

Hacker news server goes brrrr
Or, this is the AI taking over.

only half joking
Question is how bad is whatever Altman did
and secondly what his next act will be?
> I think the root cause is further up the chain of casuality. People need cars because they live in the suburbs, they live in the suburbs because they have children, they want to raise children in more square footage than the urban housing stock offers.

Modern suburbs were created by central policy in many ways; the FHA wouldn't underwrite loans for properties with small lots or in mixed-use areas.
How likely is it that the board of directors *is* the AI and they just installed their own puppet?
Google CEO Pichai advises Android users not to sideload apps
In the world of AI, there's never a dull moment.
Yeah this is bad
Someone at the company did a bad thing, and everything is securities fraud.
Sounds like he lost some internal power struggle.
Could this something to do with the moat he's been digging?
I know for a fact that there are a lot of unreverted vandal edits in Wikidata, because Wikidata's bots enter data so fast that it is too fast for Special:Recentchanges to monitor. Even Wikipedia still regularly gets 15+ year old hoaxes added to their hoax list.
I've had a positive opinion of sama as a human ever since this comment about him living with his two brothers well into their 30s: https://news.ycombinator.com/item?id=12592010

It's a corollary to my theory that anybody that maintains close ties with their family and lives with them is a wholesome person.
As noted in the release: "The majority of the board is independent, and the independent directors do not hold equity in OpenAI."
> On paper, Sam Altman would have made everyone on the board billionaires.

I know OpenAI in recent years forgot it's a non profit with particular aims, but:

> The majority of the board is independent, and the independent directors do not hold equity in OpenAI.
I'm confused. I read "we brits pay more", yet what I read is that the maximum tax to pay on a large house is £3K. I'd love to have property/council tax that low (it would cut our tax bill in half). And we live in a 1200 feet^2/112 m^2 shoebox. Granted, Redmond, WA ain't cheap, but even someplace out in the sticks is going to be at least that much if one decides on the 4000 sq. ft. McMansion.

So which part of my reading comprehension failed? :-)
I thought Sam Altman was gay. The accusations of sexual abuse don't seem to line up. And her accusations that he is shadowbanning her on social media sounds mentally unstable.
How's this for interesting: many people in my field (formal methods) seem to be pretty excited about our job prospects. Before we used to just say that people don't actually know what their code does, but now it looks like it might really be true.
Fixing defects is a different activity from support and future development, no?
Good CEO leadership is critical... otherwise you end up with Google and an inability to deliver on any ML project.
Correct, I inferred those words.

It would be difficult to prove that social media causes lifelong anything, because there social media hasn't been around long enough.

It's like smoking. They used to say the same things. Smoking hasn't been proven to cause cancer, etc. Then over time the science got better, more data, and bam. It was proven.

I believe this is similar. You don't. That's OK. Time will tell.
I would translate "not consistently candid with the board" as "he lied to the board about something important enough to fire him on the spot". This seems like the kind of statement lawyers would advise you to not make publicly unless you have proof, and it seems unusual compared to most statements of that kind that are intentionally devoid of any information or blame.
Most call them Jails, but others like to call them containers. But in comparison to Linux containers they are very different. Some would argue what you can do in jails you can do in Linux containers but, that's another discussion.

Each Jail, can have it's own network adapter, allowing yourself to host network applications, firewalls, servers and routers isolated from your main network.

These jails can have firewalls allowing you to test firewall changes without burning down your network. As well as isolated Web Servers, Music Servers, Game Servers taking no further resources other than what you give it.

You can also apply resource limits to jails, and the whole lot too. IOPS, CPU Cycles, Cores, Network, Quota Size.

With this you can then create locked sandbox environments for applications. Firefox/chromium can all run in their own jail ensuring that any virii are isolated from your core system while ensuring they only have 2mbit of network. You can even run Linux within. Ubuntu on FreeBSD, who would of thought. Can you run FreeBSD on Linux?

What I'm currently setting on my colocation box as I call them are cell's. Zones as if you wish to go Solaris'ly. Which by you can host bHyve, FreeBSD's native hypervisor in a separate jails giving you isolation. I host game servers publicly, so knowing they're restricted to their own cell, with a set amount of resources means I know my system is going to brick if something goes astray. As that too with ZFS allows me to backup real-time. Real-time migration and resource limiting, what more could you want?

There are other third party "container" attempts at containerizing FreeBSD. But in my opinion Jails are the bee-knees.

A feature I've never seen outside of the Unix world are: bectl and beadm. A dream, advance boot environment tools for when you really want to keep deep. Imagine compiling your kernel, rebooting only to find it panics. Those tools allows you to revert back to the OS to it's previous state, even jump into your newly built kernel without having to reboot. Magical.

Resources:
https://wiki.freebsd.org/Jails
https://wiki.freebsd.org/Containers
https://wiki.freebsd.org/LinuxJails
https://vermaden.wordpress.com/2022/03/14/zfs-boot-environme...
"If it catches fire, the whole parking lot is done"

haha well Luton Airport fire was not caused by an EV !!
https://www.bbc.co.uk/news/uk-england-beds-bucks-herts-67077...

The risks are going in the opposite direction with lifepo4 batteries this reduces by a large margin (( far better than petrol and diesel )), then the next step is semi-solid state batteries and then solid state.

Just no contest...

"can't be fixed" well insureance companies will need to be forced to make sure they are fixed !!! it's poor regulations that are causing this not the tech!! standard and modular replaceable batteries problem solved and this also reduces prices.
> Is that obvious?

The best-selling cars in the US are (and from afar) the F150 and the Dodge RAM, so empirically it seems correct.
Denial of Pleasure: Attacking Unusual BLE Targets with a Flipper Zero
Yeah. I didn't mention them because the 64GB+ configs are very expensive, and I don't think you can even finetune on them.
> I’m curious at what point it will flip and EVs become cheaper than ICE

If Tesla can pull off some of the manufacturing efficiencies and improvements they talked about at their last investor day, it seems very likely their up coming "smaller" vehicle will be exactly that.
Well they disabled purchasing 3 years ago. Rather than a rug pull, it's more like a bar turning the lights on 3 years ago, and then they handed out to-go cups in case you didn't finish your drinks after all that time.
It’s interesting how we (as a culture) tolerate people who have broken the social contract. As Americans we’ve really let the bottom fall out. They’re so far away from society they do not care anymore about norms. And we do not care to do anything except let them exist in our spaces to the detriment of the public.
The fact that no businesses have been willing to distribute via sideloading and save the 30% cut is pretty good proof that it doesnt work.
For me, the most valuable "take" on generative AI has been the collective discussion on HN. While many individual articles and comments have been useful on their own, it is the ongoing conversation here that has given me the best view of how AI is starting to impact society and what people think about it.

The HN commentariat is not, of course, a randomly selected, representative group, and the discussion here can be repetitive. But, as a whole, it is much more insightful than any individual article, paper, or blog post.
Apple Pausing Advertising on X Following Latest Elon Musk Controversy
Can't read the article but pretty sure demand is not decreasing, what is decreasing is the rate of growth. So still growing, but slower than before, which is a far different story.
It really depends on where you're coming from and if you understand the problems Rust is trying to solve. Rust is a strongly typed language that promotes explicitness over ambiguity, making actual application code look quite different from JS or Python which provide a lot of shortcuts but also have plenty of hidden trapdoors.

Some say that Rust naming conventions actually uses snake_case in variables because each underscore is a little trapdoor that's made apparent so you don't fall in it!

Being mainly imperative with some functional and OO niceties, it's also much less weird than many other languages. Try reading some Haskell or Erlang before judging how weird a language looks...
I don't think I've ever seen data that counts vacation homes as "owner-occupied", so in practice, the proportion of owner-occupied homes is the same thing as the proportion of people who own a home.
And thus more dangerous when they hit pedestrians in a city.
Looks like you can get an MI60 with 32gb vram for ~$500 on ebay - if you're vram limited might be a good option for less than a 3090 seems to be going for, and seems supported by rocm (being an mi50 just with more hbm).

Not sure how well it will perform as it lacks some of the smaller data type acceleration available on newer cores, though.
Is she not credible?
I wonder what he did with those gpus he had
So why didn't he reply to a comment about that?
Eisenhower might have warned about it but he apparently never asked Congress to appropriate funds for modernizing the Department of Defense accounting systems. Had he done so they wouldn't be such a mess today.
To answer your original query, we can add other incentives to the system if larger firm size (by employee number) is beneficial in certain industries. Perhaps, the most straightforward way would be to not have a cliff for the minimum size where the 50% bound kicks in, but some linear function of number of workers. Since, larger firms often have a competitive advantage, this would increase the equilibrium size.

> Why does worker ownership not matter in small companies?

1. Small business owners also exploit their workers but this is partially solved by (a) competition between small firms, and (b) labor laws.

2. The reason labor laws are often ineffective is that the capitalist class, who owns large businesses, pays off federal/provincial politicians to change laws so their exploitation is legal, or to weaken enforcing agencies. Fixing the ownership of large firms will reduce worker exploitation in both small and large firms.

3. Stock-market listed companies are especially bad at worker (and customer) rights because they have to continuously grow. By ensuring that such companies are majority-owned by workers, the bad effects of the stock-market will be reduced (though not eliminated). Small companies are rarely listed.

4. Companies usually start small. Always starting as a co-op would make many businesses non-viable. And I don't see how society will be improved by family-owned restaurants or mom-and-pop shops operated as co-ops. So let the small companies continue to be owned by their founders.

Moreover, the capitalist class also lobbies for other legal/executive changes that transfer wealth from the worker class to the the capitalist class. That is a larger political problem that is solved by reducing the power of the capitalist class with these worker-ownership measures.
You should absolutely make that.
Maybe the board members are worried about going to jail for running a 501(c)3 that's behaving like a for profit company?
Yes, and to live in a home as an "owner", you need to own the home. Which would be... the proportion of human people that own a home.
I think you’re using the word “illegal” in place of the word “criminal”
Workers AI, Email Routing, and ZX Spectrum Retro Computing
It appears that gdb/greg brockman is going too.
Really wish this is a marketing stunt and they tell us that gpt will run the company from now on
Sexual abuse allegations from his sister.
Sorry for the double post. HN seems to be having issues ....
> <img title='Jim Nielsen'/> anyone?

That's an accessibility gotcha, the title attribute tend to be neglected by screen readers and you should use aria attributes to communicate that information, and display it with other means
The Albanian takeover of AI continues. It's incredibly exciting!
Similar for 2014-2022 BMW i3 over 80k miles : about $200 maintenance total, other than tires.

Cost to go a mile varied between 1/5 and 1/10 of ICE, but had limited range (which worked for me).
Well, striking language indeed.

But.. what are the responsibilities of the board that may be hindered? I studied https://openai.com/our-structure

One tantalising statement in there is that AGI-level system is not bound by licensing agreements that a sub-AGI system would be (ostensibly to Microsoft).

This phase-shift places a pressure on management to not declare reaching a AGI level threshold. But have they?

Of course, it could be an ordinary everyday scandal but given how well they are doing, I'd imagine censure/sanctions would be how that is handled.
This is just a failure of capitalism. The most profitable areas aren't the ones that have the richest people. Otherwise, NW Austin/etc would be swimming in advanced tech because it is fairly dense, and the residents are some of the richest in the state. Which is why its hard to argue that poor people are being discriminated against.

No, the NW of Austin doesn't have good internet service because there isn't any competition, and the incumbents are extremely happy to do absolutely nothing and reap $120+ monthly payments for providing service on 15-year-old modulation schemes on cables that are 40 years old. Timewarner/spectrum/charter could roll out high split on docsis 3.1 (released 2013), but then they would have to invest in the network by fixing the pieces of the network that haven't died of old age over the past 10+ years. Or ATT could run fiber, but why when they have 30% market penetration using DSL technologies that are less than 10Mbit down/1Mbit up and old folks like my neighbor will happily continue to pay them $50 a month for it, and when the cable dies they swap it for a 4G modem.

So it's a duoploy where ATT gets the customers that are shopping on absolute price, and Spectrum gets the ones that aren't happy with 100Mbit/sec or data caps. Sub $50 or 100Mbits you get ATT. More than that, you get Specturm. Those of us that want more than 20Mbits up, are SOL, and everyone is getting ripped off because $60/month is what some people are paying for symmetric 1Gbit.

So, those people who live 40 miles W in little towns population 600-2000 can get fiber in town, or those areas with Google fiber can get it an/ord ATT and the rest of us are lining the pockets of some billionares.
I haven’t been involved with hiring with other industries, so I can’t really say. Given the way I’ve seen story points get distributed or people moved around after layoffs or a reorg at tech companies, I suspect many industries treat their employees as interchangeable, cookie-cutter or otherwise. For many skilled industries beyond software development we also rely on certification: Professional Engineers, medical doctors, pilots, etc.
I have this exact same feeling.
Pretty wild that the first job openai took was sam's
oh 100%, but you need someone to steer the ship in the right direction.
I can't wait for the revel that GPT-4 is just a chat application connecting you to a the worlds biggest center in India.

Joking aside, this feels massive. Both that it happened so suddenly and that the announcement doesn't mince words. The fact that the CTO is now CEO makes me think it's probably not a lie about their tech. It wouldn't make sense to say "we've been lying about our capabilities" and then appoint the current CTO as CEO.

This makes me think it's either financial or a scandal around Sam himself.

I can't wait to hear more
i assume you mean she lied?
I paid off a mortgage a number of years back and the numbers probably marginally made sense. The debt-free thing probably pushed it over the edge. But if I had a ten year old mortgage today? No way would I be paying it down today.
The statement claims he is no longer board chair but will stay with the company. Do you have other info?
All: our poor single-core server process has smoke coming out its ears, as you can imagine.

I so hate to do this, but for those who are comfortable viewing HN in an incognito window, it will be much faster that way. (Edit: this comment originally said to log out, but an incognito window is better because then you don't have to log back in again. Original comment: logging in and out: HN gets a lot faster if you log out, and it will reduce the load on the server if you do. Make sure you can log back in later! or if you run into trouble, email hn@ycombinator.com and I'll help)

I've also turned pagination down to a smaller size, so if you want to read the entire thread, you'll need to click "More" at the bottom, or like this:

https://news.ycombinator.com/item?id=38309611&p=2

https://news.ycombinator.com/item?id=38309611&p=3

https://news.ycombinator.com/item?id=38309611&p=4

https://news.ycombinator.com/item?id=38309611&p=5

Sorry! Performance improvements are inching closer...
> It's the only CLI app I know what requires the internet to autocomplete!

Doesn't autocompleting `sudo dnf install ...` do the same?
He hallucinated to the board
In our case, the agent accepted a lower commission because both they and the seller got more money from our offer then they would have from the competing offer which had a buyer's agent. We didn't negotiate that though, because that's entirely between the seller and their agent.
I'd agree with you if people lived forever.
Elon was very upset that somehow a non-profit that he donated $100 million to suddenly turned into a for profit. I would not be surprised if there was something not totally candid with regards to how that went down.
I doubt that's it. In general sexual shenanigans in your personal life will get you a quiet departure from the company under the "X has retired to spend more time with family / pursue other adventures / start a foundation". Andy Rubin got a $90M severance payout from Google after running a sex-slave dungeon on his personal time.

The wording of this statement is the kind of thing a board says when the company has done something deeply illegal that they will all face personal jail time for, and so they need to immediately deny all knowledge of the offense and fire the people who did have knowledge of it.
Could it be the allegations by his sister??

https://twitter.com/phuckfilosophy/status/163570439893983232...
Same, I've seen it twice. It's all about that moment when they realize that "mistake" and then, it's a "God" move, and they can't believe it. History was made in that moment. They realized computers can have intuition and think like they do.

I started showing people ChatGPT when it first came out, they shrugged, they didn't get it. Most people still don't get how important generative AI is and will be. Eventually, they'll have that moment too.
It did happen. We could learn a lot to apply to future peace by studying history.

https://www.npr.org/2022/10/16/1124680429/cuban-missile-cris...

And USSR wanted USA out of neighboring Turkey.

"Ultimately, Khrushchev received an assurance that the U.S. would not invade Cuba and, in a deal that remained secret for a quarter century, the U.S. also promised to remove its missiles from Turkey."
I guess that's it and some general marketing for their stuff. I doubt there are all that many people who would pay for HL1 remaining after 25 years unless it's a remake or something.
The issues are: a) boil-off (others have addressed that elsewhere in this these threads), and b) transfer in zero G (something close to an inertial frame of reference). (b) is hard because bubbles of gas form randomly as you drain one tank, so the pump can't work very well. Bubbles of gas are not a problem for rockets normally because they either are always under acceleration (so the gas floats to the top of the tank, while the outputs are at the bottom) or because they have small and full tanks that SpaceX calls "header tanks" to make engine start possible which then resolves the gas bubbles problem in the larger non-full tanks.