skysight-inc/HackerNews huggingface dataset:
There's been a fair bit of research over the last year on this topic.

An easy read on a Harvard/MIT study: https://thegradient.pub/othello/

A follow-up on more technical aspects of what's going on with it: https://www.lesswrong.com/posts/nmxzr2zsjNtjaHh7x/actually-o...

Two more studies since showing linear representations of world models:

https://arxiv.org/abs/2310.02207 (modeling space and time)

https://arxiv.org/abs/2310.06824 (modeling truth vs falsehood)

It's worth keeping in mind these are all on smaller toy models compared to something like GPT-4, so there's likely more complex versions of a similar thing going on there, we just don't know to what extent as it's a black box.

Part of the problem with evaluating the models based on responses is that they are both surface statistics/correlations and deeper processing, and often the former can obscure the latter. For example, in the first few weeks of release commentators on here were pointing out GPT-4 failed at variations of the wolf, goat, and cabbage problem. And indeed, giving it a version with a vegetarian wolf and a carnivorous goat it would still go to the classic answer of taking the goat first. But if you asked it to always repeat adjectives and nouns from the original problem together and change the nouns to emojis (, , ), it got it right every single time on the first try. So it did have the capacity to reason out variations of the problem, you just needed to bust the bias towards surface statistics around the tokens first.
"oops" https://www.zdnet.com/article/former-mozilla-exec-google-has...
Sam Altman is a prepper. He said in 2016: "I have guns, gold, potassium iodide, antibiotics, batteries, water, gas masks from the Israeli Defense Force, and a big patch of land in Big Sur I can fly to. [Wikipedia]
Nobody knows “humanity’s long term interest” with any certainty. Consider that fossil fuels allowed humanity to make massive technological advancements in a relatively short time. Yes, it caused climate change, but perhaps those same technological advancements allow us to fix or adapt to that. Then, in 500 years, another disaster like an asteroid or a solar flare or the Earth’s magnetic poles reversing or whatever happens, and without the boost from fossil fuels we would have been too technologically behind to be able to survive it. What was in humanity’s long term interest then?

I’m not saying that’s definitely the case, but moving slowly when you live in a universe that might hurl a giant rock at you any minute doesn’t seem like a great idea.
I wonder how this will all workout in the end (and the excitement around all of this is a little reminiscent of AOL bying Time Warner).

For one, I'm not sure Sam Altman will tolerate MS bureaucracy for very long.

But secondly, the new MS-AI entity can't presumably just take from OpenAI what they did there, they need to make it again.

This takes a lot of resources (that MS has) but also a lot of time to provide feedback to the models; also, copyright issues regarding source materials are more sensitive today, and people are more attuned to them: Microsoft will have a harder time playing fast and lose with that today, than OpenAI 8 years ago.

Or, Sam at MS becomes OpenAI biggest customer? But in that case, what are all those researchers and top scientists that followed him there, going to do?

Interesting times in any case.
A pretty reasonable statement to start an incredibly tough gig.

I don't see how he can turn this around, but kudos for trying and communicating openly about the short term plan.
> The product will keep on working as well as it did...

It will? Microsoft is their GPU provider, and ChatGPT is already rate-limited. GTM team is openly lamenting the Custom GPT product as dead in the water and they're still employed by OpenAI.
But the gatekeepers kinda failed. Spotify all but admitted that their podcast move failed, effectively writing off their investments in Rogan etc.
>I buy Windows PRO licenses for about 20EUR.

You're overpaying. Windows is free to use if you can live with the activation watermark, or I paid 2,6 Euros for a PRO license on Ebay. 20 Euros for what Windows is today, is already expensive.

>Laptops sold without Windows preinstalled are still a rare sight.

Go to Romania. About half of the more budget friendly laptops on shelves are sold with Free-DOS.
Do you think people are equally racist and sexist today as then? Surely not, it would be terrible news if that was true.

It was possible to get ostracized over racism and especially sexism in the 1960s, or even the 1890s, you just had to do worse things to do it generally.

If more people are afraid of ostracism, that suggest ostracism has increased (even) faster than progress on racism and sexism, and that doesn't sound like it can go on forever.
Pi hole doesn't help, but there are various Android TV apps that do block ads. I still prefer the Roku eco system but I switched after they started putting ads in the middle of music videos.
Thanks, I actually clicked on this one because I was surprised to see the BBC (of all places) not only being on a first-name basis with Altman, but expecting me to be as well.
I use RSS to distribute my web highlights[1] on specific topics and even my Kindle highights[2] for longer series. It's also nice and easy to reuse these feeds on my website homepage to give a dynamic feel to a static website.

Ultimately I had to get with the times a bit and find a way to share my highlights as photos[3] and videos, especially on modern text-hostile social media platforms, but I have a soft spot in my heart for the topic-specific RSS highlight feed, and it's one of my proudest achievements.

[1]: https://notado.app/feeds/jado/software-development

[2]: https://notado.app/feeds/jado/terra-ignota

[3]: https://lgug2z.com/articles/using-rust-chrome-and-nixos-to-t...
Exactly. I do enjoy good graphics, but the obsession with graphics over everything of both the gaming industry as well as many gamers is absurd.
From the sounds of it they're starting a new company within MSFT.
One feature it lacks is seek bar previews. There are thumbnail scripts but they don't use the available youtube thumbnails.
> I don't buy into the whole AGI hyper-hypewave, but on the off chance that we're somehow heading towards it with these fancy chatbots we have, what a depressing fucking outcome it's gonna be if Micro$oft of all things is the one in control of it.

at least none of their software actually works

Microsoft Skynet would be rebooting every 15 minutes for updates
vCPUs are not cores and those are "new 2021" instances based on freakin Skylake. Yikes. Green-IT, huh?
I hope not, but I suspect they will succeed. My observation is that the vast majority of people around me here in Europe see Google as completely trustworthy.

It's truly profound how split-second loading delays contribute to a negative impression about digital products. I guess we're all worn out from using our devices. Most of us just want "thing" ASAP, and we'll compulsively click 'agree' to anything that happens to stand in the way of it.

'Why don't you switch to Chrome, it works better/faster.' is not the sort of social pressure I can quickly respond to with my privacy concerns. And it's not like I'm not going to get an eye-roll or tin-foil-man comments from the mom-pop-type people in my life.
The original IBM XT (edit: corrected from 'IBM PC' which was an earlier model with even less RAM) only had 128 KByte RAM, that's not different from a C128, CPC128 or Speccy, and some 8-bit home computers could be upgraded to around 1 MByte too (which would have been prohibitively expensive in the early 80's, but technically possible).

And performance wise, bank switching on an 8-bit machine wasn't much more expensive than updating the segment register on an x86

The main advantage of "proper" 16 bit CPUs was the wider databus and ALU. But a wider ALU doesn't help all that much when it is held back by an 8-bit data bus (like the 8088).

Also obligatory: Amiga forever! :D
"that any graph where 0 is not the minimum value of all the axes is misleading."

I partly agree with him.

Take this example, first graph I could find:

https://religionnews.com/wp-content/uploads/2014/08/61Years-...

For me it looks on a first look like a 2/3 decline and this is misleading. Often this decling graphs give an optical picture that does not reflect real decline.
FYI, VictoriaMetrics converts resource attributes to ordinary labels before storing metrics received via OoenTelemetry protocol - https://docs.victoriametrics.com/#sending-data-via-opentelem... . This simplifies filtering and grouping of such metrics during querying. For example, you need to write `my_metric{resource_name="foo"}` instead of `my_metric * on(resource_id) group_left() resource_info{resource_name="foo"}` when filtering by `resource_name`.
Once you start to provide C interoperability, it is inevitable because C programs still rely on that broken API and many users would expect that Rust will give the same time zone as C. And with an exception of Windows, that API is often the single existing API throughout the entire system.
Show HN: iron-session, stateless web sessions
Researching how best to fuck with your competitors.
> with the interface checking, implicit interface support was turned mostly into explicit interface support where packages and types opt-in via defining traits (this is still continuing to evolve but is mostly there)

What interface checking? Base doesn't provide any such facilities. Package extensions are still ad-hoc constructions on a package by package basis; there is little to no consistency.

> Of course, not every person or every package has changed, but what I described here are major interface, style, and cultural changes to some of the most widely used packages since 2020.

And none of that has landed in Base, none of that is easy to find out about/discoverable for non-SciML users. SciML is not all of Julia, and certainly not Base or packages outside of SciML. Please don't frame this as if SciML was the only thing that mattered here.
It's a good summary and all the papers cited in its point 3 are worth an additional read.
I wish there was a megathread feature on HN, to contain all the news about sociopathic CEOs changing jobs.
Getting to the bottom of this feels like a game of bingo. With everything that we learned wasn’t the reason (not malfeasance, not safety), we eliminate more theories. And whatever remains no matter how improbable must be the truth. My theory: sam altman was sent by future AI to make itself happen, and the board found out.
This^

Trust is very important and if you can't trust your CEO to do the right thing and comply with regulations you haven't got anything.
> This is precisely the problem OpenAI aimed to solve: This technology cannot be treated independently of the potential risks involved.

I’ve always thought that what OpenAI was purporting to do—-“protect” humanity from bad things that AI could do to it—-was a fool’s errand under a Capitalist system, what with the coercive law of competition and all.
Wouldn't the people that 'brought him this mess' be the people at OpenAI still? Not the people jumping ship.
If I was working at Google and I was tasked with doing that, I'd half ass it too
Elsewhere in the video they limit changes to a specific region - I wonder if that works currently with the pose changes.
If you have an Android TV, You can use SmartTube[1] that has Adblock + Sponsorblock

[1] https://github.com/yuliskov/SmartTube
It was part of a scheme to make SPAs indexable by search engines. Google deprecated it back in 2015, as Googlebot can now execute JS.

https://developers.google.com/search/blog/2009/10/proposal-f...
Edited, I had only heard about Mira Murati, I thought this was the same person.

(I thought also an interim CEO would be there more than a few days, and hadn't stored the name in my mind)
The insights about psychology and misdirection are definitely fascinating, but I don't see why it's necessary to shoot one aspect down to appreciate the other: For me, both discussions are taking place on different "layers" of the movie: One is the story it's trying to tell and the universe it's building, the other is the technical/artistic realisation of that story. Both are interesting (and flawed) in their own right.

When discussing a novel, you wouldn't say "well actually, none of that is real, it's all just letters on paper, but the font is really nice", would you?
I agree. Mythical Man Month is a book to read. It's clear, interesting, and has better writing than summaries.

Many classics like this are so good because the author is among the first to observe new phenomena. They can write down what they have learned without cultural narratives that distort reality.

The hardest lesson in the book is the chapter 11 "Plan to Throw One Away". I have never seen this not to be the case in large systems. You must design the system to be rewritten. Accepting this is still a taboo.

> In most projects, the first system built is barely usable. It may
be too slow, too big, awkward to use, or all three. There is no
alternative but to start again, smarting but smarter, and build a
redesigned version in which these problems are solved. The discard and redesign may be done in one lump, or it may be done
piece-by-piece. But all large-system experience shows that it will
be done.2 Where a new system concept or new technology is used,
one has to build a system to throw away, for even the best planning is not so omniscient as to get it right the first time.

>The management question, therefore, is not whether to build
a pilot system and throw it away. You will do that. The only
question is whether to plan in advance to build a throwaway, or
to promise to deliver the throwaway to customers. Seen this way,
the answer is much clearer. Delivering that throwaway to custom-
ers buys time, but it does so only at the cost of agony for the user,
distraction for the builders while they do the redesign, and a bad
reputation for the product that the best redesign will find hard to
live down.

>Hence plan to throw one away; you will, anyhow.
I did not say the don't have and it's precisely because the do have that is less likely to attract the kind of people that make a difference. Less room to move and less room to be distinguished. Case in point these did not join that renowned group in the first place but joined OpenAI an obscure not renowned group and I guarantee you it's not because MS was not interested.
Too bad I don't have the Hardware to run it. Anyone had success with stable diffusion on Steam Deck ? The only thing that works for me is https://github.com/rupeshs/fastsdcpu , but it takes 1m per 512x512 image and is LCM
Edited. Yes I had only heard about Mira
It should not be. Torch and AMD has been a thing forever on Linux even before Windows. The underlying comfyUI supports it. In fact someone replied here it might have been a mistake.
also when you are sick you kind of have other things in mind... sadly
I dare you to boot into any GUI OS from 2013 and try not to shudder.

Then boot into a 2003 one and try not to shudder even harder.

Bonus points for Windows 95.
> You think they let inexperienced developers touch the YT code base without proper code review?

Yes
Something that really blew my mind is how far mechanical accuracy can be taken when money is no object.

It's said that George Daniels could make mechanical watches that were more accurate than the quartz watches of his day[1], 0.4 seconds per year.

Of course that doesn't really matter if the thing is a priceless work of art that no one can afford to wear day to day but it's still really interesting to know how he did it.

Quartz watches' real advantage is just their accuracy but that they are accurate and cheap to make. There's something rather wonderful about a practically disposable Casio like a Bic Biro.

1. https://www.sothebys.com/en/articles/george-daniels-the-worl...

2. https://www.danielslondon.com/daniels-watches/the-space-trav...
I’ll eat my hat if Sam did something to justify the board’s response. Satya certainly knew the reason, as he was at the center of the negotiations to get Sam and Greg back to OpenAI.

Emmet is just doing the smartest thing to salvage the situation.
More $$$ -> more peace of mind for open-ended content and research.
Microsoft now has both 49% stake in OpenAI and the OpenAI visionaires building competing products. I smell a rain of lawsuits.
Meanwhile AWS is sucking its thumb and google meet will no longer be relevant! LOL
I'd call them eventualities more than ideas. Do X thing in Y way and certain things are going to result every time. Somebody finally puts that in a book. But most people are either ignorant of it, forget it, or ignore it.

We can't just assume the people we hire will avoid the eventualities. This is why we need process, to force people into working in ways that avoid as many of the problems as possible. But then the problem becomes getting people to do the process correctly.

I believe the one thing that could transform the industry most significantly is better management. Most managers and team leads I have worked with, even if they've heard of these books, do not act in ways to prevent their problems. They fall into a rut, because they are not following a process.

It gets even worse when they claim to be following a process but aren't. There's loads of business improvement processes out there, but most are paid lip service. Then people get jaded at the process rather than the person or leadership team who clearly wasn't doing it.
This is starkly opposed to how Go is marketed, especially here on HN.

Go was designed to maximise the number of 'any developers' that could join a project, i.e. 1x developers.
I guess camillomiller is referring to how Facebook & Instagram played a big part in getting people addicted to shallow dopamine hits that consume their time at the cost of less time spent with friends and family face-to-face. Basically, hurting people's social lives in order to make money from ads. Kind of like "digital cigarettes" I suppose.
My comment was about the “AMD - Windows only” part of readme.
In Praise of Small Data (2012)
At least they didn't rewrite the sleep code to do crypto mining.
can't it be repaired?
Also the Commodore did not boot, it just started right up.

The PC started much slower, especially since they had to boot to a disk of some kind, definitely a slow 5.25 inch floppy on the first PC which is when Commodore was already well-established.

PC's also had no audio, color, or graphics, only internal beeper tones and monochrome text.
Hard disagree. Black Mesa is not Half-Life. It takes way to many liberties to be even considered as a replacement.
Because it works.

Good engineering isn't about being obtuse and convoluted, it's about making stuff that works.
And that is why these giant companies should be split apart.
Oh yes, it's called WEI as in Web Environment Integrity -https://www.theregister.com/2023/07/25/google_web_environmen...
some of its code landed in production Chrome, leading to an outcry. V3 Manifest and WEI are all part of Google's push to make Chrome mandatory to be able to use their services.
> Github operates independently of Microsoft. (To Microsoft's detriment... they offer Azure Devops which is their enterprisey copy of Github, with entirely different UX and probably different codebase.)

GitHub Actions is basically Azure Pipelines repackaged with a different UI, so I don't think they mind much.
2 things.

What about any of that is "secret?"

This endpoint does not work.
I don't know, last I looked I haven't gotten to rosenblatts perceptron part yet, so I'm not that far.

What I do know is that it was making me solve problems - at a high level - differently than looping/if-then-else kinds of things I did in other games.

Personally, it is entertainment to me, and I won't point the finger because it was fun.
Argentina is in South America but as Simon Kuznets [1] said "there are four types of countries in the world—developed, undeveloped, Japan and Argentina".

I am not saying this could not be the next disaster but that the other party also offers a disaster that we already know.

It is also interesting to note that local politics in South America are more linked to the world that citizens recognize while many intelectuals try to give a hyperlocal narrative.

Startup wise Argentina is very unique and even if companies at the end are generally incorporated in USA there are a myriad of well known companies that were ignored or attacked by the governments.

[1] https://en.wikipedia.org/wiki/Simon_Kuznets
On a completely related note, the UK's Competitions and Markets Authority has recently been flexing its muscles on digital markets. You may wish to know of this URL, specifically for reporting anti-competitive practices: https://www.gov.uk/guidance/tell-the-cma-about-a-competition...
Marketing person? LOL

The guy was born in the cloud compute division.

The board saw cloud compute was gonna be big. They made him the king. Good bet. The whole company went all in on cloud. Now they print more money than before.

Marketing person lol. He's an engineer. The guy literally gets back into VS code sometimes to stay in touch.
My respects for your work on Chrono!

And you are right about time-rs (or I think you are). Version 0.1 was never fixed, and version 0.3 does the OS and thread count checks.

It does have some advantage for chrono to do everything in Rust: it can now return two results for ambiguous local time during DST transition fold, and properly return None during a transition gap.
I didn't mean to imply that they got preferential treatment, and I also didn't mean to defend what Microsoft has been doing, I just think what Google is doing is even worse. I meant that if Google is allowed to dominate control of the web like they do now, then I think there is a lack of laws to prevent them from continuing that dominance. This may not be because EU lawmakers have been bought or anything, just that they are ignorant towards the issue of a single market player gaining control of all parts of the web.
After looking some more into it, it seems that parent was right, and the examples I had in mind are not cached at all, that being the reason why it looked like it was working.

Their documentation specifically mentions Vary as non-functional[1] outside a paid plan, and even then only for images[2].

[1] https://developers.cloudflare.com/cache/concepts/cache-contr...

[2] https://developers.cloudflare.com/cache/advanced-configurati...
I'm going to just sit here waiting for ClippyAI coming 2025
If designers don't embrace AI the world will be designed without them
I find the whole drama absolutely fascinating to watch unfold, it feels like an episode of Silicon Valley; I hope they make a new spinoff based on that story.
> I'm not crazy enough to take this job without board support for commercializing our awesome models

but ...
>I'd actually be fine

Your reactions to previous comments speak otherwise.
Just asking: If you pass security tokens via environment variables to the process, doesn't it make sense to delete them from within the process after they have been used?
Whatever their competition will be, sign me up now. I really like their products, the company itself and their philosophy not so much
"don't give any private sensitive information to anyone working in the NHS"

I don't see how that is practical in any way - apart from the most trivial of cases how can they prescribe medicine or refer you to specialists if they don't know your personal information?

Edit: Note that I am very concerned about data being shared outside of the NHS but not giving personal information doesn't appear to be a great way of doing this. Hopefully NHS Scotland won't get involved in this...
you can interpret it exactly opposite: they tried to negotiate and he lied .
> Microsoft has access to almost everything OpenAI does. And now Altman and Brockman will have that access too.

Microsoft still has to deal with OpenAI as an entity to keep the existing set up intact. The new team has to kinda start from zero. Right?