skysight-inc/HackerNews huggingface dataset:
It can't even count reliably. And this is a computer, not a human. That is one of the simplest things a computer should be able to do. It can't count because it doesn't know what counting is, not because it's unreliable in the way a human would be when counting. You cannot reason if you do not understand the concepts you are working with. The result is not the measure of success here, because it is good at mimicking, but when it fails at such a basic computing task, you can reasonably conclude it has no idea what it's doing.
No idea. I don't think there's any scientific consensus on even an upper limit of a human brain's FLOP equivalence.
I co-founded and run a non-profit makerspace. 70% of our membership is in the IT field in some way. Getting to make something physical especially something small enough to show people is a big win for a lot of them. Some love CAD designing things to be CNC milled or laser cut or 3D printed but doing manual measuring, cutting, assembly, etc. in the woodshop is by far the most popular craft. If you have a makerspace / hackerspace in the area, it's a good way to get in some time working with your hands without (or before) switching careers.

I definitely see some paths for someone to make a living or even quite decent wage doing custom(-ish) work in a few areas but unless you get hired somewhere or partner with a business, it's a lot of marketing work or grinding on Etsy or at local shows.
Logic boards and CPUs with the necessary PCIe lanes capable of feeding the GPUs, storage fast enough to do the 30GB/s that is in the spec sheet, power supplies and a case to hold such a power hungry system, etc. is not cheap.

$15k seems like a kind of low - if you've tried to spec out a server with similar quantities of accelerators recently, you'd have trouble hitting that figure, even if using consumer grade GPUs.
love ze frank.
You can, like, just do weighted average. It works.

Branch-Train-Merge: Embarrassingly Parallel Training of Expert Language Models (this is Tim Dettmers's previous work!)

> These ELMs can be added and removed to update data coverage, ensembled to generalize to new domains, or averaged to collapse back to a single LM for efficient inference.

https://arxiv.org/abs/2208.03306
Filesystem (and registry) redirection has been around in Windows for a while, and is used to e.g. make sure that pre-Vista apps still run if they do things like trying to write to "Program Files". But that all assumes that the app is not adversarial - proper sandboxing is a different story.
I saw the repeating 'A' at the end of the base64 text and thought "it's not even 512 bytes; it's smaller!"

That said, the title is just a little clickbaity --- it's a C-subset compiler, and more accurately a JIT interpreter. There also appears to be no attempt at operator precedence. Nonetheless, it's still an impressive technical achievement and shows the value of questioning common assumptions.

Finally, I feel tempted to offer a small size optimisation:

sub ax,2

is 3 bytes whereas

dec ax
dec ax

is 2 bytes.

You may be able to use single-byte xchg's with ax instead of movs, and the other thing which helps code density a lot in 16-bit code is to take advantage of the addressing modes and LEA to do 3-operand add immediates where possible.
Jobot.com is a scam, change my mind
These questions are useless unless they concede there are vastly different effects for different people.

For every 1 kid who was miserable and depressed at home, there are X kids utterly relieved they could escape the prison like environment of school.

For every adult suffering from isolation of WFH, there are X who had the most productive happiest times of their life.

For every 1 who got laid off and experienced misery, X realized they were so much happier staying home and tending to family.

Introverts finally had the world shaped to their personality for a brief moment.

But I guess all that matters in the end are gross averages.
A sibling comment mentioned "Salt, Fat, Acid, Heat" by Samin Nosrat.

I cannot praise this book highly enough. If you enjoy food but don't know the fundamentals of cooking, it may actually change your life. Part 1 alone took me from "I need a recipe to make anything other than grilled cheese" to "I can go to a farmer's market, see some ingredients I like, and make something delicious with it".

She explains in great detail the "why" of flavor combinations, balance, different cooking techniques, when and how to season, and is full of obvious-once-you-read-it advice like using the right kind of fat and acid for the cuisine you're making. (e.g. olive oil and red wine vinegar: perfect for Italian dishes, totally out of place in a Thai stir fry — you want vegetable oil and lime juice)

I do sometimes search for recipes to get a vague idea of what proportions make sense, but I don't feel lost without them anymore.
I would interpret this as showing that matrix multiplication code is carefully engineered to correctly implement... well, matrix multiplication. Stumbling on that specific mapping of 96 input bits to 96 output bits would be hard to pick out of a hat by chance, from the set of all possible mappings. Learning that precise mapping, starting from a uniform prior and only given a finite set of examples, could be seen as an impressive task, although less impressive than sorting. If a model learns the correct mapping -- and better yet, needs only 9 parameters to implement it -- then I think it's fairer to say the model does matrix multiplication, rather than that the model convincingly imitates the statistics of matrix multiplication.
Floating-point arithmetic – Acta Numerica (2023)
"No new bugs have been introduced into Minix in five years, and it hasn't gotten any more bloated!"
Extinct offshore volcano could store gigatons of carbon dioxide
They already do this. Those are part of what's called "penetration aids".
Yup. A16z can give you more details on this.
Downtown LA Office Vacancy Sets Record, Causes Distress
Thanks for the pointer to lish! I didn't know it had all that, I know it exists but was intimated by its non-standard packaging...

I decided to not go too far on the structured/object shell route for Unix in Lisp, instead trying to get existing Unix utilities to work as seamlessly as possible first. But maybe in the future I could integrate some work from lish. That's lots of impressive work under yew/los and yew/tools!
Sorry, thought it was obvious. Since it's using backend infrastructure to fetch the assets, it can crawl them as a bot in the same way that search engines do, without allowing cookies to be saved. Since scripts are often involved in the full rendering of a page, it clearly does allow for the scripts to load before snapshotting the DOM. But only the DOM and the assets and styles are preserved. Scripts are not. Most paywalls are simple scripts. If you disable JS and cookies, you'll often see the full text of an article.
Great read and awesome achievement. Could see this being useful for smaller microcontrollers.
or locating the people responsible for DRM breakers like youtube-dl?
Keeping all the data makes you susceptible to subpoenas like this, which costs money to comply with. There is no reason to keep any data that isn't necessary to the service.
Fun fact https://theaviationgeekclub.com/sr-71-or-rs-71-how-the-legen...
Yeah, that's definitely in the plan.

You actually can impart spin right now with an undocumented feature. Use WASD to move the bridge hand and/or IJKL to move the grip hand. You can even play jump shots by elevating the bridge hand a lot and increasing the speed with +. The UI does get very awkward though, so all that needs work.

Ball-rail interactions need some tuning though. Things generally work, but they don't feel right to the experienced eye, so I don't want to set up more elaborate scenarios yet.

It will be very cool to be able to play through scenarios and figure out the most reliable route etc.
.
U/theairwavearchitect explains why Congress is forcing AM radio in cars
My opinion of geohot definitely dropped after he started tweeting how easy it would be to fix Twitter, and then he started soliciting free work. He obviously underestimated the difficulty of shipping a feature across web and mobile. Hacking a prototype is trivial. Making it work well for all platforms, fully accessible, and across all supported languages is a bigger hurdle. It just gave me the impression that he thought frontend development was trivial and he'd just be able to hack it out in a day.
The product was perfectly decent -- I was a happy subscriber -- but it probably did not get the traction they sought.
Journalism is essential to democracy. Without journalism, democracy must die. See here for details:

https://demodexio.substack.com/p/the-dangers-of-an-illiberal...
Worse than accidentally paying a wrong vendor, with the right zero-click zero-day remote execution sploit visiting a malicious link can lead to pwnage of your device.

This is why it's better to never click links in emails or scan QRs. I remember an Airbnb listing that mandated extra "check in" via scanning some QR and denied stay otherwise... sorry but no way.
Ha! My Unix timeline history is vague now but I’ve used SCO, DG/UX and HP/UX in anger. Pretty sure mailx was my client on most of those! :) (not to mention SunOS and Sequent at some point. And DRS/NX. But that’s not one to mention in polite company)
More hindsight on Vim, helix and kakoune
You can buy 6+ gpu motherboards, but the consumer ones are solely for mining because no normal person has that many cards and no consumer CPU exposes enough lanes to properly support that many GPUs. A lot of enterprise vendors exist to sell you that kind of system in the enterprise space, but you should expect to still be paying 5 figures minimum. $15k seems like the low end to me.
I still have nightmares about that toad which carries her babies on her back.
>Have some examples? What would be tests that, if passed, you’d say “oh yeah, that’s AGI.”

The "G" in AGI is general. A computer program or system that could both, lets say write code and learn drive a car would be something closer to an AGI. Written tests are remarkably brittle in showing how intelligent someone is - like we already know the limitations of tests in the real world! Einstein famously flunked his entrance exam, but then invented general relativity at 26; but other posters would have you believe an LLM is more intelligent than Einstein because it could pass a test. When an LLM defends a dissertation in arguably any field that would be way more impressive than an LLM passing a test that humans already designed and know the answers to.

One problem I have with saying a 100x more powerful LLM could become AGI is that there is nothing that leads me to believe that LLMs, as they exist currently, are capable of synthesizing new knowledge and I'm not sure what breakthroughs you would need to get there. Once you start to think about that, you start to run up on the limitations of the LLM. If I were to invent a completely new programming language, I could probably teach a junior engineer how to use it in a week, but the jury is out if I would need to first generate 50,000 sample program and spend $1,000,000 in gpu compute to get an LLM to output the same thing. It's hard to consider such a system AGI. Further still, sure you have Google spending millions of FSD, but it's hard to consider the system they have as general. Could I take Waymo and have it pilot a forklift? Or a submarine? How much would that cost? A """below average intelligence""" human could learn to use a forklift in an afternoon.

All in all, there's more to intelligence than written tests.
Congratz, you grasped the facet of MAD that is unacceptable losses - for the US a single warhead getting through is too high a price to destroy pretty much anyone.
A lot of people have now had the direct experience that new things which are highly technical or highly collaborative are not really compatible with the remote work thing. I know that's hard for a lot of people to hear, but the world is not web apps (which do remote well) and a lot of projects benefit hugely from being able to grab the two or three people and get into a room with a whiteboard.
I'm actually not sure this is true. I think in general it is easier to evaluate a work of art, writing, etc. than it is to create that thing. I don't think we know yet whether kids who are allowed to use chatgpt to their hearts' content will not learn how to write, or know what good writing is. My suspicion is that they will still be able to tell good writing from bad, and they may learn how to prompt a chatbot to tweak output to make it better.

I think what they will really lose is the perseverance that it takes to write, and various other skills that are made possible by being a skilled writer. They may gain other skills along the way, of course. But it's a big unknown.
does x86_64 use this?
Do you mean integrate through a chatGPT plug-in, because they do have GPT-like answers, which they call "neevaAI"?
I'd rather pay a single fee once than be subjected to the barrage of ads that normally occur instead.

I just can't stand in app ads, to the point that if I can't pay for them to go away I have to remove the app.
Polyrhythms and Rainfall = Super Chill (Hyperplexed)
I wonder if chatgpt will start “closing” questions as “not a good fit for its Q&A format,” or “too opinionated,” or “a duplicate” of something that is acutely unrelated.

Actually, this seems to be a case where chatgpt is smarter than the humans.
Awesome video tutorial by Hyperplexed here too: https://www.youtube.com/watch?v=Kt3DavtVGVE
I don't buy that narrative, Nintendo Switch sales beating both PS5/XBOX, despite being already 6yo, is a clear signal about what the customers want, it could be a heaven for indies and AA games, games you see on the Switch, most of them are also on Steam..

Not every games are AAA/Photorealistic

Check for yourself, https://store.steampowered.com/, all the games from "news&trending" would run on the Switch with no problems at all
One exciting thing about Moore’s law being finished would be that the hardware stops changing :)
Thankfully WinForms and WPF are still around and supported in current dev tooling.
That doesn't seem that impressive. The likelihood of reading text having "sphere" in the same context (i.e. within some small number of tokens) as "roll away" is higher than by random chance, because humans have observed and described this behavior in text. There's no indication that GPT4 understands what "roll away" means in any meaningful way: just that it associates the phrase with the word "sphere". It might have chosen "bounce away" instead, and been equally unimpressive.
Eh. I still consider them stochastic parrots. My concessions lie elsewhere, primarily in the vocabulary.

We refer to algorithms like quicksort as 'reasoning' about the input. So it's fine to use the same sense of the word to apply to stochastic parrots.

The difference between an LLM learning how to sort things and compiling an implementation of an algorithm like quicksort is not terribly large, from a certain perspective.

I suppose something I'm interested in is whether an LLM that can't sort numbers could be instructed how as a prompt and then do so.

There are some examples of similar phenomenon (the one with some kids made up language was interesting) which suggests the LLMs have a lot of space dedicated towards dynamic pattern selection in their context windows (somewhat tautological) in order to have prompts tune the selection for other layers.

And, of course, lack of plasticity is really interesting.
Yeah they blocked urls of the BBC documentary critical of Modi just to not damage his image....like the man is not a a dictator impervious to critique
+1 on cook’s illustrated. I love how it goes into the why and also describes the process on how the recipe was formed.
This is what I see happening in our organization. I have told others to communicate upwards that what they wanted in 1 year will now take 3-4
> So why not just fix AMD accelerators in pytorch?

It doesn't fit the business model. I mean sure, they'll sell AMD computers now like a bootleg Puget Systems. But why buy from the bootleg when I can just buy from the real thing (or AWS) and run tinygrad on there if I want?

So the play is, get people using your framework (tinygrad), then pivot to making AI chips for it:

> In the limit, it’s a chip company, but there’s a lot of intermediates along the way.

Seems far fetched but good luck to them.
So that means a massively distributed model training network with cryptocurrency like incentives is incoming? Where and how to begin? This could free up companies such as openai and potentially lead to the first agi.

(mentioning crypto because that will motivate switch hordes of miners that already have the gpu power available)
> This a pretty specific conclusion. I wonder what indicated this.

Is this the consequence of Fox laying off their investigation unit?

Microsoft has a poor record being penetrated every which way and the usual suspects in the corners of obsolete media don't call them out on that as they invariably do to befuddle Elon M's A.I. vision and Twitter
Let's be honest here: remote and in-person is a major tradeoff with significant pros and cons on both sides. Remote work increases your talent pool by 5 orders of magnitude and removes commute overhead, but in-person work increases your communication bandwidth and team cohesion in similarly dramatic ways. Hybrid solutions put a hard cap on the upside of either path and therefore tend to give you the worst of both worlds. It makes perfect sense to be opinionated about this, especially at the startup stage. I respect the decisiveness (even though I would be very reluctant to go back to full-time commute).
I feel like you're trying to poke holes in other people's arguments, and not really engaging with an open mind.

The straightforward answer is: you don't need a warrant to risk ending up in jail.

I'm not a German jurist, but I believe that warrants are used if there's a risk that a suspect would commit violent crimes or alternatively if prosecution found someone guilty in absentia. For Alina Lipp, the prosecution just started.

It's not the only case, btw. Another famous case is Steven's Dozinger. I think that Legaleagle's video is quite evenhanded and yet entertaining in explaining his situation:

https://youtu.be/B7d2KoXmPXk

Another more recent case, is Omali Yeshitela's

https://www.mirror.co.uk/news/us-news/breaking-four-citizens...

My point is that being silenced in such ways in the west is more likely than people think. Dissenting speech gets granted a lot of leeway, but that's only until it has few chances to influence people.

As soon as dissent can actually threaten the establishment, that's when you start to see a reaction against it.

Of course, in wartime little leeway will be granted for dissent.
Obligatory grey-beard reference:

https://web.archive.org/web/20190304153147/https://dilbert.c...
Though this argument is undercut somewhat by Bush not actually winning a majority of the electorate. ;-)
Every single startup since maybe 1980 that is not borderline criminal has faced at least one incumbent that is better funded and has, frankly, more talent with better experience.

The reason they sometimes win is huge structural or incentive issues in the large companies. And they don't win often.

AMD has failed to fix the problem for years. Is it because the business structure doesn't incentivize it? Is it because the company's entrenched culture is opposed to compensation that might attract the right talent (often out of "fairness")? Is it because there's some internal owner for the function that keeps fucking up but for political reasons the CEO won't replace them and no one else can work on the thing?

Any of these are possible. I have seen - personally witnessed - all of these and more at large companies. We don't know the reason, but we can sort of guess as to the shape of it.
Prison Hulks
You're going out on a trip and planning to bring charged batteries. When comparing against candles for emergency purposes, you have to adjust for the fact that emergencies are unplanned. Batteries lose charge over time (especially the rechargeable ones we use), which makes them much less useful for emergencies. Compare with candles, which do not lose 'charge' over time.
The optics of that are absolutely awful. It does not matter how good of an idea it might or might not be. It simply cannot happen.
>If I’d described the capabilities of contemporary AI to 100 AI scientists 5 years ago

This is hard to believe, the all you need is attention paper was 6 years ago, GPT1 is 5 years old and GPT3 is 3 years old. The current crop of LLMs wasn't something that happened overnight.
>> That's kind of cool too, but I'm sure it's a very bad idea to combine worldwide surveillance and killer lasers in space.

See the movie "Real Genious" and have some popcorn.
I might just start using Thunderbird because of this. I'm only half joking.
I really don't think that's a huge issue. (Worked at a telco, but small one)

Sure, nobody works for free, but if requests for source become a thing that happens, there will be systems to retrieve it with less work as well. It doesn't need to be a long record - keeping the last couple of days for complaints handling may be painful, but not "too much traffic". If adtech can save all our clicks for analysis, telcos can handle the short term lookups.

> It's only a matter of time before they reach a telco in the chain that says "we don't have those logs sorry".

That's the whole idea - the blame for that specific call falls on them then. Get fined, next time don't lose the logs, sorry.

> Plus, each telco along the way will charge the US telco for retrieving and providing those logs.

Make it a requirement for reporting so they can't - similar to how DMCA safe harbour works. Either you deal with your customer, point at a source peer, or become the responsible party.

> a stolen credit card, at a virtual reseller where no human interaction ever happened to set it up.

That's fine. Close the account and if it repeats too often for the reseller they can get fined until they implement better fraud checks (or prevent large volumes of calls without human interaction). This is not a novel problem - that's why you can't spawn 500 GPU instances on EC2 right after you open an account.

Edit: Back of a napkin - Verizon claimed to handle 800M calls a day some years ago. Logging the 2 source, 1 destination numbers, peer ids and date in binary format, which is all you need for handling complaints, gives you <40GB per day. That's searchable with grep on a laptop. It's definitely not too much data for a telco.
Nope, that will cost $4/month :)

Also, Control D is a DNS service, not a VPN.
If mankind can't stomach 10% overhead to check array bounds and collect unused memory, what makes anybody think they can sell 1,000,000% overhead to make your DRM driver (and viruses) harder to reverse?
SuperMicro has HGX servers. $300k buys you an 8xH100 chassis with crazy amounts of memory, storage, CPU and GPU compute.
It's hard to get too excited about a logo change. It basically fluff and has zero impact on the functionality of the client, but I'll admit that I do like it over the old one and since I know they're also working on changes that matter as well, I really can't complain.
Dunno, the linked article looks like a conclusive performance advantage to me.

Bash's own manual page concludes that "it's too big and too slow" in the BUGS section.

https://www.baeldung.com/linux/dash-vs-bash-performance
Probably, in theory, yes.
I do agree that candles present a fire hazard, especially when used by modern people who are not used to using candles.

But batteries lose charge over time, whereas candles retain their 'charge' indefinitely. We have some candles for that reason.
Thanks Alex :) Looking forward to the release
what exchanges I wonder?
Relevant: ESPHome is a firmware for esp8266 / esp32 series IoT chipsets that can be configured mostly with a web gui or yaml file.

https://esphome.io
https://archive.is/bxAUt