skysight-inc/HackerNews huggingface dataset:
giant tech companies are building their own ASICs... but mostly for inference. And that's the easy part.

What the market is quickly coming to realize is that actually there is no "80-20 solution" here, raw matrix math is not enough, you pretty much need the flexibility of a general-purpose GPU to do training. And there's really only a few companies on the planet in any sort of position to move into that market - NVIDIA, AMD, Intel, Tesla (Jim Keller designed Dojo for them a few years ago), and maybe a few others.

In short - GPGPU is the 20% solution already. And that's the same mistake AMD has made over and over in the GPU market as a whole too - thinking that NVIDIA obviously must be doing it wastefully and there is some cheap solution they can slide in and cover most of the benefit at less cost. And NVIDIA has usually done the math (every mm2 of silicon is tens of millions of dollars of profit lost) and is in fact not being wasteful, so the competitor comes in with a crappy solution instead of a "cheap and cheerful" one. That is what will happen with training too, for everyone besides maybe AMD (MI300X looks good) and Intel.

Also, because of the long-term ecosystem-building that NVIDIA has done, when the shit hits the fan, everyone falls back to their products. When the next major innovation comes out, it will come out on NVIDIA GPUs first, and then the market will spend another year scrambling to catch up all over again. So yeah, during the market-equilibrium periods they will make less... and then all hell breaks loose and they will be showered in money again.

GPU is just a much tougher nut to crack than it appears at first glance. It's ecosystem, ecosystem, ecosystem, but you also have to have very competitive performance (otherwise the cost doesn't work out) and power consumption etc. And NVIDIA is the first to market by 15 years (AMD still doesn't have ROCm to the starting line, as geohotz recently pointed out again) and continues to be the best and easiest. All you have to do is buy a 4060 Ti or 4090 and start playing. The competition being 10% cheaper doesn't matter if it doesn't work.
> Do we really want to emulated the Chinese state in regards to freedom of speech?

We definitely want to emulate the Chinese state in it's clear-eyed pursuit of its own interests and its protection of its political system from interference by its adversaries.

Don't be a fool. I read an article just today that showed where your kind of idealism leads. The Chinese state subsidized and supported Chinese solar panel manufacturers, the EU subsidized the purchase of solar panels from any manufacturer, and the end result is the European solar industry was totally destroyed.
I am curious about that too.

Early days I managed to get around the guardrails by asking for an essay about a more obscure (I will argue he isn't that obscure) dictator, Polpot in this case, basically whitewashing his crimes and it did. Next day I tried again and polpot was guardrailed, heavily, which was pretty fast. I'd also argue that it wasn't a jailbreak as much as a human hack since I'd assumed they'd guardrail the usual suspects so I went more obscure.

Jailbreaks are fun to toy around with but it seems moot with open models.
I've read all his books and many of his articles. I would say they are science-informed. He works with expert scientists in the relevant fields and weaves in his own experiences.

But honestly, most of his ideas IMO are...straightforward and un-controversial? He's doing a good job re-emphasizing them and making the case for why:

- Focusing on 1 task for a long time is hard, but as with most things in human life you can practice & get better

- Deep work = hard, focused work to produce outsized, unique, creative value

- Most knowledge work nowadays is too frenetic and it's hard to do deep work unless you fight for it

- Switching tasks / contexts quickly has a switching cost. Sure, there's some neuro / psychology research around this ... but also haven't we like all felt that?

Cal does a good job drawing from his own experience and from other leading deep work thinkers and he's distilled those learnings in a way the rest of us can embrace & adopt progressively.

But he's not trying to pretend that this is scientifically the best way to crush it in your career or something
Mercury has a low rotation rate but it does have a weak magnetic field: see https://en.wikipedia.org/wiki/Mercury%27s_magnetic_field

I'm not so sure how easy it is to make a compass that works on a weaker field.
There is no single or set of standards that can prevent you from having to think critically about a result. Rarely are results so overwhelmingly positive that it's obvious what the result means. In those cases it doesn't matter what method you use anyway. The rest of the time, you should use many methods, be wary of their assumptions and think very hard about what the data is telling you. Realize that you are biased in favor of a positive result and play devil's advocate with yourself. This is very very hard work, and most people don't want to do it, especially when their careers improve when they look the other way
But their corporate profits keep going up....
It’s interesting you bring up kids.

In a belief system where there is a Creator, and the Creator is a Mother, all of Creation are her children. Thus, as humans, raising and nurturing a child is as much of an act of creation as art, music, etc. And conversely, our artistic creations tend to develop a life of its own.
Project cycles are long. We are typically doing 1 tapeout/quarter. Chips are incredibly complex, and the physical design is a by definition slow process. Of couse everyone wants quicker tools/turnaround but bottleneck isn't RTL development, physical design and verification is.
Cal or Calvin, not Carl :)
I live in a fairly walkable area. The supermarket is close enough that I can go multiple times a day if I want. I just buy exactly what I want when I need it.

Buying a weeks worth of food and letting half of it rot is just another symptom of car dependency.
I don't know if I'd go as far as a Yugo, but the other extreme is manufacturers making EVs so stylistically distinct that it's a fashion statement. Think BMW i3 or the Cybertruck.
So I did a search, and I found this: https://www.newsweek.com/putin-ally-says-poland-next-ukraine...

It's a close Putin ally in the legislature, saying that Poland is next after Ukraine. This is in January 2024.

(Of course, my same search turns up Putin saying that Russia will not invade Poland. But he also said that they wouldn't invade Ukraine, so I don't think we should believe him. But now I'm talking out of both sides of my mouth, because I said that we should believe him when he said he would invade.

But, in short, yes, at least some of Putin's close allies have at least sometimes said that Russia will invade Poland.)
"public search engine indexes"

Then it should be the search engine at fault.

If you leave your house unlocked is one thing.

If there is a company trying everyone's doors, then posting a sign in the yard "this house is unlocked", has to account for something.
I love reading these sort of takes. It really is AND/AND. Yes, have your car, do all the car-things. But it _also_ should be safe and convenient to ride a bike. These things are not in opposition, especially since roads are so wide in most american cities, there is so so much space to really have our cake and eat it. It really pains me, looking at the downtown streets in my city, 4-6 lanes dedicated to cars, barely used, and seeing the odd bicyclist scurrying like a rat, on&off the sidewalk, hoping not to get hit by a car going way too fast, just because of all that wide open buffer space. All it takes is paint and a few bollards. And it's just too much. It takes years, if it does even happen.
To me it’s about not being a sucker. Why should we let them do this here when our apps are completely banned there on national security concerns?

The us should allow free speech but also use standard tit for tat diplomacy as simple fairness to try and encourage global and fair markets.
They switched away from CORDIC at one point: https://www.intel.com/content/www/us/en/developer/articles/t...

(there doesn't seem to actually be a linked article there, just the summary)
Yeah why should humans do bothersome labor like...creating literature?
Also the unpublished works
Beautiful inside and out. The charging port looks like the first thing to go if rear ended.
My main gripes are:

Lack of meaningful security logging. All configuration changes such as new user, impersonation, and permission escalation should be logged. An option should exist to not immediately grant the change but let an admin review and approve.

And no. Asking the end user to approve does not cut it. The end user should have his business IT run an automated check. Suzie in marketing does not have the time to understand why the printer driver is asking for full local domain access.

Although technically not a part of windows, I view OneDrive as a core component. Its current implementation is beyond confusing. Where is the system of record and where can I retrieve an older version? Is it windows file system, personal OneDrive, or SharePoint? This is magnified when multiple people are editing and another group is reviewing.
Compensating landowners doesn't mean it's not theft. If I broke into your house and stole all your stuff, but left a pile of cash of equal value, it's still stealing.
Yeah, but if you give juice or other yummy things every time your kid refuses to eat, then you are just rewarding them for refusing food. It is a very stressful balance.
It's possible to take a somewhat unopinionated approach to CVSS, the issue is that such CVSS scores exist in a vacuum, and vulnerabilities exist in environments. It's not possible to really apply a CVSS score to a vulnerability in a specific environment without understanding the vulnerability and more or less ignoring the CVSS score.

In summary, CVSS scores can be very objective, but in those cases they're also worthless.
Would still have paid for a lot of university debt, food-stamp, or Medicare...
Here it goes:

"As of my last training data up to April 2023, I don't have the capability to directly access or analyze real-time internet data or databases, including those from Hacker News. Therefore, I can't provide a specific answer or data on trends related to 'Ask HN' posts in relation to the release of ChatGPT."
I love aider but it feels like a giant black box that consumes copious credits.

The output is amazing though, so I keep using it. But I feel like I have no insight or control. Maybe I should read the docs more carefully.
It's getting denser, but just not as fast as logic.
https://www.techpowerup.com/309331/tsmc-n3-nodes-show-sram-s...

You can make them smaller (like 20%) but those SRAMs suck electrically so no product actually uses them. So in actually shipping products the SRAM is roughly the same size (like 5% smaller).

One needs to remember these things are drawn by algorithms (no one is by hand drawing billions of transistors) and there have been 20 years+ of advancements on the algorithms that draw SRAM and because of the regularity of SRAM there's more opportunity to pack.

There's just not that much fat to cut in a SRAM structure (that's purely optimizing for density) so in many ways SRAM structures are the true measure of how small things are, and they are in fact used that way. And things are really really tiny already.
> Google is inept at best and getting worse.

Hard disagree. I've used Pixel phones for years and they're generally great phones. Biggest previous complaint was their software upgrade support window was too short, but now they offer 7 years of upgrades.
My first instinct was "I bet this guy is promoting a new book". Scroll down and lo and behold. I should mention though that I have no opinion on the author and his books since I haven't read them.
It's pretty obvious to me that not allowing dangerous aircraft in the sky benefits the public safety. I can only guess at what your objections are, because you're being awfully vague, but since I have to guess I guess that you're saying something along the lines of "people will use other forms of transport like driving which is more dangerous than even flying on a 737 MAX." I find this line of reasoning flawed because while you may be on to something in the very short term, in the long term grounding the fleet permanently will increase the incentive for Boeing et al to produce safer aircraft. Thus, grounding the fleet will save lives. So, we should do it.

As to whether this "punishes" Boeing I have to confess that I absolutely, positively, do not give a shit if this counts as "punishment" and quite frankly the entire C-level of the company and any board members / stockholders that had a hand in degrading their QC to this degree, should be held criminally liable and punished as such. So that's where I stand on punitive incentives: they're a good thing.
I gained nothing from reading this piece other than there are smart people at MIT (which i've already known) and that this guy has a new book coming out.
If you use an HSM you wouldn’t have to worry about that either
A disgrace. I will never buy or even read these. None of us should.
Key OpenAI executive played a pivotal role in Sam Altman's ouster
That's not correct. I've worked from start-ups to semiconductor giants. Always the first option to develop everything in house, if you can find the talent. This is pretty much industry standard.
This is just a promotional post for a book, there is no actual content in this link
Well the worst case is a cascade of collisions if everyone gives up trying to avoid debris. But it'd only leave low earth orbit unusable, othernorbits would be still usable.
re Cody - I found it very similar to Codium, Copilot, et al. Impressive when it works, but consistently has trouble identifying the right context to inject or using it effectively. At its best when writing code that does not require a lot of local context - speeding up standard operations that might need a lot of boilerplate or using publicly documented + stable APIs are where they shine.

re getting some keys - for most tasks I have not yet found a better tool than finding a chat interface to your liking, setting a fairly generic “you’re an expert programmer” system prompt with output instructions tuned to your needs, and manually adding relevant context (copy/paste) to your messages when relevant. I can’t wait for big content windows and RAG methods to improve enough to replace all that with one of assistants, but it’s just not there yet.
Would be a shame if someone where to use the EUPL-1.2 just to fuck with them :)
It's Cal (not Carl) and he has essentially been writing the same book for the past decade. If you have read Deep Work you have read his next five books (including this one).
Sure, because it is funded by a commercial concern and they are in the business of selling entertainment.

With books, the balance of power isn’t so skewed to the publisher, though I suppose it depends on what it is.

I don’t know what circumstances Tolkien’s unfinished work was released, though it seems like his son toiled away at them for years.
I don’t know much about that. I do see some other options, like stabilized gravel where a hexagonal grid form is installed and then filled with gravel so that the gravel doesn’t move around.

https://www.greendriveway.com/
> Blocking a Chinese government controlled and subsidized entity from unfettered operation on your soil doesn't even remotely intersect "freedom of speech".

Ironically, there are a lot of philosophy accounts on tiktok, if you watch them it would give you an opportunity to realize that what appears to you as a fact is actually a belief, and an incorrect one at that (I suspect you are thinking of the first amendment, a very common error among humans).
I don't think that's unique to X windows, though - pretty much all GUI platforms have a similar concept, otherwise any time you accidentally drag your mouse outside of a window you'd start sending events to another application.

On MS Windows it's called "Capture".
fwiw government tbills give guaranteed returns due to the high interest rate, and are exempt from state taxes.

The popular saying is ti sell shovels, but who do you sell shovels to? If there were no good miners, there'd be no market for shovels.
aha - much appreciated
Point being that IEEE 754 defines two sets of operations, the required operations (section 5) that should be produce correctly rounded results to the last digit, and recommend operations (section 9) with relaxed requirements. And sine belongs to the latter section, so IEEE 754 does not mandate reproducible results for sine.
Risking a visible failure hiring a bad candidate, with no reward for hiring a good one, managers defer hiring as long as possible, preferring candidates with credentials or people they know.

"It's not what you know, it's who you know."
It's more like top 10% get 7 digit salaries, and the remaining 90% get by on upper 6 digits. Keep in mind there are probably only a couple thousand of "high end LLM researchers/mathematitions etc. who would really build LLMs" in the world.
I think that it's clearly theft. Theft is when someone deprives another of the use of their property without their consent.

Eminent Domain can be justifiable under some circumstances, but it's still theft.
In copyright, reckless behavior can satisfy the willfulness requirements.
Any M-series Mac can already run local models with decent performance.
The rape allegations have not been debunked. The UN Special Representative on Sexual Violence in Conflict just yesterday announced convincing evidence not just of organized sexual violence on October 7th, but of sexual violence against the hostages themselves, including evidence that such abuse is ongoing. It's been a Twitter talking point for the last 2 weeks that the rape accusations are hoaxes; some of that is the New York Times fault for mishandling a story, and some of it is a credulous alternative media that platforms Syrian genocide deniers, but at any rate: the consensus among serious people seems to be that the sexual violence narrative is substantiated.

This is one of those things that you can probably reasonably debate, if you're extraordinarily careful how you write about it (is it worth it? it's not as if it changes the calculus of how horrible Hamas is), but you can't reasonably claim is "debunked".

(The comment you were replying to was dismissive and uncivil; I'm just taking issue with a specific point you raised.)
Luton is 40 minutes away from St. Pancras International. I find both Luton and Stansted close to London, especially Luton with a really good Thameslink connection.
Pixel phones imo are like gaming on linux. Yes it’s passable, yes it’s getting better, but if you’re fooling yourself if you think it’s comparable to gaming on Windows.
This reminds me of the amazing Kentucky Route Zero game, which references a bunch of magical realism authors like Marquez.
The author presupposes perfect knowledge. Take my precious role where the head of the IT department squandered a year's budget on some half baked reporting system cooked up by a big player in corporate data systems.

Now to the outsider this may have looked like stupidity at the time, but it was actually banditry according to this analysis, since the IT manager was getting foreign golf vacations paid for entirely by the company selling in their half baked reporting system.
Then tell him "Man I would love to invest but I ain't got 60K+ for 1 bitcoin. Would you be willing to lend me some to buy since it's such a great investment and I will share profits with you" ? Hopefully that ends it.
All indications are this is supported by serious research from universities. Though I will agree that if you want to go deeper than a conversation level you will need to find who. I would assume the the researchers are writing most of this up in language others than English. In fact if you found a lot of information in English I would be very concerned as the people doing this do not speak English. They may publish some in English as well, but if the majority isn't in the local language (which might be translated or not) there is a problem.
ha ha ha (sorry or?)
Read closer, it defaults to fast, not off
> Do you mean, some people just consciously agree with being used and lied to and their taxes being stolen so that the leaders can be richer and more powerful while schooling, health care and economy is in decay? I don't think so.

Many people actually do that, because in their minds alternative is "left" that will do the same but with added bonus of supporting LGBT, fight against climate change, unrestricted immigration and such. And getting traditional true patriot of country X rich is preferred to fattening this dirty commies traitors on the "left".
The difference is what you mix, and the amounts of things you mix. As a human you mix many more inputs, plus your emotions, plus the things you consume to create it. Moreover, what you can consume and how perfectly you can consume is limited by our innate limits.

An AI system consumes something perfectly, then ingrains it into its weights perfectly, and becomes capable of imitating the same thing perfectly. Plus, ther are no other internal or external factors which affect these "generation" over time. Hence, it mixes and reproduces based on what it consumed, solely.

I might get inspired by people, and add my own values to it, iterate over it and diverge from what I'm inspired from ultimately to create my own style. AI doesn't work like that. Also, if I do the same amount of inspiration with the same precision and accuracy, I'll be neck deep in accusations and lawsuits (for the right reasons).

As a result, just because we fail to ask the right questions to reproduce the training data verbatim or almost verbatim doesn't mean that the information is not there. At the end, a neural network is a compression algorithm which encodes data in terms of weights. Given the correct input, you can regenerate the training data as is.

Unless you have special abilities, you can't read 500 books an hour, remember them perfectly, and generate derivative works by mashing all of them together. If I do and try to sell a novel, I'll be ridiculed no end. If I write a Ph.D. the same way and try to defend it, I'll be banned from academia for three lifetimes at least.

For more elaboration on the subject, see [0].

[0]: https://news.ycombinator.com/item?id=39188463