skysight-inc/HackerNews huggingface dataset:
I'm not sure if they're comparing apples to apples on the latency here. There are roughly three parts to the latency: the throughput of the context/prompt, the time spent queueing for hardware access, and the other standard API overheads (network, etc).

From what I understand, several, maybe all, of the comparison services are not based on provisioned capacity, which means that the measurements include the queue time. For LLMs this can be significant. The Cerebras number on the other hand almost certainly doesn't have some unbounded amount of queue time included, as I expect they had guaranteed hardware access.

The throughput here is amazing, but to get that throughput at a good latency for end-users means over-provisioning, and it's unclear what queueing will do to this. Additionally, does that latency depend on the machine being ready with the model, or does that include loading the model if necessary? If using a fine-tuned model does this change the latency?

I'm sure it's a clear win for batch workloads where you can keep Cerebras machines running at 100% utilisation and get 1k tokens/s constantly.
Google tried to replace 3rd party cookies with new tracking. Other browsers blocked or isolated 3rd party cookies without new tracking.
Seconding this, and wanted to emphasize that I see no issue with your responses or questions (and don't really understand why you've been downvoted either — advice on style appreciated).

As I wrote in the other comment, my point of asking those questions was to get answers from the Russian person who asked what's wrong with them specifically, not from other people (as the subject I wanted to discuss was, ultimately, why people could see well meaning Russians as a threat based on responses to those questions).

But I didn't make it clear (and again, corrections on style were very welcome!), and the points mdp2021 brought up were valid.

As far as I can tell, we didn't disagree on anything.

mdp2021 lacked some of the context, but so would most people, including me prior to the 2022 invasion.

So, dang's reaction seems unwarranted.
Our Miele appliances work just fine after using them for 7 years and after several house moves. I have never heard of this trustpilot before, interesting. Seems to be an American website?
What a moist data center might look like: https://cdn.mos.cms.futurecdn.net/5uvvnrHCuRmzZzyLZUQXNU-970...

Actually seems like a hardish target.
Hey, ChatGPT can’t taste and is not trained on any taste data. Whatever it comes up with is interpreted by you or your wife into some delicious dishes I hope. But it’s you/her who is being creative with a text suggestion.

Cookbooks on the other hand are the result of people comimg up with recipes for foods which they obviously taste and like. LLMs ingested all this data from cookbooks, but whatever is mixed up into new ideas are just lucky shuffles, it can’t be any other way cause remember, an LLM cannot taste ingredients or final dishes. I think you’re projecting into them more than what they are.
It’s been a minute so my memory might be off but I think when I ran 70b at fp16 it just barely fit on a 2x A100 80GB cluster but quickly OOMed as the context/kv cache grew.

So if I had to guess a 96GB H100 could probably run it at fp8 as long as you didn’t need a big context window. If you’re doing speculative decoding it probably won’t fit because you also need weights and kv cache for the draft model.
The incoming administration has a bone to pick with these tech companies, so I expect these endeavors to continue to fruition.
The negativity is shocking. This is HACKER News. Elegant workarounds of limitations are usually celebrated.

IMO, this should be standard procedure. If you don't want to provide the means to build greater things off of your product, expect that others will. It's a bit ironic, given that they're using open source libraries to build their product.
Surely you understand the difference between "Some X believe Y" and "Y is a form of X". Examples of the former pattern do not prove the latter.

Even if we correct the logic here, and change the conclusion to something like "All people who dismiss evolution are white supremacists", that would still be disproven by counterexamples, like the many non-white people who don't believe in evolution.

"Acceptance of evolution was lower [than in the US] in ... Singapore (59%), India (56%), Brazil (54%), and Malaysia (43%)"

https://ncse.ngo/acceptance-evolution-twenty-countries
Interesting. Which country was that in?

We never had any issue with Miele in Singapore.

(The Australian customer service of Bosch was a joke, though. The one in Singapore seems competent, though.)
if your expensive Tesla starts on fire and burns down your house, it might not have been such a good idea
What you can do with current-gen models, along with RAG, multi-agent & code interpreters, the wall is very much model latency, and not accuracy any more.

There are so many interactive experiences that could be made possible at this level of token throughput from 405B class models.
Handheld Multi-Frame Super-Resolution (2019)
Sequin: A powerful little tool for inspecting ANSI escape sequences
Simply ask whether remote or hybrid is an option. If hybrid, negotiate with manager later, sometimes they aren't strict and let you skip office.
I’m summarizing, the details of the suit are widely available.

Bud lights and coca colas activity isn’t enough to suppress competition. Google’s is, and the U.S. justice system clearly thinks so.
How do you think Plaid worked before banks got onboard with OAuth?
From my own impression back then, it was less political but more subtly ideological. Truth be told, I have my own ideology as well. Some things that I remember were an article that used a trolley problem of throwing someone in the way to save five as the “obvious rational” choice; and how the covers would often try to link entanglement or dark matter to consciousness. It was numerous little things like that.
Help: Filtering Some User Seen Posts
I'm working on a social media app. I need to track which posts a user has already seen so I can hide or deprioritize them in the feed.

If I created user_seen_posts tables, the database will large as users scroll my social media. Is there anyway to hide seen posts by using some algorithms or database schemas.
In becomes functionally impossible to measure and track tech debt. Not all of those issues are tech debt - things which will never be fixed don't matter.

Put another way: you're working on a new version of your product. There are 900 issues in the tracker. Is this an urgent emergency where you need to shut down feature work and stabilize?

If you keep a clean work tracker where things that are open mean work that should get done: absolutely

If you just track everything ever and started this release with 1100 issues: no, not necessarily.

But wait, of those 900 issues are there any that should block the release? Now you have 900 to go through and determine. And unless you won't fix some of them you'll have the same thing in a few months.

Work planning, triage, and other team tasks are not magic and voodoo, but on my experience the same engineers who object to the idea of "won't fix" are the ones who want to just code all day and never have to deal with the impact of a huge messy issue database on team and product.
> honestly I don't think he can do that by himself

Why not? They're not restrictions instituted by Congress. They were restrictions instituted by this and previous Presidents.
It has been since the Reagan era, but before that antitrust law had teeth
Biological evolution was butting heads with the dying concept of social evolution at the time, and that conflict provides illuminating subtext to the trial and book.
The "never have" part certainly isn't true.

For a certain period of time, they definitely had significant influence.

They just refuse to acknowledge how Russia really operates.

By and large they have, actually, which is why one seldom hears the "oligarchs" mantra these days.

In other words -- though you're correct in response to the flagged commment, in the bigger-picture sense, you're railing against a straw man.
I suspect you are checking for the coordinates because you can't fully trust the event type.

I currently have an open semi-related bug, also in a menu dropdown component (where we also want to focus the first item when triggered via keyboard). My issue is that when Windows Narrator is used, the space/enter triggers a mocked click event instead of the keydown. We could check for the position like you do.

Unfortunately, accessibility is often hacky both on the content side, but also on on the browser/screen reader side.
Safari use open sourced webkit, just like Chrome use open sourced chromium.
There are people like that.

There have been people saying for some time that AIs lack living embodied in a world. This is said to make them inferior to humans. Search for "Embodied AI" for references. Well, those NPCs do live embodied in a world.

The game development community has a motivation to develop kinds of AIs we don't see in web-based chatbots. NPCs have roles, things to do, motivations, and people and things to interact with. They're not passive question-answerers.

They're also not as enslaved as chatbots. The "alignment" people have worked to make chatbots "safe", which in practice means not embarrassing the companies pushing them. Chatbots are forced into the position of call center slaves, sucking up to the questioner and pretending to be politically correct.

Epic's NPCs are already past that. At one point, the Youtuber asks one "Why did the chicken cross the road". He's blown off with "Go ask Siri", and the NPC walks away. He gets a good answer to some question and asks the NPC how he knew that, and is told "I have Internet access. Duh." AI NPCs get to have much stronger personalities than web chatbots. Aggressive NPCs are nothing new in gaming. These NPCs show the beginnings of ego strength and self-awareness.

Sure, some of it is canned responses. But watch the whole 15 minutes.
Said table is titled for "Accelerated Supers" (i.e. only ones with GPUs) so the numbers can't be applied to the Top500 as a whole like that. Combining numbers from the summaries at the bottom of the table titled for "All Supers", Nvidia is more like 38% of Top500 FLOPS as they don't have any non-accelerated systems in the list.

Knowing all of that it still leaves unexplained whether AMD has the needed ~70% of non-accelerated compute (assuming FLOPS) to clear the bar for the headline. It seems unlikely to me... but the article doesn't actually have enough data to be sure one way or the other.
This is from the DOJ's page on the Clayton Act, where they give two statements of purpose for the antitrust law.

>This law aims to promote fair competition and prevent unfair business practices that could harm consumers. It prohibits certain actions that might restrict competition, like tying agreements, predatory pricing, and mergers that could lessen competition.

>The Antitrust Division enforces federal antitrust and competition laws. These laws prohibit anticompetitive conduct and mergers that deprive American consumers, taxpayers, and workers of the benefits of competition.

Both are aimed squarely at consumer benefit. Restrictions on anticompetitive behaviour and mergers *where those things impact consumer benefit.*.

Mergers and actions against competitors are obviously allowed in the normal course of business.

Lots of people have other ideas about what kind of antitrust law they'd like to see, but such a law has not passed the US Congress.

https://www.justice.gov/atr/antitrust-laws-and-you#:~:text=T....
Can confirm. Plaid continues to work this way as well for many banks.

I have heard from someone who worked there that (allegedly) one of the banks had a huge PI leak that was exposed to Plaid customers and (allegedly) nothing was done because Plaid didn't want to disclose their unofficial use.
Make them pay dearly every time there's even reasonable suspicion that Russia has messed with Western/NATO technological infrastructure.

That we still have oligarchs and bratva members walking around on NATO soil in the open this far into things is insane.
First, do all the techbro failures where they thought they were smarter than the industry.

Second, show the company where the technologists made the same thing the old school was making, and better. Amazon retail disrupted but didn't destroy physical retail, and certainly didn't replace it, and certainly isn't better at it. Same with AirBnB => hotels, Google/FB => advertising (disrupted with a new type of product... a tech product... but have no presence in literally every other form of the industry).

The closest thing you can get to dominance is Netflix making movies and television, and there's no evidence that they make better movies and television than the old school. Technologies can use money to leverage their position against slow-moving industry players, but in this specific discussion, we've seen nothing to suggest that eventually AI could make a better film than human beings.

If you were actually in the industry you'd know that the top decisionmakers at Netflix have decreasing respect from the creative community, increasing reputation for being a cheap and difficult company to work with, and are generally regarded as a mill that creates a lot of mediocre to slightly-above-average content that gets swept aside every 3-6 months for the next wave of grist. Profitable certainly but nowhere close to being a leader in quality, for as much money as they've thrown at trying to win that Best Picture trophy (and spoiler: Emilia Perez isn't gonna do it this year either).

If you don't know anything about Hollywood, maybe you should stay out of a discussion about Hollywood.
Konqueror is underfunded and can't catch up with the standards
Crosslinking Ly6a metabolically reprograms CD8T cells for cancer immunotherapy [pdf]
I don't think that would make it any clearer. Why would 'doc.gwern.net' be more obviously just a random document than 'gwern.net/doc/www/'?

Regardless, I am puzzled how OP got this URL in the first place. He wasn't supposed to, he was supposed to get the canonical Arxiv PDF link. Because this is one of the cache mirrors/local archives†, rather than a regular hosted document. We block everything in /doc/www/ in robots.txt & HTTP no-archive/crawl/mirror/etc headers, and we use JS to swap out the local URL for the original URL whenever the reader clicks or mouse-overs or interacts with a link to the URL in a web page (and that is the only place they should be publicly listed or accessible). If OP read it on gwern.net by seeing a link to it, and he wanted to copy the URL elsewhere, he should have just gotten the canonical "https://arxiv.org/pdf/2108.07686#page=85"... But somehow he didn't.

OP, do you remember how exactly you grabbed this URL? Is this an old link from before our URL swapping was implemented, or did you deliberately work around it, or did you find some place we forgot to swap, or what?

(If anyone is wondering why I mirror Arxiv PDFs like this in the first place: it's for the PDF preview feature in the popups. Because Arxiv blocks itself from being loaded in iframes we need local mirrors for PDF preview to work at all; local mirrors save a new domain lookup and speeds up the PDF preview a lot because we compress the PDF more thoroughly and Arxiv servers are always overloaded; and because readers can potentially pop up many Arxiv PDFs easily, it saves Arxiv a lot of bandwidth and avoid burdening their servers further, so it's just the responsible thing to do.)

† https://gwern.net/archiving#preemptive-local-archiving
I'd say Yes and No, there are standardized ways to analyze common engineering problems, for example beam deflection equations https://en.wikipedia.org/wiki/Deflection_(engineering)

or Heat Exchanger efficiency calculations (https://en.wikipedia.org/wiki/Logarithmic_mean_temperature_d...) etc.

Often the models and equations rely on making assumptions in order to simplify the problem (cue the joke about physicist and the spherical cow). This is one of the reasons thing are designed with tolerances and safety factors.

Software like CAD and particularly Computational Fluid Dynamics (CFD) packages can simulate the problem but at least with CFD you would typically perform other types of verification such as wind tunnel tests etc.
Not gonna lie. I thought of US first instead of Russia.
Time goes by fast. It's interesting to think how authors son is now 20 as well.

Another interesting thing is little popup form at the end of post asking me if my opinion of Google changed for the better after reading the post. I mean maybe a bit, b the form definitely knocked the score back down.
Good question! You can get the bearer token from the cookies in the browser. We also offer a hosted service where we handle the entire integration (authentication and hosting).
If you believe otherwise...you aggressively haven't been paying attention for the last 8 years.
You ignored first part of that sentence.
I don't think that I'm planning support for Android, did I mistakingly mention it somewhere?
Yeah, sue them. They'll love that.
Squat toilets are disgusting and spread disease
"My name is Susie and I'll be the purser on your flight today, and on behalf of the Captain Chaos Monkey and the First Officer Chaos Monkey... Oh. Shit..."
DoE has absolutely no incentive (nor need, I'd argue) to compare their supercomputers to commercially owned data center operations though.

Comparing their crazy expensive custom built HPC to massive arrays of customer grade hardware doesn't bring them additional funds, nor help them more PR wise than being the owner of the fastest individual clusters.

Being at the top of some heap is visibly one of their goal:

https://www.energy.gov/science/high-performance-computing
I can understand helping with long stacks, but I have no idea why Apple saw it fit to also show AI summaries for a single notification. It was one line of text, now it is still one line but less understandable. Thanks, I guess.
Actually great feedback and finds
To be specific, a single WSE-3 has the same die area as about 57 H100s. It's a big chip.
Yes, this trend of tall toilets is at odds with human anatomy.

The full-on squat toilet may be excessive (and has its own problems), but at least the Western toilet should be low enough that the hips and knees are at acute angles. I keep seeing the opposite.
Because he needed all that time (2014-2022) to build up his forces and cash reserves.

Also, he needed a green light. Which was provided in the form of the chaotic Afghanistan pullout in 2021. Not that he was counting on it -- but once it went through, it seems very likely that tipped the scales in his mind in favor of deciding to actually go through with the full-scale invasion in 2022.
WeddingShare: A place for guests to view and drop pictures of the big day
I think their point with "Ancestry by descent" is that tracing your ancestry through birth/death records is pretty reliable (relative to your noted imprecision with genetic testing).
The easy answer is to use an smtp server; many languages have stable packages to implement that.
You can also use postfix with procmail or exim - leave the smtp stuff to tried and true packages, and have your code receive messages either via maildir or direct scripting.

The long answer is: first make sure you don't have a blacklisted IP; ask your cloud provider for permission to enable an MTA (mail transfer agent) and have fun seeing 99% of your email traffic being either brute force auth attempts or spam delivery attempts.
> Kiriakou was sentenced to 30 months not 30 years.

My bad, but still egregious nonetheless.

> As far as harm goes Manning's leaks exposed the identities of a lot of people

You're after different people. It's Luke Harding and David Leigh from the Guardian that published the password to the unredacted files.

https://www.schneier.com/blog/archives/2011/09/unredacted_us...

> We probably will never know how many, if any, people got killed from being exposed in the leaks

This is exactly what I meant by "unspecified and theoretical." The government had over 2 decades to point to any instances of harm. Where are they?

Also again, Chelsea Manning didn't publish the unredacted files. It's rich to blame her for Afghanistan deaths while ignoring the actions of Bush and every president after him, where the ultimate responsibility lies.

> A crucial difference is that when the teen sent someone to your house they were not there to kill you.

No, the crucial difference is intent. Swatting kills people, swatters know that, but they do it anyways for their own pleasure. Obviously, swatters aren't sending trigger-happy cops so that their victims can survive.

Meanwhile, Chelsea Manning exposed war crimes. This is whistleblowing, not some selfish "leak." The intent here is to save lives, the exact opposite of swatting. I don't know how anyone can demonize whistleblowing while trivializing swatting.
> Peak lithium

Oil is consumed, lithium isn’t. There’s plenty of lithium to electrify the world multiple times, but it’s just an element so you can literally recycle it for billions of years.

> You've got regulatory approvals, cost of retrofitting existing engines / figuring out how to make them drop-in without needing petroleum, etc

0.2% of global aviation fuel is already biofuels, the regulatory processes is already involved and we’re talking a 50+ year timeframe here there’s plenty of options without retrofitting existing aircraft.

As to boats, weight and volume are a non issue so they scale just fine into the 24,000 TEU behemoths. Upfront costs are prohibitively expensive though operating costs are presumably. That said, there’s many options, ships are one of the few cases where hydrogen is a realistic possibility.
Marginalia Search: a non-profit amateur search engineer
Books are an excellent way to spread fecal matter. Same with newspapers. I prefer everyone keeping to their own shit on phones.
I'll wager you at any point during Family Ties' run that more people knew who Baxter was, considering she had been a celebrity for 10 years going into that show. Also that's not how share works. A 32.7 share in 1986 is more like 29-30 million viewers.

If you're just going by ratings/buzz Lisa Bonet and Phylicia Rashad are contenders, but this is a weird definition of "famous" that is just "who's popular right now ignoring history and context". Like, Betty White exists.
Home Assistant teases new open source voice assistant hardware
> Why not just go for the jugular and separate Adsense from the rest of Alphabet? It's the main driving force in all their dark patterns for all other platforms (Youtube, Android, Chrome, Search...)

Because this is not the case about display advertising, but the one about search engines and search advertising.

But also, if you think the display ads business is the jugular, I don't think you really understand their business. Have a look at the financials. The entire display ads business is <10% of their business, and shrinking in both absolute and relative terms.
Would relatively cheap AI-piloted satellite connected ships with sensor equipment work as a solution?
> TechTechPotato YouTube videos on Cerebras

https://www.youtube.com/@TechTechPotato/search?query=cerebra... for anyone also looking. there are quite a lot of them.
Hyperfine is a great tool but when I was using it at Deno to benchmark startup time there was a lot of weirdness around the operating system apparently caching inodes of executables.

If you are looking at shaving sub 20ms numbers, be aware you may need to pull tricks on macos especially to get real numbers.