skysight-inc/HackerNews huggingface dataset:
People theorize that queries are being run on multiple A100's, each with a $10k ASP.

If you assume an A100 lives at the cutting edge for 2 years, that's about a million minutes, or $0.01 per minute of amortized HW cost.

In the crazy scenarios, I've heard 10 A100s per query, so assuming that takes a minute, maybe $0.1 per query.

Add an order of magnitude on top of that for labor/networking/CPU/memory/power/utilization/general datacenter stuff, you get to maybe $1/query.

So probably not $10, but maybe if you amortize training, low to mid single digits dollars per query?
Well maintenance including cleaning, and if you burn something on your stainless it's going to be kind of a pain compared to the nonstick.

I will say though that cast iron and stainless are the only things I want in my kitchen because I like metal whisks, forks, and spoons in my cookware.
And yet the propane stove, designed to heat, is about 1,000 times more common.*

* citation needed.
Am I the only one who gets an uncanny feeling visiting this site? If someone told me this was software satire I would believe them.

This cyberpunk-ish theme with juvenile sprite sprinkled over it (e.g. the little AI guy floating under the video and the figures under "What people are saying").

At the beginning of the video I get these '90s infomercial; "The world moves fast / information super highway" vibes. The background music seems ironic considering the visual content.

I guess it is just trying to be retro but the "I want to be post iOS 5 Apple" top bar throws me off. Sorry this is not constructive but I just must know if I'm the only one feeling this.

In any case, I don't mind Slack but I'd give this a try if they allowed more than 500 messages in the free tier. At least Slack gives you the 90 day history.
There is no neutral reporting. The act of deciding to publish something on page one is an inherent choice NOT to publish other things there. The facts are there, show me the lie in this article (vs the “choice of what to highlight”) which is the only thing that could make it shoddy.

Media both creates and reflects people’s attention and anyone pretending it’s only one or the other is showing their own bias.
There is a great opportunity for totalitarian and authoritarian regimes (China and UAE so far) to create commercially usable and free LLMs that work significantly better than alternatives (backed by large amounts of government money).

Over time, as they get used in more and more products, these LLMs can become more 'aligned' to these regimes way of thinking.

There are no Chinese companies that are not part of the Chinese government.

This is a new kind of cultural soft power.
Makes me wonder why did they not opt for Java or C# as their backend choice. I better stop learning C# and move on.
Twitter rate limited me (no blue check) could someone screenshot this?
Anatomy of a feature[1] is easily the blog post I have linked to new devs the most over the years, as it feels like an evergreen understanding new folk lack.

[1] https://inessential.com/2009/07/30/anatomy_of_a_feature
Come back to where the air is crisp - Debian 12 is glorious.
Note that /r/ChatGPT is mostly nontechnical people using the web UI, not developers using the API.

It's very possible the web UI is using a nerfed version of the model evident by its different versioning, but not the API which has more distinct versioning.
Agree, I've had great results asking chatgpt questions about AWS services. The interactivity is very helpful, and chatgpt will draft scripts too, although that's hit or miss. But for understanding concepts and services, it's great.
Blender Fanatic Shares His Japanese-Inspired Scene This Week
Better URL perhaps: https://element.io/labs/element-x

We're super excited about this release, even if it's an early one - Element X is the first Matrix client which outperforms WhatsApp/Telegram/iMessage and friends, both in terms of performance & UX.
No, the assembler is correct. Jump (early) back to the beginning of the loop if not equal to s; otherwise, continue executing the next instruction (add eax, 1) and then unconditionally jump back to the beginning of the loop.
It’s actually crazy how slow bluesky’s rollout has been. I can see why they want some level of exclusivity (so that people want to join, and when they join can immediately hook up with their friend who invited them), but they really need to open the faucet a bit.
Another tor page says ddos attacks primarily use UDP packets, which tor doesn't allow:

https://support.torproject.org/abuse/what-about-ddos/

So, is this an attack using a different method?

And what about mitigating attacks on other networks/sites that originate from tor? The site I linked only said "attackers who control enough bandwidth to launch an effective DDoS attack can do it just fine without Tor." They didn't say anything about mitigating the use of tor by attackers. And what they're saying about attacks not being possible on the network is clearly wrong.
I am not surprised. As I understand it, Vulkan is a low-level API which is a much better fit to the actual hardware than OpenGL or DirectX.

You probably want to implement Vulkan anyways, so why bother re-implementing a separate legacy API when an existing translation layer can give the same or better result for a fraction of the effort? Heck, Intel even did the same thing to get DirectX working on their Arc GPUs: they just used Wine's DXVK translation layer.
Thanks!

I admit once I saw the paywall I stopped.

Here's a link for those interested:

https://archive.is/EWAOO
> To support this claim, we review the cryptanalysis progress in the last 20 years,

...and rationally and scientifically assuming that the rate of the progress won't increase and that there will be no major breakthroughs in the future, we propose revised number of rounds for AES, BLAKE2, ChaCha, and SHA-3.

The crypto is already fast enough, thank you very much; many attacks work only precisely it's quite fast to brute force huge subspaces of key material.
Facebook actually does some compile-time optimizations, but also ships some of the profiling data for JITing between early deploy phases and the rest of the fleet: https://engineering.fb.com/2021/03/03/developer-tools/hhvm-j...

Also, Facebook used to do ahead of time compilation (HPHPc) but eventually HHVM managed to outperform it.
It's a reskinned version of Ubuntu, that has some slightly questionable packaging choices.
I've been on those ... the questions still apply ;)
>Compared to other California local governments? Again, I don’t think so.

Maybe not, though the Sacramento Metro Region has more land for housing availability than say, the Bay Area, or Los Angeles, in part thanks to being able to build on what used to be massive flood planes by Natomas.

When it comes to augmenting your neighborhood / city laws around housing to make them more friendly for things like housing density, much like other cities in California, they fail more often than not. Mid town in particular wants to keep its "charm" at all costs, and that district of Sacramento pretty reliably opposes any real change in housing policy that would move the needle on this neighborhood to make it more affordable as a result.

Due to being out able to build out though, the region is less pressured on the housing issue than others, but it costs have been rising significantly there none the less, esp. since WFH jobs became more mainstream, housing pressures are heating up significantly again, its why we moved.

With all this said, I would say that in general, the liberal attitudes around other issues doesn't permeate to housing, and thats all I really meant. What you would think liberal leaning town would support around housing doesn't come to fruition, which I think often surprises outside observers. Some of the most liberal areas in California (and the US, for that matter) have some of the most conservative housing politics in the country, as you may well know.

>What even is “conservative” in this context?

Sacramento region, and the city proper, there are lots of familial relationships with farmers because of its proximity to the Central Valley. The city is made up of a lot of people who moved from Stockton, Modesto, Turlock etc. and still have a lot of ties to that area.

They oppose, overwhelmingly, when voting on state initiatives things that limit water rights for farmers in the Central Valley. That's what I mean. Due to the surrounding region and close proximity to the Central Valley, it permeates this upward on state initiatives and politics, based on my lived experience during the droughts when I was part of a campaign to enforce more water conservation practices in farming
The emoji is certainly problematic, but it wasn't the sole piece of evidence regarding the contract.

"The buyer, Kent Mickleborough, later spoke with Swift Current farmer Chris Achter on the phone and texted a picture of a contract to deliver the flax in November, adding 'please confirm flax contract.'"

If I've talked to you on the phone about the contract and then send the image with a request to confirm the flax contract, it's harder to argue that a thumbs-up only reflects receipt of the message instead of a confirmation, especially if no further response is sent by the recipient.
Hololens, Oculus Quest, Vive Focus, Pico Neo...
Nubia is a subsidiary of ZTE, seemingly more focused on gaming. Not exactly Apple quality, but far above the random fly-by-nights on AliExpress.
Good for them! Academia is a toxic and broken environment, and this seems like a great first step in fixing it. Interested to see how the dynamic plays out at Stanford, and if other American universities follow suit.
You mean like No-IP? I used that to SSH into my own servers for a while, but I found it to not be 100% reliable.
> Google Maps

This is relatively new (<1yr?) and reasonable for someone to not assume it to be here.

> "At a glance"

Not true. There is only AQI alerts. At least on my Pixel.

> I never even realized Android has a weather app...

I'm a bit surprised due to 1) this being in the at a glance, with default on, and 2) temperature being shown in nearly every advertised display of the pixel phone. Just click on the temperature and you open the app. There's also a larger widget if you want to see multiple hours forecast.
It's just Man Bites Dog in action. If states shared data about a murder or something that everyone agrees should be prosecuted, it wouldn't be interesting. Nobody cares about that, because we all agree that if you drive to another state to shoot someone, you should be prosecuted for that.

The fact that a Sheriff is sharing data that could be used for a controversial prosecution is interesting and worthy of reporting on.
> But in common law jurisdictions generally, there is no such thing as a "valid" or "invalid" signature for simple contracts.

Note that this is also true for many civil law systems.
I think that would be a great idea. Except that I would put the age of receiving that inheritance at about 30.

It's one of the ironies of life that when you are young you have time but no money, and when you are old you have money and no time.

Think how great it would be if you got that money while you were still young enough to use it, and old enough to use it wisely.
They're compelling and useful largely because of enormous public investment in supporting infrastructure. Without gigantic roads they'd be much less appealing.
This is discussed in the article and while not a position I support, I think leaving out this detail does him a major disservice: "Yet he has refused to retract the comments—in part because of his own sexual experiences with men as an underage boy, which he refuses to characterize as abusive."

I find that overall hard to fully condemn the person for, vs to separate out those views from his work, as I've never seen anything about him personally acting that way himself with any boys. (Though you say there's more to be found,so... what is it?) I'm no doctor, but the "standard" media-presented look at a situation like that would probably be something like manifestations of trauma from those encounters at young ages combined with the other traumas of growing up gay in America at the time, which I largely file in the "bad but understandable and not actively harming others" bucket.
I didn’t downvote but was tempted.

> I'd just as much prefer to use a social media platform that doesn't bend the knee to the government. Let the people decide for themselves what is useful information or not. We live in a representative democracy - this form of government is itself a safeguard against an ill-informed populace.

Over the past decade or two with social media we have increasingly seen people are NOT good at deciding what information is useful. A large percentage of the population believes wild folklore, conspiracy theories, etc. We used to live in a truth based society (with occasional issues when lies were presented as truth). We now have a post-truth society where alternative facts are invented at will and displace reality. Worse many of the peddlers of misinformation are just not harmlessly misinformed but know they are lying.

In times of extreme crisis, we do need a quick fix. There simply isn’t time to waste placating people who think injecting bleach will protect them from an airborne illness in a pandemic. We could have spent a decade giving everyone a Master’s in Microbiology and Epidemiology and still not convinced antivaxxers, because they aren’t swayed by facts but by beliefs that feel truthy to them.

The entire point of representative democracy is to avoid the pitfalls of direct democracy which prevents expert analysis and decisions.
Modern society is complex enough it has to be guided by subject matter experts. Can you imagine if the simple majority of users of your software got to decide every product decision from now on? Or worse, you had to get approval from the 5% of users that are mad the app doesn’t display Sasquatch’s location?

Personal responsibility has never alone been adequate to deal with the externalities government is uniquely able to fix - war, natural disaster, famine, and pandemics. Collective action is required for these challenges (and more mundane ones like pollution and other externalities). Any society has to be able to balance between the rights of individuals such that a tiny vocal minority can’t overly endanger the continued existence of society. Doing that well, so that nobody is run roughshod over and everyone gets a voice is important. But in extremis we don’t care to compromise with people who are endangering the herd. Humans never have had much tolerance for that.

I say all this knowing authoritarian governments are often able to do their worst abuse in times of crisis. But politely asking Facebook to take down or spread-limit some misinformation that statistically will lead to death isn’t tyranny.
It’s apparently not legal in the EU, which is why Threads is no available here.

It’s probably only legal in jurisdictions with none (or almost none) privacy laws.
Position and momentum are not separate things that you can measure separately and recombine. They're deeply interrelated.

You would improve your counting statistics somewhat with 1000 particles*, but basically you'd just resolve the Gaussian distribution more clearly. The uncertainty of the measurement comes from the width of the Gaussian, and it's not like measuring more points is going to somehow make that distribution skinnier.

*(a hilariously, impossibly small number in quantum world, where photons come in doses of 10^20/second, or electrons come as 10^18/second)
Surely. I imagine it's just like their iPad apps. Should be here any day.
> Use of cheap human labor in developing countries through shady anonymous companies (look up the company Sama who pay Kenyan workers about $1.5 an hour).

What is wrong about injecting millions into developing nations?

The rest I agree with, although I don't think it was ever really 'open' so its not getting shitty, it always was. Thankfully, "there is no moat" and other LLMs will be open, just a few months behind OpenAI
Twilio is falling apart for the past 2-3 years now internally! C-Levels hope they get bought out. Don’t use their services! Just stop!
HHVM's predecessor at FB was an AOT PHP to C++ transpiler called HPHPc. There are a lot more optimization opportunities with JIT compilation when dealing with dynamically typed languages like PHP.
trademarks have specific scopes you can see that in the "goods and services" section right
Well, I do my best considering how you haven't demonstrated anything so far. I'll refute your claims, but I expect a real explanation of how AI could develop outside our control without hand-waving. If you can deliver that, then we can argue on common ground.

> since a primitive version of an AI couldn't jailbreak (wrong, many bad actors jailbreak it)

I did not say that. "Jailbreak" is a loaded term that basically means getting AI to do something it shouldn't. This is fine, and something I acknowledge - by generating the wrong text or image, AI doesn't kill us. Humans kill us by risking lives on unsafe AI implementations. It is as simple as that.

> Let's bet humanity on it !

Who's betting humanity on it?

> And why fixated on LLMs ?

Yeah, good question. LLMs have been around for years now, and before them Markov chains did about the same thing. Why didn't those take over the world?

> You know technology progresses right?

I do. Now I'm asking you to show me what you would tweak to create an unkillable AI. According to you this is simple and self-evident. What am I missing? You can tell me using technical terms, I'm a Unix developer by trade.
I believe it's more like they used Anthropic human preference data [1] or similar, and accordingly Anthropic/progressive American notion of honest-helpful-harmless behavior. Thus I've seen models misgeneralize towards prudish finger-wagging. For example they parse badwords like "beat", "abuse", "steal" in morally neutral contexts ("beat a benchmark" or something) as signifiers of substantial transgression and spiral into telling me how, as language models, they insist it's never okay to etc. etc. This attitude was strikingly reminiscent of American models, even though other failure modes – like hallucinations – don't seem so similar.

Papers like Tulu [2] suggest that LLaMA-65b is indeed an appropriate baseline, given reasonable prompting. Instruct datasets only convey a flavor of responses, and for a strong foundation model that can infer the intended flavor on its own, naive finetuning seems to be detrimental. GPT-4 was much more powerful prior to having been finetuned, if reports of early witnesses and researchers are to be believed.

1. https://huggingface.co/datasets/Anthropic/hh-rlhf

2. https://arxiv.org/abs/2306.04751
Arch is a bit too minimal for the people who were previously using Ubuntu's minimal install. You don't even have a desktop environment out of the box.
Maybe gravity causes matter.
AWS has some great documentations
Neat! I haven't paid any attention to this market since the original Vive.
Even now snaps are pretty avoidable for almost everything but we'll see how that lasts.

Firefox is the only major thing where I've just abandoned the package manager, and it's probably a better experience this way than the .deb was in the first place.
The $5-$10 is probably the reason why they're killing those endpoints.
IANYL, but yeah.

The services this registration covers (in Class 42) are: "Platform as a service (PAAS) featuring computer software platforms for use in project management and collaboration for the technology and media industries that allows organizations and users to create, upload, share, discuss, store, and search content meant for users of the platform; none of the foregoing specifically targeting decision support among healthcare professionals and facilities"
Completely true. And the books never sell, so the losses just offset other income.

Brilliant, really.
You should apply and use OpenAI on azure. We’ve got close to 1m tokens per minute capacity across 3 instances and the latency is totally fine, like 800ms average (with big prompts). They’ve just got the new 0613 models as well (they seem to be about 2 weeks behind OpenAI). We’ve been in production for about 3 months, have some massive clients with a lot traffic and our gpt bill is way under £100 per month. This is all 3.5 turbo though, not 4 (but that’s available on application, but we don’t need it).
Rediscovering Literacy (2012)
Gosh, I'd have to see if I can dig it up this was a few years ago.

I did all of the above, plus profiling (sb-sprof combined with disassemble will show assembly level profiling).
If you know you’ve got gigantic scale why would you not use a compiled language?

Surely it makes massive difference to hardware utilization?

I like Python and javascript but there’s perfectly fine tools around now for building systems that allow one server to do a lot more.

They say you should not prematurely optimize. Equally you should not be prematurely unoptimised.
>> This is why the court is clear they are allegations

"Plaintiffs have shown that not only have the Defendants shown willingness to coerce and/or to give significant encouragement to social-media platforms to suppress free speech with regard to the COVID-19 pandemic and national elections, they have also shown a willingness to do it with regard to other issues, such as gas prices, parody speech, calling the President a liar, climate change, gender, and abortion"

Doesn't sound to me like the court is clear they are allegations.
Please ELI5 if I am mis-interpretating what you said:

*"They have just locked down access to a model which they basically realized was way more valuable than even they thought - and they are in the process of locking in all controls around exploiting the model for great justice?"*
Threads is built on Instagram's code base, which is why you can't currently delete your account on one without deleting on both. So it'll be a tough fight for Elon to prove the code is stolen, since such a big chunk of it was already there for years.
> The sheriff dep't isn't doing this _specifically_ with "anti-abortion states", they're doing this broadly with other states "including Alabama, Oklahoma and Texas".

something something "plausible deniability" something something
Toyota's eCVT? Not at all. The gas engine can drive the front wheels directly.

https://www.youtube.com/watch?v=jofycaXByTc Conceptual explanation of the system.

https://www.youtube.com/watch?v=O61WihMRdjM Weber Auto giving an extensive hands on explanation.
GCM (ie. AES-GCM) has the following problems, which extended variants - those that deterministically randomize (key,nonce) pair - do not solve:

Inability to encrypt more than 64Gb with the same (key,nonce) pair.

Lack of commitment (whether key-commitment, or key+nonce+ad commitment).

If one is seriously considering breaking away from existing GCM standards to create yet-another-standard, such proposal would need to offer improvements in all areas (ex. a proposed standard for converting any AEAD into streaming chunk-based AEAD with practically unlimited message sizes under the same (key,nonce) and unlimited message counts.

GCM-256 is ubiquitous and is often the preferred choice for all the reasons mentioned by the author, but that very argument is what makes non-standard GCM with 11 AES-rounds silly.

In 2023 we should be working on new standards that "wrap" existing crypto-primitives (which are already implemented/available in countless hardware-accelerated libraries/APIs) to get additional features/benefits/capabilities - not musing about AES with 10+1 rounds or SHA-512-really-fast with 80-1 rounds..