skysight-inc/HackerNews huggingface dataset:
They are almost certainly doing this internally for their own chat products.

The simple version of this just involves saving off the KV cache in the attention layers, and restore it back instead of recomputing. It only requires small changes to inference and the attention layers.

The main challenge is being able to do this under scale, e.g. dump the weights out of GPU memory, persist them, and have a system to rapidly reload them as needed (or just regenerate).
If you're on the freeway and you forget to pay your bills does it crash?
I have a large and very eclectic group of buddies, ranging from one extreme to the other, in term of politic, life style, believes, education, etc.

Anecdotally, this is true in my circle.

Left leaning people around me think they are more open minded, but really they just have a different set of things they accept. They have the same number of icks, just not at the same place.

The big gap is in how they behave when in contact with things they don't like.

And right leaning people have been so far more capable of cooperating with those who don't match their values.

Also, on paper, left leaning have expressed more humane values, espacially when very general or abstract. But in the day to day, when it comes to the mondain or practical, I've seen the sexist or racist guys help more my muslim or girl friends that the ones saying every body is equal.

It weirds me out.
Thanks, I needed to read Gegel again! http://library.sciencemadness.org/library/books/gergel_isopr...
macOS on the iPad: A Compromise
Yeah; a few weeks ago a family member asked me if I was concerned that AI is going to eat up all the software engineering jobs. I'm pretty unconcerned about it; but I am a little more concerned that hiring decision makers will think that it can.

One of the reasons why I strongly feel that we're headed at lightspeed into an AI winter is: there's so much hype happening in the space right now that we're already seeing companies say things like "we're able to downsize 70% of department X thanks to productivity increases from AI". These efforts will almost universally and inevitably fail; not necessarily because AI will never be capable of doing what some business leaders believe it can, but because it can't do this yet, with agency. In a few very limited cases we'll see companies use this as an excuse to just lay off excess fat in the org, but it'll be far more common to see a pattern of layoffs + we're AI now -> profit up -> that's weird this company isn't developing nearly as many new things... -> re-hiring equal to or exceeding the layoffs -> company is never the same.

AI hype right now is burning bridges with underdelivery; we're making too many big bets too early. In 20 years it'll be the case that someone will be trying to sell a substantially more capable AI system, and some business leader says "that looks awesome, lets give it a try in this random inconsequential corner of the business no one cares about" because 20 years ago her predecessor bet the farm on GPT-4, lost the company billions over the next decade, and shareholders are now far more hesitant; despite the fact that, in 20 years, it might be The Time.
I will never understand why users are always up in arms about announcements like these. If you post content on public forums like Reddit, Stack Overflow, Quora, Tumblr, HN and wherever else then they will be available for public viewing and archiving, including by the likes of OpenAI. That has been true about the internet since day 1. If you don't agree with it, don't put the content out there.
I'm glad this covers the "canonization cycle" that's popular among news sites right now. The path to getting something declared as truth on wikipedia is to convince an unqualified journalist to uncritically repeat your claims, and now you can point to that as an official source. Often it goes even deeper if you try to track down a source on wikipedia and it's a reputable news site citing another, citing another, citing another, all the way down to the original source being some cooking blog. This means that unqualified bloggers and the tech company who host the infrastructure are the final arbiters of truth.
vercel costs 20 bucks. if every eng makes 100 websites using it, and theres 1% of the population = developer, then revenue would be 20 million a year, or a valuation of 100m tops. and thats if everyone buys..
Included in that mix will be the wise and nurturing influence of 16 year-old angry white male affluent suburb libertarian intellects.

Junior ML engineers can graft on PR-friendly "AI safety" filters all day, but someone knows what evil lurks in the heart of gigabytes of floating point numbers.
> Lactose tolerance AFAIK is a single enzyme. That taking 6000 years to develop I think is evidence against what you are saying.

Also relevant: lactose tolerance is something we start out with, babies need it. So lactose tolerance, or more properly lactase persistence, was not the development of a brand new trait out of nowhere, it was maintaining a capability past the age where it would previously degrade out of functionality.
I think it's because it's not obvious that there is a free trial, so it sounds a bit like "98% of people who bought autopilot are not using".
Sorry, don't get it. We can also say that Vitalik manipulated Ethereum protocol when the DAO hack ocurred, even if the DAO hack was a crime. There is no precise line to define what is right or wrong in crypto.

Rephrasing it: there are a lot of things that happen in crypto, MEV itself, that are no different than what these brothers did.
Agreed. It came across like disagreeing lacking nuance to be "right".
It's called Full Self Driving Beta. That means FSD is the goal not the reality.

If you don't see the advantage until it is actual FSD, then simply wait to purchase/use it until it is out of beta.
The fact that you can re-skin it at runtime with such a wide variety of skins and load such a variety of plugins puts modern software to shame.
That's the idea - settlements are usually built in favourable areas (e.g. next to rivers) so the same site may be continuously inhabited or repeatedly reinhabited over very long periods of history.
Probably, from what people are telling me. But Coq is not a general purpose language, it is a dedicated theorem prover. I don't use Lean as a theorem prover for code (only for mathematics) and I myself don't do any code formalization unless someone offers to pay me.

The reason I code in Lean is because I find it fun, and I think it is a very nice general purpose language; for instance, I like Lean much better than Haskell. If Lean ever gets the libraries Haskell has, I will be really excited.
I'm a luddite when it comes to generative AI models but to me it seems like the primary use case for training OpenAI on Reddit posts would be if you wanted to be able to create a more realistic genAI bot to post on Reddit for some reason.

Surely if you are making a genAI bot for medical/legal applications the likelihood of hallucinations/misinformation is way higher if Reddit posts are included than if it were solely trained on official medical/legal documents
A reduction of 3dB at any point in space is equivalent to halving the energy at that point.

But we humans don't perceive sound energy linearly, so half of the energy is not equivalent to half of the perceived loudness.

The usual rule of thumb is that it takes a reduction of 10dB (1/10th energy) for a thing to sound about half as loud, or an increase of 10dB (10x energy) for a thing to sound about twice as loud.

(This leads to all kinds of interesting problems with making things quieter or louder. It seems superficially implicit that moving from a 100-Watt amplifier to a 1,000-Watt amplifier would be strikingly-dramatic difference, but in an ideal world where everything else is the same then that change only makes things about twice as loud -- the same as moving from a 1-Watt amplifier to a 10-Watt amplifier.)
> “Disproportionately affecting people of color”

Are we arguing that these things are worse because they disproportionately affect one arbitrary grouping? Would it be better if it affected everyone equally? Would that make us happier? This is one of those contexts where “diversity” starts to get strange.
Radio Shack was a major retail channel for Sprint since the 90s. By the mid-00s, I would wager most of Radio Shack's gross profit came from wireless retail. They were already more or less Sprint stores with some overpriced PCs and stereos by then.
There's no content to balance it out with. Stepping outside of the popular opinion and getting immediately downvoted so nobody sees it, you might as well not have commented at all. Eventually all dissenters stop commenting.
historious indexes everything, whereas Pinboard (as far as I know) only indexes things you select. I haven't used Pinboard much, so I can't really say much.
I do appreciate that lightspeed is "about a billion feet per second" and it's also a number that's known exactly, since the foot is defined in terms of the speed of light in a vacuum.
People use down and upvotes based on what they like/dislike.

Thus, most top comments are jokes.

Anything informed but controversial will be buried down deep and can be only found by sorting for..controversial.
I‘m wondering how this (final?) barrier is supposed to be overcome: no matter how absolutely perfect the technology might one day become, how are we going to bridge the gap between “manufacturers cannot legally build a system that deliberately breaks the law” and “actual traffic in the real world only works if sometimes, drivers do not adhere to the law perfectly”?
> Hearing this line from OpenAI sounds like the death knell for the Open Web.

What does the phrase "open web" really mean? If I search for it the best answer is this: https://en.wikipedia.org/wiki/Web_standards - Reddit meets this as I can use reddit in a standards compliant web browser. Their auth and api's are theirs to do as they please including ignoring open auth and api standards.

To me the open web is similar to an OS - I can run proprietary programs which speak proprietary protocols along side open source programs and protocols. The platform is "open" - the applications might not be. Buyer beware.
I remember the FCC well enough to be very, very wary of a government-regulated internet. I'd personally rather see the internet become ungovernable - if everybody ran Freenet, Tor and I2P, there'd be nothing to censor, but too many people prefer the illusion of selective censorability for me to believe that will ever happen. What the government _can_ do without nationalizing the internet infrastructure is provide legal support for entities that want to do so in an open way by indemnifying them from "harm". I'd like to see section 230 not repealed, but made more explicit - "no forum can be held legally liable in any way for any content hosted, only the original poster".
The main reason for subsidy is that the costs are all upfront and electricity prices are unpredictable. That is not a problem that is unique to wind, particularly in the climate change era. Systems like strike prices can be competitively priced and avoid overpayment.

Arguably the main problem is that countries take a natural monopoly and then try and treat it like a market. When a well run state company could invest with more certainty.
I persevered with your website because I am very interested in the ideas, but I have to say it was very hard going. Thousands of words about abstract concepts could easily be reduced to a few hundred or spread across multiple pages. The only comprehensive list of services actually on offer is a PDF? The videos describing the merits of these decentralised services are accessed through image links to YouTube! There's lots of low hanging fruit to improve usability for those less patient than me in my humble opinion.
IEX runs with similar goals in mind to ban HFTs with special access and level the playing field.

https://en.wikipedia.org/wiki/IEX
Copy-on-Write on APFS
Very weird. They provide a very specific future date for this, and avoided using the term "open source". I can't recall any other company doing this. Most of the time, companies provide a github repository at the same time they make such announcements. Even for twitter, Elon Musk promised the algorithm would be opened, and then some time later it was just there. While generally it is a positive thing to see code being available, I wouldn't think too much into it until I can see the license and the code.
Certainly whipped my ass after hearing that intro again 20 years later.
Nobody seems to be talking about the fact that the AI behind self-driving is trained on real driver behavior...but real drivers are pretty terrible! The fact that your car hugs the right side of the road is because that's what real drivers do. And turning left?! OMG, how many times do you sit behind someone turning left at a traffic light, and they wait behind the white line for a break in traffic? This makes the turn as long and dangerous as possible. Sigh.
You don't seem self consistent in your beliefs. Not even an hour ago you commented on a thread that self-driving vehicles will not exist any time in the near future, and yet here you're proposing that "ai" is going to replace developers soon?

You believe that "ai" will be capable of the logical gymnastics that development requires, to replace developers, but that the same level of "ai" isn't anywhere near capable of taking in camera/sensor input and outputting proper accelerate/turn outputs in order to drive a vehicle?

In my mind the self-driving case is an easier, special case, subset of the task of general programming.
Because you're getting told straight away that they are monetizing your content, and not just any content but your opinions and thoughts.

"knowing" you are content, and being told straight away might lead to different reactions.
Are these medications temporary until you lose the desired weight, or is it something you have to stick with even after you are at your goal weight?
It depends on how large the input prompt (previous context) is. Also, if you can keep cache on GPU with a LRU mechanism, for certain workloads it's very efficient.

You can also design an API optimized for batch workloads (say the same core prompt with different data for instruct-style reasoning) - that can result in large savings in those scenarios.
The oldest surviving dugout canoe found could be as old as 10k years old. Certainly a number of ancient Egyptian boats have been found and dated to around the time of the pyramids. So dock piles could possibly have survived.

Of course there were no doubt a large number of boats and only a small number of temple docks.
Twitter's viral content farming started overnight when Musk started paying people for views. Prior to that, viral content usually felt pretty organic and decent.
I dunno man, maybe I'm just old but waiting "a few weeks" between announcement and free product offering doesn't feel at all like any historic rate of release elsewhere in tech, and certainly not DLC.

Elden Ring came out before GPT-4. The DLC for it comes out next month.

That's not quite the same feeling, at least to me.
A far bigger driver of speculation is scarcity. Without that scarcity, loans would do nothing to drive land value.

Tight zoning is the primary driver of real estate value, because it further increases the scarcity of land. It makes small homes worth absolutely insane values.

Further, though eliminating cheap loans will limit the amount that people can pay for the real estate, it also reduces the ability of people to pay, so every person is back to the same place with scarcity. So though eliminating loans may change the face value of the cost of housing, in real terms, eliminating loans does nothing for ordinary's people ability to obtain housing where they want it. Only increasing supply by removing overly restrictive zoning will actually improve the material conditions for people.

All that said, we should definitely eliminate financial products in the US like the 30 year fixed rate mortgage, a government creation that does inflate prices, while reducing the ability of people to move. But we should get rid of it primarily because it reduces the ability of people to move by trapping them into the home they were in when mortgage rates were low.
The world is always filled with people trying to learn how to impose some amount of order upon their disorderly lives. People look up to him, or discovered him through his blog when he was actively writing it (including yours truly) and either learned something from it or didn’t. At the very least, Marc Andreeson wasn’t just some random dude in 2007 that made a habit of posting Lifehacker-esque blog entries and if he had posted a guide to rebuilding a small-block Chevy 350 I would have skipped over it that day in NetNewsWire.
>GPT-4o interprets “how thick is the tape” as referring to the cross-section of the tape roll, rather than the thickness of a piece of tape.

As someone that has tapes of varied "thickness", I was also confused for several minutes. I would give GPT partial credit on this attempt. Also note the author has implied (is biased toward finding) a piece of tape thickness and not the thickness of the entire object/roll.

https://m.media-amazon.com/images/I/71q3WQNl3nL._SL1500_.jpg
I worked at Meta and saw the CapEx outlays, and I own META stock. They're buying and building shit without having a specific product that will use it. It's "build it and they will come" "logic" rather than starting by building something people love and need and are willing to pay for or can make money from indirectly.
Olivetti's design was a thing of beauty. The current company has nothing but the name. Even their logo was bastartised by the new owners.
Just want to put a shout out to OpenLayers and QGIS too!

QGIS is ESRI's open source competitor (and IMO much easier to use).

OpenLayers is like Leaflet but more powerful in some ways, especially when it comes to projections and transformations.
As defense in depth becomes more and more important, in-app TLS is becoming more, not less common. Especially as Zero Trust Network Access (ZTNA) is being mandated by the US federal government for contracts, the idea that you would terminate TLS at the edge and send unencrypted network traffic inside the server network is becoming a thing of the past.

This remains true even inside of a Kubernetes cluster. You shouldn't trust the network there any more than you should trust your enterprise network. I'm less sure about the implications of sending unencrypted traffic between a container and its sidecar, but certainly pods should be talking to each other over TLS.
And this is why there's so much interest in transpiling to Javascript. Rather than commit any time to understanding these often poorly designed semantics, automate that complexity away with a better designed language.
I didn't speak to profit. I spoke to energy return.
> Each stone weighed 25 tons.

There was a guy who rebuilt a section of Stonehenge using only techniques that could have been used thousands of years ago, and explained how it was possible to build it.

https://www.youtube.com/watch?v=-K7q20VzwVs
You can use ONXX versions of embedding models. Those run faster on CPU.

Also, don’t discount plain old BM25 and fastText. For many queries, keyword or bag-of-words based search works just as well as fancy 1536 dim vectors.

You can also do things like tokenize your text using the tokenizer that GPT-4 uses (via tiktoken for instance) and then index those tokens instead of words in BM25.
When even the real faculties of science have become financially driven and corrupted you know that soft 'science' like psychology is even worse.
s/interesting/sad/

My life got better when I switched from worrying if I was acting in a nonconformist way to worrying that I might be perceived as a conformist.
"Wind can't be the entire solution" is such a different statement than whatever this misinformed smug dismissal is trying to get at.
I don't find it surprising and it fits my experience with millennial, and younger, Anglo sphere women. If you bring topics like "race" or gender, you had better stay within heavily policed boundaries.

I don't even disagree with the goals of these people, but I think there is such ridged ideological conformity, that the quality of the thinking suffers. In other words, I am very skeptical of the solutions that they propose because I don't think they have the freedom to really consider these problems from every angle.
But that was the case in the first place for any of those companies.
And yet even with all that infrastructure, the market has coalesced around 3-5 shipping companies for vast majority of consumer shipments.
I think there’s a pretty substantial difference between textfiles.com archiving bbs’S if the 80s and generative AI models sucking down creative works with a key objective of becoming a marketing and internet destroying low quality content farm evilcorp.
300 lines of this code is a bit different than 300 lines of typical code where you read files, set up a backend/frontend, or parse data. In the latter case, there are a lot of tedious operations. Sure, the former also has that with reshaping and asserts or wtv.

But in a sense, the 300 lines of Llama code are essentially just lines of math. And reading through any math proof will show you that any particular line can hide large amounts of complexity.

This can be true with code with more tedious operations, but those lines are a smaller fraction of the overall code base by definition.

Even the "tedious" parts of the llama code can hide large complexity. Setting a learning rate with a schedule might require reading a paper or two for your particular architecture.

But yes, once you parse all the math and the theory, the lines are kinda simple matmul and forward lol.
So don't update it. It's not a subscription
Note that they don't actually say "open source" anywhere.
At first I thought maybe this was showing that I'm way less good at JS than I thought I was. But after thinking about it some more, I'm still fine at JS. All my sites work just fine. My clients are seemingly happy with them and I get paid for it. Instead, I'm just not good at the weird edge cases that nobody actually ever hits, which is what all these questions are!

(that being said, I do roll my eyes every time I have to clear out an array by doing myarray.length = 0 instead of myarray = []. JS is such a silly language sometimes.)
Scotland is microscopic in relation to the landmass and population that is the US. Yet... look at the sheer volume of wind turbines Scotland has to operate to get anywhere between 10% - 80% of their power generation, depending on the day and wind conditions.

You cannot build a reliable grid based on wind. It requires other non-temperamental energy sources to be available when the wind isn't blowing. Solar? What if it's an overcast day?

If you look at that chart - you'll notice Nuclear takes over the heavy lifting when necessary. So... why not just have a couple more nuclear plants and forgo the unreliable sources?

Using wind and/or solar does not automagically make your system better or more green. People have pigeon-holed themselves into a reality where only wind and solar are acceptable... and then we hide away the actual sources that provide the necessary backfill.
I'm genuinely surprised you find that counterintuitive - that would have been my exact guess.
Doing "Betas" with other non consenting humans on the road still seems pretty wild to me.
I wonder if they're less successful in finding an advisor or related to publishing efforts. Not sure if the paper accounts for survivorship bias.
Google, Alphabet needs to fund Mozilla because there are no other internet browsers available suitable for today's Internet standards. Microsoft gave up, Opera gave up and Webkit is the only other and that's now iDevice exclusive.

If they didn't they'd be vulnerable to an very large anti-trust lawsuit.