skysight-inc/HackerNews huggingface dataset:
This is exactly the reason OpenAI isn't afraid of the open-source community, like many kneejerk opponents of regulatory capture assume (they are probably still afraid of Google). Also why they still do the expensive and cumbersome RLHF training, instead of those deceptively cheap and fast finetunes. They understand their own tech and why there isn't free lunch.

Recently, John Schulman explained the issue with behavior cloning and it's a very typical ML problem.[1] Basically: what are we training the model to do? The model updates after finetuning in a holistic manner, based on the sum total of its content and capability. Suppose GPT-4 can correctly answer to many requests because it knows correct answers, in the sense that it has something isomorphic to an internal knowledge graph and tools for querying it, and that graph contains sufficient data for its tools to derive an answer at inference. RLHF reinforces this behavior by constraining the distribution of outputs (essentially, steering the model away from applying inappropriate tools for respective inputs, e.g. employing fantasy-narrative or bad-yahoo-answers cognitive routines when asked something that looks like a straightforward factual question).

Now suppose you teach LLaMA-13B to imitate those responses by SFTing it on a dump of successful GPT-4 conversations. But LLaMA doesn't have internals that would have enabled it to find the same answers; so on the object level it shallowly memorizes specific items of the post-training dataset, and on the meta-level it learns the stylistic flourish of a high-powered model. But it starts to hallucinate confident nonsense whenever you step out of the training distribution, because it doesn't actually learn to query its own knowledge graph. A little anthropomorphism won't hurt: you create an incapable impostor this way, a wannabe nerd, a character who is used to guessing the teacher's password and being praised, instead of understanding the subject, and keeps raising its hand whenever a question is asked, but is painfully clueless.

Indeed, the early and cheap success of behavior cloning was a massive red flag unto itself. There's no way all the compute and data that went into training GPT-3/3.5/4 tier models can be substituted with gently demonstrating the attitude vector. If we had models that were markedly less capable but comparably honest, we would have reasons for hope that this line terminates in a genuine open-source peer competitor; instead, we have total fraud.

It is a nontrivial task to have a model generalize epistemic honesty and not a lower-order behavior like clamping up and kowtowing or bullshitting from external examples; train it to say "I don't know" whenever it actually does not, but only then.

There are clever approaches here, but they're not such a low-hanging fruit as what passes for open-source right now.

1. https://youtu.be/hhiLw5Q_UFg?t=685
> China is of course also the biggest holder of US dollar.

Not any more, Japan is. China has been reducing it's dollar holdings at breakneck speed once it saw the US freeze dollars held by Russia.

https://www.ceicdata.com/en/china/holdings-of-us-treasury-se...

https://ticdata.treasury.gov/Publish/mfh.txt
Just set new tab to blank page. Thats where they live anyhow right? I haven't seen any of these ads people complain about and I suspect its because of my new tab setting.
the code here is hyperscript, not htmx:

https://hyperscript.org

i use hyperscript because I created it and like it, but the example could just as easily use JavaScript, the point is to show that htmx respects custom validations
Honestly, at this stage, if it doesn't align directly with increasing the baseline on the short term, it's hard to see any sort of pledge from large companies as anything more than PR. Amazon backed out, but they could very well have done like the others and buy bullshit carbon offset credits - I guess the math on their tax deductions didn't work.

Assuming that we think within system, till incentives like punitive taxation are devised to force the hand of big corporations on that topic, nothing will change. But that won't happen because of lobbies and yaddi-yadda. And even if, I doubt if they wouldn't find ways around it.

So, yeah.
This is kind of a shallow take. Building for sustainability makes a nation STRONGER in the face of declining resources. It's investing in the future.
The "Google has no moat" thing claimed that Vicuna-13B was almost as good as ChatGPT and this paper seemingly refutes that.
Just look at Wordpress for the demand for shoehorning things into something because it seems easier on the surface and accessible without learning harder programming stuff, or at least investing in the initial overhead.

There will always be demand. It's likely very practical for certain usecases but that won't stop people from abusing it in full SaaS web apps before some CTO joins and has to abandon it all when requirements evolve. Although I've seen some highly capable apps built on top of jquery plugins like Select2, which were extended well beyond their initial intent. Things that work is all that matters at the end of the day when it comes to making $$$.
The world trembled at the sound of our rockets. Now they will tremble again at the sound of our silence.
How do you do validation with custom error messages without it? It seems pretty table stakes for forms to me.

Where are the docs that make it easy to avoid hyperscript, if it's usable without hyperscript? This has hyperscript sprinkled in: https://htmx.org/docs/
If it helps, I've been using LibreWolf as a secondary browser for a while and haven't noticed issues:

https://librewolf.net
Not that I've been able to find. Brave would be the obvious candidate to implement this, but the impression I get is that they're not all that interested.
Title: "Shell Shareholders Vote to Let the World Burn"

What actually happened: Shell shareholders rejected resolution 26, which according to the linked CNBC article "calls on the company to align its climate targets with the landmark Paris Agreement and commit to absolute carbon emissions cuts by 2030"

The wikipedia article on the paris agreement says "emissions need to be cut by roughly 50% by 2030". Without arguing over whether rejecting that means "let the world burn", doesn't that target seem unrealistic? Is anyone anywhere close to hitting that target? The only thing I can think of is companies with fat margins (eg. google) that don't emit much relative to their profit, and can pay for carbon offsets to be "net zero". It's not realistic for anyone else or the economy as a whole. It's easy to lambast shell shareholders for not adopting the resolution and "letting the world burn", but if everyone else is doing the same, can you really blame them for not wanting to torpedo their company?
Could you explain what other choices were red flags for you? I’m somewhat familiar with the open source LLMs space but not enough to know why some choices are better than others.
I mean yes, that's just judicial precedent
On the flipside, it's easy to change the version of any package to any git rev and automatically rebuild any downstream dependency.
I always felt this way about my “Terminator 2: The Ultimate Edition” DVD. Then they came out with another one? False advertising!
Scott Galloway: Gen Z should never work from home if they want success–or love
Do a Google search and count how far down the list you need to get before it isn’t used as a biblical reference.
You using 3.5 or 4?
It's kind of strange that one of the major professions in our society is one where you pretend to be insane!
Unfortunately about:config isn't reliably browsable in that way. Many of them do nothing, for example.
yeah this is insane thinking haha
> nobody at this point expects a 13B parameter model to succeed with the same accuracy at the broad range of tasks supported by what may be a 1T parameter model

I think a lot of people believe exactly that. To take one example from the "We Have No Moat" essay:

"It doesn’t take long before the cumulative effect of all of these fine-tunings overcomes starting off at a size disadvantage. Indeed, in terms of engineer-hours, the pace of improvement from these models vastly outstrips what we can do with our largest variants, and the best are already largely indistinguishable from ChatGPT." - https://www.semianalysis.com/p/google-we-have-no-moat-and-ne...
The Supreme Court's job is not to legislate.
It's too bad that Microsoft as an organization doesn't care about good design. I don't look at Satya Nadella and think of a man who has taste. And Microsoft doesn't have a Chief Design Officer, as far as I know.

Instead, Microsoft has VPs. So there's no one person at the helm saying, "This is the vision and where we're heading."

As a result, I suspect there are actual good designers at Microsoft trying to start movements from within, and those have bubbled up to what we see today as the progression of Microsoft's design through Fluent from Metro and prior.

But because there's no one at the helm, these efforts will always be isolated.

There will never be anyone saying, "Let's carry these efforts across products and down to the UI." "Let's deprecate and discontinue all of these fragmented UI frameworks. Moving forward, Microsoft will only create UI using Fluent UI."

Worse yet, even if someone tried, Microsoft has tried and failed again and again and again so why would you bother? It's clear Microsoft's UIs are shifting sand compared to Apple's platforms or even Linux desktops!
Could we reach a point in a decade where it's so cheap in new construction to build parking lots where every spot has a charger?

Stores could encourage visitors vs online shopping by making the charge free after checkout.
Mozilla. They must have some really great and well meaning employees. Otherwise a good product like Firefox (or Thunderbird) would never come out of such a garbage company. Imagine if they were actually a good company with a tech focus.
Where did anyone say "not recommended in prod"? The experimental tag is mostly saying they may change the API when they upgrade Nix itself.

Also, "in prod" is such an odd thing to say about Nix. It's a built-time thing. Nix doesn't run in prod. Even NixOS isn't running Nix code. It's running systemd units.
it's a separate project, hyperscript:

https://hyperscript.org

it's based on HyperTalk, the scripting language of HyperCard:

https://hypercard.org/

with some Web-specific syntax thrown in to make things cleaner:

add .visible to <section.fade-in/>
Bah, we need CCS solidarity to improve that network for everyone, not EV makers defecting to the Tesla connector.

Also the "North American Charging Standard" is revisionist doublespeak.
It would have been nice if I had seen this article before refactoring a Java project into a C project, where learning memory allocation rules in order to use C was a painful process for me :(
To pile on the examples, I had a Comcast connection in SF that was 1gbit down, 5mbit up during covid (based on regular speed tests and what little I could glean from the plans without being the account holder). With 6 people in the house juggling video calls there was definitely some audio only days when schedules clashed.
For this case, Django apps usually pick services like Sentry, and it is the app's responsibility to integrate with them anyway, so there is nothing we need to offer.

Although the idea around some built-in analytics is still on my mind.
But it can easily become a huge pain for high-load projects, so I am not rushing this feature.
I got a haircut last month and my barber already used it and wasn't too impressed
This has strong Poe's law vibes. If you're serious: pretend I sent you an eye-roll emoji.
The general culture has gotten a lot more polarized. I'm not sure there even is a singular Overton window any more; the set of things you can acceptably say to either political tribe is narrow and they've pulled apart so far that there's no overlap in the centre.
The first link of Wulf Hein playing the Star-Spangled Banner on a 30,000 year old flute is incredible. To think that someone noodling on a flute could have produced that melody before dogs were domesticated is fascinating.
The world works on APIs and this unlocks LLMs to interact with the rest of the world. Great work.
As a non-EV owner, how much do charging stations cost typically? What's the price of a "fill up"?
I've used htmx to write some relatively simple internal tools, and it's been really useful for that. I know a little javascript, but my web skills are really outdated - I acquired them back when you rendered HTML on the server and maybe added a little interactivity with jquery. With that background, using htmx to swap out elements (rendered server-side with Jinja templates in flask) has been a lot more productive for me than trying to overcome my unfamiliarity with modern JS. The modular structure of Jinja templates actually works really well the htmx paradigm IMO.
Limited budget or machine resources, how to achieve a decent LLM experience?
GPT3.5 answer:
If you have limited budget or machine resources, there are several ways to obtain a good large-scale model experience:

1. Pretrained Models: You can use pre-trained models that have already been trained on large datasets. These models are available for free and can be fine-tuned on your specific task with limited computational resources.

2. Transfer Learning: Transfer learning can be used to leverage the knowledge of pre-trained models for your specific task. You can use a pre-trained model as a starting point and fine-tune it on your data to obtain good results.

3. Data Augmentation: Data augmentation techniques can be used to increase the size of your training data. This can help in improving the performance of your model without requiring additional computational resources.

4. Model Compression: Model compression techniques can be used to reduce the size of your model without losing much accuracy. This can help in improving the efficiency of your model and reducing computational resources.

5. Cloud Computing: Cloud computing services like AWS, Google Cloud, and Microsoft Azure provide access to high-performance computing resources at affordable prices. You can use these services to train your models on large datasets with limited computational resources.

Overall, with careful planning and thoughtful use of available resources, it is possible to obtain a good large-scale model experience even with limited budget or machine resources.
Not to mention the whole "video game" thing that people really like
Hope this link posted further down the thread does qualify though.

https://www.euroncap.com/en/results/tesla/model+y/46618
And it didn't ask for your phone number?

Maybe it's location specific then or something...
Ukrainians claim to have destroyed large Russian warship in Berdiansk
The docs don't seem to suggest using it for non-trivial things without hyperscript. https://htmx.org/docs/

They do suggest being able to use it without learning a lot of hyperscript, but I see the same with Svelte, where you can get by on copying and pasting a great deal. https://learn.svelte.dev/
My new tab is a blank page. This promo today popped up over an open webpage while I was working on another monitor.
archive link: https://archive.is/ojMSm

There is some truth to this but it depends on the situation. If you're single and trying to build a career it may help to not work from home. I saw this clip today and it's somewhat related: https://www.instagram.com/p/CsrDuE9vmHw/
I think in terms of privacy, you are worse off giving them a used Google account than a phone number. By using Google for this, you let Google know what you are logging in to OpenAI.

More generally I'm just getting tired of corps requiring phone numbers. If only there is something like SimpleLogin but for phone numbers (generating single purpose numbers for each source) to prevent phone number collection and spam.
My goodness. That raises questions. I hope you are merely naive.

"I don't hate them! I just think they got a bit worked up over a few arrests. They're too sensitive. I don't blame them for it, but when you deal with them you've got to remember they can be prone to distorting the truth."

Come _on_
i really have no idea why this is happening and am kinda nervous...
Yes and to be eligible for that they needed to support at least 2 automakers. This gets them there without having to retrofit stations with ccs
What I find rather amusing is they spend the whole paper dismissing it as ineffective yet still feel the need to worry about the 'ethics' and 'legality'. They don't cite anything with regards to a discussion/evidence of either, of course, and looking at the authorship list I don't believe any of them are lawyers or ethics experts.
In my experience, most 'centrists' just turn out to be people on the center-right who don't want the public embarrassment in their nominally liberal social circles of admitting they're on the center-right.
I'm not sure that this is any better for information density. The buttons are weird, the modal takes up extra space.
Shouldn’t be dating coworkers. Plenty of time to meet people outside of work at the gym or during hobbies.

I do think that wfh is helpful for mid to later career folks. Or at least self starters.
This is exactly what I use it for. It keeps me working mostly in python, flask, and jinja, which I know a lot better than js. For just doing some background requests and element swapping, it’s absolutely more efficient for me.
I'm very pessimistic; MS tried this back in 2012 with Windows 8. Everything from Windows to SharePoint to Office and Visual Studio tried to adopt the whole Metro design stuff, but they ended up creating many inconsistencies. They made some minor changes when they refreshed it again with Windows 10 in 2015 and from then until 2022 (Windows 11), they had settled on Windows 10's design language, but now this attempt to refresh will just introduce more inconsistencies.

Microsoft has even more user-facing products in 2023 than they did in 2012, so it's probably going to be even worse.
TIL that the Slow Food movement originated in Italy.

https://en.wikipedia.org/wiki/Slow_Food
htmx is yet another one of those forty hundred humongous different frameworks.

It also uses a DSL that has no application outside of its specific corner.

It also forces you to return HTML fragments via AJAX.

By the way I did use intercooler.js (prev. iteration of htmx) intensively and while I liked it at first, it really added up to being an HTML/JS soup when other developers started extending.
In a global system like the one we have, is there really only one game to play in order to succeed?
I think that what you said about the causes of difference is true, but that doesn't mean the party affiliation of urban vs rural voters is incidental.

The parties, to the degree they do differ, do position themselves on opposite sides of the urban vs rural divide.

https://engaging-data.com/election-population-density/
If by intelligent you mean capable of subject experience, there is nothing in known physics that even vaguely suggests that it could lead to subjective experience.

Simply responding to events in meaningful ways is something entirely different. There doesn't seem to be any limit to that beyond what is practical.
Many of the things you mentioned seem to be present under the "Design Language" menu.
If you have put the answer into the program then by definition you had the test available to you when you finalised the program, which means it is definitionally not a novel test.
You don’t need to cancel it. Most electromagnetic surveillance systems have detection thresholds (e.g. in radar you have distance gate and return signal filters). Same applies for magnetically activated mines. Reducing the signature below detection thresholds is often enough. Alternatively masking the signature with another signal to confuse the detector also often works well.

EDIT: on second thought, if you can build a device to generate 20T you can probably build a contraption to cancel it out as well. It would most likely boil down to the economics or the scale of the contraption required.
Like a torrent of the last GoT season then?

… with compression.
"80 percent" but I think it means the vote was 80% of shares voting to let the world burn.

Not clear if that means 80% of votes or 80% of all shares (of which I'd expect a much smaller turnout than 80%).

Regardless, we don't know what percent of shareholders that is. There could be 10 people who own 80% of shares, all of whom, unsurprisingly voted to maximize shareholder value, consequences be damned. That could be <1% of shareholders.
Fix rejected: does not involve accessing Hacker News.
This is the first time I've been excited to learn about a new web technology in a while. I'm going to have to play around with this to see how I want to use it. I wonder what other little things like this could be used to simplify webdev?
And what do you know, I guess JP Morgan beat me to market with the idea:

https://www.cnbc.com/2023/05/25/jpmorgan-develops-ai-investm...
I rarely have to use Superchargers because I have charging at home. But when I do, it's about $25 for an 80% top up (e.g. going from 10% -> 90%) in my Model Y.

Just looked it up: $0.45/kWh the last 4 times at Tesla Superchargers in California.
Tech population grew faster than the infrastructure in the wider Seattle area. Especially after the return-to-office mandates from the companies, traffic is at LA levels. 1-2 hour 1-way commutes are common.
Feels like more liberal arts than MBA.
Sounds like the perfect legacy for Elon Musk to have once he goes for broke and his other ventures are forgotten. The Supercharger guy.
About 50 cents per kWh at something like a supercharger. Most EVs get around 3 miles per kWh. So 300 miles of charging is about 100 kWh or $50.
> Nations have started legislating laws against falsehoods after all.

Which nations? How? Who determines what is a "falsehood"? A failed prediction is not the same thing as a lie. It might be disappointing if a company predicts they will be able to deliver a feature and it turns out that they can't, but that doesn't necessarily mean they were lying when they said they were going to.

Yes it would be nice if the world were perfectly controllable and predictable and everything that went wrong was a result of bad people deliberately deceiving you, but that's not reality.

All such laws would accomplish is to ensure that nobody ever makes a definitive statement about anything, ever again. Couch everything in weasel words to ensure that there is sufficiently vagueness to combat an accusations of "lying" and you're good to go.

> Customers boycotting Chevron doesn't stop them from buying judges and violating the environments of various nations such as Ecuador.

Because customers en masse largely don't know or care about the environment in Ecuador and no significant percentage of them are going to engage in any such boycott. The end-users filling up their cars at gas station are also not "customers" in any meaningful sense for Chevron, who is selling petroleum products wholesale in an entirely different market.

Meanwhile, customers finding that Sears is no longer a good place to buy the things they need and shopping for appliances at Home Depot and Lowe's absolutely did have an effect on Sears and let them know that they were failing to meet the needs of their customers.
Hence most CI services are stupid
For one example, Electrify America is $4/month + $0.36/kWh. (You can pay the $4 and immediately cancel, before a road trip.)

Assuming 4 miles/kWh, that's $36 to drive 400 miles. Charging at home cuts the cost roughly in half. These numbers vary depending on location.
The filler text on some of the examples (e.g. https://htmx.org/examples/tabs-hyperscript/) seems to be generated by Hipster Ipsum https://hipsum.co/. Cute.

I kinda like the aesthetic. It feels a bit like what HTML might have looked like if XHR had been baked in.
I think the creators of all the scraped training data would like to talk about intellectual property too