skysight-inc/HackerNews huggingface dataset:
As does git grep!
I would absolutely love for European countries to pay the true cost of their defense so I can drive on nice roads and children could be taught by people who make a decent wage.

Probably not going to happen anytime soon by the looks of things.
> There's also an entire section narrating how google execs passed on transformers and didn't pick up until OpenAI released GPT.

Google certainly seem to have fumbled on rapidly exploiting the tech, but I'm not sure that's totally fair.

Google built BERT in 2018, around the same time as OpenAI built GPT-1, but neither were released.

OpenAI's GPT-2 was built in february 2019 but OpenAI were hesitant to release it due to potential danger, only doing so later in november 2019. GPT-3 followed in july 2020, but ChatGPT which the first accessible to public view of the tech didn't appear until november 2022 (how time flies!).

Google's first transformer-based chatbot, LaMDA, was released in may 2021, well over a year before ChatGPT, but was then rapidly withdrawn due to negative feedback and behavior.

The difference between ChatGPT's acceptable behavior, and success, compared to LaMBDA, was OpenAI's invention of RLHF to better control it. One could argue that Google should have invented something similar themselves earlier, but surely this might have been expected to come from these same people who had been working on language models at Google ...
AI is in the eye of the beholder.
The new CEO banned buybacks.

I never understood the anti-dividend and anti-buyback mindset.

I've given quite a bit of money to partially own a business (and I don't mean publicly traded shares, but literally buy a portion of a business). I have an agreement with the operator that I'll get N% of proceeds (as long as the business can handle that percentage). Are you saying that I, as an owner, am not entitled to it? That's rather ridiculous.

Imagine a friend coming to you who says "Hey, I need $50K capital to start a business. Let's be partners - you provide the capital, and I'll do the operations. Oh, and I'll give you whatever money I want, whenever I want. Perhaps none at all. It'll be entirely up to me."

Would you take that deal? Because that's how shares work.

Shareholders, on paper, are partial owners. Yet they do not even have an agreement like I do. The company can decide not to share any money at all with shareholders. IMO, all companies that sell shares to the public should be required by law to give a representative amount of money to these owners.

BTW, my N above is significantly higher than the percentage almost any company pays back in dividends. Intel used to give about 4.5% return via dividends, and that was triple the industry average. They've since reduced it to 1.5% to be in line with the industry.
Is there support to open-source models?
btw love your work!!
Anytime someone proposes something like this - what would you expect would have happened if this was the case when Trump was president and we had COVID?

Would the outcome have been better, or worse?
I believe the vulnerable (the non-infosec-experts) are not few but majority. It’s a spectrum, and I’m definitely on it. For example, I don’t know anything about the S-mode.
> This brings me to the third point: what the EU is doing wrong. While the US tends to _buy the product_ of the new industry they want to create, the EU _funds the research_.

The US also has a lot of "fund the research" style programs: anything with a costs-plus contract. SLS is the current example in rocketry, but most past NASA programs were costs+. The commercial fixed-price contracts are a newer and more successful development, at least for things where new science isn't needed and only engineering development is required.
I don't know the answer to this, either, of course. :) I have a strong suspicion that LLMs are not, in and of themselves, the way AGI will be achieved. They may be a component of it, but I suspect there is a fundamental difference between "based on knowledge and context, I am confident this is a correct answer to your question" and "based on statistical and lexical analysis, I am confident this is what a correct answer to your question might look like," and I don't think LLM-only technology isn't capable of making the jump from the latter to the former.

So is just getting better and better at the latter enough? In some contexts, probably -- but somewhat ironically, I don't think those are the contexts that we keep pushing AI into. It's pretty good with problem spaces for which "correctness" isn't a terribly important metric. For instance, I just prompted ChatGPT 3.5-turbo to come up with a synopsis of a 1920s private detective story, with a few provided details, using the seven-point story structure, and I was surprised at how well it did. It came up with something really derivative, sure (to the point where it named its protagonist "Jack Malone," which sounds suitably detective-ish because Jack Malone turns out to be the main character of the long-running detective show "Without a Trace"), but definitely a passing grade!

But time and time and time again we see examples of AI failing at areas where correctness is important -- "hallucinations" -- and I think that's where my distinction in the first paragraph becomes more than just mere semantics. LLMs do not actually have knowledge and context, but instead just generate something that looks correct. Sometimes it actually is correct! (I could ask ChatGPT to summarize the seven-point story structure and it aced it, for instance.) But sometimes it isn't, and the LLM literally cannot distinguish between correct and incorrect responses. I ran into this at my last job, where…hmm. To be a bit elliptical about it to avoid breaking an NDA I suspect I'm still under, we were trying to train an LLM to call a JSON-based API by analyzing the user's query and filling in the correct API parameters. It did an amazing job most of the time, but the remit was "if the user doesn't specify a required parameter, prompt them for it," and there was no way to get the LLM to do that consistently. Sometimes it would, but sometimes it would just make up what it thought was a plausible value and plunge ahead. "Works nine times out of ten" may or may not be an acceptable success rate, but "one time out of ten makes up shit and sees what happens" is not an acceptable failure mode.

And this is where Chiang's thermostat analogy comes into play for me, I think: I simply don't see how you get from "looks correct" to "verifiably correct" by adding more and better thermostats. You're going to get responses that sound better, and you're going to get them faster, but you're still not going to be able to know whether they're bullshit without running them by a fact-checker.
Yes,ofc. We support all LLMs supported by Langchain.
https://docs.ragas.io/en/stable/howtos/customisations/bring-...
I agree that the premise of software reuse with humans is not realistic. However my point being that an LLM trained on the entirety of available code could realistically mix and match features across different pieces of software and build something cohesive
>> somehow paradoxically never getting closer

"Objects in mirror may be closer than they appear"
> IMHO, it's better we're left with the few successful media houses (WSJ, Reuters, AP, Bloomberg, etc.) carrying the industry on its backs

Where do these fit in:

mainstream media outlets

ABC (Disney)

MSNBC / NBC (Comcast)

FOX / FOX News / CBS news (Paramount)

CNN (Warner Bros. Discovery)
Maybe they remember the situation with Apollo 13 where they had no way to right down the procedures other than by hand and using space pages from the existing printed documents. You then had the issue where the guys were so fatigued and CO2 levels getting to a point of making vision blurry. I could see where that might have factored into the decision of wanting to avoid all of that with the ability of printing new/modified procedures.
Can't all expenses be deducted when filing taxes? I mean, taxes are paid on profit, which is revenue minus expenses.
reminder that btrfs stands for butter filesystem and not better filesystem
And the state will use it to disseminate awesome propaganda, e.g., Russia Today and China Global Television Network.
ATT.
LitterCam – Litter prevention with artificial intelligence
> public subsidies to smaller news outlets, and eventually industry transformation into a publicly funded system

Ah yes, state run media, Pravda and Isvestia! Always the same result, state-approved propaganda.
IANAB (Not A Botanist) ...but isn't this the expected outcome? Cyclones have probably been a thing for epochs, so any species that couldn't recover well would have been Darwin's reject ages ago?
A great write up.

The elephant in the room, of course, is "where did Sora's dataset come from?"
And when I code in C, there's typically at least one library with inline assembly even though my C doesn't use any inline assembly.

There is indeed a difference here between the vast majority taking part in risky behavior and library authors using focused performance improvements. There are a lot more eyes on the library code due to downstream effects than in everyday top-level code.
Who exactly is projecting 6% returns? Vanguard is projecting 10 year returns of 5.2% U.S. returns before inflation and 8.1% international stocks before inflation. At 2% inflation that's 4.56% real returns if you assume 2% inflation and went 50/ 50 on U.S. and international stock. (Non inflation adjusted returns tell you nothing about readiness for retirement so should be avoided).

And that's at 100% stock, which isn't recommended before retirement.
V r 5 (Exhibition of shadows in Unity game engine)
Weren't transistors specifically invented to improve telephone networks?
Love that little “additional” feature of closing the tab too.
Cable news should be better classified under "entertainment".
What they meant was that the R&D was fully deductible, not amortized over a number of years. It's like saying that a business's electricity bill is "tax-free" because they can deduct it from their revenues immediately.

And as it is, Google certainly paid property taxes immediately on the office building as well as FICA on all of the employees who, of course, paid their own taxes.

But haters of the R&D system love to call it "tax-free".
Find your ring size: a tool that measures rings and objects
That depends on the comp structure.

Usually comp structures look at multiple metrics that owners want to see. Owners prefer stock price to dividends, so they reward it more.
The experience of going car-free in a place designed around cars doesn't tell you much about what it would be like to live in a car-free city.
I said a few things, as you quoted from my comment:

>and of course dropping two atom bombs and killing a couple hundred civilians in one of the worst atrocities of the worst war in history just to show who's boss.

Is the book saying that:

a) two atom bombs were not dropped,

b) that they didn't kill a couple hundred civilians,

c) that it wasn't one of the worst atrocities in WWII,

d) that WWII was not one of the worst wars in history, or

e) that it didn't show how's boss?

or all of the above? To be honest I can't see any of the points above discussed in the summary of the book on Amazon. Explain?
Yes, and those cities also presumably don't have the problem of segregated neighbourhoods. (also those cities don't tend to occur in my Old Country, but perhaps they've made progress there since I've been gone? Protip: never attempt to live in a "city" which is younger than you are. Survivre plutôt que vivre)

All I was claiming is that the elevator is necessary but not sufficient: monocultural neighbourhoods were much less likely to arise back when number of flights of stairs put a significant natural gradient on the price point of each buildable unit.
Build searchable collection of local campaign finance reports with DocumentCloud
I think most people in the US rightfully have a total disdain for the media. The vast majority of articles are clickbait, propaganda or are outright wrong. Many big organizations (Hearst) have outsourced the majority of local reporting to the third world countries where they can pay pennies on the dollar.
Thank you. Yes. We support almost all opensource models. You can customise it easily by referring to
https://docs.ragas.io/en/stable/howtos/customisations/bring-...
I am thinking reinforcement on top of Blender would be straight forward with unlimited synthetic data potential. I’ve come across people incorporating SD into rendering workflow so tools are all there.
Or perhaps 'the patient is creating symptoms using their mind' eh?

The symptoms exist, they are originating due to thoughts/beliefs in the mind.
The top comment on this thread (https://www.quora.com/Could-a-human-being-survive-on-the-die...) matches what I've learned about this elsewhere. Just that "chewing for six hours a day" part is a problem..

As for gorillas - that's mostly leaves, shoots and stems. All very hard to digest, a human wouldn't get much nutrients out of that.
Tengyu Ma on Voyage AI – Weaviate Podcast #91
*Voyage AI* is the newest giant in the embedding, reranking, and search model game!

I am SUPER excited to publish our latest Weaviate podcast with Tengyu Ma, Co-Founder of Voyage AI and Assistant Professor at Stanford University!

We began the podcast with a deep dive into everything embedding model training and contrastive learning theory. Tengyu delivered a *masterclass* in everything from scaling laws to multi-vector representations, neural architectures, representation collapse, data augmentation, semantic similarity, and more! I am beyond impressed with Tengyu's extensive knowledge and explanations of all these topics.

The next chapter dives into a case study Voyage AI did *fine-tuning an embedding model for the LangChain documentation.* This is an absolutely fascinating example of the role of continual fine-tuning with very new concepts (for example, very few people were talking about chaining together LLM calls 2 years ago), as well as the data efficiency advances in fine-tuning.

We concluded by discussing ML systems challenges in serving an embeddings API. Particularly the challenge of detecting if a request is for batch or query inference and the optimizations that go into either say ~100ms latency for a query embedding or maximizing throughput for batch embeddings.

I hope you find the podcast interesting, more than happy to discuss any of these topics with you or answer any questions about the content in the podcast! Thank you so much!

YouTube: https://www.youtube.com/watch?v=xPdyivfheqI

Spotify: https://spotifyanchor-web.app.link/e/u6XPLYfF7Hb
timeline should have had the last article at 2023, not 2024.
> I do wonder though what's the highest number of different regex syntaxes I've ever encountered (perhaps written?) within a single line: bash, grep and sed are never not in a "hold my beer" mood!

Your comment is missing a trigger warning, lol. But seriously, this is one of my flags for "this should probably be a script, or an awk or perl one-liner."
I have no idea what the fascination with this is, and what makes these batteries "homemade".. also, it's spotwelding and not soldering.

Buying battery cells and spot welding them together is a thing that many companies do, even in the "western world", i know of at least three in my small eu country.

Before lithium, they did the same with NiMh and NiCd batteries.

You can also make them yourself at home, although it can get relatively dangerous if you don't know what you're doing... same as with replacing an outlet at home, but more of a fire damage instead of a shock risk, so definitely not for everyone, but with some basic precautions, can be done safely.

The bigger problem in the current times is, that device manufacturers fight hard against any kind of repair or DIY stuff, so sometimes just disconnecting the cells from the BMS (battery management system) makes it "reset" and fail the "authenticatioN" between the device and the BMS (which exists only to prevent repair). Companies know how to avoid that (via using a power supply to keep the board powered up), but attempting to DIY fix it (without knowing about the issue) makes you destroy the BMS.
In addition to what mustache_kimono said, there apparently seem to be issues with kernel functions moving / changing and breaking ZFS which then needs a while to catch up. For the latest reoccurrence of this, see https://github.com/openzfs/zfs/pull/15931 for Linux 6.8 compatibility.

There's also the fact that not everything is OOB compatible with ZFS. For example, newer versions of systemd have been able to use the TPM to unlock drives encrypted with LUKS. AFAIK it doesn't work with ZFS.

I use ZFS on my daily driver Linux box and mostly love it, but as long as these things happen, I can see why people may want to try to find an in-kernel solution. I personally use Arch so expect for bleeding edge updates to not work perfectly right away. But I recall seeing folks complaining about issues on Fedora, too, which I expect to be a bit more conservative than Arch.
I guess that line of thinking continues. Lots of companies don't run their own PostgreSQL, they let Google/Amazon/Microsoft manage it for them.
The US was stricter on its homegrown giants of the past, so I don't really buy into the idea that the US has to let big tech impose all of its dystopian ideals upon people to retain a lead over China.

The current approach may be benefiting the US economically, but it's also ticking up a time bomb in the form of an increasingly pissed off public.
Transformers are not limited to sequential data. They can process any form of data you can tokenize, as long as they have enough of it to learn the patterns and structures it contains.
Ah yes, the old libertarian cop-out. The most free market healthcare system in the world is too highly regulated and if we just take the regulations away it will perform better because ideology. This is despite the fact that if you look at healthcare systems in the world most performance metrics improve with more regulation but not less. But lets forget about being data-driven when ideological purity is at stake.
I just did a test with a Logitech BT mouse.

No game loaded in background (game mode off): 70 - 90hz.

A game loaded in background (game mode on): 120+ hz.

I wish there's a way to force BT polling rate to be in game mode.
>The bottom 10% in the US have a life index on par with or better than the top 10% in most European countries.

Not convinced.
Good point; please substitute the appropriate word for the service worker who doles out glasses of wine from behind a zinc counter. (or did zinc also postdate lifts?)
You still need the JVM to run Kotlin. Also performance.
> The force drawing the weight and the mass of the earth 'under' it together

There is no such force. Think of the accelerating rocket: there is no "force drawing the weight and the scale together". There is just the rocket pushing. The same is true standing on the Earth: there is just the ground pushing.

One of the reasons we need "spacetime curvature" in GR is to explain how the ground can be pushing things in different directions in different parts of the Earth, while all those things still remain stationary relative to the Earth's center and each other. But the whole point is that, even with all that factored in, there is still no "force drawing the weight and the Earth together". There is just the ground pushing up, plus spacetime geometry to account for the global configuration. That's it.
The previous millennium already called it “infotainment”.
Not even disagreeing with you, but it's a funny evolution of language when you consider the origin of the term battery.

https://en.wikipedia.org/wiki/Artillery_battery

We owe the term to Benjamin Franklin, who used it to describe what you're referring to as a pack (although Leyden jars are considered capacitors rather than batteries in modern terms).

https://en.wikipedia.org/wiki/Electric_battery#Invention
I think since Pat Gelsinger took over as the CEO, no stock buybacks were made.
Well, you can insist on looking at things through rose-tinted glasses or notpicking. But the facts I highlighted are inescapable...

And I won't even get into how ghastly areas around the Eiffel Tower (for instance) have become with crime, beggars, etc everywhere.
It's 2024; do we really have to point out the fact that publications take liberties with headlines? It's been that way forever.

Besides that, are you denying that transformers are the fundamental piece behind all the AI hype today? That's the point of the article. I think the fact that a mainstream publication is writing about the Transformers paper is awesome.
i’ll take my farmed salmon and you can eat what you want, including the bony and not very tasty feed fish if you so desire
The overarching point is to avoid new C++ code whenever possible. Carbon isn't intended to compete with or replace Rust. It's for more easily and seamlessly migrating away from C++ and its worst foot cannons.
The synthetic test data generation seems very useful. Do you have any idea of the cost of running this?
I'm always amazed how different people are. Living in a high density city made me miserable because there were constantly people around me. On the other hand I love semi-rural low density suburbs (What I can afford) and extreme rural even more. If I saw these policies enacted I would try hard to get out.
> Well, Google Glass probably failed either because it didn’t work sufficiently well (the technology just wasn’t there yet) or because the purported utility it provided wasn’t actually that desirable.

> AirPods probably succeeded because (despite the at-first weird aesthetic decisions) they turn out to be far more convenient than wired earphones and nice to use. If the battery life and the rate of charging, for example, had not been as good, I don’t think they would have taken off.

You're missing the social aspect to the rejection of Google Glass. IIRC the term "glasshole" was also a reaction to the privacy-invading aspect (little to no indication if the person is recording or not). AirPods had none of that, so if you liked how they worked, you could use them and not really bother anyone.

I think the Apple Vision Pro will fail for similar reasons, at least as something that people take out and about except in very limited circumstances. I had the additional downside over Google Glass that obscures the wearers facial expression (even despite their overwrought attempts at a technical solution).
Where is that log file supposed to be stored? It can't be on the same filesystem it was created for or it negates the purpose of its creation.
Do you really need an email signup for me to try the hardest riddle on the internet?
Holy crap that'd be amazing for accessibility! Open a menu and look at what the button does, label that button with the screen reader, pass around that label to others, and boom, labeled button.
The article is quite... disappointing for a french Parisian.

Let's make things clear: so called "mixed society" is actually a mix of "friends of the Mayor and allies" and poor-enough people that will vote for the so-called socialist Mayor. It's not about having a philosophical or idealogical view of society, only a practical view of election (a kind of "gerrymanding" if this concept is more understandable for US).

There has been frequent scandals with ministers still using "low income" housing for themselves or families. The article starts with the interview of some Ms Vallery-Radot, and that uncommon name prompted me to look on internet and wonder if she is related to the https://fr.wikipedia.org/wiki/Vallery-Radot which was until the 2000 ... State Advisor.

So please... do not think that Paris is some kind of wonderful place where intelligent and humanistic leaders are working for the good of the french society as an example to the world. It's just usual political shady business, nepotism (and you'll see by yourself that the results will be bad during the Olympics for example)