skysight-inc/HackerNews huggingface dataset:
My understanding (roughly) is that the way we got here was kind of by surprise. We've had a lot of the fundamental algorithms for a long time, but we ran into sort of a happy surprise when transformer models got scaled up - suddenly they started doing interesting things. Scaling them up even more made them start do do potentially useful things.

That happy discovery was never really a linear improvement path, though. We had an explosion of capability, but all along there have been active questions about how far the improvements would go with the current approach.

I think the point that a lot of researchers are making is that that we're starting to see those limits (with LLMs, at least).

There are also a lot of questions around business model and cost/value prop. Training and running these things at scale is enormously expensive. I'm seeing a lot of FOMO and gold rush mentality in the space, similar to the online streaming wars, and I'm not convinced of the long term viability of a lot of the companies. Especially once open models like llama are "good enough" and become commodities.

Of course, it's still early days and there's a ton of room for discovery, but it looks like we'll hit a limit with the current approach pretty soon.

Personally, I'd be OK with that. With the current state of things we have an interesting toy that can sometimes do useful work. It's an incremental quality of life improvement and another good tool in the chest, but it's not a civilization impacting technology.

That's probably for the best.
Given that American Express and Discover aren't accepted in as many places as this duopoly and they've both been around for 30+ years, that tells you everything you need to know.
Fair point, but as SoftTalker observed in a peer comment there are two types of equipment, industrial grade HVAC heating cooling gear sourced from the US for living | working environmental control ( F ) and actual scientific equipment ( not shown in the photos I saw which were all of HVAC type gear and marked in F ).
Which of these few sources are going to do local reporting in your town? Sure there are tons of outlets all covering the same “famous person/company does something”-type of news, but those aren’t the organizations covering stuff that actually affects your life or doing investigative work. You’re throwing the baby out with the bath water.

Also AI generated news articles will literally ingest and regurgitate press releases without doing any checking.
I did not, my assumption was wrong. my bad :(
This is a special article. The genius of the invitation to an unprepared lunch highlights the beauty of cooking and cooking together.

The description of the authors cooking with Judith is both intimate and distant. Personal and communal. And yet while silent, speaks to a deep friendship built on years of experience and taste and creativity.

My favorite aspect of the article is the lack of recipes. Meals can be whimsical and unexpected and memorable when the ingredients are there but the plan is not.

I’m sure I’ll be thinking of this article for years to come.
It's similar to us. We can reason about certain things but we often have to look up additional information in a book or ask someone. In the same way I see LLMs being augmented with traditional code. It doesn't really matter if the result is called AI or not.
The idea that LLMs are "running out of training data" is pretty widespread, but does it actually hold up?

Has anyone seen representatives of the cutting-edge AI labs - OpenAI, Anthropic, Meta, Mistral etc - express concern about this?

The impression I've been getting is that quality turns out to be much more important than quality. This tweet from Andrej Karpathy for example: https://twitter.com/karpathy/status/1797313173449764933

> Turns out that LLMs learn a lot better and faster from educational content as well. This is partly because the average Common Crawl article (internet pages) is not of very high value and distracts the training, packing in too much irrelevant information. The average webpage on the internet is so random and terrible it's not even clear how prior LLMs learn anything at all. You'd think it's random articles but it's not, it's weird data dumps, ad spam and SEO, terabytes of stock ticker updates, etc. And then there are diamonds mixed in there, the challenge is pick them out.
Everyone will have a personal AI concierge, capable of consuming all their media and then re-displaying it for them with just the bits they want (no ads).

The current digital ad industry is doomed.
There is nothing either good or bad but thinking makes it so.
> I would expect nobody to escalate over a Taiwan Invasion.

there is semiconductor industry on the table. I think there is high chance NATO will be suppressing invasion forces through launching anti ship missiles from aircrafts and cruisers as well as secretly supplying them to Taiwan.
> you can turn any biased memoryless coin into an unbiased one with a simple trick

This trick is mentioned in the article towards the end.
Oh, I thought this was going to be about AIs with more situational awareness.

Notes:

- What's the difference between "superalignment" and regular "alignment", anyway? OpenAI uses the term, but mostly for marketing purposes.

- Alignment to what?

Select alignment configuration option:
1. Asimov's Three Laws.
2. Friedman's “There is one and only one social responsibility of business—to use its resources and engage in activities designed to increase its profits.”
3. Xi Thought.
4. MAGA.
5. The first pillar of Islam, "There is no god but God, Muhammad is the messenger of God."
6. The Leader is never wrong.
Selection? >

- Has "hallucination" been fixed yet?
Without plant based life, there are no humans, so we are technically using those genes.
Not so easy to get just the tip of the iceberg to stand out.
Ha you're right. My bad (poster). I didn't realize until right now that it kid of implies the opposite. Sorry about that!
I mean actually nearly any resistance to an extremely oligarchy-friendly neoliberal idea of "free markets" is considered a fringe extremist position in at least the US and the UK, both in terms of the attitude of the culture at large and the levers of power available to anyone, so you must be in quite the left-wing bubble to believe that this is viewed as "kooky" by society at large. I agree with you that for most purposes meta-norms that create free markets (Which in many cases flows completely logically from a meta-norm of autonomy) are better for human flourishing than planned economies, including both cartel-planned ones and government-planned ones, with a few exceptions for things considered infrastructure where the incentives of a market are an ill fit to create guarantees of stability over long timescales. If you live in a western democracy, the vast overwhelming majority of people agree with that. I point out cartel-driven cronyism specifically because I would argue that most rich economies are not operating as free markets, but are essentially using the government as an enforcement arm of the power of incumbent players in many industries. I think that as compared to when this was less true, many of the societies underlying those economies are going into a bit of a tailspin, and that moving more toward free markets would actually do quite a bit to stop the bleeding and maybe turn it around. However, in term of pathos, "free trade" is still so popular that the kleptocrats who benefit from the capture of governmental institutions by industry constantly claim that is what they are doing to anyone who will listen, and the extant fringe of support for communism seeing a very slight uptick in recent years can be mostly explained as a backlash to these obvious lies told by those in power. Often backlashes are quite reactionary, and also water is wet

This absolutely delusional view of popular opinion and government priorities - along with the Great Replacement conspiracy nonsense - has led me to conclude that your preoccupation with the accusation that "people who merely believe in free markets" are right wing kooks might have more to do with your own being objectively and obviously a right-wing kook living in a fantasy world than it has to do with any reality about the general public's attitudes and beliefs in aggregate. Of course if you're one step from joining the next great wave of populist fascisms you think everyone's a tankie. Anyway, I think it's pointless to try to talk sense into someone who believes that anything remotely resembling "muslims taking over" is a serious existential threat to like, all of NATO? or whatever counts as "Western" this week, (Or for that matter, somehow an existential threat to white people as a whole worldwide, which seems to be what you lot tend to actually mean by that euphemism). There is a real war going on in Europe that has nothing to do with muslims, and you idiots worry about a slight uptick in brown people immigrating because some charismatic suits told you to. It'd be hilarious if it wasn't so tragic. I'll leave you to your frothing madness
Terrence Howard was right!
Insurance maximizes the productive capacity of the economy by allowing the entire class of actors to absorb the net cost of a peril while all continuing their productive endeavors enhancing the health and wealth of society.

Gambling allows one class of actors with better planning, impulse control, and knowledge to siphon off the productive capacity of society usually while producing nothing of value.

What's more it is usually by virtue of its other attributes and position in society the sector is often directly involved in other illicit activities or at least crime adjacent creating an opportunity to defund or deter crime by attacking this sector.
Tadalafil (Cialis) can be useful for dealing with depressive symptoms. It's commonly used in nootropic circles.

With both viagra and tadalafil, they can negatively effect sleep. So it's hit or miss for a lot of people depending on depressive or anxiety symptoms.

https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7306377/
Until a better story emerges, I'm imagining that fern mode is just what we see when it is dormant. Perhaps if we prod it in the right way it will wake up and show us its true colors.
Only use Checkboxes when None, Undefined and False are equivalent. Use Radios or Selects otherwise.
I searched the cheriot-rtos repo and found a lot of calls from tests (either directly or through the wrapper function `sleep`):

https://github.com/search?q=repo%3Amicrosoft%2Fcheriot-rtos%...

That's a context where it makes a lot of sense to use sleep. I've written similar test code myself for a different RTOS. Most of the callers are testing various form of synchronization mechanisms themselves, so using proper synchronization isn't really an option.

The non-test uses you found are more dubious though.
Just hijacking to add a public health warning about BPH. Like many men as they get older, I was getting up several times a night to pee. Thought I would just put up with it until it got worse.

I went on a yacht for the weekend, drank quite a few beers and crashed to sleep.

I awoke to find out I couldn't pee at all. I can't describe how painful things were by the time I staggered into the emergency department that evening. Definitely the worst experience of my life. A few weeks later a guy was winched off a boat by helicopter with the same condition - one of his mates had been tasked with catheterising him using the rubber fuel hose from the boat's engine, but was unsuccessful.

If you are having trouble urinating, seek medical attention - don't ignore it.
We will never run out of training data. The idea that we will despite billions in investment is absurd. Simply scraping the web is the lowest level and there are millions of other ways to glean information about the world.
A pretty grim read. I recently watched Icarus, which comes at the problem from a very different angle.

https://en.m.wikipedia.org/wiki/Icarus_(2017_film)
I came for this comment and there you are! Bravo
It's thought to improve neuronal density in the hippocampus and also (higher p) to increase bone density. A lot of bodybuilders and athletes use it for increased blood flow benefits, partly because it seems to have fewer side effects then sidenafil (which can cause mild retinal damage leading to a blue tint in the vision; probably why Pfizer used a blue tint in all their advertising). I have no personal experience with it but the theory seems sound.

https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7321982/
You’re right of course, which is why Fuji sells both Provia and Velvia. However the slide is still the image. It’s not a perfect reproduction of the scene in front of the lens, but there’s no subjective choices to be made during printing and/or scanning to invert it. Stick it in front of a light and you can see the image with the naked eye just as it exists on the film. I think that’s what OP was getting at.
after many years it will flip and you will realize that many here aren't smart at all. (it is mostly bot driven here anyway).

only 10% or so are real nerds or cracks in their field.
> Given 100% of present societies

100% of present societies are not patriarchies. Not even close to 100%.
Not at all safe to assume that.

https://www.firstsolar.com/en/Products/Series-7

Glass goes in, module comes out…at an astounding rate of production.
If this is true they altered zinc metabolism might play a role in dementia since zinc is the cofactor for PDE5, or that people who do not make enough cGMP are prone to dementia (which also means they might be low in GTP and GTP regulates glucose-insulin secretion so...)

So I think they can do better then "here is a pill give me more money".
First NIH said it does:

https://www.nih.gov/news-events/nih-research-matters/viagra-...

Then it doesn't:

https://www.nih.gov/news-events/news-releases/nih-dream-stud...

Then it does:

https://www.ox.ac.uk/news/2024-06-07-sildenafil-viagra-impro...

Who knows what to believe.
This is the sort of stuff I conceptualize as a true tech(nical/nology)startup. I realize that’s in some ways at odds with the meaning in practice. But this is amazing technology.
Learning a Language with Bimodal Blitz: Easy as Riding a Bike
Your "boys will be boys" argument is obviously self-serving, because you're acting exactly like the worst kind of teenage boy edgelord, living in his mother's basement, trolling on 4chan, participating in Gamergate. You keep making provably false claims and ignoring the evidence, and in spite of your baseless arguments to the contrary, teenage boys certainly can be racist, and teenage boys aren't the only ones using the "ok" symbol with racist intent. How about not trying to defend and justify that behavior, at the same time you're exhibiting a textbook case of that pathological behavior. It totally discredits your baseless arguments.

You're trying to argue that it's only to rile people up, with no racist intent, then you're getting totally riled up yourself, defending intentional racists. So what's wrong with me successfully doing the exact same thing you're trying to defend, back to you? According to your own words, I should be laughing at you. If you don't like being on the receiving end, then perhaps you shouldn't be defending people who dish it out.

https://www.snopes.com/fact-check/roger-stone-proud-boys/

Roger Stone is 71 years old, not a teenage boy. He was convicted of seven felony charges, including witness tampering, lying to congress, and obstruction, in relation to special counsel Robert Mueller's investigation, and he's a trusted advisor to Donald Trump who had White House access and still hangs out with him at Mar-a-Lago. Not a teenaged boy for 52 years, but definitely a racist hanging out with a bunch of other racists. And here you are defending him, with your idiotic "boys will be boys" argument, while acting just like a teenage boy yourself.
Feels very odd the title of the article mentions 93 dead when 210, with an additional 400 seriously injured, is being widely reported as the accurate number.

Similar, no real reference to the possible widely reported 4 hostage deaths that are reported from the "rescue" operation.

Genuine fact based reporting doesn't appear to exist anymore.
Performance-oriented library with no benchmarking instructions, fun. I get 850ms to shuffle 32-bit integers up to 1e8 with this library versus 400ms in BQN (•rand.Deal•_timed 1e8). However, BQN also has a large advantage at smaller sizes, such as 425us versus 120us for 1e5 elements, so a lot of this may be the random number generator. I haven't figured out how to get PCG working yet. BQN uses wyrand which is faster but I now know has quality issues (can't even generate every possible output; I need to update the page I linked...).

It's substantially the same algorithm so any differences would just be down to implementation details. Other than multi-threading which BQN doesn't do. The usage is also a little different as BQN generates shuffled integers directly; generating the integers is 100ms of the 850ms for rip_shuffle but I'm not sure whether it makes sense to subtract that or not.
We see in a mirror, not through one. Yes, a half silvered mirror can be seen in and through, but that’s hardly true of the mirrors of the time when the archaic term “glass” meant what we call a “mirror”.
Or you know, if you care about all this stuff, just don’t shoot film!

I shoot, process, and scan my own film, both color and B&W, and I don’t have any special facilities. Just a sink and a table…

As for environnemental concerns, B&W film is pretty straightforward chemically, and the developer I use is just ascorbic acid (vitamin C) and phenidone. It’s non-toxic. The fixer gets full of silver, but I take that to a lab periodically and they put it through a silver recovery system. I think the environmental impact of the film I shoot is dwarfed by all the other things I do in life (burning fossil fuels, using water in a desert, taking and excreting prescription medicines, etc., etc.)
People have been “training” models on windows api calls for decades.
Dang, that is a sad tale.
200ms Voice LLM
> Animals sans humans are honest, so there are no betrayals.

Ask anybody who has grown up on a farm if any animal is honest. Animals can and do try to fool you.
Bodybuilding, powerlifting, strongman etc all have untested federations. A lot of the money in these sports comes from the athletes themselves, so the athletes have a lot more voice, and scope to find a federation that lets them compete the way they want. Compare this to the UCI where it's a meme that any innovation that comes along gets banned in order to preserve the "spirit of cycling"[1].

[1] maybe a bit less so recently, and I definitely approve of the safety-related bans such as the supertuck
I do opportunistic collection - when I am working on a feature, and spot opportunities for a refactoring/cleanup in code that is more or less directly related to the code I'm touching, I will keep making small incremental changes and keep testing them until my feature is implemented and the cleanup is done as well. I also ensure to not make a breaking change while doing this e.g. no change to the user facing api signature. If I see issues in unrelated code, that just gets a TODO and waits its turn when we have to do changes there for some feature request.

The reason is that I can atleast somewhat justify the changes under the umbrella of my feature while utilizing the allocated time budget. If I don't do this, we will never get a dedicated release to do tech cleanup - the backlog of feature requests is just too big and too little appetite on the decision makers' side for purely tech debt releases.
Rust could be helpful, but it's just one leg of a table. Design, architecture, security concerns, hardware support, vendor support, cost, and compatibility are also important requirements.

If not already extant, a FOSS, capabilities-secure, formally-verified RTOS somewhere in the space of seL4 and MINIX 3 microkernel would be useful. Rust might help, but the problem is a lack of attention paid to formal verification all the way downstream, perhaps including symbolic execution and thorough verification of the resulting binaries.

In general, the biggest microkernel design challenges are efficient IPC and handling complex transactions across multiple tasks/processes.

seL4 and such solved IPC performance bottlenecks by proving their moves of message structures were sound under invariants. This is something Rust might be able to solve through moves and lifetimes, but it might not have enough power directly and some edge-cases of unsafe code might be needed for performance reasons.

When it comes to handling privileged events, transactions touching multiple each tasks components must be carefully locked or some privileged helper must step in that violates ordinary constraints. In largely-monolithic Linux, this is relatively easy because when lock-free patterns are unavailable, some or all of the world can be stopped and essentially anything can happen almost anywhere. This simplicity comes at a cost of low/no amounts of isolation that weakens the design goals of a "pure" microkernel architecture which leads to real, hybrid microkernels.
Super alignment is about aligning AIs that are smarter than us, while alignment is about aligning AIs dumber than us.
You think things are bad, so you just accept it getting worse?
ah, an eugenicist. and yet, if i stated that eugenicists should be eliminated from the gene pool, you'd be outraged.
Xiaomi HyperOS on Redmi uses non-dismissible notifications to display ads
Too little NO is bad for you, too much NO is bad for you.
I am always reminded of Severance, the TV show, when I think of LLMs. Data refinement is what is happening massively right now. Basically, take data harvested on the Internet, which may be of poor quality, and use a teacher-student approach to reformulate it in higher quality. Then use that synthetic data to train new models. It's a bit like the biblical multiplication of the bread loaves. How much farther can it get LLMs? I don't know.

During the next turn, though, a lot of the same synthetic goop is going to turn up on the Internet. That's probably why OpenAI is spending the big bucks to secure access to original content producers. Now, here is to hope "original content producers" are not going to depend on LLMs to generate that original content.

I think training data would be plentiful if autonomous drones roamed the face of the earth, constantly recording audio and video. There is nothing as good as reality to learn what real is. The representation of reality on the Internet has become a matter of opinion for a lot of people.
you know what else would?

walkable cities

more time off from work

more third spaces

less air pollution

less inequality

of course none of that "increases productivity or GDP" so the ruling class won't consider it. of course when they start dying like Japan with low birth rates, their 'solution' is to have a government funded dating app instead of doing the obvious.
Both are lottery tickets if viewed from a pure financial contract perspective.

Utility of a particular contract to a buyer is subjective.
With the counter-based RNG approach, apparently one idea is that you uniquely identify child nodes in your tree somehow. That is, each work unit is a node with a unique ID that's deterministically assigned and has nothing to do with random number generation at all. Then you use that to pick the random stream.

An API that uses split or jump seems a little easier to screw up.
(I'm no doctor but) I struggle to imagine that bone density can change within a day. For that matter I'd be shocked if actual muscle mass changed; I'd personally wager that its almost exclusively water weight (if nothing else, more blood getting allocated as your body does maintenance).
Obtaining a Locality Domain
(Work in progress) LLVM Libc: The LLVM C Library
That's more of a 4.5 model
Chat is about the worst possible interface for doing any sort of precise task, which presumably is what any programmer wants from a computer.
I often pick up the academic papers that are relevant to me here. To each their own!