skysight-inc/HackerNews huggingface dataset:
What happens if a child uses a computer at a friend's house to go online and something bad happens? Is it still the child's parents who are liable, or would it be the parents of the friend who are liable? What about a public computer like at a library?

Banning children from the internet would probably require any computer that a child might obtain access to to be locked down and verify that an adult is using it before going online.

That's going to be way more obtrusive than a well designed way to do anonymous age verification. It would affect nearly everyone who wants to go online, instead of only people who want to go online at sites that aren't safe for children.

> Children didn’t have access to the internet for thousands of years and they survived.

Adults also didn't have access to the internet for thousands of years and they survived, so what's your point?
> treating Sam like some hero

Recent OpenAI CEOs found themselves on the protagonist side not for their actions, but for the way they have been seemingly treated by the board. Regardless of actual actions on either side, "heroic" or not, of which the public knows very little.
LMStudio is great to run local LLMs, also support OpenAI-compatible API. In the case you need more advance UI/UX, you can use LMStudio with MindMac(https://mindmac.app), just check this video for details https://www.youtube.com/watch?v=3KcVp5QQ1Ak.
> Sorry your genetic ancestral memory of the Balkans doesn’t stack up to...

Ah, we have a serial West-splainer. I emigrated when I was 24 and I speak for pretty much everybody I've known in those years. I've studied and wrote essays on the literature and the history of the region daily through high school and college. I speak the language and the customs.

You on the other hand seem completely oblivious to the cultural significance of Kafana, or its different incarnations throughout the region, to recognize that arguing about politics, whining about history, the Great Powers, life, and the Universe, has and still is pretty much the purpose of their existence.

> PS. Was I right about the educated professionals part, or were you a displaced person whose village was razed?

I'm having a hard time comprehending the relevance. Did the displaced people in Yugoslavia 30 years ago define the pathos of the region, which BTW is more than just former Yugoslavia, in the last 600+ years?
Windows Server 2003 with Interix was my daily driver for a few years. That was my "peak Windows" moment. It had a fast UI, could run software meant for XP, and I could compile a ton of POSIX-targeted software.
I think yuou're assuming that OpenAI is charging a $/compute price equal to what it costs them.

More likely, they're a loss-leader and generating publicity by making it as cheap as possible.

_Everything_ we've seen come out of silicon valley does this, so why would they suddenly be charging the right price?
V or: How I learned even open-source communities can operate as fascist regimes
> should just be a government effort

And the controlling party de jour will totally not tweak it to side with their agenda, I'm sure.
Hemp cannabinoids may have evolved to deter insect pests
Bard is better than ChatGPT-3.5.

They are worse than GPT-4 because nobody other than OpenAI (and their free Azure credits) have been willing to throw $100 million in training a single LLM.
Completely coincidental comparison for people that you disagree with, I suppose?
Developers are clearly the weak link today, have given up all power over product and it is sad and why software sucks so bad. It pains the soul that value creators have let the value extractors run the show, because it is now a reality TV / circus like market where power is consolidating.

Developers and value creators with power are like an anti-trust on consolidation and concentration and they have instead turned towards authoritarianism instead of anti-authoritarianism. What happened? Many think they can still get rich, those days are over because of giving up power. Now quality of life for everyone and value creators is worse off. Everyone loses.
Abstract:

> Language models only really need to use an exponential fraction of their neurons for individual inferences. As proof, we present UltraFastBERT, a BERT variant that uses 0.3% of its neurons during inference while performing on par with similar BERT models. UltraFastBERT selectively engages just 12 out of 4095 neurons for each layer inference. This is achieved by replacing feedforward networks with fast feedforward networks (FFFs). While no truly efficient implementation currently exists to unlock the full acceleration potential of conditional neural execution, we provide high-level CPU code achieving 78x speedup over the optimized baseline feedforward implementation, and a PyTorch implementation delivering 40x speedup over the equivalent batched feedforward inference. We publish our training code, benchmarking setup, and model weights.

Conclusions

> We present UltraFastBERT, a modified version of the
(crammed)BERT architecture that uses fast feedforward instead of feedforward networks in its intermediate layers. UltraFastBERT serves as proof that large language models only
really need to engage an exponential fraction of their parameters to perform individual inferences. UltraFastBERT-1x11,
our deepest model with the highest promise of acceleration,
uses only 0.3% of its neurons during inference and already
achieves a 78x CPU speedup over the inference time of
the corresponding feedforward layer. With a theoretical
speedup promise of 341x at the scale of BERT-base models,
we hope that our work will inspire an effort to implement
primitives for conditional neural execution as a part of device programming interfaces.
Yeah, feels like this discussion takes the "computer" part too serious when talking about computer science. Computing isn't necessarily something with a computer. CompSci is about solving problems in general. I'd argue that we just went the normal way a science does. You start by having everyone involved, then you narrow down and focus. In CompSci, focus isn't really what's happening though, as it got broader and broader. The core principle (solving problems) still remains. We'll probably see a split down the line as well.
OGG would make a lot more sense. Even back in the Pentium days I believe there were optimized integer decoders that would handily outperform OGG stuff which only had a floating point decoder. Wikipedia is showing the og Pentium at 0.5 FP ops per clock cycle vs 1.88 integer ops.

Of course by the time you get to the Core architecture you're in the opposite situation where Sandy Bridge is at 16 FP ops and 6.2 integer ops per clock cycle.
Because real people are using it to make decisions. Decisions that could be entirely skewed in some direction, and often that causes damage.
Did they start collecting data 100k years ago? Cause that is the timescale for this stuff no?
The "zeroed-out file" problem is not about firmware lying though, it is about applications using fsync() wrongly or not at all. Look up the O_PONIES controversy.

Sure, due to their COW nature zfs and btrfs provide better behavior despite broken applications. But you can't solve persistence in the face of lying firmware.

Even thought zfs has some enhancements to not corrupt itself on such drives, if you run for example a database on top, all guarantees around commit go out the window.
Intelligence is gathering and application of knowledge and skills.

Computers have been gathering and applying information since inception. A calculator is a form of intelligence. I agree "AI" is used as a buzzword with sci-fi connotations, but if we're being pedantic about words then I hold my stated opinion that literally anything that isn't biological and can compute is "artificial" and "intelligent"

> AGI means a computer that can actually think and reason and have original thoughts like humans, and no I don't think it's feasible.

Why not? Conceptually there's no physical reason why this isn't possible. Computers can simulate neurons. With enough computers we can simulate enough neurons to make a simulation of a whole brain. We either don't have that total computational power, or the organization/structure to implement that. But brains aren't magic that is incapable of being reproduced.
I don’t get that at all.

The OpenAI board just seems irrational, immature, indecisive, and many other stupid features you don’t want in a board.

I don’t see this so much as an “Altman is amazing” outcome so much as the board is incompetent and doing incompetent things and OpenAI’s products are popular and the boards actions put this products in danger.

Not that Altman isn’t cool, I think he’s smart, but I think a similar coverage would have occurred with any other ceo who was fired for vague and seemingly random reasons on a Friday afternoon.
I've always assumed the various three letter agencies would need those sorts of people but I've never looked into it...I definitely agree with you though.
Cool. Important note:

"""
One may ask whether the conditionality introduced by the
use of CMM does not make FFFs incompatible with the
processes and hardware already in place for dense matrix
multiplication and deep learning more broadly. In short, the
answer is “No, it does not, save for some increased caching
complexity."
"""

It's hard to beat the hardware lottery!
Perhaps a better example would be 95% of people voted in favour of reinstating apple pie to the menu after not receiving a coherent explanation for removing apple pie from the menu.
Take a look at https://kyutai.org/ that launched last week
"Gastrocardiac syndrome" might be considered outdated in the medical world (not sure what they mean by that), but it's been a real thing for me. I started getting clued up on the vagus nerve because of frequent weird heartbeats (which turned out to be PVCs and PACs that my cardiologist diagnosed after I bought my own portable ECG thingy to catch them), especially when I bent over or lay on my side. After finding out I had a hiatal hernia and starting on omeprazole, those odd heartbeats dropped a ton, like by 90%.
> What's going to happen to your career when you were one of the 200 who held out initially?

Not to mention Roko's basilisk /s
High Street salesman takes over Frankenstein's lab. Can't wait to see what's going to happen next.
Sure, I agree. I was referencing only the idea that being smart in one domain automatically means being a good critical thinker in all domains.

I don't have an opinion on what decision the OpenAI staff should have taken, I think it would've been a tough call for everyone involved and I don't have sufficient evidence to judge either way.
This works, but I've noticed that my CPU use goes up to about 30 percent, all in kernel time (windows), after installing and opening this, even when it's not doing anything, on two separate machines... I also hear the fan spinning fast on my laptop.

Killed the LM studio process and re-opened it and the ghost background usage is down to about 5%.
In my comment, the emphasis is definitely on the "product people who know what they are doing" and "good product people".

Of course, if the product suite is clueless, nobody is going to miss them, usually it's better the have no dedicated product people, than having clueless product people.
Why have OpenAI take to poaching employees from M$ now?
Not sure how you arrived at that guess, but generally I guess that describes the largest demographic of HN users.

Without AI but based on some freely available statistics combined with post history, we can say definitively (assuming honesty on OP’s part) that OP is 35 or 36, and was either born in Germany or moved there when they were young, and they likely still live there or at least have a strong affinity to Germany.

We can reasonably speculate that the fact that they speak German and likely live there, as well as the standard of their English drastically increases the likelihood their parents were educated. Germany’s current total fertility rate is 1.5. It was likely higher when OP was born back in 1986/7 but I couldn’t immediately find any data on that and didn’t look too hard. Given the fact that TFR is a population mean, this suggests a high proportion of single-child families, and generally the more educated one is, the fewer children, so it’s a decent guess that OP is an only child (apparently more than 50% of German families have only one child), but I don’t see anything that would make this a sure fire bet.

I was able to complete some further analysis which could reveal more likely truths about OP such as gender, political orientation, sexuality, etc., but I think this goes far enough without starting to doxx them.
Ranked: Largest Semiconductor%20Foundry Companies by Revenue
Question: how does Spotify pay so well when they have profit margins lower than a restaurant?
I would classify their mission "to organize the world's information and make it universally accessible and useful" as some light parading acting in the best interests of humanity.
> offer it locally for a fraction of what openAI is charging

I thought the was a somewhat clear agreement that openAI is currently running inference at a loss?
Ah, yes, I'm assuming the code will be bundled (so all the imports will be completely rewritten anyway).

Is there a good use case where you wouldn't want to bundle TS code?

It seems to me that you either want to execute it directly (via Deno / Bun / ts-node / etc) or bundle it.

Even if you're publishing an NPM package, bundling rather than publishing individual generated .js files works well. You can either bundle your dependencies or leave them unbundled, both work just fine.

If you publish your .ts files, people can import those directly. In my experience that works much better in Visual Studio Code than importing the .js files.
> The good news is, it makes replacing humans - trait for trait - far more more complicated.

I wouldn't take much comfort in that. You can probably reach something that resembles a human by just providing an alternative set of signals. We already do this with the reward mechanism during training and that is proving very effective.
The Hill: https://thehill.com/homenews/campaign/496352-progressive-gro...

> The organizations include the Center for Biological Diversity Action Fund, MoveOn and Oil Change U.S., as well as Justice Democrats and the Sunrise Movement — groups that have made similar calls in the past.
> “Larry Summers has consistently advocated for deregulation — cutting critical safeguards that protect people from corporate abuse,” the organizations wrote.

2008 financial crisis: https://en.wikipedia.org/wiki/Lawrence_Summers#cite_note-ope...

> Indeed, as a member of President Clinton's Working Group on Financial Markets, Summers, along with U.S. Securities and Exchange Commission (SEC) Chairman Arthur Levitt, Fed Chairman Greenspan, and Secretary Rubin, torpedoed an effort to regulate the derivatives that many blame for bringing the financial market down in Fall 2008.[33]

> On April 18, 2010, in an interview on ABC's "This Week" program, Clinton said Summers was wrong in the advice he gave him not to regulate derivatives.[39]
I use emacs AND vi.

facetiousness aside, it's really cool to have others return on experience. Even though I kinda made a blanket statement originally, I wasn't trying to enforce my opinion, it was more of a regular result I tried to share.
Bard is better than ChatGPT-3.5.

But GPT-4 is indeed a class of its own.
Since barely any information was made publicly we have to assume the employees had better information that the public. So how can we say they lacked critical thinking when we don't have access to the information they have?
X seems to have had the worst execution from all of Elon’s companies.

I believe he could have done much better if he started from scratch and formed a lean team to execute on a vision.

Now he has to spend a lot of energy from having Twitter not be a dumpster fire.

X is a worse brand than Twitter.

They haven’t done much to the recommendation algorithm - except add a special case for Elon. My feed is a mess.

Even if I pay, I get a shit ton of ads.

Many scammy accounts have a blue checkmark now. It’s hard to trust.

Elon himself violates their own policies by tweeting lies and hate.

All in all X probably deterred a bunch of people from buying Teslas as well.

But Elon wanted “Free speech for myself, not for thee” and that’s what he made.
Doing the same with pry ALL THE TIME. It basically became my standard programming workflow. Especially you can also do `ls` to inspect objects and classes.

Is there any other language which can do that? And I don’t mean unergonomic debuggers.
Paris Hilton's company suspends ads on X, one month after partnership agreement
There is a reason why the top researchers and engineers at OpenAI stood behind Sam. Someday you will learn the value of good leader
What are the potential consequences? Does this open doors to faster edge inference or improved capabilities?
He's part of the selection panel but he won't be a part of the new 9 member board.
uh. We're arguing about _who is controlling AI_.

What do you image a neutral party does? If youu're talking about safety, don't you think there should be someone sitting on a boar dsomewhere, contemplating _what should the AI feed today?_

Seriously, why is a non profit, or a business or whatever any different than a government?

I get it: there's all kinds of governments, but now theres all kind of businesses.

The point of putting it in the governments hand is a defacto acknowledgement that it's a utility.

Take other utilities, any time you give a prive org a right to control whether or not you get electricity or water, whats the outcome? Rarely good.

If AI is suppose to help society, that's the purview of the government. That's all, you can imagine it's the chinese government, or the russian, or the american or the canadian. They're all _going to do it_, thats _going to happen_, and if a business gets there first, _what is the difference if it's such a powerful device_.

I get it, people look dimly on governments, but guess what: they're just as powerful as some organization that gets billions of dollars to effect society. Why is it suddenly a boogeyman?
Ubuntu squeezes more performance than Windows 11 on new AMD Zen 4 Threadripper
We know you have heavy biases but its impossible to deny that OpenAI is leading both the commercial and open source space. I don't think that will always be true but it is true now.

On top of that, they have done an amazing job executing on getting product out to users. No other company in this space is even remotely close to this.
Absolutely, as if it was basically not there.
I tend to do this in code review. But what I consider critical is that it comes without a "I want this changed" mentality, and instead a "let's find something we can improve on for next time" mentality. The current PR can go in as-is, but we should aim for always getting better at the craft.
Yep, outplayed like in chess. Started with a handicap, led the game to the stalemate, won the match.
There's a lot of differences between the US and France that result in different suburb/city situations, but I think "white flight" and "redlining" cover a decent chunk of it:

https://en.m.wikipedia.org/wiki/White_flight

https://en.m.wikipedia.org/wiki/Redlining
Why is it good news?
Yeah, overall I love TS as a language, and the tooling can be made to work well.

I just feel like there's a bunch of functionality in TSC that's more troublesome than it is useful. The same could be said of Node, of course.
New drug delivery system could reduce daily diabetes shots to just three a year
I wish I could have the text output instead of getting a vocal answer. We all can read way faster than we can listen to speech, and I don't need a lot of the fluff I get from LLMs. But I guess that's what most users want? Something that's closer to a conversation with a human? But I don't care about being polite with an LLM, it feels like an anti-pattern because it's too much overhead.

Ideally I would:

* query by voice

* get the response in text as soon as possible, maybe even as I'm still talking, with the LLMs correcting the response as I give more information, and without needing me to touch anything

* follow up by voice, even before the response was finished, and without needing to press anything

I hope we'll get there eventually!
In addition to overprotective parents and screens, there’s the fact that there’s just fewer kids today, reducing the chances that any kid has a critical mass of similar age neighbors to play with. The percentage of the population that’s under 18 peaked at 36% in 1960, and is down to 22% now.

And that understates the perceived decline, because most children are now born to minority families. Only 18% of the non-Hispanic white population is children. So if you’re the kind of person writing about these issues—probably a college-educated, non-immigrant white living among other similar people—the percentage of your local community that’s kids is even less.
Doesn't mean we shouldn't hold an organization accountable for their publicized mission statement. Especially its board and directors.
I was just amazed that my super old laptop could run youtube/games for my 2 year old. It had Windows but was too slow to really use.

Fedora Silverblue was too heavy, but MX Linux made that computer run like my main. No slowdowns ever. Moments like this make me wonder who/what is leading us.
Taking decisions in a way that seems opaque and arbitrary will not bring much support from employees, partners and investors. They did not fire a random employee. Not disclosing relevant information for such a key decision was proven, once again, to be a disaster.

This is not about soap opera, this is about business and a big part is based on trust.
> what the heck is Larry Summers doing on that board?

The former president of a research-oriented nonprofit (Harvard U) controlling a revenue-generating entity (Harvard Management Co) worth tens of billions, ousted for harboring views considered harmful by a dominant ideological faction of his constituency? I guess he's expected to have learned a thing or two from that.

And as an economist with a stint of heading the treasury under his belt, he's presumably expected to be able to address the less apocalyptic fears surrounding AI.
Yes, GC should be smart enough to free up space from padding. But then there's a write amplification penalty and meeting endurance specifications is impossible. A padded write already carries a write amplification >1, then GC needs to be invoked much more frequently on top of that to drive it even higher. With pathological Flush usage, you have to pick your poison. Run out of space, run out of SSD life.
They need a common man representing the board. After all AI will take those jobs.

I can be that common man
The argument stays the same though. Your body is reducible to an input/output mechanism.

In terms of complexity, since we haven't solved brain yet, it doesn't matter that much that there's also other parts of the body involved, as we don't even know the exact complexity of the brain, but the argument stays the same.

In theory we are input/output mechanism, possible to emulate if there's enough capacity.

But in addition AGI wouldn't require many traits that humans have since it doesn't need the same evolutionary survival mechanisms. It only needs part of it.
These are (presumably) for things that even user styles are not supposed to be able to "break". Sifting through https://meiert.com/en/blog/user-agent-style-sheets/ shows quite reasonable things such as

@media (scripting) {
noscript {
display: none !important;
}
}

optgroup {
float: none !important;
position: static !important;
white-space: nowrap !important;
word-wrap: normal !important;
}

in the Firefox UA styles (though I'd permit overriding the former and I'd expect shadow DOM to handle the latter), or

input[type="password" i] {
-webkit-text-security: disc !important;
}

in the Chrome UA style.
Buy Microsoft stock. Got it.