skysight-inc/HackerNews huggingface dataset:
> It's like saying nuclear missiles can't possibly be dangerous and nuclear arms reduction and non-proliferation treaties were a scam, because the US, China and the Soviet Union had positioned themselves to capture the majority of the strategic value nukes bring.

I'm honestly not sure if this is sarcasm. The non-proliferation treaties are indeed a scam. The war is raging between the US and Russia and nuclear is a big part of it (though just words/threats for now). It's nonsensical to think that these treaties are possible.
The point is to stop her turning up in 11 years with 452m of magic treasure she found in a lake.
Yet, the climate is still changing. Inflation is rising.
The world definitely has advanced but never became a better place.
To find meaning in connection you have to open up and the avenues are at every point. From local walks to sports, to neighbourhoods, to hobbies. This place is community, we share ideas and exchange our views, we have the ability to express and that's how we connect.
Fair point, and you could have multiple drivers too. But the most common objection to BEV trucks is with regard to long haul semis.
Weird! For me, it's like I just gave myself superpowers. When I do it for the first time in a long time (like months -- and provided I do it hard enough for long enough), I get an endorphin mind+body high for the whole day that must be what heroin is like. Paradoxically, I can only bring myself to exercise in times of low stress. In times of high stress, I stop all my good habits and onboard bad habits and fuel a feedback loop of that stress, which has worked out great so far. :D
That youtube video is basically a crime against humanity. I'm being hyperbolic, but only slightly. I have never seen such blatant misrepresentation of results used to "verify" entirely unrelated hypotheses. Anyone with even a mild understanding of deep learning can spot this; but clearly the audience for these videos is _not_ people with deep learning experience. Rather, it is the followers of the cult of alignment.

At least one aspect of why this is so popular has to be that deep learning has now gotten sufficiently close to the popular conceptions of what a "general AI" should look like according to science fiction. As such, layman are using priors from e.g. Asimov (which deliberately simplifies things for poetic irony and "violations of the laws") such that they feel like they are actually already equipped to handle these relatively advanced topics.
I’m glad the obvious outcome occurred to remind us to rein in our unreasonable enthusiasm.
I keep plugging Oxide and Friends on this site, but the "Paths into Systems Programming" episode" is relevant and was a good discussion: https://oxide.computer/podcasts/oxide-and-friends/938256
it's IO not CPU bound
It’s possible they are trying out a shaved/turbo version so that they can start removing the limits. I mean as it is - 25 messages every 3 hours is useless, particularly for browsing and plugins.
That show and his Youtube channel are always a recommendation of mine to any new cat owner or person who doesn't have cat experience but wants to learn cat culture.

I watched a marathon of 'my cat from hell' around when I first got my two boys (they are 8 now) and I really think what I learned from watching jackson break down cat issues has helped me raise them into the sweeties they are today.
The comment you originally replied to was talking about "a non-interacting boson star," i.e. a boson star made up one of the hypothetical types of boson that makes up dark matter.

In that case, the only significant interaction between those bosons and you would be gravity which, when in free-fall, affects the path you follow but won't in itself crush you. This assumes that (a) that there's not much normal matter in the star to crash into, and (b) that the mass is not large enough to generate deadly tidal forces. That's why the OP specified "a clean solar-mass boson star".

But it's worth noting that a "clean" non-interacting boson star can't really form in the normal way, since the bosons in question don't interact with each other in any way that would allow them to form dense clumps. You'd need some normal matter to provide a kind of anchor. In that case you'd see a more normal-looking object that just happens to be heavier than it should be given its visible composition, and you wouldn't be able to "drop through it."
They aren't. That's where a strong future hope comes in, and the desire to follow God's laws over all else.

That doesn't make it easy, but if one truly believes something, shouldn't they be be willing to make sacrifices for it? People don't think twice about giving their life for their country, so why would somebody be any less convicted?
I don't think it matters how good or bad C# is, Object Oriented Programming is a mess

Learning, how to use an Object System (a tree of objects/classes) is inherently hard

The current problem with F# is that it doesnt do enough to shield you from objects, it does what it can, but still to use F# effectively, you still need to learn some C# and a lot of API that basically Objects inside Objects inside Objects calling Objects calling Objects and more Objects

OOP is bad because eventually OO systems becomes too complex, OO API is intimidation

Separating Data from Behavior manages complexity better

If the only flaw in C# is knowing which method calls requires the new keyword because its a constructor, and which dont because its a factory, that is bad enough to want to avoid it
I’m not religious at all, rather agnostic, but my wife is a nonpracticing Christian. (Although I find a good sermon/pastor to be motivating, thought provoking, and just full of basic life lessons that happen to he documented in an old book).

I’m fine with the concept of the right church because of the community effects especially as a parent and wanting my kid to have as many positive role models as possible in his life; peers/adults/seniors. So after many years of being with my wife, we decided to start when my kid was 4. We actually wanted to start earlier but it’s a hard habit to just introduce, then 2020 happened, etc so here we are. It’s been quite a positive adjustment. It’s easy to see the cult and abuse headlines and write it off, but when done right I still think it’s incredibly powerful and religion as a whole is just a framework for peaceful civilization and coexistence with communities.
As some of us predicted, the government is aiming at making it illegal for too-rich individuals to withdraw from failing banks, thereby preventing runs. It's what every other country does.
That’s like saying “they’re already murdered, there’s no harm repaired by this so just let her go”

She would just murder again…
Here's an example of an 8x H100 machine - look at the tech specs: https://lambdalabs.com/deep-learning/servers/hyperplane

6x 3000W PSUs in a 3x3 redundant config. So 9000 watts total. So at least 240v x 50A. x2 for redundancy.
Yes. Seems to have definitely gone down. Not sure what they have done but even with things it used have no trouble with, it struggles now. Most likely they are experimenting on reducing the compute per request.
Covid: Top Chinese scientist says don’t rule out lab leak
> First, I’m inclined to think that longtermism is an invalid and harmful ideology

It is, but (aside from as a sort of sociological explanation of the belief in AGI risk) that’s mostly beside the point when discussing the problems AGI x-risk. The problem of AGI x-risk is that it is an entirely abstract concern which does not concrete flow from any basis in material reality, cannot be assessed with the tools of assessing material reality, and exists as a kind of religious doctrine surrounded by rhetorical flourishes.

> The external factors, such as corporate interests and 1% wealthy interests/prejudices, are not a good reason to dismiss AGI concerns.

They are way of understanding why people who seem (largely because they are) intelligent and competent are trying to sell such hollow arguments as AGI x-risk. They aren’t, you are correct, a logical rebuttal to AGI risk, nor are they intended as that; the only rebuttal is the complete absence of support for the proposition. They are, however, a tool that operates outside the realm of formalized debate that addresses the natural and useful cognitive bias that itself is outside of the realm of formalized debate that says “smart, competent people don’t tend to embrace hollow positions”.

> Second, even from just a reading comprehension level: one side says AGI is a problem, then the other side cannot just say, “No, AGI is a false problem and here a the real problems”.

1. If they couldn’t, it wouldn’t be a “reading comprehension issue”, and

2. They can, for the simple reason that there is no material support for the “AGI is a real problem” argument.

> Bender et. al are just sidestepping the moot point,

A point being moot in the sense that AGI x-risk is is a reason to sidestep it. (The danger of using auto-antonyms.)

> I think honest experts could simply say, ultimately we don’t really know what will happen.

To the extent that is accurate, that is exactly what the Bender/Gebru/Mitchell group does. The problem is thinking “we don’t have any information to justify any belief on that” is one sided and means that utility of AGI is somewhere between 0 and the negative infinity that the x-risk crowd calculates from (some unspecified non-zero finite probability) times (infinite cost), whereas the reality is that we have as much reason to believe that AGI is the only solution to an otherwise certain existential calamity as to suppose it will lead to one. The utility is somewhere between positive infinity and negative infinity.
jmap-perl was only ever a tech demo and somewhat incomplete (e.g. it lacks push subscriptions, and a few bits that could theoretically be supported are stubs), but it’s not actually all that much code—even in fairly verbose Perl and including contacts and calendar support, the entire repository is around 11,000 lines of code (naturally depending on libraries for things like HTTP, OAuth, IMAP, SMTP, CalDAV and CardDAV), and could be shorter.
> not uncommon for companies to loose over 2% of revenue in banking fees and other enforced banking inefficiencies

Do you have a source for that number?

And even forgetting that "crypto" comes with both delays and transaction fees, it is also known to be able to lose most of it's value basically overnight. So unless companies want to wake up bankrupt, they'd have to constantly change real money into tokens and back again for their transactions. I wonder how efficient that would be.
"In a search for authenticity, commodification of Mason jars occurred leading to irony, as drinking out of canning gear highlighted overconsumption and lack of scarcity, the opposite of the designed intention of the jars.[11] Its utility has been praised for use as a variety of household functional and decorative purposes; such as an oil lantern, soap dispenser, speaker or vase."

Reading this part of the article, it is much more "editorialised" than what I'm used to - characterizing usage of mason jars as ironic and hipster related.

The fact is that Mason jars have developped different uses because they are a different product today - while hipsters and irony are legitimate to mention, I find it misleading to attribute these uses as ironic.

For one, tomato sauce being sold in a variation of the mason jar makes them ubiquitous in most homes in northern america - you don't buy them for canning, you end up with a whole bunch and don't know what to do with them.

Not entirely certain why I'm irked by this.
I had this happen to me too, and it was really strange. The border dude looked really pissed off at me. He didn't call my wife or anything, just berated me for a while (for what?? for driving up to Canada?). Very strange. He didn't check on anything additional at all, just yelled at me for a while (for not having a wife in the car??) and waved me through.
Parent discovers the difference between DMA and RDMA
> Daimler Trucks said the trench plate does not represent real-world driving.

Holy shit, any automaker who says that needs to have all their vehicles banned from US roads immediately.
Hey don't be mad at me, I'm not the one who makes these rules.

It appears that currently if mostly affects legitimate sellers and facilitates despicable differential pricing, but in absence of such rules the picture would likely have been different.

Also manufacturers face hefty criminal penalties for declaring a safe product and selling lead salts, what kind of penalty can be levied on a Chinese shyster?

Also-2, retailers can and are held liable for selling dangerous goods, see Schwartz v. Macrose Lumber.
I don't see how quantum computers are relevant? We can't build them, and there certainly isn't any interesting quantum computation in the brain.
That might be a violation of the EULA.

(I'm just kidding. I hope...)
Even a 1000ft thick motherboard?
we're also considering moving to a 192 bit combination of xoshiro128++ with pcg64 (early stages, PR doesn't exist yet). this would have the advantage that you could do really cheap rng splitting by modifying the pcg state while avoiding the 128 bit multiplies that make bigger pcg slow. also it would mean both sides of the fued would be mad at us :)
The thought just occurred to me, does training data ordering have any impact on LLM loss? It's not a terrible experiment to try, right?

There reason I'm asking is because we tend to educate humans using a fairly well-ordered path of curriculum. Take, for example, children's books. The limited vocab, sentence complexity, and concreteness of ideas are all supposed to help them learn better. In other words, parents aren't trying to teach their children language by reading them to sleep from The Pile[1]. Doing so would be considered detrimental to language learning. Like I said, just a thought.

1. https://arxiv.org/abs/2101.00027
That's sarcasm, it probably also wasn't actually Funny. Nothing about what they said suggests they didn't subsequently look into why their tests missed the issue
> You're just using power that could go towards training a better LLM.

What if I haven't found that special someone yet, the one that will help me raise the next better LLM? I think I already got like 40% of the dataset I find valuable, all I need is to find someone with the other 40% and we could go in a journey together to find the remaining 20%. Sounds like the adventure of a life time.
Not a single photo of the office, in an article talking about its merits?
It has already happened. Philips has designated 3x months for a single toothbrush lifespan, which may or may not be the case (depending on one's toothbrush using habits) as the head clearly does not annihilate automagically after three months. For the sake of the conversation, let's say the recommendation is valid.

Where it gets more interesting, though, is actually not at Philips but at shops that sell replacement heads. Sale assistants do go out of their way to actually lie to their customers and tell them that a single toothbrush head will last, like, many-many-many months. And when asked at the next shop visit about why the toothbrush started yelling three months after replacing it, they will blink their eyes and literally inform the customer of «having never heard before about it from any other customers». The situation happens on a regular basis, and the only recourse that works with such people is brushing the pesky flies aside and politely ignoring them. Since not every customer can or does that, the ink business of electric toothbrush replacement heads prospers.
I think that's true for a lot of (most?) people. I just chuckle at articles that state it is true for everyone.
Recommend Clickup highly for multi user flows on a free tier (infinite users), only issue you can not attach many files (have uses google drive link for that earlier)
You seem to be nitpicking when the reality is that this is a person who is aggrieved at service of legal process, caused by Amazon, unjustly compelling him to do disproportionately onerous legal work, all in an attempt to discredit and/or dissuade him, and/or gain something for a countersuit. It's really not clear where you're going with this nitpicking, nor why. For the common person that's a pretty damn good approximation to being "sued", not that most people in this comment thread have actually said that in any case. So it's either a weird flex or a pretty bad faith attempt to throw up chaff.
They eliminated the server-tier licensing so now you have to go cloud or go datacenter, which is much more expensive.
Mostly because if you are caught selling something illegal you're in for some serious trouble, unlike overseas sellers in selective jurisdictions.
Also, every website would have to have a way to do this. That's a massive bootstrapping effort that, you can't change every website in the world very easily, there'd have to be a very massive advantage for them. I don't see the evolutionary pathway to get your suggestion implemented.

Besides, this already exists anyway, it's basically:

brong+secretkey@fastmail.com

Or if you have fastmail style subaddressing:

secretkey@brong.fastmail.com
> which has often made me wonder: do these people use this software themselves, and if so, do they take any pride in it?

Agreed - Jira is functional but there are endless little annoyances like this.
My usual problem is that I work across two project boards, and no matter what board you're on, the default project that Create Task picks is the last board that you created a ticket on, not the project for the current board that you're viewing.
L2 is unified on all CPUs I'm aware of. Only L1 is split between instructions and data.
Also the test is adversarial, it’s not about throwing softballs to a child. The interrogator should have a good understanding of what constitutes intelligence, the kinds of mental faculties humans have, and ask questions that thoroughly test those faculties.
I have found in practice it can be annoying for ChatGPT to start lecturing me in response to a prompt that is not particularly controversial or edgy. I think this is a problem with the one-size-fits-all models. To give a kind of rough analogy, imagine that every time you watched a film or show - which would most likely be an older film or show - with cigarette smoking, your smart TV showed a pop up dialog warning you about the dangers of smoking. If you're an educated adult who already knows about these dangers, you might just find that annoying and condescending, and not "aligning" with your preferences.
It was a nice walk through of the big picture process and all that but a hidden gem I came away with was checking out the sources for tables he used in the slidedeck. Particularly the Large Model Systems Organization out of UC Berkley [1] who have a Chatbot Arena running leaderboard based on open human feedback where they show two responses to your prompt, you pick a winner and then they show you what models were used. Great easy way to see the diversity of output and the similarities can be eye opening too.

[1] https://chat.Lmsys.org/?arena
Me, dumb: I change my Sonicare toothbrush head whenever it tells me to. I haven’t had a cavity in 8 years.

You, a clever toothbrush-hacking genius: haha, the head is new again!

This is neat, and I find the process of reverse engineering the Sonicare toothbrush fascinating, especially sniffing the NFC communication, but please change your toothbrush head every three months.
Travolta lost millions of dollars on Battlefield Earth. That's commitment!
80 GB per GPU and the consumer GPU is purposefully lower memory to induce demand for server grade.
Yes, definitely faster now but crappier.
There's going to be a distribution around the mean of the proctoring of those tests. There may even be outright corruption and bribery going on at the tail end.
Nope, wrong. The number of errors and the magnitude of each is very relevant.
There were rumors floating around that GPT-4 was going to be a 100 trillion parameter model. Those rumors seemed ridiculous in hindsight, but this announcement makes me rethink how ridiculous it really was. 100 Terabytes of GPU memory is exactly what you need to train that class of model.

However, I’m not even sure enough text data exists in the world to saturate 100T parameters. Maybe if you generated massive quantities of text with GPT-4 and used that dataset as your pre-training data. Training on the entirety of the internet then becomes just another fine tuning step. The bulk of the training could be on some 400TB dataset of generated text.
I think this has a lot more memory than Cerebras. Their site doesn't say how much memory they can attach to each Cerebras chip and I've gotta imagine that's because it doesn't look good vs their competitors.
> The median person in field thinks 5-10%, not 2-5%

The median person in the study here, under a particular definition was 5-10%, other comparable studies have found 2%, and similar questions using arguably better definitions in the same study found lower percentages.

> median timelines are shorter than 40 years.

The median person suggested a 50% chance in 39 years.

> since unaligned ASI is the default case

I challenge this assertion. Many relatively smart scholars who are more involved in the alignment space than, presumably either you or I, have put forth cogent arguments that alignment-by-default is perfectly reasonable. Dismissing those out of hand seems naive.
WASM Demo with Rust
Half of my family grew up in Kyiv Russian-Ukrainian, experienced other Russian atrocities, or is still there under duress like my uncle’s family. So you’re already blatantly wrong.

Your entire framing is about low level random anecdotal details instead of the actual high level issues, because you have minimal personal experience on the ground yet entirely ignorant on history or geopolitical reality.
Availability only on GCP and in particular cost.
> Zen 4's L3 apparently maxes out at 384MB(!!).

That's with them holding back and not adding any v-cache. If you stacked an extra 64MB on each of the 12 compute dies, you'd have 1152MB.
These are just my guesses but:

Software for TPU is still in its early stages. CUDA is well established. You can test on a gaming GPU that you can find (locally!) in many markets. XLA is meant to solve this, but first impressions matter and my first impression was that it has not yet "solved" this issue.

TPU is only available via Google Cloud - as far as I know they don't have NVIDIA's widespread distribution to various HPC/supercomputer systems. This also has implications on scaling up more than a few pods, as they will need to be colocated with speedy interconnect (which is provided by the various existing HPC systems that use NVIDIA's chips).

Finally, I think many people are discovering that the supposed benefits of TPU are marginal at best in the face of the types of natural scaling issues that both GPU's and TPU's suffer from when scaling out to e.g. hundreds of pods.

I'm certain that someone with more experience than I could give a better answer though - and again, all speculation. I refuse to use TPU because Google Cloud's system for getting access to said TPU's was horrible for me when I tried it. I believe John Carmack has a nice tweet thread specifying the same issues I ran into.

In general, Google has a habit of developing tech for other Googlers first, and as such winds up ignoring a lot of real-world scenarios faced by researchers/practitioners. NVIDIA on the other hand has been working directly with a ton of institutions and businesses ever since the inception of CUDA.

That their TPU's have seen any adoption at all is mostly due to their research program which granted very cheap access to TPU's to tons of people.