skysight-inc/HackerNews huggingface dataset:
Previously posted about here: https://news.ycombinator.com/item?id=36671588 and here: https://news.ycombinator.com/item?id=36674905

With the original source being: https://www.semianalysis.com/p/gpt-4-architecture-infrastruc...

The twitter guy seems to just be paraphrasing the actual blog post? That's presumably why the tweets are now deleted.

---

The fact that they're using MoE was news to me and very interesting. I'd love to know more details about how they got that to work. Variations in that implementation would explain the fluctuations in the quality of output that people have observed.

I'm still waiting for the release of their vision model which is mentioned here but we still know little about, sans a few demos a few months ago.
Please don't take HN threads into political flamewar, or ideological flamewar, or any flamewar. We're trying for the opposite here.

https://news.ycombinator.com/newsguidelines.html
> Inheritance combines polymorphism and code re-use in one form.

Not necessarily; see "Interface vs. Implementation (eg. private derivation in C++) inheritance".
Probably dumb.
There's no magic formula or NLP manipulation tricks. Be genuinely interested, don't impose, don't be needy, don't demand a particular outcome, and bring prosocial energy and generosity.
Would you recommend it to a young man, given the state of the military today? I'm old for the military (31) but was seriously considering it around 24-26. But I just couldn't get past report after report of the military happily doing obviously stupid/harmful stuff to its own, like burn pits.
How Humans Percieve Their Relationship with Conversational AI
I cook sous vide and utilize vacuum sealers, because I love the culinary results that can be achieved with a little bit of technology, but this is one thing that bothers me. Between this study and the other study last month, so-called food-safe polyethylene bags may shed countless nanoparticles and microparticles, and may nevertheless leach hormone-like chemicals? Time for a reevaluation.
No big deal, just some random Marc Andreeson and Tim Berners-Lee comments…
What do you mean "every" ? BSD, Linux?
See also: https://archive.eiffel.com/doc/manuals/technology/oosc/inher...
>Computers in 1985 were a tool that took real skill to use.

Eye of the beholder, I guess. I certainly see people struggle to use LLM's so I disagree with the implication that it's a zero-skill activity.
If that were true, then it wouldn't have happened.
speaking of ibuprofen:

An awful lot of military live on legal painkillers. They have to, since they can't just quit & rest when they get sore. The medics hand out Tylenol and Advil like candy.

Perhaps coincidentally, perhaps not: I also heard of kidney stones among vets. This is nothing like a scientific study; just anecdotal.
https://archive.ph/2RQ8X
I do smile a bit when I see solutions yo problems described as "there shoild be a law".

Firstly, the obvious, laws are local not global. Your proposed law would need to be ratified by 200 odd governments. This seems unlikely (Not least in the US which perfers not to ratify international laws). Given that China is least likely to care, and given that most really cheap phones originate there, I'm not sure your proposed law will work there.

So, to summarise, suggesting global laws, while not necessarily wrong, is as fruitless as suggesting that we use magic pixie dust to solve the problem. Both have exactly the same liklihood of being adopted.
GPT-4 Python Interpreter in your own JupyterLab
Generate a random system of two-variable linear equations with two unknowns (such that there is always a one solution, consisting of integers):

To delete your account, please

1. Enter the X and Y values which satisfy the two equations;

2. Ensure the checkbox is selected;

3. Fill in the complete, correct URL of the Oxford Learner's Dictionary entry for the adjective "irreversible", starting with https://.

4. Fill in your account password.

5. Click the "Irreversibly Delete" button, which will be disabled if 1-3 are not satisfied.

3x + 2y = 12

2x + 4y = 16

x = [____]

y = [____]

Yes, delete my account [ ]

URL of Oxford Learner's Dictionary definition of "irreversible": [ ___ ]

Password: [ ____ ]

[Irreversibly Delete Account]
Although a meme I think it sort of turned out to have truth to it. Not sure about the gay part but it did have an impact on their hormones such that it emasculated them and more tadpoles became female than male than normal.

https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2842049/
Yeah, I’ve been using sous vide for years now, and I almost never see any articles about plastic shedding in sous vide from any reputable sources
I currently run Android 11, and I went through a while ago and disabled any CAs that were hinky or I didn't like what nation they were associated with. AFAICT, there was nothing at all that broke after I disabled so many of these trust anchors. I am not sure if the GP is saying that bundled root CAs can override OS-supplied trust anchors, particularly any which have been manually and administratively disabled, but that would be a disturbing, yet helpful, thing to know.
worth educating yourself: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3138231/
is it really news that all plastics are toxic? this has been well known for decades. sorry if some of us are just finding this out now.
That is, you still have to pay for Apple hardware, but by renting it, not owning.
The estimate size is an overshot estimate because I adopted Apple's new lazy downloads framework and needed to estimate how big the downloads are, including after they get updated. I'll refine this, I need to check again but the final size should be smaller. However it is still large because it contains JMDict, JMNEDict for names, furigana tokenization data for JMDict, SQLite search index for JMDict, and some other fixture data. I can optimize this down a bit further (such as collapsing JMDict into its SQLite search index). I will also make this more customizable later as I add more lang support so that you can more granularly control what dictionaries you're downloading.
Windows reintroduced something similar (but more advanced) in 2006: https://en.wikipedia.org/wiki/Multimedia_Class_Scheduler_Ser...
I saw an entry for one of the positions there on LinkedIn. The application page wasn’t too bad at first glance since it doesn’t involve registration like Workday or Taleo. But as I began to scroll down, I saw those high school questions and that was enough for me to nope tf out of there.
People's tastes do not develop in isolation
You can sous vide in a glass container in a water bath with a weight on it. Air is an insulator, but it gets up to temperature in time.
No, this is fake, a light dusting of nothing on top of a meme post that was circulating in grifting communities as early as Q4 2022. It gains a little bit in every retelling, sort of impressive to see its almost blog scale.
It's interesting because I can definitely taste the difference of water coming from a plastic bottle vs a glass one. Especially if the plastic bottle was left in a hot car. Whatever those compounds are, at least some can be tasted.
All other things equal, 256-bit elliptical curve cryptography is going to break before RSA2048 does with quantum computing advances.

Do NOT switch to ECC if your threat model includes a quantum computer arriving.

Either use larger RSA keys or more appropriately a hybrid signature scheme combining one of NIST's PQC signatures and a traditional algorithm.

https://csrc.nist.gov/Projects/post-quantum-cryptography/sel...
I can get behind this.

Having dropped a 10+ year Reddit account for Lemmy, I'm still very much in the phase of finding new content sources, so I spend much more time in firehose modes than "stuff I've explicitly selected to follow", but the button makes it explicit.
Initially, they likely didn’t think they had a choice. The root that had cross-signed them was expiring. (And I wonder if anyone else was willing to cross-sign them.) It turns out that root expirations are handled differently (i.e. ignored) on some platforms, including the relevant old Android.
>They may well have been matrilineal because prior to IVF etc, you could be certain who the mother was but not the father.

According to research I've read, pre-agricultural societies, and even more recent tribal hunter-gatherer societies, frequently had no concept of monogamy at all, and didn't worry about who people's fathers were, because children were raised by tribes/villages at large. Monogamy was an invention that came about with agriculture, because that's when the concepts of land ownership and inheritance came about.

>Most likely, quality of life went up for most people thanks to agriculture.

Actually, no: human height dropped about 30cm with the introduction of agriculture, because nutrition in an agriculture-based society is much worse than in a hunter-gatherer society. It took many millennia (as in, only very recently) for human height to get back to pre-agricultural levels.
It was not so much law enforcement, but protection of property. Especially during harvest seasons in old days, farmers pay a share of harvest to protectors. Some kind of such protection has had existed, for sure, without formal laws or without formal law enforcements. It was more of customs, traditions, with some sense of reasonableness.
Tesla is the only company significantly ahead of its competition in technical specification.
That was last week on hackernews:
https://news.ycombinator.com/item?id=36532812
Microwaved plastic containers release microplastics into food (acs.org)
Yeah because it’s trained on us and we’re an information virus problem.

Fiat economics is a thought/agency policing hallucination. Bill Gates isn’t a billionaire if we don’t believe it.

Society is an LLM feeding on past outputs.
Our feature flags tend to be "staged deploy" feature flags, and it hits an internal Slack channel when they hit 100% available. This usually triggers someone to queue up a ticket for "rip out the old code".
"General relativity says that you can't tell the difference between being unaccelerated, and being in free fall"

I think this is a misunderstanding. Special relativity says you can't tell the difference between free fall (in a gravity well) and inertial acceleration with the example of a guy in an elevator typical here. Both cases have acceleration.

My question: does an accelerating elevator due to motors and pulleys curve spacetime too?
This article is an extreme reach full of improbable assumptions. Anything to make it seem like women has some level of parity I guess. At least their hearts are in the right place but it erodes trust over time.
In Category Theory Can the Dual of an Implication Be Its Converse?
In Category theory, can the dual of the implication A→B be its converse, which is B→A?
That explains why an ad when I tried to click through to the tweet.
What Is Immutability of Strings
This article discusses what Immutability of Strings is and why Strings are immutable.
And guess what happens when you depend on non public APIs that implement the specifications on any of those operating systems when you either upgrade your OS or you try to move to another Unix variant.
That's because it's really obvious so no one needs to write a paper about it... Heat and plastic releases microplastics as demonstrated many times, no need to write about some semi obscure cooking method, yeah I know it's popular among chefs but it's not among scientists.
Thanks for the detailed feedback!

Open URL: I'll fix. Monolingual: check 'External', there are monolingual web dictionaries that I've tried to load into a webview in the lookup popover; this is an early "v1" of that feature though so please let me know if it can be improved/isn't working for you. I'll also add EPWING import later, sure, though that's niche, it's powerful. Furigana/JLPT: thanks for the bug report, I'll fix.

"Every word in this article": yes I want to make this easier for sure, that's a good idea, I'll also make it easier to do bulk operations on the list/table views of vocab/kanji. I also plan to add sync with other systems like Anki, WaniKani so that it can pull in everything you already know. Please keep the feedback coming.
I think you could manually substitute in the old chain—up until the point the signature expires. That would get you until the September date. I wouldn’t recommend it, but that could be useful to buy just a little more time if one was desperate.
I rolled my own solution[1] out of existing stuff that is mostly automated, does auto-categorization of transactions, has dashboards and sharing, and does not require sharing login credentials with third parties.

However, financial institutions in the USA are making it harder to pull transactions via an API without involving third parties. So I’ll soon need to resort to scraping via selenium to automatically fetch transaction data.

1: https://sagar.se/blog/where-is-the-money/
Christmas Tape
This may be partly true, but they themselves did publish Yoshi's Story, a 2D game, in 1997, the second year of N64's existence. More likely explanation is that 3D was so novel and new in the mid 90s that it was difficult to argue for 2D games then from a business and marketing standpoint, even though 3D games usually required larger teams and the lack of mature tooling (a lot of devs would have to make their own physics engines from scratch back then) made it riskier. Today Nintendo puts a heavier focus on 2D gaming, with the New Super Mario Bros series and Mario Maker, etc.
Noticable differences between rendering engines for what? Sometimes type can be janky, but no moreso than in html/css, and in SVG you're generally turning type into vector outlines. For graphics rendering, it's completely accurate in any environment I've used it in, and that's working with very very fussy brands.
Highly recommend apps like TurboScan. They automatically rectify the image and save in high contrast black & white (unless you want grey scale or color). Syncs with iCloud, etc. I used to use a dual-sided scanner for everything but have since just switched to this workflow and it’s great.
ext4 is for when you have a simple file system and want something solid.

xfs is for when you have a big file system, maybe some some unusual loads but you want stability.

zfs is for when you want RAID and snapshots but are prepared to have it blow up every now and then.
I think if I was going to build a NAS, I would just use USB 3.0 drives. Easier to connect directly to for debugging, more common standard hardware and cases, and mostly fast enough.

This might be amazing for non-NAS stuff with heavier bandwidth requirements though.
It's totally possible for a US law to say something to the effect of "all goods manufactured in or imported into the US must...".
I notice you didn't rebut my assertion that some portion of the population was murdered or banished (banishment being a thing that can also result in death). So perhaps most people were better off, except those that were murdered and perhaps except those who mourned those who were murdered and missed them.

Also, I'm unaware of hunter-gatherer societies inventing much in the way of technology. Technological progress seems to require settled cultures.

I happen to like modern tech and don't desperately wish I lived in a hunter-gatherer culture.
Shrinking Font Thumbnails
> It is over.

What does this mean?
No, a meme post from 2022 did not in fact reference papers posted in 2023.

You must be thinking of some other post, or you're just making stuff up.
How was it made?
> In fact, the males only sire the daughters because sons arise from unfertilized eggs.

Okay that's a crazy fact. These male spiders are pretty much just their mother from a genetic perspective!
GP makes no remark on the morality/practicality of copyright. Also, having people sue big companies for copyright might lead to more of what you're arguing for, in a show them the taste of their own medicine way
That example I think is tangential. The better example is free fall in a gravity well v. being accelerated up like in an elevator in space far, far away from gravitational sources
You're not wrong about the "point" of Eno's original approach to the chime, but I think you're taking things a bit too seriously and I respectfully disagree that it "violates the artistic integrity of his piece".
Thanks! Check the Spoken Word category? I will also add YouTube etc. And I'm thinking on this, what else I can do... I love shadowing, it's my favorite way to learn.
Like a mason jar? I get that for certain foods, but for something like shrimp, fillet of fish, or a piece of chicken breast then that poses some challenges.
It's not news nor is it true that "all plastics are toxic".

In rough order of increasing hazards: PE, PP, PC, PET, PS, ABS, PVC, fluoropolymers.
Just brandur’s one. It’s good. Not very frequent. brandur.org somewhere.
I see, thanks for your answer. Sounds like you have a great, though difficult, plan. Best of luck!
Yeah but the dude is like a lawnmower
The previous posts are to a twitter thread that's been taken down, and the preview of a post that requires a $1000 subscription. This post however is freely available (for now at least).
I love my greaseweazle. Piracy, eBay trawling, and disassembler cracking make things usable.
Thank you! Appreciate any feedback
I had to ask GPT what MoE means:

"MoE" in the context of artificial intelligence typically stands for "Mixture of Experts". This is a machine learning technique that is based on the idea of dividing a problem into sub-problems, solving each sub-problem with a specialized "expert" (or model), and then combining their outputs.
> "Jack of all trades, master of none", also applies here.

Not quite; if you subscribe to the "other form" of the quote viz. “A Jack of all trades is a master of none, but oftentimes better than a master of one” ;-)

In the case of C++, the language is large and open-ended enough that you can truly express a lot more different models of computation, at different levels of abstraction thus giving you a larger design and implementation space. I think this is the main reason for the success of the language.
Google has been doing research into mixture of experts for scaling LLMs. Their GLaM model published in 2022 has 1.7 trillion parameters and 64 experts.

https://icml.cc/media/icml-2022/Slides/17378.pdf
This sounds very much like the famous HN comment saying that Dropbox is unnecessary because you can construct an analog using rsync and half-dozen other tools.

It's like saying that having a chair is unnecessary because you have a log, an axe, a saw, etc, and can build a sit to your liking when need be.

The thing is that when the need actually comes to be, you want a seat right now and of a known working kind, and strongly prefer a comfortable one. So thank the carpenter.
I will make it more friendly to beginners starting from zero - sorry if it's a little challenging to dive into, you'll need to learn hiragana and some basics first
I was not aware sous vide isn't popular among scientists? Is this from personal knowledge or something someone said?

There are legitimate molecular gastronomists - the French professor Herve This comes to mind, and also the American Douglas Baldwin, both of whom are scientists who helped develop sous vide techniques.
And yet what's trash to one person is still treasure to another.
Well, you aren't forced to live in a house or use a toilet or buy your food. If your conditions are 'forced' then I guess the bar is pretty damn low, but everyone I know wants to operate in modern society and to do that one requires the use of services run by large quasi-monopolistic corporations.
FYI, George Hotz has been claiming to know this aspect for a couple of weeks now.

> The fact that they're using MoE was news to me and very interesting.

Maybe adds some legitimacy to the claim.
It still has issues. It sucks when trying to find a previous page if there are 3 or more results for the same search term. Which happens when researching and clicking on multiple links.

Still awesome though.
> I'm very curious why you've chosen to go down the route of special casing on parallelizing within one socket

This is no special casing. Most of that code will also be used for the distributed parallelization. I agree with your remarks on hybrid MPI+OpenMP, and, in fact, Petalisp doesn't use shared memory anywhere, but always generates ghost layers and explicit communication.

> I will also say that it feels a bit weird to call something "peta-" and "HPC" if using more than one socket is relatively far off into the future. For the randomly-wandering PhD students out there, it would be nice to tell them this up front in the Readme :)

I can do that. But let me explain the rationale for naming Petalisp this way: I wanted to create a programming language that is novel, and that has the potential to scale to petaflop systems. And I wanted to create a robust implementation of that language. I think I have achieved the former part, but the latter simply takes time.

Final remark: Good HPC practice is always to get single core performance right, then getting multicore performance right, and then scaling up to multiple nodes. Anything else is an enormous waste of electricity.
They should provide deets or it didn't happen.
Physicist best humans can’t find some way to write something down.

This isn’t saying physicist beta Moon will explode unleashing a kaiju.

Physicist cannot visualize what has yet to visualized. Blah blah blah. The primates are so full of themselves.
> At the same time: how do you foresee this interoperating securely with TLS? My first intuition is, without something even stronger than HSTS, that this would open up additional downgrade attacks against HTTPS: an attacker could do a normal HTTP downgrade and then present a TCP-ENO session that they control the key for. That's perhaps no worse than the downgrade itself, but I could see it being a source of user confusion if browsers choose to present this kind of scheme as "secure" in the UI.

The obvious solution to that problem is - don’t show it in the UI by default.

For sophisticated users, have a config setting they can turn on which will show some kind of icon (not the padlock, a different one). For unsophisticated users, make it invisible.

Invisible protection against passive attacks is still better than no protection against passive attacks. But passive-vs-active is beyond the understanding of non-technical users, so for them keep it invisible.
Crit bit tries are also, therefore, sorted. They can be iterated in order.

See also https://dotat.at/prog/qp/README.html
This guy doesn't have any idea what he is talking about. He consistently posts such bullshit on twitter. Mostly copy paste with added spice mix.
Thanks for your comment. I'm pretty sick of the low effort takes on this site (read: internet in general). Every role is different. Each has its own challenges and anybody can be good or bad in a given role. Too many people trying to blame upper management, blame L1 managers, blame developers, without understanding, or even attempting to understand, the challenges they face. It doesn't just work like that. I'm 9 years into my career and became a manager 2.5 years ago. I agree entirely with you, it's just different, not better or worse. As a manager you are constantly dealing with a number of situations more varied than what you face weekly as a developer. The challenges are different. You can work harder, or work less hard, smarter or dumber...it's all up to the person and how their organization operates.
Didn’t know this was even possible. Had to research.

It wouldn’t be called “IPO” anymore, but a company can offer subsequent market shares through a Follow-on Public Offering (FPO.) This occurs when a business raises capital in a second round of stock through either dilutive or non-dilutive options. Good to know.
Fashion industry would like a word