skysight-inc/HackerNews huggingface dataset:
Potentially open source models will much better, but it won't happen fast and it may require new forms of crowdsourcing stuff. Wikipedia did not happen by miracle, people build the infrastructure that allowed to compile knowledge in such a way.

Similarly we need to think how to develop large models in the form of so-called public goods.

Open source models will actually face less resistance (more transparent) and less friction about copyrights etc.

The main disadvantage of open source is that building user interfaces to models requires expensive specialists that usually don't work for free. So, just like the UI of linux and other open source apps is forever a bit dated, the UI of models (not just the GUI, but the whole setup) will be less slick.
Of note:

"... our technique works poorly for larger models, possibly because later layers are harder to explain."

And even for GPT-2, which is what they used for the paper:

"... the vast majority of our explanations score poorly ..."

Which is to say, we still have no clue as to what's going on inside GPT-4 or even GPT-3, which I think is the question many want an answer to. This may be the first step towards that, but as they also note, the technique is already very computationally intensive, and the focus on individual neurons as a function of input means that they can't "reverse engineer" larger structures composed of multiple neurons nor a neuron that has multiple roles; I would expect the former in particular to be much more common in larger models, which is perhaps why they're harder to analyze in this manner.
This is not relevant to GP's comment. It has nothing to do with "are there fixed 'themes' that are operated in each hemisphere." It has to do with more generally, does the brain know what the brain is doing. The answer so far does not seem to be "yes."
It is usually not billed monthly. They SAY it’s $5/month, but your actual price is $60 right now, for a whole year. That’s a huge difference. You’re paying a good portion of full price, with the “benefit” of having it stop working after a year.
Apple already went down that road with bitcode and they abandoned it, or so I thought.

The problem is that you can't solve the problem of developers not adopting new hardware features by abstracting the hardware to a lowest common denominator, which is what WASM does and what it will always do (because the web guys have no interest in letting people write ARM or Intel only web pages, let alone NEON only web pages). You can see this problem in the writeup where the use case is posited to be SIMD, but that's only one of many possible features CPU vendors could add. What about all the others? Now instead of waiting for Android devs to adopt new features, you have to wait for WASM to get it and users to update their OS and Android devs to then adopt the new features as well. This doesn't sound faster.

So I'd guess that a better investment would be in better developer toolchains and emulators.

There are other problems with that approach:

1. How can devs measure performance if it's the Play Store that compiles the app? Upload it, download it and measure that? You never know what you're gonna get and the app may even be recompiled behind your back without you even doing a release.

2. An example of a painful transition was 32->64 bits, said to be hard due to the need for doubled up testing. Well, WASM doesn't fix that and it's not obvious how it could. It has a 32 and 64 bit variant and the need for testing both versions is driven by the way C/C++ work, not the way native code is expressed.

3. Even just abstracting SIMD isn't all that easy. The Java guys have spent years designing a SIMD abstraction that covers up the differences between AVX and NEON. C++ doesn't have any such abstraction, you literally code against intrinsics for the specific instructions. So it would only work if you assume a really awesome auto-vectorization compiler module, but the JVM guys also spent years trying that and eventually gave up. The JVM can auto-vectorize some things, but to exploit the full power of SIMD units automatically is too hard.
Beautiful. Thank you for that link.
Ask HN: How can there be backdoors in memory chips?
Been catching up with the news lately, stumbled upon allegations against Micron [0] (does anyone remember Bloomberg's SuperMicro scoop?).

How does one put backdoors in DIMMs? Flash memory? What is the threat model? Assuming airgapped computers, will a memory backdoor simply xmit secrets in an RF side channel?

[0] https://www.theregister.com/2023/04/01/china_micron_probe/
Do you think that iCloud is excellent?
"We and our partners process data to provide:

Use precise geolocation data."

Flag this website.
Restic Backup Android App (Unofficial)
There is no recommendation made here. These are observations and far from clinical guidelines, or anything any doctor would recommend you do.
You possibly have a relevant point if it wasn't for the fact that we are already at a crisis in regards to loss of privacy and its impacts for society.

In this respect, any further loss is of significant concern.
What federal investigators say after the fact doesn't change what happened in the moment. The hospital refused the treatment during a medical emergency. The article also quotes a hospital spokesperson who sticks by their behavior suggesting they will do this again in the future.

At the very least, doctors need to think about these issue during medical emergencies in many red states in ways that they don't have to in blue states. I personally don't want my doctor to have to consult legal counsel before giving me the treatment the doctor knows I need.
The Bronze age collapse is one of my favorite topics in History. And I see a lot of parallels between the centralized palace economies that produced much brittleness then and the 'everything is controlled by networked digital computers and defined in software' Ruby Goldberg machine of a civilization we have now.
How can it not be? Please explain.
Goodbye to Roblox on Linux with their new anti-cheat and Wine blocking
The party is over.
Then I guess I'm a philospher too: do what I say, not what I do.
Yeah, and so are e.g. canned veggies or beans or fruit. More food touching plastic, but somewhat less botulism and spoilage than before we did that.
...but you can use a mouse and keyboard with the iPad. And an external display.
He didn't say behavior. He said explanations of behaviour. Split brain experiments aside, this is pretty evident from other research.
We can't recreate previous mental states, we just do a pretty good job (usually) of rationalizing decisions after the fact.
https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3196841/
The reason why we are tired and what to do about it [video]
The latest CDC Homicide Mortality by State numbers show neither Florida nor Texas even in the top 20:

https://www.cdc.gov/nchs/pressroom/sosmap/homicide_mortality...

Although many of the highest homicide states are in the South, such as Mississippi and Alabama, many are not, such as New Mexico and Illinois.

Region-wise, the contention "the region the Big Apple comprises most of is far and away the safest part of the U.S. mainland when it comes to gun violence" is not supported by the data. Taking the latest FBA violent crimes (2016 is the latest I could find online broken down by Metropolitan Statistical Area) homicide rates per 100,000 inhabitants:

https://ucr.fbi.gov/crime-in-the-u.s/2016/crime-in-the-u.s.-...

The safest MSAs in America, tied with zero homicides in 2016, are:

Albany, OR M.S.A.
Bangor, ME M.S.A.
Casper, WY M.S.A.
Columbus, IN M.S.A.
Dalton, GA M.S.A.
Danville, IL M.S.A.
Iowa City, IA M.S.A.
Lewiston-Auburn, ME M.S.A.
Missoula, MT M.S.A.
Ocean City, NJ M.S.A.
Oshkosh-Neenah, WI M.S.A.
Rochester, MN M.S.A.
St. George, UT M.S.A.

These are all relatively small, here are some larger MSAs with lower homicide rates than New York-Newark-Jersey City, NY-NJ-PA M.S.A.:

Boston-Cambridge-Newton, MA-NH M.S.A.
Gainesville, FL M.S.A.
Midland, TX M.S.A.
Santa Fe, NM M.S.A.
Urban Honolulu, HI M.S.A.
Portland-Vancouver-Hillsboro, OR M.S.A
College Station-Bryan, TX M.S.A.
Fargo, ND-MN M.S.A.
Minneapolis-St. Paul-Bloomington, MN-WI M.S.A.
Boston-Cambridge-Newton, MA-NH M.S.A.
Seattle-Tacoma-Bellevue, WA M.S.A.
El Paso, TX M.S.A.
Naples-Immokalee-Marco Island, FL M.S.A.
San Jose-Sunnyvale-Santa Clara, CA M.S.A.
San Diego-Carlsbad, CA M.S.A.
Deltona-Daytona Beach-Ormond Beach, FL M.S.A.

Thus the contention of "the Big Apple comprises most of is far and away the safest part of the U.S. mainland when it comes to gun violence" does not appear supported by the data.

(EDIT: The most violent top 20 MSAs in the USA belie the notion of homicidal violence as being associated with a particular political party, on either side; it is a pan-American issue: Guayama, Puerto Rico M.S.A.
San Juan-Carolina-Caguas, Puerto Rico M.S.A.
Ponce, Puerto Rico M.S.A.
Fairbanks, AK M.S.A.
Detroit-Dearborn-Livonia, MI M.D.
New Orleans-Metairie, LA M.S.A.
Memphis, TN-MS-AR M.S.A.
Mayaguez, Puerto Rico M.S.A.
Mobile, AL M.S.A.
Philadelphia, PA M.D.
Baltimore-Columbia-Towson, MD M.S.A.
Savannah, GA M.S.A.
Auburn-Opelika, AL M.S.A
Flint, MI M.S.A.
Hammond, LA M.S.A.
Salinas, CA M.S.A.
Chicago-Naperville-Arlington Heights, IL M.D.
Albany, GA M.S.A.
Montgomery, AL M.S.A.
Shreveport-Bossier City, LA M.S.A.)
> I think people might be tempted to jump ship.

Jump ship to where? Oculus?
I guess it's true, not just a rationalist but also effective altruist!
That's not what OP is asking. OP is asking for an overall intuition for "all" of mathematics, not just what a proof looks like.

It takes a while undergrad degree worth of pure math study.
I believe it has been admitted that the bulk of it is sexting. They try to hush that sort of thing, up, though, because that would be admitting it's mostly a made-up issue.

There's also the revenge-porn distributing of sexting. Wrong, but hardly child sexual abuse.

If they're keeping track of what everyone is searching for I'm probably way up there on their watch lists--I've done a lot of suspicious looking searches fleshing out ideas for answers to the worldbuilding forum on StackOverflow. And I recall long ago a discussion where someone asserted snuff porn was widely available--probably broke a few meters in the monitoring HQ on that one. (No--found nothing that wasn't obviously fake and said so. I did find the very discussion thread on page 1, though.)
Yeah, but this time, it doesn't have access to native parts like dll.
True, but not the strongest example...
A phone contains private photos, conversations, has authorized access to email, chat and social media accounts, it's a second authentication factor, it has payment cards, saved passwords, browser history, potentially health data (for example, period tracker and medication notification app) and other data that they might not want anybody else to access, or could even cause them problems if the wrong person saw some of (which doesn't mean it'd be something illegal or inappropriate - but some teachers have really weird ideas about how the life of a student should look).

Touching it without permission is unacceptable. Ask the student to put it away, pull them out of the class if they don't - but don't touch the phone.
Have you tried Sourcegraph's LLM assistant, Cody, yet?
You can always turn off NAT, LAN announcement, Relays and STUN -- and run SyncThing behind WireGuard. I use Tailscale and it works like a charm.
> I am gobsmacked at just how terrible modern vehicles are.

Okay, but in fairness to modern cars as a whole, how long has it been since Chevrolet was considered a high-quality brand by the market? Forty-five years?
You think that “different cultures have different attitudes towards food” is an extreme claim?
Creating effective assessment tools for energy-efficient buildings
βαίνω and Bein are completely unrelated. "kommen" (and english "come") are related to βαίνω.
I guess some companies do not have problem of hiring even if it's not perfect conditions for you personally
I found the piece a bit lacking:

>"Givers think that conversations unfold as a series of invitations; takers think conversations unfold as a series of declarations."

The author refers to take-and-take, and then uses "giver" and "taker" pretty euphemistically. I think that quote is the closest thing to a definition of either type that we get. I'm relatively sure they mean giving and taking opportunities to contribute to conversation, but they don't seem to explain it well and that leaves one projecting ones own notions onto the piece.

Meh.

I mean, I know something about improv, so I kinda knew from the headline what they meant about doorknobs; it didn't feel like there was much other substance.

Maybe I skimmed too fast.
This. When I was a kid, history classes were my least favorite. I just had very little interest in what I was being taught.

At some point, I started to notice that we're all showing up "in the middle of the story", so to speak, and stories about the past are immensely helpful for putting the current moment into context. This is true for what we think of as "textbook history", like the history of politics and war and the rise and fall of nations, to put current world events in context, but it's perhaps even more valuable for smaller things that matter to us more immediately in day-to-day life.

I have found that reading about the history of a scientific or mathematical field helps the ideas stick much better when trying to study. Learning about my parents' and grandparents' lives before I was born made some aspects of my childhood make a lot more sense. And reading about the history of the software and tools we use helps illuminate some of the design decisions and tradeoffs that were made.

For me, that shift didn't happen until I was well into adulthood, and I suspect that's common. I think once you reach a point where parts of your own life feel like "history", like a prelude for where you currently are, then it's a lot easier to notice the value of history in other areas.
I bet today’s 1000$ there will be no such thing as AGI in 50 years.

Unless the definition of AGI will be bent to fulfill the craving.
just not in the US != only in the EU
If you direct the model output to itself and don't view it otherwise, how is it not an "internal stream of thought"?
I agree with the substance but I don’t agree with airing dirty laundry on Twitter.

I’m not an exec but I’ve said things at work I regret. I’m sure many of us have. You just say a stupid thing here or there sometimes. It seems destructive to bring that all out publicly on Twitter.
Which was funny to me because it wasn't until well past 2000 that any of my educational systems were Windows; grade school was Apple IIs and early Macs (one was color!) and high school had higher end Macs.

Cheap clones able to run 1-2-3 was a big part of it, but the real lightning bolt for everyone I knew was Windows 95 and the Internet. And most of the kids I knew would push their parents towards the Windows for the games.
Not enough is bad so more than enough must be better?
That's still irrelevant if you can't use it as XMPP, it also doesn't work exactly as XMPP either.
I heard him on Lex too, and it seemed to be just a given that AI is going to be deceptive and want to kill us all. I don't think there was a single example of how that could be accomplished given. I'm open to hearing thoughts on this, maybe I'm not creative enough to see the 'obvious' ways this could happen.
Even so, backing things up with data and proving things via the scientific method is one of our most powerful tools we have to get people to listen to an argument. Without controlled experiments, why should anyone take your position or the opposing position on the issue?
Guardian is a leftist magazine. Why are they carrying water for employers?

Oh, it's an op/ed by an employer. Laughably transparent.
ugh no
>> But reading in this article and others they discuss manic behavior as well as periods of deep depression.

Ah yes, like all great therapists a diagnosis based on reading 3rd through 6th hand articles. Or maybe just an excuse for being a bad human being.
This is the business version of, "well actually I could do this in a weekend."

The potential for one decent connection for future jobs/coworkers (referral bonuses!)/cofounders is very high with something like this. 50 euro is fine. If it's too high, the market will signal that. If it isn't, it will fill up.
Because they have arguments that AI optimists are unable to convincingly address.

Take this blog post for example, which between the lines reads: we don't expect to be able to align these systems ourselves, so instead we're hoping these systems are able to align each other.

Consider me not-very-soothed.

FWIW, there are plenty of AI experts who have been raising alarms as well. Hinton and Christiano, for example.
The article misses one of the design goals that's pretty obvious if you look at the reverse-engineered Airtag protocol: they don't do any public key cryptography at all on the tag itself. And the reason for that is that it would wreck their battery life.

Anything that relies on "attestation" violates that constraint.

Of course, another possible approach would be to JUST NOT HAVE THE NETWORK...
This brings to mind the CANBUS hack article on HN a few weeks ago...horrifying but fascinating to think you can steal a car by attacking it's IoT headlight..
Diet coke has a pH of 3.2-3.6. Something that is "basically just water" shouldn't dissolve enamel.
Privacy concerns aside - I'm unclear on the specific approach used in this study and how it differs from previous work and would love some input as to whether my interpretation is correct.

From my reading, the tl;dr is that they:

- Build a subject-specific model to predict fMRI activations when presenting a subject with words

(I don't believe this is novel in and of itself. I know it has been done with ECoG - [1] off the top of my head but I am fairly certain there are others. so maybe using fMRI is the main advance here?)

- Use GPT to generate candidate sentences, and see which candidates most match the true activations.

(This method of narrowing the solution space seems new.)

The improvement on within-subject accuracy over between subject leads me to believe that this is an actual benefit, but I'm struggling to determine how they quantify the improvements over and above "GPT is good at predicting human language".

I may be misunderstanding the approach altogether however, so take this with a grain of salt.

[1]: https://www.ucsf.edu/news/2021/07/420946/neuroprosthesis-res...
As a long time electronic music producer, I make sure once installed my primary software is never updated as a rule[0]. My flow doesn’t make bouncing everything to audio feasible and there is nothing worse than opening a project you have worked on for a few months to find that it sounds… different. Counter-intuitively, learning to predict and deal with crashes and working around known bugs on the fly is way easier than stopping everything and spending days debugging what exactly messed up your sound—you have a few hundred of interwired devices, and if it turns out that a small change in some arpeggiator timing algorithm or macro wiring, intentional or inadvertently caused by some improvement, is impossible to completely revert, lost inspiration aside you may feel some pretty dark emotions because the thing as you knew it is basically gone.

So while the App Store model of forced updates was barely acceptable in case of toys for sketching ideas like Figure, Reason Compact, iKaossilator, etc., with my primary DAW? and I have to pay for these updates, too? For as long as App Store offers no requisite controls, proper desktop software (and of course all hardware) will rule, and I know I’m not alone with such a flow.

[0] The only exception is if all tracks I started in this version were finished, and that never happens. Otherwise the new version gets installed on a new machine, I’m not in rush.
One piece of analysis missing from Macrosticks is how hand size and shape is influencing individuals' preferred hold. The author seems to have an underlying thesis that it's all about how the holder learned, but I don't believe it.

I learned at ~8 and my "ah ha!" moment came when I realized that it was easier to hold chopsticks with my left hand despite writing right handed. Now I can do it well enough with both hands.

My hold is somewhat like the "right hand rule" grip, although the lower chopstick fits into the groove of my thumb unlike the reference photos. And while I've tried other grips — as demonstrated to me by Asian friends — they've never "fit" with my relatively large hands.
It means if Google sued (not in all cases), they can block your service from using Transformer model.
Stake ETH at a return of 5% Per year & simultaneously short an equal amount of ETH for the whole year.

This is about 2.5% per year risk free, but this is also lower that the risk free rate (T-bills).

Recall that the 2.5% per year is in ETH, so if the price of ETH increases, by say 10x you return per year is also goes to 25% per year.

You can also do this with NEAR.
The simple answer is that the same subword tokenization algorithm is used for everything, for all symbols of all languages in all alphabets and of all domains (books, tweets, code, etc) and for all other symbols like emoji, which include combined characters, punctuation. If you'd optimize for digit-specific tasks, it would make all sense to have special treatment for digits, but the current widely used models don't seem to do that, at least GPT up to GPT-3.5 doesn't - you can try it out here https://platform.openai.com/tokenizer . And it kind of makes sense, because in actual usage seen in training data IMHO digits are most likely not used for math to represent decimal integers, they're used as phone numbers or components of identifiers like "GPT-3" or parts of mail addresses, things like that which are more common in textual data than math.
This is great! Reminds me of how my uncle can hold two spoons/forks like chopsticks to serve food quickly and efficiently. I never mastered the technique, but it seems like a useful skill to have!
This is a half-truth at best. The places where you can only grow inedible crops are extremely marginal environments and they usually can't support economical densities. These are pretty unique environments like the northern plains and northern central Asia where only a small percentage of the livestock population lives. Even here, livestock are usually fed to the extent that the land can support and then additional feed is provided with crops grown in less marginal environments. For finishing, that's almost entirely human edible crops like corn, sorghum and oats (even if the specific varietals aren't considered edible).
No one wants mass shootings. People just disagree on how best to prevent them and what’s most important about life.

Throwing fuel on the fire just leads to hastier emotional decisions not better decisions.
The biggest problems:

a) Selecting a book, we want something at least one or two members have already read to make sure there's a good recommendation. Going by reviews has not worked well, it's better if someone brings the selection to the group because they have some personal stake.

b) Coordinating the schedule - you want to give people enough time to read the book but two months out the calendar is still volatile so often I have people drop out last minute due to meetings being schedule over, frustrating for everyone and apparently people don't want to tell their manager bookclub trumps work meeting.

c) Recruiting new members, we usually have a steady core group but want to beef up our roster to where we don't end up with awkward 2 people meetings.

Some of these issues don't apply with technical/business book meetings since it can be done chapter-by-chapter. We've done that as well and it's easier but usually after two or three chapters people drop off or lose interest in specific ones.

You could argue that your website isn't concerned with some of the above (e.g. people preselect books, then others show up automatically) but Goodreads and others already do the same for free.