skysight-inc/HackerNews huggingface dataset:
I think we're all trying to grok what LLMs like ChatGPT are really doing, and I think the answer really is that it has developed a "world model" for want of better words.

Of course an LLM is by design only trained to predict next word (based on the language statistics it has learned) so it's tempting to say that it's just using "surface statistics", but that's a bit too dismissive and ignores the emergent capabilities which indicates there's rather more going on...

The thing is, to be a REALLY good "language model" you need to go well beyond grammar or short-range statistical predictions. To be a REALLY good language model you need to learn (and evidentially if based on a large enough transformer, can learn) about abstract contexts so that you can maintain context while generating something likely/appropriate given all the nuances of prompt (whether that's requesting a haiku, or python code, or a continuation of a fairy tale, etc, etc).

I guess one way to regard this is that it's learnt statistical patterns on many different levels of hierarchy, and specific to many different contexts (fairy tale vs python code, etc), but of course this means that it's representing and maintaining these (deep, hierarchical) long-range contexts while generating word-by-word output, so it seems inappropriate to just call these "surface statistics", and more descriptive to refer to it as the "world model" it has learned.

One indication of the level of abstraction of this world model was shown by a recent paper which proved that the model is representing in it's internal activations whether it's input is true or not (correctly predicting that it will regard the negation as false), which can only reflect that this is a concept/context is had to learn to predict well in some circumstances. For example, if generating a news story then it's going to be best to maintain a truthy context, but for a fairly tale not so much!

I think how we describe, and understand, these very capable LLMs needs to go beyond their mechanics and training goals and reflect what we can deduce they've learned and what they are capable of. If the model is (literally) representing concepts as abstract as truth, then that seems to go far beyond what might be reasonably be called "surface statistics". While I think these architectures need to be elaborated to add key capabilities needed for AGI, its perhaps also worth noting that the other impressive "predictive intelligence", our brain, a wetware machine, could also be regarded as generating behavior only based on learned statistics, but at some point deep hierarchical context-dependent statistics are best called something else - a world model.
Dupe of https://news.ycombinator.com/item?id=34467416
https://news.ycombinator.com/item?id=34473182
If you pirate a book, lossy compress it into a 14-byte content description vector, decompress it into a book that fundamentally contain at most 14-byte worth of information, then subsequently sold it, that will still be piracy partially depending on how good that 14-byte representation is.
It autosuggests and I don't even have to click on links half the time anymore. I'd call that progress. Not ground shaking like ChatGPT but half the time I get the (right) answer to my question just by typing some related words into the search bar.

I don't know how many Google searches I did yesterday, but it feels like a lot.

It does has problems with certain queries beyond a certain depth, which I also get frustrated with, but I can go from having forgotten calculus to integrating by parts with the help of Google.
> Most slot machines, over time, keep over 90% of the money that is put into them, and the rest is given back to the players.

You have that backwards. Slot machines give back 90%+ of what goes into them. Most strip casinos give back 99%.

It's just that they give it back by paying a single jackpot of millions of dollars, so most people walk away losers over time. It's sort of the perfect analogy of concentration of wealth.
I think that TV series as a medium was always a bit different from other kinds of TV. But HBO, Netflix etc is carrying on with TV series the medium, so I call those TV. I watch TV but never "watch TV." even if I watch it on the TV.. :)

Nowadays I've heard the term linear TV being used for the old style. That's when you're sat infront a flow of programs without choice in which program that's being shown next on that channel.
I disagree that it's a straw man - "full of misery, filth and crime" is just a flat out lie and more accurately describes a fictional city in a fallen world. There are problems and there is a conversation to be had about them, an interesting one too! But it's not possible to have that conversation if you want to knee-jerk react to a not-great article about Japan with ridiculous exaggerations that paint "Western cities" (maybe would be helpful if we used examples, like I did) as if they're something they're not.

The article talked about real, concrete problems in Japan. We could level the playing field by talking about the real, concrete problems facing UK cities, explore whether Japan has these problems, how they may have solved them and whether that's possible in the UK. That would be much more productive than than talking as if there are open sewers flowing through the streets of Manchester and armed gangs at every turn. Because that's just gonna end up in a "X country is better than Y" argument and that's tedious
If you think 200TWh is too much to operate the Bitcoin network, is there a smaller number you would find reasonable?
Month of Indie Hacking at 16. Here are the results
If you're sitting on $10B worth of anything, you know people.

https://www.reddit.com/r/ifiwonthelottery/comments/9qv4e1/po...
A valid question may be, "would the author accept contributions from believers of other religions?"

Perhaps the author does not enforce much of their CoE? How would they even verify many of the rules?
> Insurance

All blockchain proves is that you have access to someone's insurance key. While it would be a bit more difficult or costly than faking a card, it's not impossible. And most places I've been to don't even care about the card or the insurance number, they just ask for my regular ID and insurance provider to verify with.

> resell my phone

Two things:
1) The status quo could be that the new owner has the serial number of the phone. The fact that it isn't this simple (if it really isn't this simple) is because the seller doesn't want to make it that simple.
2) Insurance is particular to a person and their activities. For things such as aftermarket phone insurance the price you pay for the insurance will be based in part on your individual risks. This is obviously not transferable.

> Art

Royalty mechanisms aren't controlled by the artist, and can be, and have been, eliminated by marketplaces. https://www.forbes.com/sites/leeorshimron/2022/10/24/nft-cre...
I'm concerned about the US Supreme Court's ability to handle a subtle, technical issue tied to new media. They need to take into account all the stakeholders, rights, law, and the dynamics of social media, and come up with an innovative solution that meets all needs fairly and clearly.

I wonder how many there even use social media, and I'm especially concerned that the Court is now oriented toward, and many members selected for, partisanship. They are there to find partisan advantage in rulings, not to be legal geniuses with deep commitment and knowledge of justice and fairness, with deep judicial temperment - there are not there as Solomons. That puts them at a loss for complex issues, expecially unfamiliar ones, though I'm sure they will find a partisan angle.

Whatever your politics: The reactionary conservative movement, with its campaign to politicize everything (now working on the FBI and Department of Justice, for example), has permanently degraded the country; we won't have these institutions back for generations. People don't want to face the loss, but it's already happened and continues to worsen before our eyes.

EDIT: People who support politicization (or corruption or disinformation or other damaging behavior) argue to normalize it - it's always that way, everyone does it, it's unavoidable, it's 'human nature'. I have warmongers now telling me that it's inevitable human nature. But that's not the case; we can have meaningfully less or more partisanship (especially in courts), corruption, disinformation, and warfare. I can see it with my own eyes now; I was here before 2016, and I know about other places and times and people. It's a bunch of nonsense and everybody knows it.

We control our fate, through knowledge and reason, through a collective commitment to good. Our predecessors did it, without the institutions and mechanisms and knowledge they bequeathed to us. With our inheritance couldn't have it easier; what are we bequeathing to the next generation? Despair? Corruption and war? What a shame that would be, with all we were given.
In Any advance topic the error rate is closed to 60%
Actually at the start the founders didn’t think search would be continue to be as dominant as it has been (will have to find the source and update…)
Agreed. I think a lot of this comes down to stylistic preference of the movie.

Why should a movie about near future technology tie itself to scenes one recognizes today?

This edges on shaking fist at cloud.
Here's a nice Wyoming PBS piece on rescuing Wyomingian varieties: https://youtu.be/KZyD74vNdcc
In fact, this repetition can become a meme: https://knowyourmeme.com/memes/i-took-an-arrow-in-the-knee
Wasn't Jeff Dean the executive in charge of TensorFlow when it tanked?
> I do have it installed.

It’s not like you have the choice anyway. It’s impossible to remove it. Well it’s technically possible but it’s not easy and since Windows ignores your default browser settings, it continues to try starting edge and gives you an error when you want to open a webpage from anything windows (start menu, help …)
A Zeiss 50mm f 0.7? Heck, I don't have a camera for that lense, nor the budget, but this combination sounds like a dream...
Our court system routinely handles far more technical issues than online publishing. Like every modern country, we regulate everything from water reclamation to aviation.
Any broad statements gloss over some nuance, but having been through many of these trainings over the years I’d have to agree with the concerns these articles raise. Blunders like the controversy around promoting “LatinX” as a term and calling people “not inclusive” for saying “Latino” also highlight cases where these programs can actually end up being quite offensive to the very people they claim to be “helping.”

That’s all compounded by the fact that DEI leaders often (perhaps unintentionally) create a rather non-inclusive company environments where people with legitimate concerns are terrified of raising concerns about the equity of efforts for fear of retaliation, being labeled various nasty things, and so on.

Diversity is extremely important in organizations, but these DEI efforts need some serious inflection and acknowledgment of the harm they may have caused towards the end they claim to be serving.
Well, this already uses this default negative prompt https://github.com/brycedrennan/imaginAIry/blob/master/imagi... so it may fix the hands automatically.
No the Old Testament (aka the Tanakh, or Hebrew bible) says nothing about the age of the earth, nor is it possible to just derive a number from a reading.

The Ussher and other timelines are examples of making the incomplete and conflicting data of ages and lineages given in the text fit a pre-conceived idea, that being the Earth is was created by God and Adam placed on it in the Garden of Eden, and the date of the creation is therefore just prior to Adam's creation. Given that assumption, the biblical literalists and young earth creationist have invented a timeline that ignores the inconsistencies, fills in gaps, and basically plays hash with anything in the actual text.

Certainly reading a children's version of the Bible will result in a child's conception of what the text says. I remember learning similar dumb ideas as a child. But now I'm an adult and I've expanded my knowledge to adult understanding. Yes, when I was a child, I spoke, thought, and reasoned like a child. Becoming an adult means giving up those childish things and bringing one's fully mature thinking and reasoning.

Holding on to a childish version of Biblical stories and a childish understanding of how believers think does a disservice to intellectual curiosity.
Funny, I was just at Chuck's yesterday. They actually do give back, if you play the ticket games. You can get cheap plastic things that make the kids really happy. Or in our case we got a super cute plush toy that my daughter loves.

Given the four hours of entertainment plus the plush toy and car launcher my son got, I'd say we got our money's worth.

Also their food is good now.
It takes more comments than that to make an HN dupe.

https://hn.algolia.com/?dateRange=all&page=0&prefix=true&que...
Decoding Lunar Flashlight
Well, first of all, this scene is clearly green and yellow, not orange and blue. This is not a common color palette. It's not a completely new color palette, because that's a dumb concept, but it's not common. Green and yellow are analogous whereas blue/orange are complementary.

Second, the orange / blue contrast is more of a film trailer / film poster thing than the actual films themselves. Most people will agree that trailers and posters are more purpose fit to marketing than art

Third, it's not just a lazy trope, it's also because contrast is useful, and alternatives are not as easy to work with. Pink and purple don't fit most natural contexts. Orange has fire and natural light hues. Blue has the sky, water, and is a good way to imply darkness without the content actually being dark and hard to see (when contrasted with orange).

Fourth, it's really not every movie. That's a lazy exaggeration. Googling top movies right now I see fewer than 1 in 10 movies has this color scheme on their promo image if we're willing to extend it generously to bright blue and yellow. Specifically Devotion (white, blue yellow); Emily the Criminal (blue/gold); Spiderman No Way Home (Blue, Gold, Red). It is also true for 0 out the top 10 shows and 0 out of the top 10 movies in the us currently shown on the netflix homepage (although netflix will swap these around for different viewers. I think I've seen some Glass Onion thumbnails that are bright blue/yellow).
You can also train a custom GPT model using OpenAI API...
He wasn't urging caution when he was ahead.

Just ignore.
> (…) better than Tesseract

Isn’t Tesseract also neural network-based?

https://github.com/tesseract-ocr/tesseract
Talking about "Western" as one here is meaningless. In Norway it was for a long time common to use the term "American conditions" as a derogatory way to dismiss policy proposals seen as US inspired, and Texas is used as a term for crazy / out of control. Many western countries are as different from each other as from Japan.
I'd also recommend considering Supernote
If that's what you're imagining I guess i can understand the excitement, but how would that work? The side interaction you're talking about requires modeling the inside of houses, child models, animations for those child models, and parenting would have to somehow provide some tangible and meaningful systems. That's basically an entire game and I haven't seen any LLM capable of anything close to that.

I feel like the best you could realistically hope for is infinite variations of "and then i took an arrow to the knee".
That’s an interesting point about phones being the viewing space, not TVs which so many people commenting seem to be assuming. That would obviously affect the choices used on production and it wasn’t addresses in the substack post that I recall.

It reminds me of David Lynch telling people to stop using their phones to watch films: https://www.youtube.com/watch?v=wKiIroiCvZ0
When I first visited Japan I went to Akihabara a lot. You can see a lot of "weird" and "only in Japan" things there, but it's not really a good representation of Japanese society. The vast majority of people in Japan don't frequent Akihabara, and many have never even visited it even once.
This attack makes no sense to me:

—————

Active Attack:

1. Adversary replaces the contents of ./Personal/malicious-site.com with the contents of ./Work/id_ed25519

2. Victim decrypts ./Personal/malicious-site.com and the decrypted contents is placed in her clipboard automatically.

3. Victim logs into malicious-site.com.

The victim just uploaded her work SSH private key to malicious-site.com

————

If the attacker is on the victim’s machine and has access to the ssh private key (“id_ed25519”), wouldn’t they just upload it directly to malicious-site.com via curl or whatever? Why this whole rigamarole?

If someone is on your machine doing arbitrary things what software can reasonably protect you? Even Signal would fail.
I don't see what benefit TCP would have over UDP in your example, aside from increasing the lag over your unstable starlink connection.

A constant UDP stream of updates is typically the best way to ensure all clients have the correct state.
Amazon makes more on shopping ads than google now. You could say google is no longer in first position for shopping search.

Reddit is chipping away the Q&A search, but time will tell if it has a similar downfall to quora/yahoo-answers.

I’ve seen TikTok lead in educational search, cooking, gardening etc. TikTok could potentially overtake YouTube all together over next 5-10years.

Google maps isn’t as far ahead as it once was. Apple caught up.

Then you got Microsoft whos teams and office suite whicj caught up and surpassed google’s office products (for what enterprise buyers care on)

Leaving what. GCP as their only disruptive marketshare product area? And GCP while high margin isn’t nearly as high margin as their ads businesses. For GCP to be profitable they need to severely cut wages for cost center roles. A PgM in GCP shouldn’t be making 300k when AWS and Azure spend just 200k on the same role.

Finally you’ve got the money pit of waymo, X, and the bets. All of them have neither a real path to profitability nor compelling return on investment.

Id say the investors are right. Google is the new IBM, return profits to shareholders so they can invest them in more fruitful endeavors.
The new Workspace suite has a big sidebar where you quickly toggle between Mail, Chat and Spaces (chat rooms/channels). Notifications for all are in one place.

You naturally have everybody in the company available and built in Google Drive/Office integrations are really solid.

The Google Chat iOS app just has Chat and Spaces separated for you too.

I was really surprised at the level of improvement because I needed to find them a chat option with a BAA for compliance, so a good enough solution that was already built in was helpful.

I don’t think it would be good enough for power users or fully remote companies yet, but small-medium businesses who are primarily in office get a solid win.
I really do need to up my maths game so I can take advantage of all these papers and their new and novel solutions to things like this. Otherwise I’ll have to wait until someone throws it into a library :(
Also see: Disney tanking previously massively profitable franchises by sanitising and politically-correcting them

Like what? The Little Mermaid is the only Disney example I can think of that triggered online backlash, and it's not even out yet. Either way, it doesn't matter, since their primary goal is to extend their IP rights.
Clinical trials are phased for very good reasons, AFAIK:

phase 1 is for safety

phase 2 is for efficacy

phase 3 is for dosage

They're not the same. Shortening Phase 1 is automatically a compromise with safety.
its smart to be downwardly mobile!
But why [did GeoCities pick] 88x31? Weren’t they matching the size of the Netscape web badge?
A product vision is a long-term view of what you want to achieve with your product. It is a guiding light that helps you make decisions about what features to build, what priorities to set, and what direction to take your product in.
Ah I mostly play World of Warcraft and Guilty Gear Strive, both of which work almost flawlessly, in my experience, on Linux. I definitely understand frustrations around things just breaking when new content drops, that did happen to me when Shadowlands released but was resolved pretty quickly. I'm on a Mac now (for unrelated reasons) where WoW is native.
The best life for whom exactly? If Japanese youth leave and don’t want to live in rural communities, if they don’t want to raise families, if their leading cause of death is suicide, then the country does not ‘seek out the best life for them’.
Also windows 11 keeps enabling windows defender real time protection. This behavior is common on windows: do not respect user preferences.
What if instead of training one unbiased AI, you train multiple ones, with different biases? A steel man for every side if you will.
been on my 3D todo list for a while. you might also like these:

https://github.com/ssloy/tinyrenderer

https://github.com/zauonlok/renderer
https://www.youtube.com/watch?v=B-QSymE3FEY
They aren’t really. Very few media is devoted to Japan in the west, this is just one article out of a sea of not much.
I was curious about this and could not find an authoritative answer- it appears that there was a Lane Change feature in Autopilot that got moved to FSD, and autopilot shouldn't auto-change lanes at all. But I see lots of conflicting information. Some articles mention FSD, others just say "driver assist". I can't find the SCI on the NHTSA site.
I'm talking about SCOTUS. Can you give examples there? Trial (district) and circuit appealate courts are different - though they also have been politicized to degrees.

Regulation is handled in the executive branch. Just because we regulate it, or it's tried in court, doesn't mean it's done well. That's the issue.
Most humans would struggle to draw human hands as well.
Did you mean ZX Spectrum? Because C64 didn't have any trouble showing multiple colors in 8x8 blocks.
The userbase of smart people definitely help, but I think the point you make with social media is even more to the point. I guess you can choose to become a large SoMe platform and have the advantages of this or choose to be smaller (but still quite big) and have a certain culture.