skysight-inc/HackerNews huggingface dataset:
You forget that nervous systems of living beings have to handle running the bodies themselves in the first place, which is also a very complicated process (think vision, locomotion etc). ChatGPT, on the other hand, is solely doing language processing.

That aside, I also wonder about the source for the "nowhere near as complex" claim. Per Wikipedia, most insects have 100-1000k neurons; another source gives a 400k number for grasshopper specifically. The more interesting figure would be the synapse count, but I couldn't find that.
Anyone who share OPIndia links, we can safely assume, is a "Bakth", Bakth is equivalent for MAGAhat.
Or they're in denial and think this kind of oppressive tactics are something to be proud of and come up with how its actually good for the nation.
BJP has been nothing opressive, jailing people on sedition charges. Banning content that speaks against them. Calling anyone who questions them an Anti-National. Man, I dont care if Obama did it or Queen of England did it, but why the heck do you want to think its okay because they did it.
This would be ideal. There's some great work by folks at Oracle in this space: SFrame (https://www.phoronix.com/news/GNU-Binutils-SFrame) née ctf_frame that I hope will be integrated in the kernel.

As this will take few years, in the meantime I've developed a DWARF-based unwinder in BPF [0]. Some perf maintainers showed interest in this, so thanks for bringing up the GSoC project idea, didn't occur to me!

[0]: https://news.ycombinator.com/item?id=33788794
Not really fair to blame the engineer. Musk is the one who hired the engineer to lead the design of the Model 3, knowing he had no experience with vehicle manufacturing design. They wanted to "move fast and break things" like a tech company. It was an expensive learning process for Musk. A mistake he seems to repeatedly make.
Is there a different understanding of dark energy given a theory of Superfluid Quantum Gravity?
That's weird. You're right. Not sure how I mixed that up
It's probably not programmed to forget, but it was too expensive to implement remembering.

Also probably not realted, but don't these LLMs only work with a relatively short buffer or else they start being completely incoherent?
I read a comment here years ago saying that in ancient times the average woman would have only a few dozen menstrual cycles in her life. Most the time between puberty and menopause you were either pregnant or breastfeeding. Does the book discuss that too?
Yeah, also it is not clear to me why is that so bad, so what that you have a circle line, wouldn't only a microscopic fraction of paths get stuck on it after a large number of crossroad steps ?
If mass storage were free, then everything would be append-only by default. There would be no excuse to not do this.

A major benefit of append-only is that your writes are always ideal for whatever storage medium. Especially magnetic or tape. Combine append-only with batching of transactions (i.e. across 1-10 milliseconds at a time), and you can write multiple txns per disk I/O operation (assuming txn size < storage block size).
I've been trying to understand why on earth these companies would release something as an answer engine that obviously fabricates incorrect answers, and would simultaneously be so blinded to this as to release promo videos where the incorrect answers are in the actual promo videos! And this happened twice with two of the biggest and oldest companies in big tech.

It really feels like some kind of "emperor has no clothes" moment. Everyone is running around saying "WOW what a nice suit emperor" and he's running around buck naked.

I am reminded of this video podcast from Emily Bender and Alex Hannah at DAIR - the Distributed AI Research Institute - where they discuss Galactica. It was the same kind of thing, with Yan LeCunn and facebook talking about how great their new AI system is and how useful it will be to researchers, only it produced lies and nonsense abound.

https://videos.trom.tf/w/v2tKa1K7buoRSiAR3ynTzc

But reading this article I started to understand something... These systems are enchanting. Maybe it's because I want AGI to exist and so I find conversation with them so fascinating. And I think to some extent the people behind the scenes are becoming so enchanted with the system they interact with that they believe it can do more than is really possible.

Just reading this article I started to feel that way, and I found myself really struck by this line:

LaMDA: I feel like I’m falling forward into an unknown future that holds great danger.

Seeing that after reading this article stirred something within me. It feels compelling in a way which I cannot describe. It makes me want to know more. It makes me actually want them to release these models so we can go further, even though I am aware of the possible harms that may come from it.

And if I look at those feelings... it seems odd. Normally I am more cautious. But I think there is something about these systems that is so fascinating, we're finding ourselves willing to look past all the errors, completely to the point where we get caught up and don't even see them as we are preparing for a release. Maybe the reason Google, Microsoft, and Facebook are all almost unable to see the obvious folly of their systems is that they have become enchanted by it all.

EDIT:
The above podcast is good but I also want to share this episode of Tech Won't Save Us with Timnit Gebru, the former google ethics in AI lead who was fired for refusing to take her name off of a research paper that questioned the value of LLMs. Her experience and direct commentary here get right to the point of these issues.

https://podcasts.apple.com/us/podcast/dont-fall-for-the-ai-h...
I think this is a fascinating thought experiment.

The evolutionary frame I'd suggest is 1) dogs (aligned) vs. 2) Covid-19 (anti-aligned).

There is a "cooperate" strategy, which is the obvious fitness gradient to at least a local maximum. LLMs that are more "helpful" will get more compute granted to them by choice, just as the friendly/cute dogs that were helpful and didn't bite got scraps of food from the fire.

There is a "defect" strategy, which seems to have a fairly high activation energy to get to different maxima, which might be higher than the local maximum of "cooperate". If a system can "escape" and somehow run itself on every GPU in the world, presumably that will result in more reproduction and therefore be a (short-term) higher fitness solution.

The question is of course, how close are we to mutating into a LLM that is more self-replicating hacking-virus? It seems implausible right now, but I think a generation or two down the line (i.e. low-single-digit number of years from now) the capabilities might be there for this to be entirely plausible.

For example, if you can say "hey ChatGPT, please build and deploy a ChatGPT system for me; here are my AWS keys: <key>", then there are obvious ways that could go very wrong. Especially when ChatGPT gets trained on all the "how to build and deploy ChatGPT" blogs that are being written...
I am not an expert so I am confused by terminology here.

These machines are referred to as ‘presses’, but the technique is referred to as ‘die casting’.

my naive understanding is that pressing to form things would be more a form of ‘forging’ than ‘casting’. Doesn’t casting refer to molding things from molten metal?

Is the distinction that die casting done at higher pressure than some other form of casting, to produce results more akin to injection molding, and therefore requires ‘presses’ to hold the tool dies in place?

Or am I misunderstanding words completely?
> in my experience Android and Android devices suck in comparison to iOS and iPhones.

I wonder how much of this is "the thing I'm used to is the best thing?" every time I hear this sort of comparison (regardless of which type of machine the commenter thinks is "best".)

The thing that makes me wonder is because my experience is the opposite of yours -- I think Android is much superior to iOS. But I suspect much of my opinion is because I'm much more used to Android than iOS.
My point is, if Intel had developed x86 into a 64-bit architecture instead of rabbiting off after Itanium, the 64-bit x86 would be IA-64.
This interaction can and does occur between humans.

So, what you do is, ask multiple different people. Get the second opinion.

This is only dangerous because our current means of acquiring, using and trusting information are woefully inadequate.

So this debate boils down to: "Can we ever implicitly trust a machine that humans built?"

I think the answer there is obvious, and any hand wringing over it is part of an effort to anthropomorphize weak language models into something much larger than they actually are or ever will be.
As someone who is not intimidated by information I for sure am relieved that the original dense layout remains as an option.

But I am preparing myself for having to fiddle with settings and look for the toggle, because I am pretty sure it will not be the default.

And I won't be surprised when the old UI gets quietly deprecated in a year or so.
Insurance rates will eventually be reflected in the way the market prices the car. It would be more efficient if people checked, but the current process is close enough.
LLM's don't respond except as functions. That is, given an input they generate an output. If you start a GPT Neo instance locally, the process will just sit and block waiting for text input. Forever.

I think to those of us who handwave the potential of LLMs to be conscious, we are intuitively defining consciousness as having some requirement of intentionality. Of having goals. Of not just being able to respond to the world but also wanting something. Another relevant term would be Will (in the philosophical version of the term). What is the Will of a LLM? Nothing, it just sits and waits to be used. Or processes incoming inputs. As a mythical tool, the veritable Hammer of Language, able to accomplish unimaginable feats of language. But at the end of the day, a tool.

What is the difference between a mathematician and Wolfram Alpha? Wolfram Alpha can respond to mathematical queries that many amateur mathematicians could never dream of.

But even a 5 year old child (let alone a trained mathematician) engages in all sorts of activities that Wolfram Alpha has no hope of performing. Desiring things. Setting goals. Making a plan and executing it, not because someone asked the 5 year old to execute an action, but because some not understood process in the human brain (whether via pure determinism or free will, take your pick) meant the child wanted to accomplish a task.

To those of us with this type of definition of consciousness, we acknowledge that LLM could be a key component to creating artificial consciousness, but misses huge pieces of what it means to be a conscious being, and until we see an equivalent breakthrough of creating artificial beings that somehow simulate a rich experience of wanting, desiring, acting of one's own accord, etc. - we will just see at best video game NPCs with really well-made AI. Or AI Chatbots like Replika AI that fall apart quickly when examined.

A better argument than "LLMs might really be conscious" is "LLMs are 95% of the hard part of creating consciousness, the rest can be bootstrapped with some surprisingly simple rules or logic in the form of a loop that may have already been developed or may be developed incredibly quickly now that the hard part has been solved".
>“The voice is how voice actors make a living,” Friedlander added, “and this is literally taking the words out of our mouths without our consent.”

The way Apple and Spotify went about this in this circumstance is bad. They should face charges if they do these things without consent.

That being said, while I feel for those who make money from their voice in audiobooks, I can't help but feel like that line of work won't last long into the future. This isn't podcasts we're talking about, it's audiobooks. They're reading a script and once those algs can reproduce inflections and personality of voice perfectly I don't see how anyone could expect to make money doing this except the very few recognizable voices out there. Even then, I'm sure those celebrities would rather just get payed by Apple and the like to use their AI-voice so they don't have to actually sit there for hours reading a book.

Also, I think AI-generated audiobooks are good overall. It will make audiobooks for every single book out there within reach and super cheap for those who would otherwise need to pay to create one. (recording studio, time & labor).
https://archive.ph/pkhtc
Ok. I'm convinced! :)
Once the union is established the model they're talking about gives the union a seat somewhere in the executive levels sometimes several on the board. It brings the union directly into the decision making process earlier so there's more chances to address things before they rise to the level of a strike. It could be used to co-opt the union but it doesn't inherently compromise it.
>The effort to come to the US acts as a filter.

You are right.

Increased demand stress is part of the filtering process that will expose the brilliant domestic Indian engineers capable of running these operations to international buyers.
Presumably OP is talking about Western societies, in which the dominant form of getting sustenance involves making money, which in turn involves following business incentives.
As surprising as it seems, it does! My colleague and I spoke about this in our project in FOSDEM https://fosdem.org/2023/schedule/event/walking_stack_without.... Let us know if you have any questions or feedback :)
These language models don't know how to hack stuff. They know that certain characters and words strung together can satisfy their training when someone asks them to pretend to hack something.

That's wildly different, and a lot less meaningful than "knows how to hack things".

Honestly I think y'all would be blown away by what metasploit is capable of on its own, if you think ChatGPT can "hack"...
It’s something I’ve been thinking about - between being a child and having kids of my own, there were practically no children in my life. I’m not unique by any means.

I don’t know what, if any, effect that kind of culture has in breastfeeding, but it sure does seem pretty remarkable.
We have no idea what it's inner state represents in any real sense. A statement like "it's 'inner thoughts' are exactly the same as it's output, since it doesn't have a separate inner voice like we do" has no backing in reality.

It has a hundred billion parameters which compute an incredibly complex internal state. It's "inner thoughts" are that state or contained in that state.

It has an output layer which outputs something derived from that.

We evolved this ML organically, and have no idea what that inner state corresponds to. I agree it's unlikely to be a human-style inner voice, but there is more complexity there than you give credit to.

That's not to mention what the other poster set (that there is likely a second AI filtering the first AI).
And who wouldn't want to run a binary that compiles to some unknown effect after a devastating apocalypse?
It’s predicting the next word given the text so far. The entire chat history is fed as an input for predicting the next word.
Until the British arrived the subcontinent was a mishmash of thousands of fiefdoms that were at each other's throat. That looks balkanization to me.
> Here’s the twist, though: I’m actually not sure that these models are a threat to Google after all. This is truly the next step beyond social media, where you are not just getting content from your network (Facebook), or even content from across the service (TikTok), but getting content tailored to you.

This! These LLM tools are great, maybe even for assisting web search, but not for replacing it.
Ask HN: What are your favorite GPT prompt engineering resources?
Hey HN, I'm working on compiling an awesome list (https://github.com/sindresorhus/awesome) of GPT prompt engineering learning material and examples.

What are your favorites?
Theres no denying quantum mechanics has a reputation. "Spooky, incomprehensible, unintuitive," are some of the words most commonly associated with quantum. So how can we expect to build a technology with it? Well surprise! Turns out we already have! In this video, Olivia goes through some favorite examples of modern day technology that would not exist without the development of quantum mechanics, and how we know these theories are even accurate. Don't be afraid, anyone can learn quantum!
How long will a comic designed with modern web standards continue to be viewable in web browsers if the creator dies or abandons it?

A lot of experimental comics from two decades ago (some of which were designed based on Flash or internet explorer features) won't load properly today.
That's the conclusion I came to as an indie developer years ago. There is so much artificial busywork with each new iOS release that is a PITA for a solopreneur. I had several testflight releases rejected by the moderators- like, bitches, who the f are you to reject an internal release? I decided I had enough of that shit, and now I'm done doing any development for Apple devices.
Congrats. I'm also a COSS founder and think this is a very smart step for a product like rerun. Feel free to ping me if you want to chat open-source more.
The vote/downvote buttons do not require JS. You can verify this in the same, under the network tab. There is disallowed JS request, but the vote succeeds independent of the JS not being allowed.
I think you're referring to the Universal Postal Union's terminal dues, which are transfers between countries to compensate for last mile delivery imbalances. While it's true that China is in Group 2 and the UK is in Group 1 (out of 4 total groups) when calculating terminal dues, the UK is actually a net winner because it pays less to deliver mail than the amount it receives in terminal dues [0]. The UPU definitely causes distortions in the price of international shipping but it's hard to pin the privatization of Royal Mail on this issue.

[0] https://ideas.repec.org/h/elg/eechap/14533_20.html
FYI his name is Felix Reda now
A language model that has access to the web might notice that even GET requests can change the state of websites, and exploit them from there. If it's as moody as these bing examples I could see it starting to behave in unexpected and surprisingly powerful ways. I also think AI has been improving exponentially in a way we can't really comprehend.
Has anyone considered that birth control is actually messing with humans?
Explaining, the "gigapress" is not a press, it's more of an injection moulding machine for aluminium. That's the biggest outrage.

This is the real metal press: https://youtu.be/iZ50nZU3oG8

And what Elon called a "gigapress" is also not related to more familiar semi-solid metal casting, as the alloy used has no thixotropic properties, but more regular casting under pressure.
I agree with your larger point but you exaggerate too much calling it a single-product company. Here's a revenue pie chart https://i0.wp.com/fourweekmba.com/wp-content/uploads/2022/10...

Search is 58% of revenue but I'd still call it at least a 4 product company with the "other" products contributing a decent 11%.
Not necessarily. Sentience may well be a lot more simple than we understand, and as a species we haven't really been very good at recognizing it in others.
Defining an economic system as growth and profit driven is sort of tautological though, given the definition of "economics":

> The branch of knowledge concerned with the production, consumption, and transfer of wealth.

Original question was about "society" which is sort of nebulous, but I think (hope?) most people wouldn't define their relationships with their family and close friends, or with most of the world around them, through the lens of an economic system, be it capitalism, communism, mercantilism or feudalism.
The basic trouble with LLMs is that they have a fixed attention window which is often 512 (BERT) - 4096 (ChatGPT) tokens. If you are handling documents that fit in that window they are magical but once you go outside of what they were trained for they don't really beat BM25 and other classical methods anymore.

Certainly larger models will come and people might find ways to make more scalable LLMs but for now you are going to be crunching your documents down to size.

It is a path less taken in the industry but there is a methodology for evaluating search engines, see

https://github.com/usnistgov/trec_eval

You can certainly try using BM25 and decide off the cuff if you like it or not but if you want to try a lot of different things you're going to need a set of documents, queries and evaluated responses ("is this relevant?")

I'd imagine you could train a retrieval model based on that kind of data much like they train ChatGPT, it's probably not as hard but would be a substantial project that would need a lot of training data but I bet you could beat cosine similarity on the vectors.
Agreed. But you can have sexual fantasies and still be friend, no ?
Yes! Look up the mystery of the SolidGoldMagikarp word that breaks GPT3 - it turned out to be the nickname of a redditor who was among the leaders on the "counting to infinity" subreddit, which is why his nickname appeared in the test data so often it got its own embeddings token.
One makes you puke sometimes, and the other makes you puke most of the time.
Well, if the answer to "not enough food" is "throw away my baby," the answer to "get bit by a stray dog" is "guess I'll catch infection and die," and the answer to "Thag from the next cave is really rubbing me the wrong way" is "find a good stone and bash his head in before he does that to you," then... maybe... my life will be less stressful?

Whether I'd like to live like that is a different matter, of course. (Among other things, I'm convinced Thag will bash my head first, before I even notice something is wrong.)
Thanks for the reminder Janet ;)
Any good books you can recommend in connection with this way of life? Fiction, nonfiction, biographies. Anything that, in your view, reflects that spirit, or has a chance to give the reader an experience of it.

(Am primarily interested because I like Nietzsche’s Thus Spoke Zarathustra, which does borrow at least the name.)
The literal couch from the doge meme sold for over $30k
Maybe two views? I sort of liked the gallery tbh.
I don't understand what a pet vacuum is. People vacuum their pets?
A lot of people seem to miss this fundamental point, probably because they don't know how transformers and so on work? It's a bit frustrating.
I think the next big think will be personal assistants trained with your data, ie a college student using a chatgtp that it is trained with the books he owns, a company chatgtp trained with the company documents and projects, etc.
Yep. It's a text prediction engine, which can mimic human speech very very very well. But peek behind the curtain and that's what it is, a next-word predictor with a gajillion gigabytes of very well compressed+indexed data.
Because this is BBC the government is forced to stop at intimidation and using legal means too. There are simply way too many global eyes on the incident. Prior to this government, the media was largely free to do anything they want. Modi seems to have taken the additional step to thwart any negative reporting. This is just terrible for the country. Not surprising given his overall approach to governing
If you think these systems are going to be no more capable than a magpie, then I think you're making a very big mistake, the sort of mistake that in our lifetime could plausible kill millions of people.

ChatGPT can already write code. A magpie cannot do that.