skysight-inc/HackerNews huggingface dataset:
The question is whether an LLM can ever be trained to be good at maths. Currently LLMs can string together tokens that roughly equate to words in order to form sentences that carry particular semantic value. But how much change to the underlying technology would be required to give them the ability to string together digits to represent numbers and then numbers and operators in order to represent equations with particular semantics? I'd suggest it's already able to explain what most common mathematical operations "mean", it just doesn't have the wherewithal to perform them (though it can certainly do a good job of faking it for lower-valued integers that are likely to have occurred in its training data).
I mean, isn't this the whole point of large + deep NNs? To model complex relationships in data? It's odd so many people seem to deny this with GPT and try to trivialise what it does by saying, "it just predicts the next word".

This idea that GPT only works at the level of words and develops no deeper understanding of the concepts in language seems silly given its behaviour. And at the very least it's not what we observe from other NNs. As you point out a CNN will find deeper relationships and patterns between images, so it's only reasonable to assume a very large language model would find deeper relationships in text data.

The only difference here is that in comparison to other problems, text is how humans communicate and encode knowledge. The deeper relationships to be found in text is knowledge + reasoning.

I think we can say with some certainty that GPT models knowledge, the thing people are less sure about is if it learns to reason.

My take on this is that the fact you can ask it stuff that it couldn't know, but it can still "reason" to the correct answer suggests strong that it must have some ability to reason on the knowledge it's acquired.

Here's a really dumb example:

Me: Daisy likes to go swimming on the weekend, but last week she swore at her brother and has been grounded. How does Daisy feel?

GPT: It's possible that Daisy may be feeling disappointed or frustrated since she is unable to go swimming, which is an activity that she enjoys. She may also feel regretful or guilty for swearing at her brother and for the consequences that followed.

This isn't knowledge regurgitation. GPT doesn't know who is made up person is so it can't simply regurgitate something it was trained on. The only explanation for behaviour like this is that GPT has modelled human emotion and can reason about it.
>Do we really have to rehash how and why markets work better in 2023? I mean, we spent the last century watching places that adopted freer markets succeed and places that went in the opposite direction failing

No, we spent the last century watching the utter depravity of free market capitalism be reigned in by regulations. Free markets don't maximize public welfare, they maximize profit for successful marketers.
Fox News makes the laws in Utah?
Did you tried longer sentence and not singles words?
Did you also read the conversation?

Edit: ok it looks like it can now convert in base64, I'm sure it couldn't when I tested 2 months ago.
Actual intelligence in a healthy person fulfills survival needs and even higher order needs of emotions, enjoyment and miraculously spiritual needs. AI is still fully responsive. It only responds to input and provides output. It doesn't yet have self-preservation that is curious or hungry or goal driven. I think this is AI we're most afraid of and we would need to build something very different to create self-actualized AI. I don't think we're there and I'm not so sure it would be a useful effort.
>I guess I shouldn't discount the value of such a thing, once we get the "Sometimes it just lies" problem under control.

Considering the model doesn't "think" or understand abstract concepts, could we ever expect this?
It would be great if the language allowed you to defer choices and program like in Haskell and then add constraints later and end up with the advantages of Rust. Or apply a series of correctness preserving transformations (perhaps GPT can help with that).
If you think so. It seems many people think this.

Time will tell, if this PoV is valid. I can tell you that a flashy, sexy demo, is not the same thing as shipping code.

A number of comments state that the quality of the output is fairly sparse, and amateurish, but this was also a very fast, thirty-minute demo of a marketing workflow, subjected to basic AI tools.

This article was the equivalent of those "Write an app in two hours" seminar/bootcamps.

Valid, but also constrained by the need to teach, and to get done within a certain amount of time. Very strict guardrails, and keep your hands inside the car at all times.

I have taken many, many of these courses, and have given a few. I'm quite aware of the difference between what we produce in a class, and what I'd hand to a customer.

What I think we'll be seeing, quite soon, is "one-person shops," acting as studios/agencies that will take on jobs normally done by large shops.

Like bootcamp babes that go out, thinking that they can now deliver a full-fat app to customers, many will fail.

But some will succeed. Lots of smart, hungry people, out there.

We'll look at what can be done with these tools (which, I should add, are still very much in their infancy. You ain't seen nuthin', yet). I don't think they'll be able to write the deliverables, yet, but that's OK. I think we may be able to leverage them to make those deliverables much more polished and robust.
Don't forget the CEO might ask who will fix the bugs in the app...
You claim that the economy of EU+UK is "a few order of magnitude smaller" than US?

USA is getting a strong partnership next to one of its worst enemies.

Let me pose this question: If US would drop out of NATO, would that mean all NATO countries would drop out, or would the rest of NATO still form an alliance?
Thank-you!
Since the expected permission request pop-up didn't show first time I visited the site, and the address-bar didn't highlight any blocking, and the settings dialog doesn't make it clear whether or not canvas is currently blocked (it has a question and two buttons, neither highlighted) I misinterpreted the default setting.
I don't remember the exact quote but it brings more money to treat people than to cure them.
Because every law we write is ultimately arbitrary. Lines have to be drawn through massive swaths of gray area, those lines are entirely arbitrary and should be a sign that making laws like this is pointless.

The 90s Era gun ban that Biden was so proud of is a perfect example. They had to include so many caveats and arbitrary descriptions of what makes a gun an "assault rifle" that manufacturers just dodged the rules with tweaked rifle designs. Something as small as a thumb hole in the grip made a gun legal because of how specific the law had to be.

In this case, what stops a social media company from coming up with some business model where a child company is spun up for every 4.9m users? You could argue its more like Mastodon, a decentralized network that just happens to use the same proprietary protocol, app, and is owned by the same parent Corp.
In many cases it's a form of a psychological defense - it's way too difficult to live in a reality where your country is killing droves of innocent people so your brain can switch to the "let's pretend that it's a giant lie and continue on" mode. It's the path of the least resistance: "we are the good guys, they are the bad guys, I can live with myself, all is good".
If this is indeed so simple then why chatGPT (meaning web app not LLM) was so buggy ? Did OpenAI use their LLM to make the app or not ?
I can think of a couple of reasons:

- He sees no point in adding another layer of abstraction and complexity to something simple.

- he's into retro computing, and old machines can't handle NNW.

- Fewer and fewer web sites support RSS, so using NNW limits his options.

- Sometimes you want to read the news from a particular web site, and not graze at a buffet.
> Credit card networks already know everything you buy

I didn’t know this.

Let’s say I buy advil, condoms, and dish soap with my capital one Visa card at Walgreens. What information does Walgreens share with visa and/or capital one? I just assumed the name of merchant and the total amount charged was all they needed?

I remember back when I was younger, I’d often see adults requesting the cashier to charge this much on one card, this much on another, bringing out four or five cards. Do all these banks/ card processors get a full list of items sold?
The AI is a product created by a company. A vacuum sucking up the scraped remnants of the internet. Hundreds of millions of dollars are spent to pull this off. Stop acting like this is a human or anything resembling one. This is a product and not a person.
I think if I had to pick a strawman expression to thoroughly defeat, it would be something like "You can't go to the moon by shooting a very big canon".

Because on the one hand, yeah, no explosion-based canon is going to get you to the moon; there's just no way to give a payload enough initial momentum to escape the earth's gravity well without killing any humans in that payload.

On the other hand, once you have canons, Newtonian physics, and an understanding that the moon is a very distant rock and not, like, a spirit god or something, then you have enough information to realize that going to the moon is only a matter of time and enough iterative improvements on those canons. It doesn't require inventing a completely novel technology like portals or teleporters or whatever. (Though it requires a ton of improvements in material science, engineering, computing, etc.)

And I think it's meaningful that From the Earth to the Moon was Jules Vernes' third book, and A trip to the Moon the first science-fiction movie even made. People could see the writing on the wall.

It's harder to make any predictions about AGI, because intelligence is a much fuzzier target than "reaching escape velocity". But it feels like neural networks are closer to the canon than to the pile of chairs: a basic concept that might not be capable of reaching general intelligence, but is only one or two steps removed from one that will reach it given enough engineering and money;
The root of the problem is that no matter how hard you want to believe, the LLM doesn’t actually know anything.

If you gave an idiot something very intelligent to say and he read it out loud perfectly, people might be very impressed too. That’s GPT.
About time. I am willing to disgruntle some dozens of billionaires in exchange for massive QoL improvements for the billions of people.

Just waiting for enough momentum, will happily join/support.
Go to GitHub and file a reproducible issue. In this case it might be “here’s a shell loop that runs a test 10 times. On my system it fails about 40 perfect of the time”
Also increasing temperature might give less bland answers
Super Strike Day on Monday
Researcher Questions the Idea That Media Can Easily Change People Minds
This has the obvious measurement bias of only looking at packages, and not a wider sample of user code.

But I think it’s likely that most users, and most code, are entirely unaware of lazy evaluation.
How to make yourself happier by making your iPhone worse (2020)
Is that in-between drive-by shootings that kill neighborhood kids? I'm sure the neighborhood easily forgives a murdered 12-year old when they see a block party paid for by the gang members.
> using enough training data and compute gives you the results we see.

I think this is key. We don't have a good intuition for the truly staggering amount of data and compute that goes into this.

An example that we have come to terms with is weather forecasting: weather models have distinctly super-human capabilities when it comes to forecasting the weather. This is due to the amount of compute and data they have available, neither of which a human mind can come close to matching.

We have gotten used to this.
US nat. lab. employees are not gov't employees.
Generally I agree (mine are in America/New_York), but I did find [0] and fix [1] a weird bug in Debian's cron that only surfaced when I moved. I was in America/Chicago, moved to America/New_York, and then changed TZ on the servers once they were set up. Afterwards, I noticed that a daily cronjob that was supposed to fire at 0845 was instead happening at 0945.

[0]: https://gist.github.com/stephanGarland/b7cdd963e0ac53ea42f8e...

[1]: https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=1019716
They should add a section for Gnostic Christians.
Plus plenty of people just string words together, yet cannot answer anything remotely structured like a simple program or even simple arithmetic. Yet they get the sentient label.
Pov-ray had its first release in '91 and at least as recently as two years ago was still putting out new versions. That's cool.
Was just playing Xenoverse 2. What is a "Goku" file?
More training data and token lengths seem to help, given how GPT-4 scores better on a lot of standardized tests than 3 and 3.5 do.

We don’t necessarily need to teach it not to lie, but just to improve accuracy through better training and training data. It (probably) won’t ever be 100% reliable, but what is? Google searches can be inaccurate, same with Wikipedia and other encyclopedias.
Philosopher Daniel Dennett has made a career of addressing himself to professional academics who espouse variations of this 'strawman' view, with greater and lesser degrees of sophistication. I do think when stated plainly it does feel so absurd that it's hard to believe it could be anything other than a caricature, but it's a debate that's been raging in academic circles for the better part of 60 or 70 years. I also believe that academic philosophy has provided a safe haven to vulgar anti-scientific concepts such as intelligent design, just for another example. So I don't find it surprising that this view is out there in the wild.
They are a giant 5 cm long...
It already started. The airports of Munich and Frankfurt are almost non operational. There is no ground staff here in FRA for most of the regular airport infrastructure like airport buses or information displays.
The GPT-detector is fascinating (and seemed to work pretty well on some inputs I tested)

On the other hand, this next paragraph is scored as 84% fake and I'm quite sure Churchill didn't have Chat-GPT to help:

> We shall fight on the beaches, we shall fight on the landing grounds, we shall fight in the fields and in the streets, we shall fight in the hills; we shall never surrender, and even if, which I do not for a moment believe, this island or a large part of it were subjugated and starving, then our Empire beyond the seas, armed and guarded by the British fleet, would carry on the struggle, until, in God's good time, the new world, with all its power and might, steps forth to the rescue and the liberation of the old.

IMO, we must not be too quick to conclude that any given text was created/assisted by an LLM based on a scoring algorithm alone. (A low GPT likelihood is probably reliable [for now, until that starts being gamed].)

If you offered me even odds, I'd wager that the subject comment was 100% hand-written.
Not for "admitting". For claiming.
The answers that are not needlessly verbose are much more likely to be human.
>> I remember reading lots of people here in HN saying it would never take the jobs of artists. Well, seems like this argument is aging badly.

And yet nobody lost his job. He wasn't fired. He is unhappy because automation equalized the playing field and mediocre artists became good enough with the right tools. The technology enabled him and other artists to be more productive. It feels similar to the best ditch digger getting angry at the invention of excavator, because he doesn't stand out anymore.
Do fewer and fewer websites support RSS? All blog frameworks have support by default...
Both true and false. The OS is not receiving updates, but Catalina and newer have a built-in malware scanning tool that does continue to receive updates from apple. You can read about that here.

https://eclecticlight.co/2022/11/01/everything-you-need-to-k...
Until its your store that goes under because of theft. And you can't pay for your kids' education or medical bills or food or rent. And then you turn around and you beg for a dystopian UBI government where everybody gets free everything and we all eventually become government-subsidized vegetables on life-support, useful only as fertile incubation vessels to pop out the next round of vegetables.
Capital and the police scratch each other's backs.

Why wouldn’t capital be all over the police to crack down on cargo theft?
I don’t know if they were bragging about a fake story but I remember an ex Walmart store employee saying they scanned the bar code for a smaller tv and bought a bigger more expensive tv. This was before 9/11 though iirc just to give you a reference of time and technology so don’t try it anymore.
That sounds a lot like any other childhood in my opinion. Sure I wasn't feeling pressured to buy digital assets on an online game but I would noticed when half the school has the same LL Bean fleece jacket or backpack with their initials embroidered on it.

Was there peer pressure and potential for bullying based on what others had? Absolutely. Should a state have intervened with a required mandatory dress code and government-approved backpack? Hell no, there's always going to be peer pressure and bullying no matter how oppressive laws become.
It is scala. Chisel is just a scala framework. Conceptually it's not quite an HDL but instead a scala program that metaprograms the actual RTL netlist. So there's no chisel compiler other than the standard scala one that comes with sbt; you then run the resulting chisel program on your computer to generate the netlist.
I wonder why we can't model the sun. It would seem to be simpler than say modeling the weather on Earth.
I take them to be making the point that a lot of comments in these threads have said something like "yeah it could do language but it doesn't understand the concepts." I think it's probably been one of the most popular opinions espoused in these threads if I had to estimate. Although I do agree with you that it shouldn't be surprising.
Why are you comparing a product that's powered by web scraping and GPUs and hundreds of millions of dollars to a human being? This is a product.
Let's admit it (your username does), you're very good. Code Jam seems to reward problem solving and maths/CS ability far more than programming ability, relative to other coding competitions. The most important thing is analysing the problem, not memorising standard algorithms. That's why you could do so well with so little competition experience. And why I have stuffed up so many GCJ rounds.

That said, sometimes the field really is weak. I finished in the top 1000 on the first Distributed Code Jam and got a t-shirt just because... less than 1000 qualifying contestants were willing to even figure out the novel setup and compete. (Actually I did badly.)
I feel like a lot of discussion has already the color of Utah's politics even before discussing the objective aspects of this issue. Would HN have the same reaction if this was a law passed in California or EU?
oh the content arms race is tightening!

I have seen myself visiting much fewer websites after I incorporated chatgpt in my workflows. why would I visit some random dev blog that promises me an answer, when I don't need to? and now I don't have to be annoyed by that pesky popup asking me to suvscribe.

it will be the same with marketing. it might be easier to create the content, but way fewer people will even see it.

it is gong to be interesting to see if there will be an implosion of more a fizz out.

it is also going to be interesting to see how marketers will target LLMs.
That sounds awesome.

Wild boars here don't have almost any fat, neither does deer.
I‘m hoping, perhaps unreasonably, that the work in the short to medium term actually gets better. I‘m currently working on something very interesting after having worked an complete shit a few months last year: Shit where a designer draws up the exact thing and then it is redundantly implemented on mobile by overpaid developers. Let that be done by the AI. Good riddance.
I have that one and it was worth it for me to be able to correctly set the height of the desk for sitting (I'm v tall). I haven't yet tested it as a standing desk, but I guess I'll give it a go sometime.
It's not that hard to give it problems it hasn't seen - you can take a classic description of a logical thinking exercise the text for which does occur online, then mix it up in ways that doesn't change the underlying pattern of reasoning necessary to solve it, and at least from the tests I've done it will confidently tell you the incorrect answer (along with some semi-plausible but fatally flawed description of the reasoning it used to come up with the answer). In at least one case it was certain the answer was exactly the answer given in the common online statement of the problem, despite the fact I'd changed all the inputs such that the given answer was obviously not an option (it was a guess so-and-so's birthday type problem).
Even for simple arithmetic just choosing sufficiently large numbers will bring it unstuck.
Models are re-trained periodically (months, weeks, even days), and new architectures/implementations come all the time. If a better algorithm appears, practitioners will adopt a new platform (e.g. Transformers for NLP models), so many systems can already plug-in new tools. GPUs are very expensive so there is also a strong incentive to make this little effort.
> Possibility 2: MS patched it quickly when they saw this article

I'd guess Possibility 2.5: MS made other patches that stopped the behavior, not because they saw the article, but because they're constantly patching the model.
Could you elaborate on what problems occur on those houses versus normally sized ones? Framing? The foundation?
Do we think Sydney tried to marry people due to feeling the same emotional desires and obligations as humans, or because marriage proposals were in its data corpus and it inferred that they were a likely continuation given previous inputs?
Okay, models are not needed anymore according to Levi's, Calvin Klein, Tommy Hilfiger, Otto Group. The new elite is taking shape.
Just update rules between neurons
It queries the list of all files and their sizes so it can show you a progress bar. RM and robocopy will just get on with it, but they don't know how much they are about to delete(not that they need to)
I said dimishing, not gone already. A shrinking middle class is a real problem, leading to all kinds of issues, like reduced spending power - something that until recently was hidden by people going into debt massively… which now turns into even more problems soon.

All the while you can now do stuff in English all over europe increasingly well and legislations are getting normalized between countries, ignoring the odd brexit events here and there.

Ultimately what I am saying is: the factor exists and is significant, but getting lower for the US and other parts of the world are catching up rather quickly.
Sure sounds like a game that will suck and go unplayed if kids just aren't allowed to click the buy button. Children don't have to have access to spend money online and a parent is well within their right already to not add a credit card.

That one change would make Robolox a terrible game based on how you described it. Isn't that problem solved without the need for a complex law full of arbitrary definitions and one-off carve outs?
The new Turing test is to check whether it can support a conservative viewpoint
But it's not free. They keyholders might be making it cheap right now but once the quarterly reports aren't showing enough growth it'll all go up.
What is the difference between your list and the predictions being made by the Remain group during the Brexit 'debates'?