skysight-inc/HackerNews huggingface dataset:
> The large language models are a little surprising. I’ll give you that.

I think this is the key point about LLMs that kind of explains the wide and polarized views on whether it understands or parrots, whether it can think or is the precursor to thinking or is a dead-end, whether it will catastrophically destroy the world, or “merely” make it steadily worse with bullshit, or just put a few industries out of a job.

Almost nobody is really surprised that if you throw more compute at a neural net it becomes better at the task it’s trained on. But almost everybody is really surprised that becoming better at a task like ‘natural language prediction’ would produce all these strange abilities that sort of look like “understanding the world”.

One way to resolve this surprise is to find some reason to believe these strange abilities are fundamentally not an understanding of the world. Thus stochastic parrots, this article, Yan LeCun and Chomsky, etc.

Another way to resolve this surprise is to find some reason to believe these strange abilities fundamentally are an understanding of the world. Thus regulation of AI, existential risk, Hinton and Yudkowsky, etc.

I don’t know what the correct resolution of the surprise is. The only thing I’m confident in is that it’s correct to be surprised by the abilities of LLMs. My current (tentative) resolution of the surprise is that language encoded way more information about reality than we thought it did. (Enough information that you can fully derive reality from language seems improbable, but iirc it did derive Othello and partly derived chess and I would have thought there wasn’t enough information in language to derive those without playing the games as well, so I can’t rule it out.)
Generating worse code in half the time is a service degradation, IMO. I mostly use it for monotonous scripts and one off functions, where saying “write this thing” while I click off the tab and do something else for a minute is a not in anyway a problem. I could tolerate it being 2-4X as slow, because now I have to spend an equivalent amount of time as that correcting errors it didn’t make a month ago.
It's a classic story. In a city where anything goes, some things don't go, particularly a free little library in front of someone's home: https://www.sfchronicle.com/sf/bayarea/heatherknight/article...

For what it's worth, my neighbours up in Glen Park haven't been nabbed by the lawkeepers, flouting the law for years now.
Oh, and I agree - it'll be useful for a number of reasons, but 'being generally intelligent' won't be one of them. :-)
If AI powered tools are able to provide a lot of value (they probably will), and they require lots of data (they probably will), then it's a conversation worth having.

Though artists are often very leftist and/or liberal they tend to be extremely conservative about intellectual property rights because their livelihood depends on it. This is fair enough, but unfortunately even outside of AI, intellectual property law is already overzealous. We probably need alternate funding models or something.
I’m sorry you had that experience. I came to Lisp in the 90’s, forged in the fires of many a comp.lang.lisp flame war. But I’ve not seen anything like you describe.

And I’ve not seen anything like that in the, albeit casual, contact I’ve had with the Lisp community since then (mostly IRC). I think the Lisp community has always been quite friendly. Especially today.

Just my experience, I wouldn’t let that one experience drive you away. Modern books a projects in the field are excellent and exciting.

To your question, I’ve never really left Lisp, it’s just not been a good fit with my work or colleagues. But I will forthrightly say I’ve argued against it when a developer wanted to incorporate Clojure into our enterprise project. I didn’t feel it was worth introducing for a couple hundred lines of code since nobody else on the team knew it.
> Brooks: No, because it doesn’t have any underlying model of the world.

I don't know whether to be more disappointed with the famous technologists who are apparently unable to think of questions to ask GPT-4 that require a world model to answer, or with the writers who don't question them about it.
It’s interesting how the most common impulse when confronted with how good chatGpt is - find ways in which it fails, or does something silly.
I have no idea what part of this comment chain contradicted shared ownership, so I'm afraid I can't conjure a good response.
This ai self-censors excessively now, usually when public figures are concerned and refuses to do anything better than their overlong ai summarizer (paid). It is very fast at showing you what kagi wants you to see.

Goes to show that adfree/paid search engines (a.i. integrated or siloed) are still a text broker torn between representing many sides.
> Annoyed at all these N=1 articles from prominent thinkers about this stuff.

It's a transcript of a casual interview, not an article, and certainly not a publication whose purpose is to convey statistical rigor.

As an aside, it doesn't strike me as entitled that society might permit thinkers of academic renown to express their personal opinions in less than rigorous settings on subjects to which their peer-reviewed contributions may be categorized as "prominent".
https://www.ndlegis.gov/assembly/67-2021/testimony/HPOLSUB-1...
Returning to the Office Is Killing My Budget
The more I think about it the more I'm convinced I am basically just predicting/saying my next word whenever I speak.
> A common response to this by AI advocates is to point out that humans lie all the time

That’s true. But when someone lies frequently, we stop trusting them.
I'm no longer interested in engaging with you on this (or any) topic.
When you don't need a relational data model and you just need to store random key=value entries
Well it's a language model.

Technically its just a really good auto complete, whose factual database is a side-effect of stringing together contextually correct tokens. It by itself is entirely incapable of knowing when it is wrong, despite possibly generating sentences apologizing for being wrong when told it was wrong
Youre right but I think the point still stands. Many times it really is easier to verify than produce. Compilable code being a good example.
Here is another data point which supports your conjecture:

https://en.wikipedia.org/wiki/Antikythera_mechanism
Unfortunately even though the questions are about GPT-4 the answers and personal experience only refer to GPT-3.5 at most. I hope openai changes the name of the next version to avoid this confusing narrative by prominent people. 3.5 vs 4 is like comparing a toddler to a high school kid.
Anti-India cabal in State Dept shaped online discourse on Modi: Ex-US diplomat
Why is something so seemingly simple (sane package management) so hard to accomplish?

Quicklisp is pretty bad but at least it's -somewhat- comprehensible and Lispy. Going over ocicl, I don't know whether to laugh or cry. What is ORAS, "artifacts", "OCI registries" and why should I care? Why is systems.csv CSV and not .lisp? What is this 9MB binary (no source) named "oras" doing checked into the repository?

If I wanted all this enterpriseitis I wouldn't be using Common Lisp. I think that's a big strike against ocicl.
They do on my Audi, and the UX is excellent: when they sense touch, but not actuation, the non distracting display previews the state and would-be state.

It’s a 2019 model year and while VW owns controlling shares in originally distinct Audi, perhaps VW did a bad UX variation on later models?
What direction is north? Is that between where I am currently sitting and the North pole?
Nitpick about the counting. It's actually even easier!

from collections import Counter

def most_common_colors(pixels, n):
return Counter(pixels).most_common(n)
Whilst you're all screaming around the AI LLM hype, here we have Sam Altman pushing his AI antidote snake oil to potentially hundreds of millions of people who won't be able to tell what is real or fake on the internet as a equally dystopian iris scanning nightmare to verify humans to counter against everything getting faked by AI.

He's hedged in both sides of either direction.
I also find an uncanny valley with Tom Cruise on Top Gun Maverick, but because de-aging surgeries instead of de-aging CGI.
You can. Although I have long since lost many of the details, I used the Apple II to present subliminal perception data in experiments for a cognitive psychology lab that was an early programming job for me in the 80's. We had to run an oscilloscope on the signal to catch the vblank to time our display onset properly.
I'll never cease to be amazed by people who unthinkingly apply "policy". What an embarrassment.
I think it’s less easy to ignore 1 mil American deaths if it’s from a sudden explosion. Also, covid did have huge economic and cultural ramifications.
It turns out to accurately predict the next word requires huge amounts of implicit contextual knowledge i.e. understanding about the world.

Next word prediction was the trigger, the optimisation for the task results in a broad (but currently unreliable) model of the world.
> No one said sentences like “This is Tom. They is happy.” until a few years ago.

No one still says that, because even when semantically singular, “they” remains grammatically plural.
I think he nailed it on that, chatGPT is not trustworthy. Not sure about authentic, halucinations could be authentic ideas in their own right
We’re building “Langchain for Ruby” under the current working name of “Langchain.rb”: https://github.com/andreibondarev/langchainrb

People that have contributed on the project thus far each have at least a decade of experience programming in Ruby. We’re trying our best to build an abstraction layer on top all of the common emerging AI/ML techniques, tools, and providers. We’re also focusbig on building an excellent developer experience that Ruby developers love and have gotten to expect.

Unlike the Python project, as it’s been pointed out here a countless number of times, we’d like to avoid deeply nested class structures that make it incredibly difficult to track and extend.

We’ve been pondering over the “what does Rails for Machine Learning look like?” question, and we’re taking a stab at answering this question.

We’re hyper-focused on the open source community and the developer community at large. All feedback/ideas/contributions/criticism are welcome and encouraged!
Backups are more than just a good idea!
I dunno about you, but I spend a LOT of my time fixing code that was broken in some subtle way the compiler didn't catch

If we're talking about generating and integrating sample code, it's great at that

Anything more advanced and it's a footgun
You probably know this but for others, Lucky Jim was written by his father Kingsley Amis, who was also a popular author in his time. Reading Martin’s memoir about his relationship with his dad is pretty good.
if you want details, you can read the Senate report about Russian Efforts Against Election Infrastructure [1], Counterintelligence Threats and Vulnerabilities [5], and everything in-between.

you may find such things as "The Russian govemment directed extensive activity, beginning in at least 2014 and carrying into at least 2017, against U.S. election infrastructure' at the state and local level." and "The Committee found that the Russian government engaged in an aggressive, multi-faceted effort to influence, or attempt to influence, the outcome of the 2016 presidential election."

[1] https://www.intelligence.senate.gov/sites/default/files/docu...

[5] https://www.intelligence.senate.gov/sites/default/files/docu...
Seems an odd argument. Essentially information transparency is bad.
I've mentioned this before, but I have a bootlegged "Everything Carlos did for The Shining," which was a LOT, but Kubrick hardly used any of it. Good stuff.
Wow... huh? I don't know about that. Been into personal computers since the 80s and it seems like storage has always failed orders of magnitude more often than anything else.
> Captchas. These can obviously be worked around...

Best to not consider this a barrier at all. I helped build a lot of systems to bypass these and the "guarantees" they offer are truly "de minimus". Phone numbers and credit cards are are only slightly better.

The real answer is to determine how much value a successful compromise of your service can generate, and combine enough barriers to clearly exceed that value. Some criminals are very business-savvy, but many have poor judgement of value and will overspend on marginal cost-of-acquisition and try to "make up for it in volume", so it's important to be obviously not worth the expense.

Unfortunately for PyPI, there's a wide gamut of value gained from compromise from a wide variety of different actors. And for some of those actors, the potential value gained is existential, so they are willing to spend anything to compromise PyPI, and they have incredible resources. So then PyPI has to make itself more expensive than compromising Windows/SS7/Linux/iOS/Office365/AT&T/etc/etc. And that's a very difficult field to find yourself competing in.

Shameless plug: http://resolved.dominuslabs.com feel free to reach out for custom work - specializing in accessing gated sites for new search engines to do better web crawling, scraping public data, etc.
Proudbarrassed.
You seem to have spent a lot of time considering this issue, how would you go about solving it?
I've seen travel videos of Japan where the person a local warns do not get arrested in Japan. It takes a month or two to get started as you sit in jail. Then you eventually get a lawyer who probably doesn't speak your language. And Japan has an unusually high 99.9% conviction rate.
Does anyone know of a similar workaround on Firefox for HSTS?
> My current (tentative) resolution of the surprise is that language encoded way more information about reality than we thought it did. (Enough information that you can fully derive reality from language seems improbable, but iirc it did derive Othello and partly derived chess and I would have thought there wasn’t enough information in language to derive those without playing the games as well, so I can’t rule it out.)

The information isn't in language itself, it's in language as actually used by humans. GPT4 knows about chess because it's "read" a significant fraction of everything we've ever written about chess. A human being who did that without ever playing a game would also start out better than a typical novice.
Austin accelerator, known for charging founders up to $20k, files for bankruptcy
Caching.

It'd be pretty silly to use a relational database for something that trivially shards across servers, often doesn't have any consistency requirements, and only needs 3 columns (request, response, expiry time).

I don't think it's even possible to use postgres as a traditional cache. Eg this trigger looks extremely slow and I would be unsurprised if a human holding ctrl+shift+r could single-handedly DoS a cache like this: https://stackoverflow.com/questions/26046816/is-there-a-way-...
Lecun's law: Every discussion about AI eventually results in someone catastrophizing about an evil AI taking over, despite having no argument for why an evil, omnipotent AI is likely to ever exist.
yes. I remember boomers shitting on Wikipedia around 2004, but fast forward to present day and the same people would cite it.
> What do you get for Sep 3 1752?

An adjustment for clock drift[0]?

0 - https://www.historic-uk.com/HistoryUK/HistoryofBritain/Give-...
> And just a reminder, those of you opining based off your experience with GPT3.5... GPT4 is a huge, huge improvement.

God, yes. The number of people of HN pushing up their glasses and saying "well, actshually..." when they're basing their opinions off the 3 questions they asked 3.5 is starting to become pretty grating.
How did you like the health-tech industry? It is something I have been considering but have heard mostly negative opinions.
It’s a bit different when it’s someone coming at it from a totally new angle and doing their own interpretation than the same rightsholder churning out more of the same because it was commercially successful in the past.
Multiple choice tests are easier than fill in the blank precisely because it's easier to recognize when something is correct than it is to regurgitate a fact from thin air.

You don't have to be an expert to recognize when ChatGPT is providing useful information. There's a middle ground between expert and novice where ChatGPT provides real value. Its the times where you would know the answer if you saw it, but can quite remember it off the top of your head.
Interesting. Have you tried the Steins;Gate one?

I liked the first anime series, but (for me) the visual novel was incredibly tedious and boring. Did a refund of it on Steam about after 10-15 mins (from rough memory).

Theres no way I'd be able to put up with it for the whole duration.
That's called "rule of law" and a core foundation of any democracy.

The law equally applies to everyone, no matter the reason for it.
The issue with all these experts is they still think it's human nature to be able to fully understand the world before they speak about it. On the contrary it's human nature (and all animal nature) to figure out how to navigate the world without fully understanding or having a complete model of it. All you need is a working model that affects the facets of the world you need to deal with.

I still remember in the 90s my school friend came over to my house and I was sending a fax for my dad. He was surprised the paper came back out the other side. He wasn't an idiot, and he was 15. But his model of the world didn't include deep thought about how fax works, he just merely concoted a system where the paper just went through the wire. That moment stays with me and reminds me what it is to be human and think like one. I think chatgpt is like my friend, and that should scare and excite us.
Redis persistence I would imagine is certainly a primary use case these days, but I can appreciate that perhaps this is not the case.
If people are opportunistic then you should remove the systemic issues that make crime seem like a good risk.

One way to do that is to make it clear that committing a crime is very likely going to result in punishment, which is what the US does.
Good to know, I was not aware of this. Thank you!
Unfortunately, the story about script wiping the filesystem is... well known, though I don't necessarily want to search the archives for it right now.
ChatGPT never looked worse (less convincing).
If LLMs are an understanding of the world it would mean humans in a few decades found a way to create sapience with many orders of magnitude fewer interacting elements than evolution did. I find that doubtful, at least in light of the fact every other way we've replicated biological computation requires many more computational elements.
A big reason for that is that "prison population" is defined differently by different countries.

China's prison population is lower, but they have "administrative detention" which isn't included.

How to lie with statistics.
Looks like SMM is still there.
The price of their all access is 2x other spaces. Their pay as you go makes sense for our volume of use and what I tell you has been our experience.
The pricing is a bit steep. For churn heavy sites it is completely unusable. You will miss out on a lot of customers. Formspark for example gives you 50K submissions for $25. I think you should come up with a recurring subscription plan in addition to the current usage based pricing, perhaps 10k actions for $5, 25k for $10.
Pretty much any brand has had some issues here and there.

If you actually want a durable SSD, your best bet is probably to buy "new old stock" of a model that is 1-3 years old and has proven to be reliable.

Of course, it's not always easy to gauge the reliability of a product based on forum posts. A popular product that is 99.9% reliable will... still have thousands of unhappy people crying on forums if they sell millions of units.

In the end, you should probably just have some kind of daily (or better) backup system so that it's not a huge deal if your drive kicks the bucket. That probably makes more sense than obsessing over reliability in a world in which we as consumers don't have much insight into actual failure rates.
Which visual nivel is highly branchy? I've no patience for them so I've only seen a few, and they were almost like reading a (bad) book. Fans of the genre in forums seem to be against too much "gameplay", too.
It also demonstrably is either flat out wrong about a lot of things or completely invents things that don't exist. It's a random process that sometimes generates content with actual informational value but the randomness is inherent in the algorithm.
Someone whose account got banned because the invoice they issued via PayPal had "ALEP" in the license key contained within. Aleppo is the banned word.
But in this case there’s a rather simple alternative of just getting a young actor to play a young person.
Man, I don't want to crap on someone, but Kagi hasn't impressed me at all. The need to pay for it eventually didn't help much either

It was a little better than Google for sure, and a lot better than DuckDuckGo, but I really really don't like having to log in. Every time I wasted one of my free trial searches by getting bad results felt really bad too
Indeed.

Plenty of wealthy people (and not wealthy) commit crimes for no other reason than greed - a lust for money, or power and no concern about hurting others to get it. There is no "structural reason" that drives them to commit crime.

OP lives in an idealist world where humans are intrinsically good and never made choices that hurt other people or society, if they do, it's because they were "forced into it".

Clearly that's not based on reality.
I feel like adolescents are actually the key audience for theaters.
I think the main issue is that since we don't have access to the implementation of GPT-4, there's no way for researchers to know how it works, so either they're not saying anything or they're just making things up.

GPT-4 is "multimodal" and RLHF'd, so it was trained with some tasks other than next word prediction. I don't remember if it's been trained for code correctness (by running unit tests etc.), but other models have been.
Notice that my problem is not cutting costs per se but that it's the only metric looked with no analysis of long term impact.

It's the nuclear and daft option instead of actually becoming more efficient.

If an incompetent guy fires the competent people and calls it success because they saved X on salaries and ignored the myriad of cost cutting alternatives because he doesn't really understand the domain problems except "less cost" then it's not really "how things are supposed to work".

Easy to claim that the ones who do it are in authority therefore they're right but then that means every gov out there is right in whatever they do.
According to Gamers Nexus their main issue was shitty BIOS which was a different problem than the X3D issues. Their horrible response was just another fail on their part.