skysight-inc/HackerNews huggingface dataset:
Last night I asked ChatGPT to explain to me how to build an OIDC provider using a specific Ruby gem. It gave me a solution that mostly ignored the gem. I pointed this out, it explained that the gem didn't actually exactly provide much that would reduce the code size, and offered up a version that used it more extensively anyway.

It used what I told it both in the original case, and gave me reasoning for why not using it much was a decent choice (and I verified that it was right), and showed me with an example that demonstrated it was able to reason about how my feedback related to the original answer and apply it. Later it went on, as a result of a subsequent question, and fleshed out the rest of the process. Everything it gave me worked.

To me that is a clear example that while it certainly fails to apply concepts fairly often (and often writes broken code), in other cases it does well. I'll add that this was after I'd spent some time searching for examples and I found nothing like what I suggested and I was about to resign myself to a slog through a lot of really bad documentation, and searching for some of what it suggested afterwards as well made it clear it did not just crib from training data.

For me, this is an example of it reasoning better about the subject than a whole lot of people I found discussing this subject in forum posts I came across, who often made mistakes the code it gave me did not or made assumptions that the code ChatGPT gave me made clear were wrong (as I could verify from the fact it worked)

On the other hand it struggles with something as simple as addition of large numbers that a determined child could do.

Nobody will claim it's consistently reasoning well. But I also regularly see it reason better than a lot of people I know about specific subjects, and so it's exasperating to see people dismiss individual examples of failure as evidence it "cannot apply concepts properly" rather than as individual datapoints.

People both over- and under-estimate how well it can reason based on the types of problems they put to it, and it's certainly an interesting subject how to gauge an "alien intelligence" like this that is so uneven in areas where we expect a relatively even basis and so have all kinds of heuristics for whether someone "knows".

This is part of the problem: We've all gone through a childhood and while we've picked up different things, we mostly have a shared floor that is relatively even across a wide range of basic skills. LLMs don't have that, and that messes with peoples heads. Those of us who have gone into skilled professions similarly have all kinds of preconceptions about what a junior or senior developer looks like, for example, and LLMs do not fit neatly into those boxes.

They're dumb as small children in some areas, but still talk confidently about those subject as if they were an educated adult. That is a challenge and a problem. But that doesn't mean they're not able to reason about other subjects. Just not all of them.
>Even if you do prompt it correctly, and it responded in the abstract with all these pros and cons, you cannot be reasonably sure that the code it also provided actually follows these best practices. It will just anytime mindlessly wander from "the best experts on the Internet are saying this" territory to "I just made this up" territory.

And?

As a Sr. Engineer, this is exactly how all the slop my Jr's and Mids send me looks. Copy pasted, Stack Overflow, and when I read through Jr code my mind is boggled. I want to shake them "did you even read your own code. do you even know what your code is doing? Why did you do this?" Forget style, best practices, etc,

In my opinion, LLM's produce code that is as good or better than most Jr engineers and as a Sr it is my responsibility to audit, review and test all code. As a Sr level engineer I spend 90% of my time judging/fixing/improving others code, and less than 10% of my time writing my own.

LLM is just another source, and unlike the Jr, I can quickly ask it why it did what it did or to refine it. You ask the Jr to iterate on the project and you won't hear from them until they mention a blocker at tomorrow's stand-up (or you just pair it out and spend 2 hours teaching them, while the LLM turns it around in 15 seconds. There is value in teaching of course, but we build quickly, too).
And it’s a north south orientation which leads to more diversity in species and perhaps people too (my hunch)
Graphic videos of Hamas attacks spread on X
Have you met someone who's good at bullshitting their way out of a tough spot? There may be a word salad involved, but preparing it takes some serious skill and brainpower, and perhaps a decent high-level understanding of a domain. At some point, the word salad stops being a chain of words, and becomes a product of strong reasoning - reasoning on the go, aimed at navigating a sticky situation, but reasoning nonetheless.
Ha..Ha.Ha
Proton CEO: 'Why I take customer service calls' [video]
> I have to remember to go fetch the one in the bank vault periodically

I feel you, but I don't think Average Joe's threat model requires keeping a Yubikey in a safe deposit box (this is besides the issue that safe deposit boxes are less safe than you think: https://www.nytimes.com/2019/07/19/business/safe-deposit-box... ). A cloud-based passkey (like 1Password) is fine as the off-site backup key for most people.
I love the origin a story of the alphabet. Ancient Egypt used hieroglyphics to write ideas and concepts but eventually created a more efficient script called demotic.

Traders or miners from Phoenicia visited Egyptian quarries and saw this squiggles on walls. They decided to just use some of the characters to represent sounds and not concepts as the Egyptians were doing.
By properly training LLMs, and filters to catch unwanted behavior, this can be mitigated.

Even without all that, the agent would need mechanisms to protect itself that would also cause harm.

The scenario you suggest is so unlikely with all the protections that would be in place, that you would actually need someone with the goal of making LLMs behave maliciously for it to succeed at all. At the end of the day, it comes back to people and their goals.
Beyond W.E.I.R.D. theories and perspectives: masculinity in Chinese societies
You remind me of a comment I heard from a user, "I like the magic wand button in Photos. Why doesn't it just automatically magic wand every photo?"

Ha ha, I have no idea. Almost a decade ago I worked on the Photos team for a stint, I should have asked.
> Technically that's a subtly incompatible ABI change

Yea, that's what I said. And it's subtle because of the language making it a foot gun.

> Of course, the same problem applies in other languages if a constant value changes.

That's just C++ the apologist talking.
'AI Photo Studio' on your phone gets trending
The immense enthusiasm for AI is currently shifting from websites to mobile platforms, and this app is beginning to go viral.
Inevitability of death isn't justification for murder-suicide on a global scale.
I don't trust my phone with my passwords store, they are on a password manager (some in firefox, some in other sw) on a laptop (and backed up to another encrypted machine).
Understood, thank you. I appreciate the explanation.
The most critical step here is to print a completely functional, with model, llm algorithm on a t-shirt.
"Europe gives Elon Musk 24 hours to respond about Israel-Hamas war misinformation and violence on X" - https://www.cnbc.com/2023/10/10/elon-musk-warned-about-misin...
How do I use ublock origin rules in safari browser on mac? (using safari because of battery consumption :(..)
Said Gulfstream carries 18 people, though. Whether 5x or 10x, it isn’t 10,000x.
Censors complain not enough censorship.
(Guessing the faster glass.)
Yeah, we did do this when we got large enough for a shared slack channel with aws. But for most orgs, just having this piped to your alerts channel is good enough.
Thanks!

It gets harder on larger boards, because the border pieces are a big hint. (But it’s still pretty easy.)
Public wifis are still a thing, many of them not well secured against Mitm attacks. Also compromised routers. So even if you trust your ISP (and their IT security and supply chain) there are still good reasons to want HTTPS everywhere
Being flawed is the new being sentient.
What’s the irony?

Would it be ironic if he typed it on an iPhone? Or transmitted it over a public spectrum licensed exclusively to some carrier? Or washed his hands with soap purchased from a store?

It’s ok to use non-FLOSS things. But it’s bad to ban FLOSS or be confused over whether something is or is not FLOSS.
> I've never been able to master the art of flipping a coin onto the back of my hand

That's not the usual way of doing it. Usually, you catch it in the palm of your throwing hand, and only then put it on the back of your other hand, flipping it once more in the process.
Unlike other software patents?
How can we know if John Riccitiello was not basically told what did by major share holders?

"Ok, we are going try to push the envelope, if it does not work don't worry, you'll get a nice bonus while endorsing our despicable behaviour on you departure."
As @andersa correctly pointed it out, put the function in a header file and refrain from inventing useless complications.

How could this post get to the front page of Hacker News?
It's because devices have been pushing these system preferences.

At one point I believe MacBook Pros were coming with default dark mode(or at least asking you which you prefer during startup).

My phone auto switches to dark preference based on time/environment.

Now, you don't want to be the ONLY product your user uses that blasts their eyeballs out because it doesn't respect system preferences.. Do you?
Yes, you can combine the steps to make it more efficient. In that view, it's "just" a different gamma curve. It's far harder to "split" a curve than combining two steps though.
There's no need to actively try to make the AI malicious. That's the default for any AI that's more operationally capable than humans and has some difficult goal. Humans can only hinder it, so the goal is better accomplished with the humans removed.
Would anyone of you know any tool that would simulate working on GSM connection (EDGE, 3G, LTE) on Linux box?

I am looking for any reliable way of simulating user application working on mobile phone.
Oh I just started using this. I was a bit disappointed initially that it can't randomly drop connections through its probabilistic filters, but you can still achieve this with another process commanding it so it's stayed.
> "If 1Password becomes unreachable for any reason, you still have access to everything in your vaults"

Temporarily, i guess? Since it's not stored in an open format?

Is this not bound to some sort of "Secure Enclave" or whatever, and won't survive a reinstall / restore / etc. ?
Thanks, I actually got the idea from recently finding bandcamp-collection-downloader, as doing it by myself just does not sound like fun, at all :D

The tagging I’ll keep manual (I have the Jellyfin library location shared via SMB and added the share to MediaMonkey on my Desktop PC) as I have specific needs for genre, by far my most important field besides the basics (Artist/Album/Year/Song, and those are all tagged properly by Bandcamp).
Couple of points:

For me that points to reasoning happening by replication of sorts of often poor human output, but not by having a "mechanic" way to reason. As I said, humans are often poor at reasoning.

I also think code creation isn't a good area because it is narrower and more mechanically linked by probability than a lot of other areas (so token probability is potentially more informative). I could be wrong there, though.
Finally, congrats on launching!
I thought I read DSLRs are dead? Everyone is making mirrorless now?
Photoshift – Shift your photo into midjourney photo
Primarily crafted for commercial product photography, yet compatible with all scenes and pictures
It fine to think that way. The problem is restricting other peoples right to free association if they do not want to hire them
. Having a DUI is not a protected class.
> Bullshit is a good case to consider, actually. What is the relationship between bullshit and reasoning?

None in principle, at least if you take the common definition of bullshit as saying things for effect, without caring whether they're true or false.

Fallacious reasoning will make you wrong. No reasoning will make you spew nonsense. Truth and lies and bullshit, all require reasoning for the structure of what you're saying to make sense, otherwise it devolves to nonsense.

> But these models don't use any rules of inference

Neither do we. Rules of inference came from observation. Formal reasoning is a tool we can employ to do better, but it's not what we naturally do.
If you're using a tool that drives headless chrome, there's also programmatic access to Network.emulateNetworkConditions... the same knobs used for network throttling in the Chrome dev tools network tab.

https://chromedevtools.github.io/devtools-protocol/tot/Netwo...
It's not that interesting a question and is really just a language issue.

Formally, reasoning is about a rational process of deduction through which a conclusion is drawn from a set of information. Informally, reasoning is 'that thing humans do when they think'. By the first definition, GPT4 is pretty obviously capable of reasoning, as is as lot of other things, such as Prolog or a cat. By the second, it's not and won't be until you can e.g. hire it as a PA or trust it to look after your kids for the day.

It's only coming up because what GPT4 does is the closest thing to the informal definition we've yet seen.
This. LLMs don't need to be conscious to wreak havoc. The moment they reach the proficiency level of a junior programmer we're going to have a massive shitshow because so much of what we do is online and so much of that stuff is not written/maintained correctly.

It's only a matter of time before a rogue AI erases a bank's database or randomly triggers an anti aircraft missile or something similar.
8tk/s on 34b?

I've managed to run Codellama instruct 13b with my laptop's RTX 3070 (8gb VRAM) at 6tk/s by offloading 27 layers into the GPU with llama.cpp

I've been considering getting a macbook for running 34b+ LLM inference, but with the speed in which small LLMs are progressing, I think it is better to get a laptop with an RTX 4090 and 16gb vram. Maybe It can run 34b models by offloading layers into the GPU.
Capitalism isn’t conscious and still controls every aspect of almost everyone’s life, leading us to exhaust the basis of our very existence.

No, you don’t need consciousness at all, a bunch of rules and a primary objective (profit maximization) is enough even on lowly meatspace CPUs despite us being given the ability to reason and introspect we are so proud of.
Aren’t the explosives recipes making the drones explode also “open source” or at least not IP restricted.
MGM Hackers Waited for Days Before Issuing Their Ransom Demands
Why would you assume it could be expected to have "mechanized" reasoning capabilities, whatever that is?

I find these questions generally poor at gauging anything when people haven't given them to a representative sample of people first as a benchmark. Consider that not long ago there was a tedious trend of people posting "difficult" questions of orders of operations involving basic arithmetic, and a significant proportion of people in the threads would continue to belabour and argue for the wrong result even after having been told in excruciating detail how to apply the rules. In other words: I think people here tend to massively overestimate the reasoning ability of the average person.

E.g. to the example questions here, I'd bet the average person can't give a satisfactory definition of entropy, much less be able to tell what it does "forwards" before even considering "reverse". So why would we treat this as a benchmark of whether or not an LLM can reason?
Two examples from Apple:

• The Swift Programming Language: https://github.com/apple/swift

• FoundationDB - the open source, distributed, transactional key-value store: https://github.com/apple/foundationdb
I came to wonder a similar thing - was this typeset or were perhaps entire pages engraved or similar?
https://archive.ph/s5Nf8
The article says:

"Reasoning means being able to put those concepts together to solve problems."

There's more to reasoning than just following rules of logic ("putting concepts together"). It is also detection where the concepts cause contradictions and do not fit, and the whole mysterious magic of how to modify the concepts to make them fit.

In the first meaning of "reasoning", AI (and computers) have been able to reason for a long time. It's the second meaning that evades us.

I said before that in the 90s, cutting edge AIs were based on various theories of how to do reasoning under uncertainty (fuzzy logic, bayesian networks, etc.). Then deep NNs blew these systems out of the water in practice, but at the expense of us not understanding how they reason with uncertainty, and if there is any consistency to it. So we progressed, but didn't reconcile this problem, what is the right way to reason with uncertainty, and it might just be very very hard. (That's why I am interested in P vs NP, as I believe there is an answer there.)
It was announced in 2008! 15% into the 100 year language.
That is a point more orthogonal to mine. I am saying it has no general "method" to go from concept to application. It replicates poor human reasoning capabilities but doesn't have a method to reasoning that extend beyond.
There's also the issue of dizziness if rotating fast with a small radius.
None of which matters if it is active exploit, which not only the government but users fo the software should be made aware of even if no patch is avalible yet, this will allow them to make the choice to shutdown the system, apply network level or other security measure, increase monitoring or many many many many other things they would be unable to do if software vendors keep it hidden for months while they choose what is the best course.

I am fundamentally a full disclosure supporter.
Samsung actually do that.
there's labrea which is pretty dusty: https://github.com/dustin/labrea

you could probably achieve something similar with bpf today.
While one might well argue over whether they "must have" this, it's clear that they do end up with internal models of the world. Even quite literally:

https://twitter.com/wesg52/status/1709551516577902782
I was listening to Ezra Klein's podcast on the subject awhile back. He talked with lots of AI researchers and was surprised to learn that many of them did see a (small) chance of apocalyptic outcomes yet persisted with the work anyway. He was puzzled by this, but to me it's quite simple - these people are engaged in the oldest of human endeavors; creating children. I suspect that the risks are acceptable to these people; what would you do for your own children?
I'm sorry, but I fail to understand the point you are trying to make.
Elsevier and other corporate tools could disrupt scientific publishing
You heard of New IP? The Huawei/Chinese plan to reform the Internet that keeps getting criticized for a variety of reasons. I haven't had the times to read the proposals proper, but the stuff about build trust directly into the network seems like it could solve this problem, at a price.

> Having security and trust be “intrinsic” to the network will require core layers to carry metadata about the
users, applications and services being transported. If users need to register in order to have packets sent to
their destination, the result is that network operators, and those who license the operators, can remove
individual users’ access at any time.

https://dnsrf.org/.k-media/d3c1d810de1e98bdf7af7aa52406e837.... (critical of the proposal)
Yeah, it replicates poor human reasoning capabilities but doesn't really have a proper method to reason through things. The later is what I expect from a true machine intelligence.

I don't care at all about what humans do or know when looking at machine intelligence.
Not taking credit cards was just a thing for most German businesses before the pandemic. Not really specific to taxis.
ExxonMobil agrees to buy shale group Pioneer in $59.5B deal
Actually this is potentially wrong.

A $300 lens is objectively better than a $5 smartphone lens.

A $2000 lens may be objectively better than a $300 but it depends what you're standing in front of and you.

The Nikkor Z 28mm f/2.8 is my favourite so far and it wasn't exactly expensive.

The priority order for things is of course:

1. What the photographer is standing in front of

2. The photographer

3. The lens

4. The camera
Not wanting to introduce a new compiler is like wanting to introduce a new language. If you don't like the choice the package maintainer makes, roll up your sleeves.

That said, we can mitigiate it using mrustc to generate c. Does anyone keep a list of all the targets libcurl is getting built for?
Thing is, you as a small shop don't care... but large corporations, they get so many applications that they use background screening to filter down the load to something that their HR can handle, and in some cases (especially in government, aeronautics and medical) client contracts require regular checks of employees.
Which protections? There are no protections currently and you are then imagining there could be effective ones?

We have no capacity to allow machines to judge malicious, moral or ethical behavior within the context of an LLM. So I'm not sure how we could implement them.

To implement anything remotely Azimovian, we would need to have AI that can reason and reflect deeply about its potential behaviors and likely subsequent consequences.

This seems very far off still...
Thats the whole point, I don’t know what I am doing.
> If you got into a DUI, how does the government get to tell random website X that they are not allowed to say that you got into a DUI, especially when the information was public record.

Like every other countries in the world have?

> how does the government get to tell random website X that they are not allowed to say that you got into a DUI

By saying you can't publish the information and suing if people do? It's not perfect but its very easy for governments to not make it show up in google so employers won't know, like it's a right in almost every developed country.

Americans seem unable to imagine anything else than what is.
>"at the expense of us actually not understanding how they reason with uncertainty"

That is the crux. It is doing something to anticipate words beyond the next token. It has to, to construct these long coherent documents. Just like humans do.

Just because we don't understand it doesn't mean it isn't reasoning. Isn't 'thinking ahead'.

Just like I can say we don't understand the brain, thus humans aren't actually reasoning.

There are a lot of brain studies that look into the pre-cursor changes in the brain pre-ceding conscious thought.

We can't say NN aren't doing something similar.
Man, this essay starts and ends with me doubting the author, because of the typo on the first heading: "justs", and confusing "conscience" and "consciousness" (also typoed to "consciounsess"). How ever good the middle bit was good...
Does every desktop Linux distro include MP3 support in the base system? How many of the audio files on Wikipedia are older than 6 years old?
And comcast: https://github.com/tylertreat/comcast