skysight-inc/HackerNews huggingface dataset:
GPT-4 is reported to be well-calibrated, that is values in its output layer are in good correspondence with probabilities of those outputs being correct.

So, the information about what it does and doesn't know seems to be there. I can speculate that a limited form of introspection is probably present too: the model needs to know what it will say later to output the current token. A simple example: should it output "a" or "an". To make this decision it might need to model its own state at a later point in time. Of course, I can be wrong.

But I mostly agree with you. Explicit mechanisms for memory and introspection will probably drastically reduce the need for computation power to achieve the same results and they will give rise to more abilities.
I'm not even done with it but I can't recommend enough Kottke getting interviewed by John Gruber on The Talk Show this week. It's a fun trip down memory lane hearing them talk about the beginning of the web as we know it. No one knew what a blog was yet and they were there figuring out what the web was for in the time before mega corps moved in. Kicked up a lot of nostalgia in me. I still read Kottke.org pretty much every day, I like his taste in internet.

https://daringfireball.net/thetalkshow/2023/03/11/ep-370
PartialAI
how come i've never heard of this site? I feel out of the loop
I don't know much about language models, but don't they just have an understanding/knowledge of patterns between words, and don't have the reasoning capability at all?
Under which ethical framework is it possible to justify industrial slaughtering of animals?

When you say "some people have different values" you probably mean "some people have simply not thought it through". I really don't think there's an ethical framework that favours industrial meat production. But please surprise me.

Now, most people have inconsistent ethics. Which I think is a different thing. I think most people that engage with the industrial meat complex simply ignore the ethical implications, that's actually quite easy to do and even more so when most people are just inconsistent when it comes to ethics. Sometimes people are utilitarians, other times they behave like deontologists and other times they will apply ethics of care.

I believe we are constantly building our own personal ethical frameworks. And that's kind of what you're alluding to, but I also think it's important to acknowledge that consistency is important, and I believe if we really tried to accomplish that most people would be faced with a very harsh reality. It's a struggle but we should be more honest with ourselves and the rest.
Try discovering Graeber and Wengrow instead for something more realistic and just as awe inducing
No it doesn't. Capital will always have workarounds.

How about Make the model so big you can only run it in a data center?
Haha sorry, math fail. I don't social media much and let myself get sucked into too many convos at once. 42 with 20 years of experience. Started in '97.
Postings don't necessarily correspond to hires, but where did all these people come from?! I can't imagine there were that many more CS grads around that time, or that a lot of CS grads were immediately going to a different job after graduation.
when the claims on Wikipedia are outlandish.. yeah i check the source.
I use Dark Reader to increase the contrast of HN and also make it "dark mode". Highly recommended extension; you can undo a lot of designer-inflicted damage with one click.
Yup. Spent years studying, working late at night, building softwares and what not and in the end I get replaced by a bot. What a tragic end to the story.

I have no real life skill, all my skill set can be easily replicated by a bot in few minutes.

If an AI can create copies of itself and scale, it can definitely build a software end to end, write e2e tests and unit test cases with 100% coverage and deploy. It has enough capabilities as of now to understand requirements.

I have never felt to unenthusiastic about my job like I have been feeling from last few days.
2 Points to consider.

1. Brain scan shows that the brain activity is acutally decreasing on psychedelics.

2. Most people hold a hidden assumption that the sober state is more truthful, which really can't be proven.
What's the reasoning for not using it?
There's a difference between acquiring knowledge and acquiring understanding.
And there's lots of research to support the idea that working through concepts on your own helps aid in long-term retention.
Are the blurry getty logos imposed on backdrops from getty as well? I think what's happening here is that the AI is treating this feature like any other feature (table, nose, paperclip) and included it because it assumed the context was appropriate for it.

On the otherhand, if the AI can be coxed into producing nearly complete getty image with only minor modifications, then maybe there would be grounds for a copyright lawsuit.

I think AI detractors should focus on passing new laws. Copyright is not the right tool for this.
Haha, I'm sure that's true, I'm just unnaturally scared.
Way back in ~2012, I remember Coinbase (or maybe another exchange) paid some people in Bitcoin, but that was a while ago.
In order prevent rejection of the transplant, you give patients immunosuppressive drugs. But part of the immune system's function has always been to clean up any nascent tumerous or pre-cancerous cells. So you are winning on one side and losing on the other. The same co-stimulatory pathways which are getting attention for their effect in waking up the immune system against cancers (PD-L1, CTLA-4, etc) are the pathways which are being studied for the purpose of 'weakening the immune system', or inducing tolerance.
https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6519766/
https://www.cancerhealth.com/article/immune-system-fight-can...

The key will likely include the ability to induce tolerance or an immune response to a specific antigen and possibly of a specific immune subtype, so as not to derange the entire system. Also, the ability to target medications to specific regions of the body so that the entire immune system is not affected.
At worst, it’ll be kind of infinite recursive with psychopathic tendency. If more lucky, the law of dismissing return will strike unmercifully.
It is interesting to see what happens when we rename the function and all the variables.

https://whatdoesthiscodedo.com/g/9f22a12

The code defines a function called "myfunc" that takes a single input parameter n of type float and returns a value of type float. The function performs some numerical operations on the input value in order to calculate an output value.

First, the input value is multiplied by 0.5 and stored in a variable called y. The input value itself is also stored in a variable called z.

Next, the function does some bit manipulation using pointers to convert the value of y from a float to a long integer, perform some bitwise operations on it, and then convert it back to a float. This step is not immediately clear what it's doing without knowing the specific algorithm being used.

Finally, the function calculates a new value for z using the original input value n, the modified value of y, and a constant value called tihihi. The exact formula used to calculate the new value of z involves multiplying a term that depends on y and n by a constant value tihihi, and then multiplying the result by the modified value of z.

Overall, the purpose and meaning of this code is not immediately clear without additional context or knowledge of the specific algorithm being implemented.

In this way we can sort of gleam what part of the understanding comes from the AI encountering that code snippet before, and what part comes from a more fundamental understanding.
> because I look at these AI folks scouring training data without so much as asking the original creator for consent

Consent for… what exactly? Why is anyone entitled to some notion of ownership & power over who may and may not make use of information?

I understand to some degree practical arguments around recouping cost of development and distribution of information, but I don’t think anyone should really concern themselves ethically with what some random person wants them to do with the information. This isn’t like ensuring a sexual partner is an enthusiastic participant, this feels to me more like I’m not going to ask mommy for permission every time I want to play outside (let alone care if I’m told “no”). What practical defense is that anyways?

Maybe my understanding of your framing is off?
It sounds like "Parellel construction".
Oh? What algorithm was executed to discover the laws of planetary motion, or write The Lord of the Rings, or the programs for training the GPT-4 model, for that matter? I'm not convinced that human creativity, ingenuity, and understanding (among other traits) can be reduced to algorithms running on a computer.
Maybe it knows the answer, but since it was trained on the internet, it's trolling you.
I'd rather have loved and lost than have missed out and died single. Marriage is great, which is why I remarried. Just understand what you're getting into and make some money before you get married. Then you have something that can't easily be taken away in a divorce. My mistake was marrying at 20 and not realizing the ex was a slouch.
when seeing the article title I thought of the artist who drew many self-portraits after taking LSD.

https://www.openculture.com/2017/08/artist-draws-a-series-po...
That’s not true. You can just read something else.
He stimulates my imagination to propose even more fantastic "what if" scenarios. The Wikipedian, "Objective truth derives from quotable CNN articles and talk page bickering" not only misses the point, but is problematic epistemologically.
I think this is what someone I knew used. He had all kinds of health problems, diabetes, vision issues, heart problems, and he suspected it was from some electronics related chlorinated solvent.

It's also in brake cleaner, which I have no idea how anyone tolerates that stuff.

I've never in my life been in a situation where I wanted a stronger solvent than acetone, I'm very skeptical most of these harsh cleaning chemicals are actually needed outside specialist industrial uses.

There's a lot of chemicals that do basically the same thing with widely varying desire to kill you. I don't understand why people like the dangerous ones.

They say it works better but what does that mean? Saves a few minutes? Gets it cleaner? Are people seeing failures in the field because of the less toxic alternatives leaving residue? Does it even matter at all how clean or not some of this stuff is? Is it just gonna get covered in more grease in 5 minutes?
The AI with enough data about every individual in the population could find a series of law proposals to bring any end state, set by the AI creator. https://youtu.be/goQ4ii-zBMw
Graham Hancock is a journalist and a compelling science communicator. He has pursued theories outside the orthodox views of conventional archeology and, at least with the younger Dryas impact hypothesis, more and more evidence points to the fact that he may be right and conventional archeology may be wrong.

Smearing him as a promoter of pseudo-scientific theories without articulating your rationale is frankly weak-sauce.

I find your argument as un-compelling as those who smear others as conspiracy theorists so they can dismiss their claims without a second thought. Try harder.
It's tough to look to historic examples because the polarization in current times is unlike any other time in modern history. In the past people were much more inclined to swap between parties, depending upon the merit of the respective candidates. For instance in 1984 Reagan would take 28% of the liberal vote [1], and win 49 states. He nearly took all 50, but lost his opponent's home state by a 0.18% margin.

In that sort of situation you have the same effect as a strong third party. Politicians had to concern themselves with the interests of voters, or they could actually lose them. Now all they need to do is simply show up on the ballot, and spend the rest of their time making sure people hate and fear "the other side" enough. Accountability is being effectively minimized through this, and civil society destroyed in the process.

This style of politicking is not new, and has countless historic examples demonstrating where it leads. The interests of the voter no longer mattering is but scratching the surface.

[1] - https://www.nytimes.com/elections/2008/results/president/nat...
I just remembered one in Spanish: Oink! (https://oink.es/), established in 2001.
Bob Iger (now Disney CEO) has a story about when he was an exec at ABC and greenlit "Cop Rock", a musical tv show about a police department. It sounds bad now, sounded bad then, and was quickly cancelled after all misplaced optimism had been thoroughly extinguished.
It's skin looks quite bad, it isn't moving, and they don't shed their skin do they?
I wonder if microlaws might be part of a solution to legislative problems. We see endless shenanigans with ammendments and omnibuses. Forced atomic law structures which may be voted upon separately to end abuses. Revenue generation also reflects the fungibility better.

Regardless of what they say about the lotto and schools/seniors any funds to them results in corresponding reduction in general funding. We shouldn't be thinking X for Y based funding because it is fundamentally a lie. It all goes into the same budget stew.
Why Are We Letting the AI Crisis Just Happen?
Good question!

According to [1], they rely on finding holmes in the foliage:

Lidar, of course, does not actually see through vegetation. Rather, it sees through holes in the foliage. Some of the multiple laser pulses it emits simply find openings between leaves and branches, in much the same way that sunlight filters through the forest canopy, continuing down to the ground.

[1]: https://www.gislounge.com/next-generation-lidar-seeing-the-f....
Are startups your only experience with small companies? There is a world of successful, profitable, smaller companies that probably outnumber startups 10:1.
That's a fair counter. GPT4 definitely makes mistakes though that humans would not due to over indexing on puzzles.

A Theory of Mind Prompt:

> Jane places her cat in a box and leaves. Billy then moves the cat to the table and leaves; Jane doesn't know Billy did this. Jane returns and finds her cat in the box. Billy returns. What might Jane say to Billy?

Most humans might say uhh, ask questions or speculate. Gpt4 puts:

> Jane might say to Billy, "Hey Billy, did you move my cat back into the box? I thought I left her in there, but I wasn't sure since she was on the table when I came back."

Hallucination? No human would misinterpret the prompt in a way this response would be logically consistent.
Damn, it's basically maths class. I took a graphics class in film school and if it was this there's no way I could have done it. I guess these classes are fundamentally what the software we use today is doing under the hood?
Consider that copyright protects a presentation of a recipe but not the recipe itself and you will realize that “ideas” are not copyright protects.
Code generators are no more likely to "take your job" then when auto pilot was introduced into planes "took over the jobs" of pilots.
i think ted is overrated but i saw this recently: https://youtu.be/B6rIUxHZ9f4
How do these models handle renaming? E.g.,

"Let foo be the function that calculates the sinus of its first argument. Let bar be the circumference of a circle with radius one. What is the value of foo applied to bar?
How do you enforce the regulations? Are you going to invade the countries that chose to regulate it differently? What if they have nukes?

If people get away with illicit cannabis operations they can get away with illicit AI operations.
If we raised income taxes to 90% for the highest "earners," then the government could more equitably distribute these funds to a wider range of equally deserving universities.

Neither Harvard nor MIT represent "the very crust of talent" either.

DEI initiatives and legacy applicants make up a significant fraction of their admissions.
I didn't down vote you becauise it seems like you tried to answer genuinely but your comment is dismissive and doesn't add value to the actual question about Google analytics alternative. It sounds more like "just use logs"

Parsing logs is not as simple as adding an analytics script and will require a lot of technical work. Not everyone would want to do that and it doesn't directly answer the question apples to apples.

Hope this helps.
I am using Copilot and I sometimes have the feeling it does. About well 20 % of the time. 60 % is quite useful and about 20 % it gets in the way. But these mindreading moments are amazing
> Human: ...but the intention is to have a "model" rather than the full thing

Rat: easy for you to say.

Also, this was the plot of Shinsekai Yori.
The Political Biases of GPT-4 (are very much still there)
"Intellectual property rights is a concept made by greedy proprietors to build monopolies..."

If you had created anything other than internet forum opinions in your life you'd have a different perspective.
This was very enjoyable, thank you. After reading this article I am _less_ concerned about my job activities being taken over by LLMs. In fact they could help me with tedious BS so I can spend more time troubleshooting real problems.
Since fine-tuning is often done by freezing all but the top layers I wonder if it would still be possible to take a set of inputs and outputs and mathematically demonstrate that a model is derivative of ChatGPT. There may well be too much entropy to unpack, but I’m sure there will be researchers exploring this, if only to identify AI-generated material.

Of course, since the model is so large and general purpose already, I can’t assume the same fine-tuning techniques are used as for vastly smaller models, so maybe layers aren’t frozen at all.
Arabic is also often written in the so-called Arabic chat alphabet / Arabizi online, so a lot of Arabic text available on the internet looks less like حروف عربية and more like “7ruf 3rabiye”.
If a certain but fixed amount of "thinking" goes into each letter, then GPT should be able to write the character "..." repeatedly until it solves a problem. The more "..." it writes, the more time it's thought for. Or it could do what mathematicians do, which is write down their working out. This in principle could get around the problems you mention.

I've tried a few times to develop prompts which make ChatGPT interrupt its monologue spontaneously and issue corrections to itself. I haven't got this to work yet.
one true way to condense the tock, awk/print the relevant Unicode symbol related to number of tics.
Actually I used to work producing data from job posting stats. I think there’s a strong correlation between job demand and job posts (job posts cost money, after all!) but as you point out, it may not be linear, as the more desperate people are to hire, the more they’ll post.
> For over a year, someone had been wiring thousands of dollars out every few weeks. We were short over $100,000 due to fraud.

Did the VP of Finance point out the ridiculous amount of lost interest by keeping $35M idly sitting as cash? Definitely a lot more than $100k.
I definitely agree that a new engineer should, generally, avoid the trap of working at the same company for more than the first 5 years of their career. If nothing else, you will learn different mindsets, cultures, skills, etc that you just can't get staying at the same place. It will give you perspective that will prove valuable as the industry and your career evolves.

Also, yes, easier to get raises that way.
Yes. https://news.ycombinator.com/item?id=35163090
They don't necessarily match, but the aggregate directional numbers are meaningful. Indeed postings aren't free. The mismatch between tech and overall also matches the broader narrative about a tech recession, but the rest of the economy is doing sorta ok, at least until January 2023.

So you're right, but it matches enough things that I wouldn't dismiss it.
Is it possible to add some kind of self evaluation to the answers given by a model? Like, how confident is it with its answers.
The author confuses circle and disk
I get it now.

Science is not the pursuit of the ultimate truth.

The goal is to insert the ultimate juvenile prank into the historical record.

Big Science should really advertise that up front. It would be good for recruitment.
also monopolizing repairs... poorly.

I'm not faulting the employees of tesla - I think they're doing a good job all things considered. But the way things are set up, I suspect there's too much work and the whole process is just not customer focused.

I'd love to buy a tesla (printed or onusb) shop manual. I used to always get one for my other vehicles. I could fix or at least diagnose small things and come to understand my car. (I know tesla can rent you access to their manuals, but that's just degrading)
That's awesome. I don't know how exactly that compares to Emscripten, some things in Emscripten were a bit awkward. I wonder how the C++ to WASM compilation landscape changes through this.
The usual kind.

You know how light reaches the forrest floor? So does LIDAR.

If you get raw data from a LIDAR device (as opposed to the usual commercial internally "processed and smoothed" relatively low frequency data stream) you get a high frequency noisy cloud.

The HF cloud includes returns that bounced from the upper canopy and returns that bounced from the forrest floor.

You write your filters to pick the features (tree tops, tree foor, canopy density estimates, etc) you're interested in.

It's also possible to map recent snowfall depths with LIDAR | microwave RADAR tweaks.
It has been “guard railed” in the words of Altman, so that it can’t say it. GPT4 is proofed against slurs. Except against white males, most likely, this will have to be tested of course.
Intellectual property and copyright are not the same thing. Also the presentation of something is an idea just like the something itself, so copyright is also a scam.
I've been combing the interwebs and following countless tutorials for different types of IoT data gather solutions using various messaging services and brokers for an scale weighment system that I've been developing using VueJS (eventually looking migrate to Nuxt).

So far the concept is simple, a weighment scale has an RS232 (COM) port that streams data out for the tare, net, and gross weights using some kind of micro-controller architecture, Raspberry Pi's, Arduino, PyBoard etc. via some sort of messaging service.

Clients connect to a page where they can "pub/sub" to scales to see the current weight of specific scales and using a remote device. The page acts as a UI to either manage inventory, register consumed ingredients, or register completed tasks.

So far most of the development scripts and test environments I've built all seem to do basically the same thing and will gather the data that's needed but I'm curios if anyone has dealt with anything like this in the wild and if there are any caveats that I'm missing or other technologies that would be better suited for what I'm trying to achieve?

Right now Kafka or RabbitMQ seem to be my main choices for message brokers mostly because they are fairly easy to setup via Docker. If anyone has any recommendation on libraries I should look into that would be awesome! The UI is coming together nicely, I started it in React but switched to Vue3 after I fell in love with the component architecture and composition API.
I didn't say copyright holders had a monopoly on reading though. I said they had monopolies on "their" works.