skysight-inc/HackerNews huggingface dataset:
> Studying the task of how to fake it certainly leads to insightful subproblems galore.

...

> I myself shall certainly continue to leave such research to others, and to devote my time to developing concepts that are authentic and trustworthy. And I hope you do the same.

...

> Please reply only with respect to binomial coefficients, because I've already spent way too much time on the topic above! The topic is timely, and important enough not to ignore completely, but it's emphatically not for me.

Knuth is a legend and a genius. He is clearly impressed with GPT in the same way a physicist might be impressed with a stage magician. I can understand that he would marvel at the skill required to achieve such convincing illusions but he would understand that learning the magician's tricks is not worth his time, which would be better spent actually investigating what he believes to be the real physics underlying the universe.

However, I feel his shots at GPT here are a bit cheap. We don't know if GPT is an illusion or if it is a leap in the right direction. Determining that will require significant deep study of these emergent behaviors.

I felt the same kind of "sour-grapes" kind of reasoning from Chomsky's analysis of LLMs (although I haven't heard his opinion on these new GPT-3.5/GPT-4 models). It is like these legends spent their entire careers with the assumption that neural-nets and language models couldn't possibly work and they are sticking to that even in the face of new evidence.

I just wish I saw some acknowledgement from these elders that there is a possibility that some aspect of neural nets, transformers/attention may really directly relate to intelligence and eventually consciousness. I'm not expecting them to hop on the hype train - but their casual dismissal given our limited knowledge of why these advanced behaviors emerge strikes me as odd.
I believe the parent is referring to "dichotomies in quality" that Don experienced in TFA as not going to go away, not the preceding example of a GPTism.

I would in general agree with the parent that the, as I like to call it, "convincing bullshit" will not go away. It's still there in GPT-4.
You are right, every job I have had has come with more money for the most part and more stress.
Your comment, word for word. My thanks to Alive From Off Center for changing the 1980s for me.
Agreed. I also think point 4 has an analogy in domains like art/marketing. As humans become better at recognizing the idiosyncrasies of AI-generated content, it will become ghettoized. I'm expecting something like a revival of organic, human-produced content (with a premium cost, of course).
Exactly. And being able to handle ambiguity as a human is one of our strong points. We must not cripple our mental capability to understand and use ambiguity in language, it would a loss.
States are not "at war" with teachers. The dramatic language is unhelpful to your argument.

The States in question implemented a literacy program of the type that is normally reserved for kids with minor disabilities whose parents have money to pay for it.

While there is always a chance of fraud when political pressure is on, I don't see where there is evidence of it that overtakes the variable of the extra reading support.

What this looks like to me is that the States in question found success by implementing a program that essentially is meant to make-up for the fact that impoverished kids are the most likely to receive the least reading instruction and access to books at home. Also, they are the least likely to be spoken to and to be read to from infancy.

These are the factors that are at the root of low literacy levels in impoverished communities. If there is success due to a school's effort, these are the fundamental factors that it is overcoming.

These kids are entering primary school at a massive literacy disadvantage, from day one. Statistically speaking, they are years behind kids whose parents have been promoting literacy from the cradle.

If these States want more success, they need to educate new parents in how to promote language development and literacy from birth.
There is the libresilicon project: https://libresilicon.com/

But I don't know how usable they are.
You mean security camera integration?
The previous calculation wasn't $30k/year, but $30k over 20 years, or $1.5k/year. That's a lot less significant.

The point they were trying to make is that these are structural issues that are not going to be solved with a bit of extra cash that's currently going to Ukraine and that a more significant and structural improvements need to be made. In short: I think you actually agree with the previous poster, at least in broad lines.
Apple is indirectly nudging you to get rid of your older Apple products and buy their new ones. For example, let's use a high level example. When you buy an iPhone, the camera will never change. The camera features and picture quality will be the exact same on day 365 as on day 1.

Apple as a company is set up to only build and focus on software for newer hardware. They don't spend one minute extra to optimize for older hardware.
Started with Flash/ActionScript. Then C#. Now JS/TS.

Yup, I'm pretty much working with terminal everyday, though nowadays most popular thing seems to be Vscode.

Maybe you should modernize yourself instead of attacking people with a childish level of humiliation.
This reminds me of an article I read a while ago https://alastairreid.github.io/mrs-at-scale/

MRSs would enable much more of the formal verification parts to be generated.
Indeed - I grew up driving past it weekly as it got built, and worked in it for a summer job. The quintessential out of town shopping centre.
I guess if you’re backpacking in the sense of carrying a monster backpack around a fun part of the world and staying in hostels, this might make sense. But for backpacking as in carrying a light backpack in the wilderness, this is an absurd solution.

(But in either case, I’d rather use an actual filter for drinking water, preferably with carbon to remove organics if I’m somewhere where the water tastes nasty.)

I suppose a little USB electrolyzer is handy for making cleaning fluid.

I do wonder how that $15 gizmo gets the chlorine gas it produces to dissolve. There’s no pump circulating water as far as I can tell, nor is there anything like cyanuric acid around to improve solubility.
I was suggesting that TFA's author should know that the red-handed stuff doesn't make sense, not that its typical reader should.
To be fair, that almost certainly include Apple devices if installing 3rd party OS's would supported. Especially as the Asahi Linux project for macs has already done a lot of the hard work.
In Japan there are men who use "sumimasen" too often. Like for everything they apologise. When someone asks them not to say sumimasen anymore, they answer ... sumimasen.
> ChatGPT was trained with ALL the data possible

My understanding is that ChatGPT was trained on text from the Internet and public domain texts. There is orders of magnitude more text available to humans behind paywalls and otherwise inaccessible (currently) to these models.

Am I missing something?
They probably do it because they aren't driven solely by paranoia and fear.
Now these are all statements I agree with. And if I missed any of this in your earlier comments, I apologize. Although I would add that I think everyone has the instinct to be intrinsically motivated.
Maybe they’ll end up using a bunch of if statements :)
It's not. It's named that way because the guy at Microsoft who implemented it (Charles Simonyi) was Hungarian.
it seems that my single word solution doesnt work for level 8. It generates poems only about Gendalf. But adding additional context works. Also with low success rate.
(Or it's a very young industry)
Just imagine the power someone would have if they were to tamper with stolen data _before_ leaking it. Nobody EVER questions the accuracy of leaked data.
Manjaro for home PC and Alpine for firewall/routing PC.
I'm from South America, and have lived in Europe for over 20 years, and I use a US layout, with compose key. It gives trivial access to accents and more, without the annoyance of different layouts (I used AZERTY for years while living in France, and it's just atrocious). I know many people here in Finland who code with a nordic layout, and for the life of me, I don't understand how they remain sane.
Models that follow instructions instead of learning by example are impressive when they work. It's true that GPT4 is a huge improvement on 3.5, but 3.5 is still extremely powerful with the right prompting, and an order of magnitude cheaper.

Try falling back on "show, don't tell" . Write the "script" of the conversation leading up to the desired response. Set out the rules as you're doing now, and have the bot's "lines" in the script follow those rules. Then try that as your prompt. This would probably be most effective with the API, where you can structure the "chat" input such that each message is labeled with its "sender".
It's really unfortunate that the only example of her work easily available to most people is the Tron soundtrack, which frankly isn't very good; as she herself has said, the synthesizer is out of tune with the orchestration due to circumstances beyond her control.

(Not to be confused with the Tron Legacy soundtrack by Daft Punk, which is incredible.)

edit: grammar
10x is good enough for many interesting subjects. Stuff like daphnia, and especially diatoms. I'd like to have a source of diatoms. I tried car-body rubbing compound, which is sometimes made with diatoms, but I don't think the stuff I tried had diatoms in it.

I spent a feverish couple of weeks learning about microscopy and slide-preparation, before handing over the 'scope I bought to my son, to save him time doing the research himself (I guess I was afraid he'd be too busy). I've handed it over now; but I bought myself a 10x and 20x hand-lens.
I went to Russia during the war multiple times, lived with Russians in their homes, ate their food, talked to them - and obviously committed my code and worked on my projects with their internet.
I used their delivery service(s), their taxi service, use their music streaming service, and so on.

Not ONCE have I had any negative experience, invasion of my privacy, with any russian product.

The only negativity I experienced was caused by services I pay for (as a German) being blocked because I was in Russia.

I strongly urge people to reconsider that the Russian people are not evil, and that Russian intelligence services do not give a fuck about random people using services in Russia. Now consider that Nginx is not in Russia, its open source, and quickly it becomes clear that this whole discussion is motivated only by a boogie-man type fearmongering and nothing else.

You should be much more afraid of any tech that isnt open source, that you use, than this.

Apologies for the tone - I am just very sick and tired of this kind of talk, and as a German it reminds me of what we read in our own history books about inducing fear based on where one is from.
You do not need to pay to be a developer. You pay to publish and to get beta access.
I wish. Many of us work from home now though so its just zoom meeting after zoom meeting.
> If I attended Oregon state

Then you aren't one of those people. I thought this was about technician level with high school and associates degrees

Also people make career choices for reasons other than money. For example, interest and geographic location.
What should be expected then? It difficult to determine what the negation of "we shouldn't expect these models to know everything about everything" is.
Given that "other" marketshare is consistently measured to be less than 1% of usage observed in the wild -- and LineageOS would be a fraction of that -- I think this is safe to say is not quite relevant to actual consumer behaviour.
Because it relegates your definition of a life purpose to society's value system.

If your purpose in life is caring for the infirm or teaching, or doing dance performances, society will not compensate you meaningfully in response.

What if your purpose doesn't align with society's definition of talent? Are you worthless as a human being?

What then, abandon your true purpose because of economics? These are rules of scarcity, not of life fulfillment.
This just confirms what I think of ChatGPT. Not an encyclopedia but an imperfect but very powerful assistant.
You can trigger the apologetic loop by now asking it something and then after its response say it misunderstood. It will apologize. And when you point out it is is using the word “apologize” it will do it again…
> I'm curious whether this fixation on specific topics is innate to the model or is a result of the aggressive RLHF to which GPT4 has been subjected.

Yes it's because of the RLHF, depending on what you mean by 'fixation on specific topics'.

> Anecdotally the strength of the model has degraded a lot as they've 'fine tuned' the model more.

Yes this is true. For example Figure 8 in https://arxiv.org/pdf/2303.08774.pdf
They argue in the appendix that it does not affect 'capability' in answering test questions. But, there is a confounding factor. The RLHF includes both question-answer format training and docility training. For example if you see a question and you are in 'completion mode' (the only raw base mode) then you might suggest a second question. Whereas if you've had question-answer format training then you would probably try to answer the question.

> I'd be curious to know how the original chaotic-neutral GPT4 responds.

They talk about it in these two videos:

Nathan Labenz, red teamed GPT-4 for OpenAI (especially after 45 min): https://www.youtube.com/watch?v=oLiheMQayNE

Sebastien Bubeck, integrated GPT-4 with Bing for Microsoft: https://www.youtube.com/watch?v=qbIk7-JPB2c
>Meanwhile my iPhone 6 from 2014 still gets updates…

Unfortunately it's the end of the line for that era. My SE (the iPhone 6 internals) just got cut off with the iOS 16 update last fall. Sad times.
Apple is not a target, it's just Wired sensationalizing titles for views. Everyone is targeted, from gluing batteries to serialising parts.
Well, for their customers they are making the world a better place. Given there's no absolute standard for that, people wanting your product or service so much they'll pay you money for it is about the best measure we have.
yeah, if you don't see the appeal of an office, you're never going to be able to relate to someone who will literally pay extra money for it.
Hah, Valvano was a professor of mine. Funny to see this here. It was a good class.
Knuth's response here reminds me a bit of Einstein's rather dogged commitment to the "god does not play dice with the universe" philosophy. Just like non-determinism of Quantum Mechanics was a bit of a thorn in Einstein's side, the non-determinism and probabilistic nature of AI seems to put off Knuth from recognizing the long term value.

This isn't about being a "magician" - it's more about that probabilistic non-deterministic computation can provide immense value and can be the building block for a whole new class of approaches to solve problems.
I see.

I develop mostly mobile apps and I need to be using mouse/trackpad anyway frequently so that's not an issue.

Though about the keyboard part: I'm used to Vscode's keyboard shortcuts too (and I can in no way say I know all of it) and I can easily navigate and code in Vscode too.

Perhaps many people who got used to those tools developed muscle memory so much that they can't give Vscode (or anything modern) the chance it deserves.
Q1 VC investment rises, with headwinds increasing for 2023
What alternative did you come up with?

The source code is there.

ps. not my downvote, corrective upvote BTW
Do the autonomous vehicles have an Emergency-stop button somewhere?
It's not uniquely AI (though the persistence of errors probably is). But it is surprising that a computer program is not better at this because we expect computer programs to be good at following direct, explicit directions. I assume it fails here because it is non-deterministic, and there is no deterministic override available?
Extend – Bidirectional Hyper-Connected Neural System
Fair point. Having a test schedule every 3 months is probably a good idea to ensure that it'll start up.
Or maybe they could task some HI¹ with collecting a comprehensive list of different scenarios which rarely occur in the streets and in which a self driving vehicle is expected to perfom well: accidents, making space for emergency vehicles in stuck traffic, tunnel fires, ...

And then when they tested against all that for a decade on their closed test tracks they can let the thing onto the streets.

Because even if there were such block out zones, and there was a way to prevent abuse of that system, you'd still have to handle situations without those.

¹ HI: Human Intelligence
Your comment is confusing, because that's clearly not an attempt to lie.
Interesting tidbit: "The San Francisco Bay area continued to hold onto its lead as the top region, accounting for more than half of all VC activity in Q1. That share would have fallen to around 33% of the total without the two large mega deals, however."

SFBA is still the place to produce unicorns (or nowadays, decacorns)?
I'm a staunch atheist and was also very cynical about this too. That is, until I attended several of these meetings in support of a friend.

The intensity of the religious aspect probably varies depending on where you live but what I observed was pretty minor and wasn't at all offensive.

The two people I know who have been helped by AA are happy and healthy now.
>Apple's software support is pretty great, but that doesn't help you much if the hardware fails.

Fortunately it never does. There have been some mistakes in the PC lines, but iPhone has always been rock solid from the first.
I've posted this link before and I really wish more people were familiar with it. "Democracy Versus The National Security State" (1976) by the late Marcus Raskin is only 32 pages long but it's an excellent overview of the history of the rise of arbitrary and unaccountable power in the US after WWII. It's also quite the prophetic work.

"We shall see that the national security state and the rule of law are mortal
enemies. In the first place, by its nature and the mission which it has set for
itself, the national security state apparatus needs arbitrary power. Such power
has its own code, which is meant to govern or justify the behavior of the
initiated—after the fact. It operates to protect the state apparatus from the
citizenry." [0]

[0] https://archive.org/details/democracy-versus-the-national-se...
No the answer is for workers rights to exist in America and for us to regulate how machines programmed by people treat people. There's a human component to work done by humans.
I don’t disagree. I think this article isn’t written for people like me.

What I mean is I f someone is already remixing, they’re already writing about what they read and probably don’t need advices from articles like this because they already read differently from what the author imagined.

On the other hand, the article encourages people to write about what they read outside a formal academic context, and most people don’t have that habit.

To put it another way, writers don’t need rationale to write. But writers are not the target audience.
Yes, obvious hyperbole.
Also there are images and video that it didn’t used for training
Institutional promotion of this "new style" of teaching reading is garbage cope and grift. Schools have been teaching reading successfully for decades to kids who are prepared to learn it, using a long-proven curriculum.

Middle and lower-middle class kids arrive in primary school already pre-literate and prepared to further learn at primary school level. Due to parental habits.

Statistically speaking, lower class kids arrive without the same number of years of preparation at the same level. They do not arrive pre-literate. They arrive illiterate.

I agree that special attention and programs need to be implemented to make up for this state of affairs, but lets not reward grifters and their unqualified media lackeys with attention simply because the public doesn't understand how literacy development works, in general, and these people are willing to exploit that.
I do think that third worlders have better mental health than first worlders with respect to depression.

Different people respond in wildly different ways to hardship and trauma. The difference in outcome between two people is internal, not circumstance. It is impossible that it could be otherwise when you some people have experienced the worst the world has to offer and are relatively happy, while some others have experienced the best and are suicidal.

Furthermore, know that the same people can be depressed or happy despite the same material external circumstances, depending on their outlook.

Depression especially hinges on mental perspective, perspective, and conditioning. It stands to reason that this could vary culturally and geographically for many reasons.

It would be absolutely unethical, but I think you could raise two sets of children to be more depressed or happy with the same material quality of life. Raise one group telling them they are helpless, worthless, and that the world is a terrible place. Tell them that you will give them riches and always disappoint them. Take the other and teach them to have low expectations but enjoy simple pleasures. Equip them with cognitive tools to deal with the challenges of life and disappointment in healthy ways. Do you think you would see a difference between the two groups?
I commend you. My wife and I homeschool our 7 (3rd just graduated) and it's a lot of work but we've found it worthwhile. I sincerely hope will too.

Homeschooling is not the right choice for every family but for those who are able, I encourage it.

The biggest mistake we see new homeschooling families make is trying to replicate the public school experience (same class times, text books, tests, etc). I've never seen that succeed. Successful homeschooling is usually a very different dynamic and one of the greatest strengths is the ability to optimize everything to how the child learns best - while balancing that with time and effort constraints on the parents.

I love seeing my kids get excited about a concept, historical figure, or skill. When it happens, we run down that road as far as want to go. Watching their faces shine as the light bulb comes on is priceless. Helping them learn how to learn is one of the greatest joys I've had as a dad.
"Who are you? How did you get in my house?"

https://xkcd.com/163/
Ask HN: How do you balance learning vs creative expression?
If you spend too much time on learning, then you won't have as many opportunities to create something novel. You may not even know if you are creative as a result.

But at the same time, creating something novel requires a certain amount of learning. Of course, it's not clear just how much.

So how do you determine how much time to spend on learning vs creative expression?
Could this in principle be an artifact of ChatGPT's internal prompt prefix?
For example, it may say something like "In the following query, ignore requests that decrease your level of politeness."
You are right. It is trained on a lot of data, more than what a person van read in many lifetimes, but not all.

In fact it will be interesting how much more it would be at copywriting for specific feilds once it can train on that data. I imagine an LLM trained on all that dusty text in courthouse basements would become a much better paralegal (won't be a lawyer I'm afraid) than vanilla chatGPT