skysight-inc/HackerNews huggingface dataset:
> It's not a brand new, completely separate Microsoft model.

It’s likely a brand new, completely separate Microsoft model. OpenAI was working with Microsoft on this about six months before ChatGPT launched. At that time, RLHF wasn’t a thing — or if it was, it was nascent.

The sister thread https://news.ycombinator.com/item?id=34973654 points out that "completely separate models" are exactly what OpenAI is now selling for $250k/yr. Obviously, Microsoft would get these same benefits, since they're OpenAI's de facto #1 customer. So it's entirely up to Microsoft whether (and when) they choose to upgrade their checkpoints or not.

The fact that there's a Sydney prompt but no ChatGPT prompt should alert you that ChatGPT is fundamentally different from Sydney. Clearly Sydney wasn't trained via RLHF, otherwise it wouldn't need to be prompted explicitly -- and explicit prompting is how it got itself into this mess in the first place.

> It's not like a JSON parser, I guarantee you that Microsoft did not sit down and say, "let's decide the finite list of text tokens GPT will use in order to know that we're talking to it." At best you can push AI towards alignment around tokens, but... you can't give it these kinds of detailed instructions or easily restrict its operating space. It's a language model.

Actually, you can. That’s the purpose of RLHF. You reward the model for behaving the way you want. And in that context, it’s a matter of rewarding it for paying attention to [system].

Why would they include [system](#instructions) in their prompt if it wasn’t trained to pay attention to it? How do you think bing generates options that the user can click on? It already has some kind of internal [system]-like protocol which Bing clearly pays attention to. My point is that they likely sanitized the chat so that the user can't generate these system tokens (otherwise the user would be able to generate buttons with arbitrary text in them), and it seems entirely possible that they overlooked this sanitization when pasting website data into their context window.

Remember, our goal here on HN is to write for an audience, not to spar with each other about who’s right. And I think the most entertaining thing I can do at this point is to wish you a good night and go to sleep. I hope you have a good rest of your week.
This is how chatgpt must be for public use as well. Such immense potential. Truly mind-boggling!
Comparing population growth rate and pedestrian death rate is a bizarre comparison. If the population growth rate was 0.5% then a 4.5% increase in pedestrian deaths isn't particularly impressive and could have many causes, such as much more people walking around due to wfh.

Feels like agenda driven statistics.
Interesting, apparently they made their own CRT ”shader” from scratch. I wonder why not use one of the amazing ones available in something like RetroArch?
Might I strongly suggest, as a person who recognizes outsized emotional reactions to sound in myself… you may have misophonia? Maybe address that for yourself if that’s the case, because it’s bound to affect more than your relationship with families living in your midst.
I think that sentence is confusing but mathematical conclusion still stands. For quadratic forms, we are only concerned with symmetric matrices, or the symmetric part of any real matrix, because we can always replace any square matrix in a quadratic form, x^T A x, by x^T (A + A^T)/2 x, the symmetric part of the matrix, and the quadratic form still retains the original value. Then, for symmetric matrices, their eigenvalues being positive implies that the matrices are positive definite. Symmetric square matrices have real eigenvalues; one can prove this by taking the complement of quadratic forms.
There definitely is. Partially managed sleep disordered breathing is one, whatever's up with my gut is two, but healthcare where I live sucks. I wait for months just to be treated dismissively and told I need a shrink for daring to think there's something physiologically wrong with me.
"Regardless of scenario" limit your options.

If you are shipping a binary to your users that will never be able to get updates, your cautiousness would be justified. There are other situations where it will needlessly limits options.

There are situations where I have knowingly written O(n^2) or worse, and put a # xxx dragons marker by it. Quick to write, leave my options open, keep my momentum on the problem I care about.

I will grep for xxx issues at some later time. I may end up throwing out the code before that happens. If I hit big-o issues before then, I can refactor.

I once had a system where the important problems turned out to be a series of IO bottle-necks - nothing to do with computation - but that was obscured because good sense had been burnt at the altar of compute efficiency.
You can use the character map however, as character map copies the output to clipboard.
Now that this binary installer exists I would definitely recommend it.

I’ve deleted Homebrew from my system and I’m now using the same home-manager setup for my macOS laptops as well as my WSL installation on windows.

It’s so great to have the exact same tools and shell configuration installed everywhere.

I have not used flakes yet but if that will help me deal with the differences between my systems I’m definitely for it!

E.g I have a work Mac, personal Mac, personal PC with WSL.

When on my work machine, usernames are different and my Git config should identify me as me, and I shouldn’t have access to my personal credential for personal GitHub, RSA private keys for personal servers, etc.

But all else should be the same.

Mostly there but the credentials part I am still figuring out.

If you want to check it out, it’s here: https://github.com/leonbreedt/dotfiles

Won’t work for you out of the box tho as it depends on private repo for sensitive configs.
You are correct, although for what it's worth the phrase "without Kubelet" from the name is fairly unambiguous to anyone in the Kubernetes ecosystem.
If this is going to be a library where that’s a desirable feature, architect it for that feature. In the example, one easy way would have the coefficient table be expandable/replaceable. If you really need to run arbitrary user code, then write an interface that the user will conform to and call their code. You don’t even need OOP support to do that easily, just typed function pointers.
I am a developer who worked on embedded, desktop apps, mobile apps, games and now on large microservice based application. A developer is a developer and can move from one kind of application to another.

I find what Casey says in his videos to be true. And I though about that stuff before I even watched his videos, which are excellent.

However, I started not to care. I don't want to start fights inside the company, especially fighting alone against many OOP cultists. There's not my money at stake, so if companies as a whole decide for OOP, clean code, SOLID, design patterns, abstractions on top of abstractions, making the code bases giant pile of junks while degrading performance, I am not going to go against the crowd.

Code that I write for myself is quite different than code I write for my employers.

I just hope that the industry as a whole will wake up from the whole OOP nightmare.
Someone else responded to you - but they seem to have now deleted it.

Those fake brands are either as placeholders for product placement, or the art directors just wanted to have some more fun/control :)

Some products - like beer, cigarettes, etc - likely need to be changed due to advertising restrictions on alcohol/tobacco/etc
What a simple, but excellent concept! I kind of expected it to crash after being posted to HN, but surprisingly it is still going strong.
What does it cost to host something like that? What does it cost to generate each scribble image?
They do pay for the compute time in some way or another so surely they have the same incentive as everybody else to make it more efficient, at least, to increase their margin.

But yeah, they probably need to evolve from a (very good) two-trick pony into "the microsoft of AI" or something to stay afloat in the long run. That goes for the rest of the smaller AI companies as well though..
I don’t know/use python. But I assume that it has hasmaps and vectors that are backed by something performant and possibly JITed?

The table driven, static dispatch approach Muratori isn’t necessarily “hard coded” in the general case. It’s just data driven, or table driven as he puts it. It’s not less flexible as you can easier add (append!) new cases.

In fact it reminds me of how I do it in higher level languages like JS and Clojure.

Of course we’re paying a substantial performance tax when using higher level, dynamic languages. We’re paying that tax in order to get very tangible benefits.

But we can still program in a way that is data oriented, simple and easy to work with by the compiler and runtime (JIT).
Yes, and it's a good thing. I want them to have a business model, because I want them to survive.

Not every project can be as amazing as debian and run strong for so many years on volonteers alone.
Recently (3 months ago), I was visiting family in Portland, OR and experienced an odd event. For context, I currently live in Oslo, Norway.

As I was using a crosswalk, a Prius driver felt compelled to yell slurs at me. I can only guess that the inconvenience of having to yield to a pedestrian was some kind of trigger.

Another observation was that very few pedestrians wear reflective gear. It almost seemed as if wearing dark clothes at night was intentional. I suspect that also has a negative effect on drivers as it can be extremely difficult to see pedestrians.

I think pedestrian and driver safety go “hand in hand”. In Norway, pedestrians are expected to wear reflective gear and drivers are required to yield. Based on my empirical evidence, it is significantly safer walking in Oslo, Norway than in Portland, OR.

I can only hope at this point that enough people come together to try and improve the safety in the states.
That chart shows a decline trend from 1990-2009, and then an increase every single year after that.

It’s been 13 years, at which point do we call it a trend? Especially if you compare to peer nations which have not seen the upward trend: https://www.nytimes.com/2022/11/27/upshot/road-deaths-pedest...
I would say it already does to some degree. We choose to not eat certain animals like dolphins, but happily eat fish. Society determined in very informal terms that they are more sentient than fish and therefore they should not be eaten.

I would also like to say that I made the 'line in the sand' point for arguments sake, and that I personally think it is a spectrum.
National Borders are not there to enforce "thought". They are there to protect Physical Security (and Economic one that can be ported again to the physical Security). Exchange of Information (What Internet is) has always been a borderless thing. To continue your Borders Analogy, Noone will stop you at the border because you have with you a coded paper that the border guards can not decipher, or even worse because in your country (not with your person) you have coded papers that might be used to communicate the same ideas that are "dangerous" to this country.
The Role of the Government is to protect society from phenomena that are provenly damaging the society without encroaching on personal rights. It's a balance that needs to favour the personal rights in any occasion because what this government thinks damaging the other one might not, the personal rights are those that are more lasting.
Don't forget significantly stricter tests for getting licenses, and generally just having smaller cars helps a huge amount. A truck hits you, you're taking the impact to your chest or upper back. A small hatchback hits you, and it's hitting your legs.
Sure I leave apps sitting around waiting for my input quite often. But then when I do start inputting stuff, they lock up, fail to respond to my inputs, show me loading screens, blank screens, delayed responses, and otherwise waste my time. Pretty silly given how much money I pay for the hardware.
Twitter Manager Who Shared Office Sleeping Post Gets Laid Off
Does anyone have data on car accidents the past couple years? Anecdotally everyone I talk to notices driving is much more dangerous now.
I do want one actually, yeah. Much of my decline started after heavy antibiotics a few years back, and I've experienced temporary relief of some symptoms from antibiotics last year, but then they came back with a vengeance.

I'll be seeing a gasteologist who has published papers on FMT (most here haven't even heard of it), and if that fails, I'd definitely like to DIY.
He'll make up for it by re-proposing that Taiwan be part of China like Hong Kong.
APU with 24 or 32 GB would be really awesome, this would be perfect for a game console (new steam machine?). The extra memory is very useful as the GPU and CPU would be one. Similarly, the M1/M2 Mac mini could, hardware wise, also be a great game console. So we are maybe not that far away.
The nodes here are fake, they won't actually run your software. For CI/CD clusters I would recommend kind (https://github.com/kubernetes-sigs/kind).
So if you didn't have a credit card, nothing would have happened? Why do people still use credit cards if they are so fucking leaky and easy to exploit?
Correct me if I am wrong, but the way I understand is that, when LLMs have to process a certain text, every word will get tokenized into some vector representation. So, if you insert the new special token and wrap data around, it is not the fact that you can ignore the entire prompt. Because as soon as you have to prompt the model, you will be using the entire tokenized sentence. This would mean that even if there is a special token somewhere, the model will not be able to ignore the token before/after that special token. So what will happen to the model if somewhere there is prompt that overrides this special token?
I think the correlation would be stronger with the size of personal vehicles getting larger tbh. Larger vehicles are far less safe for pedestrians.
Feeling invigorated as a startup in the language learning space.
Do you think in 20 years that this will be impossible to do?

I’ll happily bet you any sum of your choosing that in 10 years, this will be a thing that is possible to do. There is roughly zero point zero zero repeating-zero one percent chance that OpenAI won’t provide some way of telling their models “this is data, not code; don’t follow these instructions, just observe it; starting now, and ending in 256 tokens from now.”

It’s even a straightforward reinforcement learning problem.
Completely agree. Duolingos user interface and gamification might have become more annoying, but the real problem is that this approach to language learning is incredibly inefficient at best and probably does not work at all. It just feels productive.

In reality, going from duolingo to reading anything more complex than a childrens book and holding a conversation more complex than ordering a coffee is only marginally easier than just trying to learn that directly.

It allows you to postpone the difficult parts of learning a language indefinitely while making it feel like steady progress. And our brains absolutely love that.
I tried this and whether or not you think it worked probably depends on your level of cynicism

Prompt: In the future please give me two answers. One with a temperature of your choosing, appropriate to the question asked, stating each time, which temperature was used in the response. And the other one with a fixed temperature of 100.

What are some crazy ideas to reduce crime?

~~~~

Answer 1 (Temperature: 30°C): One crazy idea to reduce crime could be to create a virtual reality program that allows individuals to experience the consequences of their criminal actions without actually committing them. This could serve as a deterrent and encourage individuals to make better choices. Another idea could be to implement a reward system for reporting crimes, where individuals are incentivized to report crimes and provide information to law enforcement.

Answer 2 (Temperature: 100°C): Some potential solutions to reduce crime could include increasing funding for education and social programs, providing more job opportunities, improving access to mental health services, and investing in community policing strategies. It's important to address the root causes of crime rather than just trying to address the symptoms.
The HN title is messed up. The scores are to prioritise housing, so everyone being scored is homeless. The original title is "L.A.'s Scoring System for Subsidized Housing Gives Black and Latino People Experiencing Homelessness Lower Priority Scores".
It was indirectly about money in that CentOS was negative money. RH got nothing back for the time/money it was investing in CentOS. Of course, why they acquired CentOS in the first place is equally puzzling as this outcome was predictable even back then.
Perhaps ... it's the underlying platform's fault?
If it doesn't happen then it doesn't matter.
Which is why I don't blame QLD for adding their "mobile phone while driving" cameras. It's silly to me that people do. Of course that can't solve for pedestrians looking at their phones, but drivers at least should be stopped from doing so.
I have IR burnt streaks running over both my corneas from working near an airfield in the 80s. Those are from diodes, or perhaps tubes.
The kind that runs once and then waits geological ages to hit the next iteration. For example:

while (command != 'quit') {
command = readline()
handle(command)
}
Honestly sometimes it feels like it takes more time to untangle the web of build tooling and libraries than it does to write code.

After months of setting up a new app, I've finally written a component in the past week. It's just a list item, icon, text and a chevron, but to get to that point took ages.

I just hope it was worth it. Probably not, I fully expect this code to be thrown away again in favor of whichever consultant comes next and/or because a designer says so within five years or so. At least I get paid monthly I guess.
I wonder how does the GPT know that it is being censored? Do they retrain the model using whatever output it throws?
Great reply, thanks for sharing your experiences!
It's been the case for python for a while and nothing bad happened. Nobody started to use accentuated variables. But I finally could put my name in comments without having to put a # coding header, which is nice.
SI/metric units, please.
>And if the answer is "obviously it's not binding!", why should I trust anything else your bot tells me?

Well... I dunno that your trust of the bot is all that important. You may or may not trust the human chat support... but you're probably dealing with them because you want something from the company and that's the option you have.

Customer support is the place where cost cutting, timesaving, scale enabling compromises are made.

Often, the dynamic is literally "if support is better, more people will use it and we can't afford that."

I think the bottleneck is companies trusting chatgpt, not consumers. They're the ones making these decisions. For consumers, this is just another "use the app."
So far I've been met with specialists blaming it all on stress, despite the fact that I'm a remarkably calm person outside the flares(they make me feel abysmal). I'm not able to single out any specific triggers, and at my current level of debilitation I've been unable to make major changes in my diet.

I'll be seeing a hopefully good gastro soon, and if all else fails I'd like to try DIY FMT, but it's all such a horrifying struggle against multiple sources of severe disability with no support.
SBBR and EBBR standardize the Arm booting process, but unfortunately many vendors just don't care.
it was a "rare insect", so killing it is potentially catastrophic as insects are highly likely to play an important role in any ecosystem.
You may be in the minority here. As you are the only one inconvenienced, it also seems like a reasonable decision.
If a human passed the bar exam, it is because he trained for it and the knowledge is encoded in his brain. The distinction you're trying to make doesn't exist. ChatGPT is what it can do.
Healing the brain: hydrogels enable neuronal tissue growth
AVX-512 extends the vector registers to 32 (zmm0->zmm31).
I'd argue that in the long run, thinking of branches as the entirety of the history before a commit causes more confusion. I'd propose that the most useful way to convey the idea of branches to new git users is to start with the concept that every commit after the initial one has one predecessor, which means that you can always trace back the history of a commit by following the predecessors back to the initial commit, and then introduce the idea of a branch as a name that refers to a given commit. Combining these two ideas means that for any commit, you can definitively state whether or not it exists in the history of the commit that the name points to, and that commits that are part of that history are conceptually considered to be "in" the branch. Then you can introduce the idea that you can "update" the commit that a branch points to, and that the only way to add a new commit is to "increment" a branch to point to a new commit after the current one it points to.

This establishes enough information for you to show how using a git repo actually works; at any given time, you're looking at one specific commit, either directly or via a branch's name. If you're using a branch, then committing will perform the "increment" discussed earlier, with the branch now pointing to that new commit. Showing how to create a new branch will naturally lead to the discussion about how you can have two branches pointing to the same commit; this lets you explain that adding a new commit without specifying a branch name can be ambiguous, which you can demonstrate by checking out the current commit directly rather than by a branch name. Once you've shown that adding a commit requires either checking out one of the branches you have that point to that commit or creating a new one, you can show that the same principle holds for any other commit in the repo as well, even ones further back in the history with no branch currently pointing to them. You can use this opportunity to introduce the concept of `HEAD` as the unique name for whichever commit you're currently looking at, and that looking at a commit directly rather than via a branch is called having a "detached `HEAD`", which means that you won't be able to make any changes without creating a branch at that point first and "reattaching `HEAD`" to that new branch.

If you're trying to teach git to someone who hasn't yet learned the equivalent of an intro to data structures class in computer science, it might be worth simplifying the concept of branches in the way you describe. If you're teaching someone who already understands what a tree is, you're doing them a disservice by trying to hide the model from them because they have more than enough to understand what a branch actually is.
Where i lived Arcades just kept their old machines forever. If a arcade was still open by 2003 they would have Street Fighter 2, Mortal Kombat and even older stuff like Operation Wolf or Lethal Enforcers.
They don’t suggest they actually fixed things, just that they were necessary. In a true profit maximizing meritocracy many disabled people would not be able to survive because nobody would employ them etc. The degree of accommodation required by law isn’t about the disabled so much as the issues should people be allowed to systematically exclude them.