skysight-inc/HackerNews huggingface dataset:
Skimming it, there are a few things about this explanation that rub me just slightly the wrong way.

1. Calling the input token sequence a "command". It probably only makes sense to think of this as a "command" on a model that's been fine-tuned to treat it as such.

2. Skipping over BPE as part of tokenization - but almost every transformer explainer does this, I guess.

3. Describing transformers as using a "word embedding". I'm actually not aware of any transformers that use actual word embeddings, except the ones that incidentally fall out of other tokenization approaches sometimes.

4. Describing positional embeddings as multiplicative. They are generally (and very counterintuitively to me, but nevertheless) additive with token embeddings.

5. "what attention does is it moves the words in a sentence (or piece of text) closer in the word embedding" No, that's just incorrect.

6. You don't actually need a softmax layer at the end, since here they're just picking the top token and they can just do that pre-softmax since it won't change. It's also weird how they talked about this here when the most prominent use of softmax in transformers is actually in the attention component.

7. Really shortchanges the feedforward component. It may be simple, but it's really important to making the whole thing work.

8. Nothing about the residual
I’m sure that’s the one being referred to. It’s great.
If you are making some sort of distinction based on a legal principle, I don't understand what it is.
This is super motivating. Thank you tbh. Good post.
There’s a discussion about this in ecological terms by historian William Cronon in his book "Changes in the Land" (1983), which talks about the ins and outs of this so-called technological inferiority, but also touches upon the superiority (or symbiosis) of the indigenous people living lightly on the land, and having an understanding of sustainability that Europeans are only now coming to acknowledge as useful and important.

https://en.wikipedia.org/wiki/Changes_in_the_Land
Well, this is a showcase that it's not impossible to construct a defense, that doesn't fall instantly, with a couple of characters as an input.

And it was only a quick experiment, very small scale. I've collected a small list of attack prompts. Applied them onto my prompt, gradually increasing the N to 50. I've tweaked the prompt to stabilize it on a weaker gpt-3.5-turbo model. It was about 600 attacks total, per try. Once the defense started working, I've confirmed that it works with gpt-4, which is more steerable with the system prompt.

The weak points are that the list of attacks was small. It is also still somewhat responsive to prompt editing requests.
Ask HN: eReader as external monitor?
Looking at the price of eInk monitors, I've been tempted to try using a spare eReader as an external eInk monitor — or connect a USB keyboard, and run Linux on it.

Cursory research turns up projects such as KoboWriter (https://github.com/olup/kobowriter/) which seem to have overcome some of the difficulties (though the process is still involved).

Has anyone done something like this? If so, how did it go? (And where can I read about it!)
My first job in SF was with WebLogic and at the time their #1 product was a JDBC driver that let applets talk directly with databases proxied through a Java server, looked something like Applet<->JDBC<->HTTP<->Server<->JDBC<->Oracle (most of the time).
It's a bit of a pain if two people share the car. Even worse if two people share more than one car. There never seems to be an option to force use a specific phone when more than one is possible. They all seem sticky to a phone and it always seems to be the other one.

I guess a good thing about carplay is that when traveling with someone else, they can use their phone to update things like maps, and we're not completely locked out of it until we come to a stop.
Because it’s built around a very specialized set of needs (data manipulation, visualization, and statistical modeling), and it is essentially best in class at it, but it has quirks as a result. Anyone coming to R from a background in another language will feel those quirks intensely and assume it’s bad.
Not sure I get it, but on my first use it pointed out connections between Dehumanization and Memes that I had not previously considered. Curious.
Pale Moon has no relation to Mozilla at all; other than being a fork of Firefox of course. It's a pretty small niche project, and I found the Pale Moon people in general to be rather, ehm, off-putting, to put it nicely, and that Tobin guy who created the issue particularly unpleasant (IIRC he managed to get banned from Pale Moon).

Either way, I think the situations are a bit different; naming libraries "$langname-foo" or variations thereof is common in many languages; and I don't think anyone is really confused by this. Attempting to ban the usage of $langname in package and domain names is unheard of AFAIK. Ruby on Rails, godoc.org, gobyexample.com, and many others would be disallowed under this policy.

And as much as I disagree with the author's stance on guns, putting it in a Trademark policy seems ... weird.
What quantization methods rely on second order gradients? I thought people just applied gradient decent, then round to whatever precision.
…that is: raised pigs of selected breeds, and more importantly: almost never uncastrated males, as their meat tends to have a bad taste (so-called boar taint, see link below) that makes it unsellable. That's why the overwhelming majority of raised-for-meat male piglets are castrated, so as to not develop that bad boar taint taste, at an age less than 14 days old. A cruel procedure by the way, which is at most places still done without any anesthesia or analgesia (pain relief). With feral pigs of course, none of that happened.

https://en.wikipedia.org/wiki/Boar_taint
I find if I don’t give a bit of a loading indicator that users get suspicious if the action worked or not.

A loading indicator does a nice job of indicating work being done.
> CarPlay and AndroidAuto don’t give the car any access to the phone data

Perhaps that's changed. There have been warnings about using AndroidAuto and CarPlay with rental cars for years. Now that cars are increasingly collecting data and sending it home themselves, any info your personal car has collected from your phone or usage can be sent back too.

https://www.wgal.com/article/connecting-your-cellphone-to-yo...

https://www.creativetechs.com/2022/06/24/how-to-safely-use-c...

https://old.reddit.com/r/AndroidAuto/comments/v1z1ru/is_it_g...

For some details see:
https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9571200/

> In addition, the forensic artifacts acquired in each analysis area show that the forensic artifacts obtainable in IVI systems using Android Auto and Apple CarPlay are not limited to the internal storage in a mobile device. As such, a digital forensic examination of various elements constituting the IVI system is a useful addition to vehicle forensics. An increasing number of people are using Android Auto and Apple CarPlay, and more vehicles and manufacturers are sup-porting these systems. The proposed forensic methodology and the acquired artifacts can be applied as an important basis for future vehicle crime investigations.
I just pop up the text "Loading..."
They needed an architecture that could take advantage of the scale, first. That's what BERT did.
My bet is that (previously discussed by others and here) that they have cascades/steps of models. There's probably a 'simple' model that looks at your query first, which detects whether your query could result in a problematic (racist, sexist etc.) GPT answer, returning some boiler-plate text instead of sending the query to GPT. That saves a lot of compute power and time. If I were them I'd focus more on those auxiliary models which hold the hands of the main-GPT model; there are probably more lower-hanging fruits there. This would also explain why they didn't announce GPT-4 details; my bet is that the model itself isn't very impressive, you're just getting the illusion that it got better by these additional 'simpler' models.
I’ve been working on giving it uniquely-generated boundaries around each bit of input, along with an example of what to ignore. I’ve had pretty good results so far.
I don’t like the 8 dot spinner when it is small. It is hard to see.

When it is large it’s fine.
Considering they are trained from the internet AI will be heavily influenced by cat pictures so they will only kill those who are not cute. The future will be people endlessly posting photos of themselves on the internet being cute in hopes of holding off the AI death squads, so pretty much the same as things are now but with AI death squads.
> These lies are knowingly spread by the White House and the Democrats.

This sentence appears an example of Brandolini's Law. The problematic phrases are "the White House" and "the" Democrats. I'll explain.

- It is one thing to cite a source that shows a politician making an incorrect statement. That's fair and important.

- It is quite another to claim that a group of people are knowingly spreading these incorrect facts. It is easy to claim <some group> is spreading lies without specifying (1) the members of the group involved; (2) the mechanism by which these people speak for the group; and (3) why one's definition of the group is reasonable in context. Not to mention (4) Why is this particular detail worth mentioning in isolation from the broader context?

- Perhaps most importantly, when someone writes (or speaks) (5) is that person writing (or speaking) in ways that maximize the desired interpretation? And good luck with that, given the realities of your audience's background knowledge, reading comprehension, attention span, and biases.

I'll posit an even more fundamental basis for Brandolini's Law that has nothing to do with intentional malice or deception: the imprecision of human language makes it inherently difficult to fact-check someone else's sentence, because one has to interpret the sentence before criticizing it. This leaves some room for the original author to deflect the criticism by saying "I didn't mean that" (and this might be genuine, fair, and reasonable!) ... but meanwhile no clarification was issued (seriously, WTF?, why aren't corrections better integrated in the source material?) and many people are still reading the original statement and interpreting it in some subjective way.

Sometimes I think it is amazing human societies function at all.
Predators were… designed?
> the GPT-4 message cap at chat.openai.com was shown as something along the lines of "we expect lower caps next week"

At the time I noticed that the wording they gave technically implied they expected the cap to get more limiting and then that's exactly what happened, and I haven't been able to work out if that is indeed what was the intended message or not.
Mexico’s president vows to eliminate national news agency
To add on to this, it can in fact be much more complicated than both styles put together and still look correct if done well. If you’re on iOS Safari, try scrolling to the top and then slowly pulling the page down (the universal iOS Safari gesture for refreshing).

It starts out not spinning and each segment fades in to full opacity one by one, creating an impression of the spinner “filling up” as you get closer to completing the gesture. The moment you complete the gesture, the fully solid spinner starts spinning, then the spinning slows while some of the segments start fading, and the fade starts pulsing as well. By the time the spinning has stopped, the pulsing is in full effect. When the action completes, all segments quickly return to full opacity and the spinner quickly begins spinning once again, and then (while spinning) the whole icon both fades and shrinks until it disappears.

That is an incredibly complex and incredibly well-executed spinner animation!
Is it? I don't think DNA plays into who people elect/hire as much as a college degree. Also, people know which college they went to. People generally don't know what % of their DNA is Norwegian.
> 1. The data/emails were most likely stolen and the media was trying not to make the same mistake as reporting DNC hacked emails, which was a Russian intelligence operation.

This is a complete assumption on their part if that happened. Instead of researching and taking time to assess the finding, they assume foul play. Why does it happen conveniently when the Democrat Joe Biden would suffer from investigating this clearly? Why would they assume it was stolen? Why would they assume it was Russian disinfo? Do you not see the clear profile of ideological politicing at play here? It's all conveniently explained away and meanwhile they get to keep playing politics and pretending to be bipartisan.

> 2. Hunter Biden is not a politician, unlike the Trump kids (who are all hopeless cocaine addicts but no one seems to care) he never worked in the White House. And there's 0 proof Biden was a part of any of Hunter's bullshit. So outside of muckraking and dirty politics, there was nothing newsworthy about it.

So being a cocaine addict is newsworthy when it's the Trump kids but not when its a Biden kid?

>So outside of muckraking and dirty politics, there was nothing newsworthy about it.

Strong disagree. This is exactly the thing that muckraking should uncover. Again, if this was about a Trump kid, everyone would want to know and investigate it. Including you and me.
Yes, humans are good at it. Is your language model?
I believe Jay actually works at Cohere now (although I’m a little surprised that the post doesn’t state that).
The API is out now so you can use it with third-party apps, just FYI.
Completely agree, as evidenced by the fact that the same fontawesome package includes both as an option it feels very wrong to suggest that one is "wrong"

I, personally, prefer the one on the left too but I wouldn't ever say the one on the right is wrong or broken or needs to be "fixed"
> What company are you talking about exactly?

Lightning Labs. The founders were heavily involved in the debate over increasing block size that led to a hard fork. I have no idea if they honestly thought the network Das better off with a smaller block size, but after successfully fending off a block size increase they created a company to develop a lightning network implementation.

> Now you're just being obtuse. I'm obviously not talking about cryptography.

That doesn't actually answer the question. Are you referring to cryptocurrencies as a whole lot a subset of smart contract protocols?
Now I can’t help but imagine the raw GPT-4 is just some huge raging asshole and it just has a bunch of “handlers”.
At least for Android Auto this was necessary before the wireless version became popular. Data over the cable but audio was still done via Bluetooth. At least in my "older" car.
My iPhone has asked me before if I want to give my contacts to a car, it’s never done it unless I said yes.
To add to that, the Dutch VOC was a corporation with a private army and navy that set up colonies and sold stock in their profits. They helped precipitate the first stock exchange as we know it, if I recall my history correctly.
Famine, Affluence, and Morality (1972. PDF)
That's my point. People were obsessed with how right they were and turns out after a period of time, they were actually wrong and what they were campaigning against (why?) become the defacto choice.

I clearly remember at least 4 different family members all calling my first mobile phone a "wanker phone" and every single of them carries a mobile these days.
>Why cannot it be controlled by the user? Probably because it is intented to be used as a backdoor or to report users who install pirated software, or download unapproved materials etc.

I have a simpler answer that doesn't require inherent malice: To keep out hostiles that have control over the computer, be that virtually or physically. You can't compromise what you can't access.

Personally, I understand the concerns behind ME and PSP and am not particularly concerned. I trust Intel and AMD to not fuck with me, else why would I buy their processors? If I don't trust the ME/PSP because I don't trust Intel/AMD, I certainly can't trust the rest of their processors either.
Repositioning Tiered HotSpot Execution Performance Relative to the Interpreter
The traffic cameras were installed on intersections where they would generate the most revenue rather than on intersections that generate the most accidents or injuries.
The spinner on the right is better simply because 90% of users have already been trained to have a visceral hatred reaction to the spinner on the left. I would rather look at a pulsating orifice than the left spinner.
All the content on the site is bundled in the javascript -- even all the text. The only markup in the html file's body is an empty DIV.

That's ~55 KiB of minified JavaScript (roughly, Act I of Macbeth in size) for a page with 82 words. Modern web development sometimes goes out of its way to be overcomplicated.

Ironically, the animation is all being done with CSS.
I notice you don't justify your position that those people 'get in the sea'. Lets find you a swimsuit, maybe a floaty?
Perhaps as measurable as the quantum state of the universe itself. After all, “environment” includes the universe.

So realistically, probably not. That’s why I felt it necessary to say “I believe.”
"I'm from the government, and I'm here to help."
OK but junk food and soda are huge sources of excess calories, which is another way of saying "eating too much".
> the raw GPT-4 is just some huge raging asshole

That's pretty much exactly how one of the OpenAI Red Teamers Nathan Labenz describes the raw GPT-4, starting around 45 minutes into the video:

https://news.ycombinator.com/item?id=35377741
I'm glad even big companies struggle with centering things, which tells you how hard it really is :')
Thanks. ML noob here. I liked the insight that attention adds context, by modifying the distance in an embedding.
Please next time post your takeaways instead of a repetitive prompt sequence.
The architect Kashef Chowdhury's presentation on the design. Much more visual, gets covered in 10mins:

https://youtu.be/lc1DMkQqfLw?t=243
> They try to mix in exploitative strategies which abuse the tendencies of their opponents.

without knowledge of other players, how do pros wins consistently at casinos?
That is a Bluetooth feature.
What cheap, near-zero config wifi APs have worked well for you? I'm looking for something simpler than ubiquiti for my house.
It's not magic. It's a world model. World simulator. World includes many objects, like a calculator for example. Or "The Hitchhiker's Guide to the Galaxy" by Infocom. So does the simulation.
8 years ago we were pretty much where we are now. It will come faster than you might thinkm
> cultural as you are implying

I… didn’t think that’s what I was implying. I didn’t think I was implying anything at all, I was pretty direct about my meaning.
Call a Node.js Async Function from C++ Native Code
I’m about to go to bed so I won’t (just yet) give your comment the response it deserves, but as I read one question struck me: what are the empirical aspects of cognition? Is cognition not a function of life itself?
You're a car manufacturer, you suck at software. Right now, it's mainly a cost center for you. There are two options that may be preferable:

1. Bail out of infotainment and let others deal with the software, that way at least you aren't paying for this. If you go for an open source/standard, maybe you can commoditize your complement.

2. Monetize it somehow, with the (dis)advantage of owning your stack as much as possible.

OP suggests (1). GM is choosing (2). Either makes a bit more sense for car manufacturers than the current situation, if they don't worry too much about losing customers while they make the transition, and if they can do (2) without sucking too much.

Another thing to note is that when AV cars arrive, the user (former driver) will have a lot more time for infotainment. It's possible that differentiation will more strongly select for these types of features. So again you have the options of bailing out/doing it yourself. The current situation: Letting Google/Apple own much of the stack is the worst for you, since these companies may prefer their own cars (there are persistent rumors of an Apple car, Google is known for Waymo).
It’s the latter.
My heuristic is to just buy LEDs made by Phillips or GE, since invariably any generic or store-brand LED I've tried seems to lack rectification and/or filtering and stobes at 60 or 120 hz. I haven't tried any fancy/expensive "smart" programmable bulbs, but plain ones I do get seem pretty reasonably priced.
The mandatory Matrix hacking scene mention - Trinity uses NMAP? Here is a video https://www.youtube.com/watch?v=0PxTAn4g20U
Sounds like an interesting book, I’ll check that out
Also, not all types of dithering have regular patterns.

And as someone else noted in this thread, a jpeg would offer better image fidelity and filesize than this dithered PNG.
I have been writing prompts for a GPT-based document 'digester' for business-internal people who can't code but do have the right background knowledge. Every day I have to expand the prompt because I found a new spot where I have to hold the thing's hands so it does the right thing :)
They still have onStar and push it despite all reason. I drove a 2023 chevy bolt recently, and couldn’t figure out how to get the nav software to render a map.

All the buttons in the UI just initiated phone calls with someone (something?), so I hung up and switched to carplay.

It is a shame that the onboard nav is busted. My old BMW EV has extremely good range predictions, etc., and my phone does not even attempt such things.

I’m not switching to Google’s ecosystem, so I guess I’ll just never buy a GM moving forward.
I love CarPlay but I’ve given up on wireless. The idea seems nice, but in practice I have two issues.

First CarPlay just takes a fair amount of power so you’re going to notice it’s effect on battery life.

Second is the audio playback lag. I can’t stand it. It feels like seconds (though maybe it’s not that bad). The interface is ok but hitting pause or play or next track takes noticeable time to happen.

I’ve only ever tried it in my car. Maybe it’s fine in other vehicles. But it’s useless to me. It’s extremely responsive when connected by cable, so I just ended up going back to plugging in.
Current SOTA post training quantization method is GPTQ:
https://arxiv.org/abs/2210.17323
This seems like a reasonable take, but I can tell you with 100% certainty I'm not a threat to any of the devs/entrepreneurs in this thread. For me, it's just fun to see how other people are scratching out a living. My feeling is that not all successful ideas are easily replicable when you consider all the factors that contribute to one's success, so just because someone else managed to pull it off doesn't mean I could.
Given the off-grid mentality that often comes with solar power enthusiasts, hosting on a computer in a different city sort of puts you back on-grid. I like to imagine that the maintainer is also talking to their friends about mesh networking.
I think Neil Patel has the best resource on SEO
https://neilpatel.com/
Option 3 is that Google and Apple pay me to take care of this problem. Why wouldn't I just do that?