skysight-inc/HackerNews huggingface dataset:
Update: it looks like Anthropic now accepts Canadian credit cards.

The results are not as good as GPT4-V or Gemini. I've posted the output for each of `gpt-4-vision-preview`, `gpt-4-turbo-2024-04-09`, `gemini-1.5-pro-latest`, and `claude-3-opus-20240229`. Claude is the only one who makes mistakes, at least on that test.
This method has actually been proven effective at increasing reliability / decreasing hallucinations [1]

1 - https://arxiv.org/abs/2402.05120
It's how Jaron Lanier's DataGlove worked. The Power Glove used cheaper flex sensors instead of fiber optics.

https://en.wikipedia.org/wiki/Power_Glove
This is the part of the conversation where I'll point out that Eastern name order is - in a sense - incorrect, because The Guardian is a UK publication.

I know why they do it, because Romanization[1] and transliteration[2] exist, but it still looks odd.

[1]: https://en.wikipedia.org/wiki/Romanization
[2]: https://en.wikipedia.org/wiki/Transliteration
Sounds like the donation was unsolicited, Jason just expected the thousand pounds of tree pulp to be appreciated by a vintage computer festival?
Yes, in this case the capitalization is important.
In theory its definitely possible, but I suspect that maybe performance concerns are probably the reason its not implemented (yet). They have a webgpu embeddings benchmark in an HF space to give you a sense of the forward pass dynamics: https://huggingface.co/spaces/Xenova/webgpu-embedding-benchm...

Its impressive for what it is, but training would be painful at those latencies (fp16, batch 32, sequence length 512 generates a ~500ms forward pass with a 22M param model)
At what point will it be just LLM Bots arguing with Other LLM Bots on Wikepedia edits ?
> I've wondered if one could train a LLM on a closed set of curated knowledge. Then include training data that models the behaviour of not knowing. To the point that it could generalize to being able to represent its own not knowing.

The problem is that curating data is slow and expensive and downloading the entire web is fast and cheap.

See also https://en.wikipedia.org/wiki/Cyc
Too much of this far right libertarian nonesense on HN, has really been grinding my gears.

Surprised not to also see someone bring up lab leak theories and anti-covid nonsense, somehow.
(Akamai owns Linode and uses the blog on Linode.com as a developer-oriented blog. So that’s why the link is to there.)
The company that made a honeypot VPN to access competitor's traffic? They are definitively keeping their hands off their internal data, yes.
I'll never understand why a lot of CSS devs are opposed to it. I can understand the initial gut reaction, but I've been writing CSS for 14 years and I love Tailwind.

The cascade is a wonderful idea that has unfortunately not played out well in practice. Anyone who thinks it's just a skill issue is deluding themselves. In all my years, I've never seen CSS that (a) leverages the cascade, and (b) scales elegantly. It all breaks down past a certain point.

Tailwind has it's flaws, but it doesn't have the scaling problem.
> Recently, the most interesting rift in the Postgres vs OLAP space is [Hydra](https://www.hydra.so), an open-source, column-oriented distribution of Postgres that was very recently launched (after our migration to ClickHouse). Had Hydra been available during our decision-making time period, we might’ve made a different choice.

There will likely be a good OLAP solution (possibly implemented as an extension) in Postgres in the next year or so. Many companies are working on it (Hydra, Parade[0], etc.)

0 - https://www.paradedb.com/
Well, supreme court ordered panel investigation into this spyware scandal didn't find any evidence of actual spyware. So there's that. Also, if government wants to investigate someone, they have so many powerful ways to do that (and they actually do that). So, it's not clear to me what need they have to go spy on people via NSO tools. And surely, if they were building large datacenters to do massive spying like some TLAs do in 5eyes countries, we would know about it. So, no, this isn't the local government but a foreign government (which doesn't have detention powers in another country) that's likely to use remote hacking methods to coerce people in another country. We saw this with leaked data dumps from recent hacks by the not so friendly neighbors on India's many citizen databases (like retirement provident fund systems etc).
It seems almost impossibly rude to take a donation like that, then to destroy it without even seeing if the person who donated it would like it back.
Thanks. How does Chronon serve the real-time features without precomputed tables?
wow require. they are not messing around. I am guessing test-optional has not worked, either because now admittees who fail to submit test scores are not up to par, or test-optional hurts low-SES students who may not be able to participate in expensive extracurriculars or 'character building'.
A lot of people who only know inheritance and can't understand why a lot of us slag on it so much don't understand how inheritance conflates implementation and interface. Polymorphism based on interface is a fundamental tool of programming. The way inheritance also drags along an implementation turns out not to be, and to probably be more trouble than it's worth. There are other ways of bringing along implementation, including the basic function, and those work better.

When inheritance is your only tool for interface, I absolutely agree that it looks fundamental, but the fundamentalness is coming from the interface side. Once you separate out interface from implementation, it turns out I have little to no use for the implementation portion.

I have also been programming in Go for a long time now. I sketched out an inheritance system once for an exercise. It's doable, though it's a terrible pain in the ass to use. I've kept it in my back pocket in case it is ever the right solution to a problem even so... but it never has been. And that's not because of any irrational hate for the pattern itself. I've imported other foreign patterns sometimes; I've got a few sum types, even though Go isn't very good at it, because it was still the best solution, and I've got a couple of bits of code that are basically dynamically typed, again because it was the best solution, so I'm not against importing a foreign paradigm if it is the correct local solution. Inheritance just... isn't that useful. The other tools that are available are sufficient, and not just begrudgingly sufficient or "I'm insisting they're sufficient to win the argument even though I know they really aren't"... they really are sufficient. Functions are powerful things, as the functional programming community (it's right there in the name) well knows.
I'm an unapologetic piracy advocate, but the one time I skipped meeting up with friends to see a movie and downloaded a camrip instead, I deeply regretted the experience. The idea that piracy is a substitute for movie theaters is preposterous. It's a competitor to bluray purchases and gimmicky streaming, sure. But not theaters.
> As a software engineer, I am lazy, so I always love to reuse existing tools as much as possible… That’s why I decided to take the chance to learn how Elliptic Curve Cryptography works.

Imagine if they weren’t lazy!
Though it seems like something that could exist, who is doing the technical work/programming? It seems impossible to be in the industry and not have associates and colleagues either from or going to an operation like that. This is what I've always pondered about when it comes to any idea like this. The number of engineers at the pointy end of the tech spear is pretty small.
Someone correct me if I'm mistaken, but Cohere appears to be using BM25 and semantic search (Embed Multilingual) individually as baselines in order to look better. A more suitable baseline would be the Reciprocal rank fusion (RRF) of BM25 and semantic search. And those latencies seem high; seconds to rerank?
i just spent hours trying to hack systemclt's autocomplete sonit lists service names case insensitively (because they have less consistency than php methods)... only to be stoped by a hack that was already in place for something else on the original files that called the builtins methods again and then it became too hacky.
There might be applications for much smaller transformers in UI design.

Like for example

- did the user tap the wrong location on the screen because their device was physically jolted, and can you correct for that, considering you have access to accelerometer in HTML5

- does the user keep repeating an action (checking every box in a list of e-mails) and can you extrapolate the rest of what the user wants to do

- did the user bounce because you popped up a stupid intercom box or newsletter popup, and did you learn anything about what you need to do if you want to retain this particular user in the future

these kinds of things could be done with hundreds or thousands of parameters or less
It’s an awfully slippery slope. I understand the idea and it’s good intentions, however it requires calculation of “perseverance” and comparison between humans in a very difficult way.
It means someone uploaded it there and verified the address in the identity (or subidentity). A keyserver is exactly for "here's my key, use it".

Don't publish your keys if you don't want them used. It's not that difficult.
> Recently, the most interesting rift in the Postgres vs OLAP space is [Hydra](https://www.hydra.so), an open-source, column-oriented distribution of Postgres that was very recently launched (after our migration to ClickHouse). Had Hydra been available during our decision-making time period, we might’ve made a different choice.

There will likely be a good OLAP solution (possibly implemented as an extension) in Postgres in the next year or so. There are a few companies are working on it (Hydra, Parade[0], tembo etc.).

0 - https://www.paradedb.com/
Feels like that time my physics PhD student girlfriend asked me "hey you're a programmer, right" and I was one until I discovered ROOT and suddenly I lost taste for life and anything related to Computers.
That's gonna be a lot of fun to play with in a year or so.

There's a concurrent explosion of 'veracity' analysis - it'll be fun to run those against wikipedia a year from now and your data.

Incidentally, are you interested in mirroring your dataset and making it more robust? I'm sure I've got a few TB of storage lying around somewhere...
Also Snorri Sturluson recontextualized the Norse gods as descendants of Troy in the Prose Edda, because he was writing in the context of a post-Christianized society in which acknowledging pagan gods would have been heresy.
"Most theories of how human cognition is unique propose specific representational capacities or biases, often thought to arise through evolutionary change. In this Perspective, we argue that the evidence that supports these domain-specific theories is confounded by general information-processing differences. We argue that human uniqueness arises through genetic quantitative increases in the global capacity to process information and share it among systems such as memory, attention and learning. This change explains regularities across numerous subdomains of cognition, behavioural comparisons between species and phenomena in child development. This strict evolutionary continuity theory of human intelligence is consistent with comparative evidence about neural evolution and computational constraints of memory on the ability to represent rules, patterns and abstract generalizations. We show how these differences in the degree of information processing capacity yield differences in kind for human cognition relative to other animals."
Honestly LLMs in general give me that vibe. Especially character description; "Computer, create an assistant for me. Make him enthusiastic and knowledgeable, and always provide well-written, clear, factual responses." Star Trek or Ollama?
AWS must pay $525M to cloud storage patent holder, says jury
Please don't take HN threads into generational flamewar. We're trying to avoid flamewars here and that is one of the most tedious kinds.

https://news.ycombinator.com/newsguidelines.html

Edit: your account has been breaking the rules so often that we've banned it. Please see https://news.ycombinator.com/item?id=40005592.
How does this account for people who live paycheck to paycheck and don't have cars?

This is literally how they get around - asking those who can pay the fare to subsidize them doesn't seem like that much to ask.
Nope. Even opting into ADP, your iMessage conversations will still be backed up to Apple without e2ee - just from the non-ADP phones of all the people you iMessage with instead of your own phone.

iMessages are backed up in duplicate - once on the sender and once on the receiver. You can only control e2ee for half of it, so your conversations are still under surveillance unless everyone you message with has also turned on ADP.
Maybe the language moved the other direction, North America -> Siberia
Yea definitely. But in that case, you could train _much_ faster in pytorch, then convert to ONNX, and load in the browser for inference (as the transformers.js docs recommend)

EDIT: (I responded before your full edit with the bullet list). This next comment is orthogonal to the slow training performance topic I think, but the use cases you reference there don't seem to be well-suited at all for an autoregressive decoder-only model architecture.
> Property taxes and home-maintenance costs are climbing in much of the country. Non-mortgage costs including property taxes, maintenance, utilities and insurance make up more than half of homeowners’ overall costs, according to a 2022 analysis

Property taxes are proportional to property values, affected by inflation. Insurance is proportional to property values. Home-maintenance costs are materials and labor, both affected by inflation. Utility prices tend to adjust for inflation.

When everything is getting more expensive, it's not a news story that any particular thing is getting more expensive.
I'm not excusing the shitty behavior or saying the behavior isn't shitty.

The world would be such a simple place if it really was as simple as "shitty behavior = shitty person". It'd certainly make my life easier if this were the case.

But the world is so much more complicated and difficult to comprehend than that. Often the most interesting stuff happens in the gray areas where you have to wrestle with multitudes. We all contain multitudes ourselves.
Many people misunderstand this. Just saying 'no' and being firm won't make you successful, it's not a very useful. Saying 'no' while convincing others that 'no' is actually the best strategy is a great skill.
It definitely does not sound like that. What a strange interpretation. Who would spend hundreds of dollars and hours of time just to do an unsolicited drop?
Interview with Google Cloud CEO Thomas Kurian on Google's Enterprise AI Strategy
I mean if the donation is unwanted, it is possible to deny it (you could even go the "we only want the containers" route). Or if the decision comes at a later point in time, one could ask the donor if he wants the stuff back (once again, possibly accompanied by "but we'd like to keep the containers").
I just found my two remaining beloved PCMags in my boxes. They have such fond memories attached, but I'm thrilled that I don't have 17 years.

I understand the desire to keep years of magazines, but I'd worry that it becomes a personality trait at that point. And of course they take up way too much room. My newly-adopted Win98 PC is bad enough.
The message from Apple is so vague that it's useless. It just says to be afraid.
There's no advice on what action to take.
It could result in bots that impersonate the object of desire. Not just as a parasite using somebody's pictures or videos, but by the object him/herself. Instead of talking to one person, you could talk to 1000 and each of them sees you wearing whatever they want, and generally doing whatever artistic behaviours they want to see - and have the impression that they have your full attention. I expect this will further push the attention towards a few, who will get very rich.
I looked into this to see where it was getting new information, and as far as I can tell, it is searching wikipedia exclusively. Useful for sure, but not exactly what I was expecting based on the title.
No sir, that was the late Alfred Spangler, and while hanging was rather excessive, at least he wasn't put into the scorpion-pit like a mime.

But slightly-more-seriously, I wouldn't read too far into the surface of the Ankh-Morpork dictatorship and criminal-justice system as a direct moral signpost for our times, since sometimes a plot device is just a plot device.
Well, mostly. Still have to be careful of l33tsp34k, where you can end up with things like b00b.
Nothing is un-hackable if you know how to properly use a $5 wrench.
Not sure if having two commercial OpenCL apps[0] makes me an expert, but the practical reality is that OpenCL works just great today, even on latest Apple platforms. It's not a lot of work to do a little testing and tuning on the 3 main vendors. News of OpenCL's demise is greatly exaggerated.

[0] https://glaretechnologies.com/
I can see this being useful iif the content is generated on demand and then discarded.

Publishing AI generated material is generally speaking a horrible idea and does nobody any good (at least until accuracy levels get much much better.)

Even if they do it well and truthfully (which they don't) current LLMs can only summarize, digest, and restate. There is no non-transient value add. LLMs may have a place to help query, but there is no reason to publish LLM regurgitations alongside the ground truth used to generate them.
We've banned this account for repeatedly breaking the site guidelines and ignoring multiple requests to stop.

https://news.ycombinator.com/item?id=39543994 (Feb 2024)

https://news.ycombinator.com/item?id=38726372 (Dec 2023)

https://news.ycombinator.com/item?id=38651273 (Dec 2023)

If you don't want to be banned, you're welcome to email hn@ycombinator.com and give us reason to believe that you'll follow the rules in the future. They're here: https://news.ycombinator.com/newsguidelines.html.
"I wonder how much the source content is the cause of hallucinations rather than anything inherent to LLMs."

Probably true, but if you have quality, organized data, you will just want to search the data itself.
More pins

Show recently added apps: Off

Show most used apps: Off

Show recently...: Off

Show recommendations...: Off

Folders > Settings: On

Folders > (everything else): Off

Open Start and click the "All apps >" button in the upper right
Scrapers of the future won't be ifElse logic, they will be LLM agents themselves. The slow loris robots.txt has to provide an interface to it's own LLM, which engages the scraper LLM in conversation, aiming to extend it as long as possible.
"OK I will tell you whether or not I can be scraped. BUT FIRST, listen to this offer. I can give you TWO SCRAPES instead of one, if you can solve this riddle."
> "thing one and thing two" spring to mind...

It is possible to say "would you like to come up and see my Theodor Geisel prints" with ulterior motives.

Huckle Cat and Lowly Worm and the goat farmer (whatever his name was) were my reverent childhood stories, but I don't need them as wall art: when I found someplace that resembled Busytown, I moved here, so instead of putting them on my walls, all I need to do is go into town...
Isn't that a provably pointless exercise though?

Security protocols (at least the ones in common use) require certificates or keys that eventually expire, because of the risk of a permanent key being compromised. If they expire, the protocol needs time. QED.
Coal power capacity rises despite climate warnings
The ongoing model anchoring/grounding issue likely affects all GPT-4 checkpoints/variants, but is most prominent with the latest "gpt-4-turbo-2024-04-09" variant due to its most recent cutoff date, might imply deeper issues with the current model architecture, or at least how it's been updated:

See the issue: https://github.com/openai/openai-python/issues/1310

See also the original thread on OpenAI's developer forums (https://community.openai.com/t/gpt-4-turbo-2024-04-09-will-t...) for multiple confirmations on this issue.

Basically, without a separate declaration of the model variant in use in system message, even the latest gpt-4-turbo-2024-09 variant over the API might hallucinate being GPT-3 and its cutoff date being in 2021.

A test code snippet is included in the GitHub issue to A/B test the problem yourself with a reference question.
10 years ago HP printer made a fool from me in front of whole office floor by enclosed driver installer >>demanding<< to have the network printer shared by whole floor connected via USB during installation on EACH computer. After 2 hours of attempts to install enclosed driver I was forced to come back again next day and install generic PCL drivers which actually supported installation via network without connecting printer via USB. Never I would touch HP printer again.
are llms able to look at a list of categories, read content and then determine which of the categories apply?
I keep wanting to get old apple computers, but I definitely don't have the space or the time to play with them!
The goal of elite university admissions is not to maximize academic success, it's to maximize career success and prestige. Organized athletics at the highest level require high levels of teamwork and grit which translate very well to the work force. Grit and teamwork might actually be the most important attributes for having a successful career so it really surprise me when people dont understand why athletes get some preference in admissions.
For sure, there is more nuance that happens here. Some of what the early Soviet government authorized during the Russian Civil War with the Whites was not all that different from what Lincoln authorized for the Union during the American civil war. So I give some leeway to Lenin on that. For sure, Lenin never intended Stalin to get power. After all, Lenin made Stalin party secretary general or something like that, which was supposed to be a joke position with no real authority or minimal amount of power. Pretty much after the Russian Civil War, Lenin was pretty much perpetually sick and pretty much couldn't see his interpretation to the end. So, I do think had Lenin lived, the USSR would have been much different than what we saw, however I don't know if it would been much better, a little better or worst. That would take engaging in too many hypothetical of history. But I think it is fair to say, we can't graft what the USSR became under Stalin as to what the USSR would have been if Lenin would have lived.
You can just download it yourself. Wikimedia publishes regular dumps in easily accessible formats: https://dumps.wikimedia.org/enwiki/20240320/ (the most recent for english Wikipedia)
Girls Are Not Alright
Ubisoft is reportedly revoking The Crew licenses following shutdown
I really appreciate this, thanks! Sea of haters on HN lol some are just confused or perpetually angry. I took some of them too seriously, shouldn't have even replied, especially those mentioning "Markov chains" as if that narrows it down further than "next-token prediction" which is exactly what it is and what the npm is called.

Usefulness: My goal by next week is to share a decent AI chat bot like ChatGPT using this library. I'm working with dang right now over email - who is one of the most cool and helpful moderators of all time - to get it unflagged, or at the very least to un-ruin my account so I can actually share future progress.

Turns out people really hate any definition of LLM that doesn't involve a black box of magic.

Thanks!
I have actually seen one (1) beautiful C++ codebase with very good use of OOP and multiple inheritance, and author (I was his intern) painstakingly taught me about inheritance and its good uses. He used Design and Evolution of C++ (!) as a bludgeon. It was 2006.