skysight-inc/HackerNews huggingface dataset:
It's not a human. I imagine if you have a use case where counting characters is critical, it would be trivial to programmatically transform prompts into lists of letters.

A token is roughly four letters [1], so, among other probable regressions, this would significantly reduce the effective context window.

[1] https://help.openai.com/en/articles/4936856-what-are-tokens-...
> Are they finally applying filters and operands to image searches?

That was a bug, apologies. It should be fixed now.
Those venues have huge issues with referees. It comes down to who is reviewing the work.

The irony in your comment is that it is related to the paper we are discussing. There is a big problem with poisoning from group-think and self reinforcement in current ML research.
Perhaps set a timeout on the operation then? Given this is kernel it's not as easy as userspace, but I'm sure you could request to set a interrupt on a timer.
This is only an issue if you send commands to a LLM as you were communicating to a human.
Quora, Pinterest, Medium, The New York Times, Scribd, etc
At its core, it is price fixing, and already technically illegal.

There is no sound argument that can be made that weights in AI software programed in don't have biases created by human's, and won't ever engage in illegal activity. They are just trying to make the argument, its not illegal because an AI does it.

We have already seen how Amazon uses their bait and switch algorithms (dynamic pricing) and there is more to learn about with regards to Project Nessy.

It is anti-consumer activity, which can only occur in concentrated business sectors (oligopoly/monopoly).
With the amount of straw men in this comment, it's like an early Halloween.
But billionaires already have that, they want a chance of getting their own god.
Regulatory capture for SpaceX? Is that a joke? Are you heard of a company called Lockheed, or perhaps Boeing?
It was requested for…weather, alarms, music. You know - all the things his phone ALREADY DOES.
What else can be done?

If you are sitting on 1 billions $ of GPU capex, what's $50 million in energy/training cost for another incremental run that may beat the leaderboard?

Over the last few years the market has placed its bets that this stuff will make gobs of money somehow. We're all not sure how. They're probably thinking -- it's likely that whoever has a few % is going to sweep and take most of this hypothetical value. What's another few million, especially if you already have the GPUs?

I think you're right -- we are towards the right end of the sigmoid. And with no "killer app" in sight. It is great for all of us that they have created all this value, because I don't think anyone will be able to capture it. They certainly haven't yet.
Not yet but it's something we want to look into.
If you search for 'a', which one of the Unicode 'a's will it find?
Xenophobic is not really the correct term here. Political and social efforts to extract or maintain wealth for the incumbency is part of human society forever, e.g. the rollback of the Great Councils reforms in Venice and the fall of the republic Rome.
Refusal to treat AIDS and HIV positive patients (1987) [pdf]
Previously: https://news.ycombinator.com/item?id=41039708
> their data

Love how it's their data when it might make them money but not their data if they get sued.
How could the legal aspect affect here allowing ported games to played from another platform?
It's so hard to get painkillers nowadays that people with chronic pain can't acquire them. The govt listened to this kind of argument and decided to just make everything regulated rather than making everything legal. Not a big surprise honestly
What's that weird APL derivative called that quants love so much? Julia? Reminds me a little of that, in the syntax at least. A little like MUMPS, too, maybe, and probably closer to that level in terms of its abstractions.
I understand the AI context, but this is dangerously anticompetitive for other search engines.

This is a dangerous precedent for the internet. Business conglomerates have been controlling most of the web, but refusing basic interoperability is even worse.
Secrets Of A Ransomware Negotiator
Probably because theinformation.com is hardwalled and thus, unfortunately, off topic for HN. If there's a more substantive article that people can actually read, we can switch the URL to that.
>Then why not remove this crap (LLMs) from the loop altogether

Because reading is faster than writing.

Someone could spend a few years or even most of their life writing a book that can be read in a matter of hours days or weeks.

Humans writing have to proofread their own work. Or occasionally even pay someone else to do it.
https://archive.ph/GERuA
The 5-set Venn diagram looks beautiful (and is apparently by Branko Grünbaum), but is a similar symmetric 4-set Venn diagram also possible? Can't find any such example on the internet

EDIT: apparently not, from Wikipedia: "David Wilson Henderson showed, in 1963, that the existence of an n-Venn diagram with n-fold rotational symmetry implied that n was a prime number."
I dumped my intel shares just now, stock price has been sinking for the last week over this news but I'm predicting a recall or a big lawsuit will make the news from bad to worse.
Foreign Data Wrappers for Migrating from Oracle to PostgreSQL
The ex-servicemen I hired used to bug me about taking customer abuse in meetings...

I pointed out we bill by the hour, and if someone wants to sit there irrationally ranting at people to work though their solution... so be it... lol =3
This is true of opium. They used to give it to babies. This was because they didn't have safer drugs like we do today
AI companies do not seem to be having issues finding cash from VCs, and the idea that OpenAI of all companies might not be able to find investors willing to give them money seems crazy to me, but maybe that's discussed in the paywalled article I wouldn't know.
CachyOS looked so promising... Good performance, ZFS in the Installer, arch based...

Unfortunately the setup crashed on my notebook and my proxmox VM, so I could not really test it. What a pitty...
Hospitals bought into a contract where the terms basically said "don't rely on us for anything important, especially not anything that impacts human life". Patients were certainly medically impacted, perhaps up to the point of early death.

Whose incompetence is that? If a hospital pays for an energy redundancy solution where the vendor basically communicates "please don't use us for anything important", and then a power outage costs lives, are we seriously saying that the hospital shouldn't have to pay big time?

I'm not saying that CS shouldn't be liable. I'm saying that when consumers are looking for someone to sue, and regulators are looking for someone to punish, those who directly interface with the consumer should be in the direct line of fire. Hospitals in turn should be able to sue CS.

We certainly should not prefer that the blame goes straight to the engineer as then the consumer would basically have nobody to sue. That's a world of even less accountability. Those who are most capable of taking responsibility should take responsibility, and not merely those who are most blameworthy from first principles of local causality.

There could be billions of dollars of damage here. There must be billions in liability as well to balance the economic scales. This is way past the single individual who pulled the trigger.
The number of notes per bar is not really finite given you can make any a:b polyrhythm and you can make any subdivision you like. For example, see the famous falling coin rhythm based on the Fibonacci series in Bartok's "Music for Strings, Percussion and Celeste"[1]

[1] If you want a look at what "Pyramids on Mars"-style musical analysis is like, Erno Lendvai's book about Bartok is pretty awesome. Since Bartok never really wrote or said anything about his compositional methods it's very hard to prove anything conclusively.
1) Everything went mostly well

2) The things that did not fail went so great

3) Many many machines did not fail

4) macOS and Linux unaffected

5) Small lil bug in the content verifier

6) Please enjoy this $10 gift card

7) Every windows machine on earth bsod'd but many things worked
I think the blog universe would only benefit if medium ceased to exist.
Eventually it comes down to who has deployed more silicon: AWS or Azure.
This idea was already tried with the hour record. Between 1972 and 2014 a standard bike was used to match what Eddy Merckx used.

What happened was cyclists lost interest in the hour record because the bike became too dissimilar to the bikes they were riding professionally.

After a new rules for modern bikes were introduced for the hour record, interest was renewed in the discipline.

For something like the Olympics which is a one day road race or individual time trial, I think the current UCI rules for those bikes are fine. Everyone is on roughly competitive bikes. Marketing aside, I don’t think anyone really thinks the top Specialized bike is better than Canyon or Cervelo or Trek or whatever.
The Functional toolkit for Kotlin HTTP applications
Why there are so many errors with Intel cpus lately? CPUs used to be the most reliable parts of a computer. Are there too many "moving"variables to extensively test everything? Is it no longer possible to grab the speed crown without cutting corners?
Related ongoing thread:

AI models collapse when trained on recursively generated data - https://news.ycombinator.com/item?id=41058194 - July 2024 (64 comments)
Is WebP better than JPEG? (2020)
I gotta say, Claude is a godsend for building out quick prototypes of ideas, especially when those ideas require domain specific knowledge that you know a little about but aren't specialized in. Which is most interesting programming projects.

Sure, I could do it myself, but it would take more time, each step would have less momentum, and I'd have to think more while I do it. Which, there's a place for that too, of course.
Eminent domain powers in the US are very broad at this point and almost certainly would include zoning. The question is if the government can do it without compensation. Either way the government can zone land or protect species. The question is if they've gotta pay individual land owners or not.
Related ongoing thread:

The problem of 'model collapse': how a lack of human data limits AI progress - https://news.ycombinator.com/item?id=41058867 - July 2024 (6 comments)
> I predict we’ll see other vendors removing similar bonehead “features” very very quietly over the next few months.

Absolutely this is what will happen.

I don't know much about the practice of AV definition-like feature across Cybersecurity but I would imagine there might be a possibility that no vendors do rolling update today because it involves Opt-in/Opt-out which might influence the vendor's speed to identify attack which in turns affect their "Reputation" as well.

"I bought Vendor-A solution but I got hacked and have to pay Ransomware" (with a side note: because I did not consume the latest critical update of AV definition) is what Vendors worried.

Now that this Global Outage happened, it will change the landscape a bit.
GPT4o already does that, for problems involving math it will write small Python programs to handle the calculations instead of doing it with the LLM itself.
Keep in mind that the Prover-Verifier game is not that it's training on AI-generated data (as if to imitate it) -- rather, it's training against a discriminator that verifies for correctness (a calculator) and understandability (a smaller, less-capable language model). You can think of this as a distillation method, but it's not like it's generating large amounts of source data and then retraining on it. This method only works on specific problems where there is an absolute right answer that can be verified with an independent heuristic (in this case, a math calculation).

However, there is a lot of potential in the world of self-play and adversarial-training to improve the quality of our LLMs with true reinforcement learning.

For one recent paper on this topic, also check out SPAG -- I found this one to be fascinating:

https://github.com/Linear95/SPAG

I've been keeping notes on this topic in a WIP paper, and if you'd like to read my (rambling) ravings about it, you can find more info here:

https://github.com/HanClinto/MENTAT

I think that self-play and reinforcement learning are going to absolutely be important for the next level of LLM development. If you use AI-generated data, then you must have an objective metric to verify "goodness". Nothing is free, and simply asking an LLM to rate the quality of its own data is not going to cut it. I think that's the point of the article.
Since Skylake. It's the reason Apple dumped them.
You mean things like grip strength? Or even personality traits like aggressiveness? A ton of things correlate with a specific gender.
No, bad/wrong/nonsense is not the only risk here. You're missing the main point that the authors are making: the shape of the distribution gets changed by this process. A model trained on human data will produce fewer high-perplexity examples than it was trained on (you can see this in Fig 1b, even between generation 0 and 1). In a literal information theory sense, these perplexity values indicate how much information is in each example. Over successive generations models have less actual information to learn from even if they have the same volume of text.
I have information that Youtube is redirecting from "www.youtube.com" to "m.youtube.com" when it detects a mobile user agent. The page data that is returned appears to be incompatible with the app's parsing code.

Will figure this out.
This is not true. If your sync function loops until the value is set, then the Promise will never resolve, since it never yields to the event loop.
Count the number of occurrences of the letter e in the word "enterprise".

Problems can exist as instances of a class of problems. If you can't solve a problem, it's useful to know if it's a one off, or if it belongs to a larger class of problems, and which class it belongs to. In this case, the strawberry problem belongs to the much larger class of tokenization problems - if you think you've solved the tokenization problem class, you can test a model on the strawberry problem, with a few other examples from the class at large, and be confident that you've solved the class generally.

It's not about embodied human constraints or how humans do things; it's about what AI can and can't do. Right now, because of tokenization, things like understanding the number of Es in strawberry are outside the implicit model of the word in the LLM, with downstream effects on tasks it can complete. This affects moderation, parsing, generating prose, and all sorts of unexpected tasks. Having a workaround like forcing the model to insert spaces and operate on explicitly delimited text is useful when affected tasks appear.
Ironically, it's only junior engineers that haven't learned how to say "no" that I've seen hold this opinion.
I'm also wondering about the extent to which we are simply burning venture capital versus actually charging subscription prices that are sustainable long-term. Its easy to sell dollars for $0.75 but you can only do that for so long.
Awesome product, glad to pay for something I use every day, the wallet will simplify my life
Remember to make sure your XML parser doesn’t fetch remote DTDs. You’ll also want to make sure that the code which validates the signatures in the SAML assertion reports to you which specific parts were signed. You will also want to validate the schema of the assertion. Also make sure to reject assertions which aren’t signed at all. Don’t forget to store the ID of the assertion to avoid replay attacks.
There's a complexity missing there. It's like the effects of incest upon dna. Or an echo chamber upon conversation.
I didn't read the book, I'm afraid. I don't know if he actually mentions it anywhere.
Such a relief/contrast to the period between 2010 and 2020, when the top five Google, Apple, Facebook, Amazon, and Microsoft monopolized their own regions and refused to compete with any other player in new fields.

Google : Search

Facebook : social

Apple : phones

Amazon : shopping

Microsoft : enterprise ..

> Even still, this monthly progress across all companies is exciting to watch. Its very gratifying to see useful technology advance at this pace, it makes me excited to be alive.
I am aware of that. I visited Thailand several times and even attempted learning Thai (besides planning to move there for work in mid 2010s). I don’t live in Poland any more but I know several Poles with Vietnamese roots, hence my assumption/comment regarding the night market.

Apologies if the way I phrased my comment was somewhat confusing! As a Pole who studied Persian I can see how people might expect ignorance in that matter.

(pndy’s comment is correct)
I don't think Special Relativity would allow that.
Email is by far the best way to interact 1 to 1 available online. I don’t care what anyone says. It’s not perfect but it just works.
Is this a pedantic argument about a specific definition for "message passing"? If not, then it's wrong: door_call() allows passing an arbitrary/opaque buffer of data into the call, and returning arbitrary data as part of the return. (Maybe the confusion stems from the fact that the sample code in the linked article skipped the second argument to door_call(), but you can see it documented in the man page).

If so, then I retreat to the argument above: there is nothing about "Remote Procedure Call" as a metaphor that requires "message passing". That, again, is just an implementation detail of other RPC mechanisms that don't implement the call as directly as doors (or binder) do.
Anyone know what caused the very big performance jump from Large1 to Large2 in just a few months?

Besides, parameter redundancy seems evidenced. Front-tier models used to be 1.8T, then 405B, and now 123B. Would front-tier models in the future be <10B or even <1B, that would be a game changer.
They're doctors, not CEOs. They are advising based on the behaviors they see from most of their patients, who probably come in asking for quick solutions and are unable to make lifestyle changes stick. Patients who are educated about their own conditions, willing to listen to advice, and able to keep to that advice over the long haul are a very small proportion. Not that doctors shouldn't offer this sort of advice anyway, I am just asking you to please try to understand why they behave in such a way.
Audi part. Cars are not moving. If the rest of Volkswagen is similar its going to be bad. Tesla is just more visible. I think only Toyota is making money right now.
Per the article 0.2% of .com domains are phishing vs 4.2% of .top. Or put another way, if you have a .top domain it's about 17 times as likely to be phishing than a .com domain.

.com has the most phishing domains by virtue of by far being the biggest, not because they have looser controls or are less reliable.
The joy, excitement, and surprise of computing – Con 2024
Just like every security feature in the physical and digital worlds, security just inconveniences honest people and the cost to bypass reduces the amount of people who try.

Eventually it becomes expensive to scrape reddit's data and most people will stop.
Semioscape: An AI-enabled concept cartographer
>Should that happen it may impact the park's tourist revenue but the governor is working on diversifying the states income.

Oh no! Wyoming might lose 0.007% of their GDP. I hope the governor can save them in time!
I'd love to see what would hang off those footnote references, but I don't suppose I could say I blame you for leaving them dangling.
Or rework the array so realloc() can expand its size?
My friends and I contracted to a company in 2004 to build a text message system. The company decided they didn't want to pay us the last month's bill. They'd spent all their money buying a custom Harley as a prize for the customers and now had nothing left.

We met with their CEO+CFO+lawyers and our lawyers. They were adamant they wouldn't pay the last payment. We pulled out our contract and showed they didn't own any of their code because there was no IP transfer in there. They said "We need a minute." We left the room, came back in and there was a check for the outstanding balance in the middle of the table.
We share this in the match proposal, but the future state I envision using it also as a method for verifying users.
MOMAland: Benchmarks for Multi-Objective Multi-Agent Reinforcement Learning
Dial it down my dude.
Its very common for people high up to know nothing, but they are calm and speak well in meetings. Even for VC backed startups, its really about selling a vision and having the proper pedigree, not grinding away at all hours of the night
I didn’t have a “clean” ip so most emails I sent went to spam. But was rectified after recipients marked as safe or “not spam” on their end.

Not really an issue for me since I am not using it for mass marketing; and it’s just a personal email server. So just a single user (me).

There were issues with block lists and outlook but was fixed after IP reset. Fortunately most of these services provide near instant feedback via mail protocol or bounced emails.

Plus I have a metrics exported via Prometheus and feeding into influx db and grafana dashboard.

Also fun to monitor Dovecot and postfix logs and get them into grafana. The number of script kiddies just sending random requests is fun to watch. Had a couple of instances where attacker was clearly trying to find a vulnerable user and try to use
my server for spam or something else.
Instagram won't allow it
Our servers hit max capacity and profiles are taking a bit longer to get set up. Stay tuned.
Are you arguing that adults should not be able to choose what they ingest because some people used to give opium to babies at one point?
Lots and lots of synthetic data from the bigger models training the smaller ones would be my guess.
> When Google strikes an exclusive deal with Reddit, it is ..

It's because reddit is selling content created by users, base on promises that reddit supports open internet, open data, etc, without their consent and sharing revenue, which maybe legal but likely not ethical.
This video is about this updated post: https://www.reddit.com/r/intel/comments/1e9mf04/intel_core_1...
Or at least, reddit posts and comments that are content messaging / marketing (human or AI) fit in better with earnest and natural posts, so that they're more effective.
Yeah, but what does that actually mean? That if they had simply doubled the parameters on Llama 405b it would score way better on benchmarks and become the new state-of-the-art by a long mile?

I mean, going by their own model evals on various benchmarks (https://llama.meta.com/), Llama 405b scores anywhere from a few points to almost 10 points more than than Llama 70b even though the former has ~5.5x more params. As far as scale in concerned, the relationship isn't even linear.

Which in most cases makes sense, you obviously can't get a 200% on these benchmarks, so if the smaller model is already at ~95% or whatever then there isn't much room for improvement. There is, however, the GPQA benchmark. Whereas Llama 70b scores ~47%, Llama 405b only scores ~51%. That's not a huge improvement despite the significant difference in size.

Most likely, we're going to see improvements in small model performance by way of better data. Otherwise though, I fail to see how we're supposed to get significantly better model performance by way of scale when the relationship between model size and benchmark scores is nowhere near linear. I really wish someone who's team "scale is all you need" could help me see what I'm missing.

And of course we might find some breakthrough that enables actual reasoning in models or whatever, but I find that purely speculative at this point, anything but inevitable.