skysight-inc/HackerNews huggingface dataset:
For all the leaks on: Secret projects, novelty training algorithms not being published anymore so as to preserve market share, custom hardware, Q* learning, internal politics at companies at the forefront of state of the art LLMs...A thunderous silence is the lack of leaks, on the exact datasets used to train the main commercial LLMs.

It is clear OpenAI or Google did not use only Common Crawl. With so many press conferences why did no research journalist ask yet from OpenAI or Google to confirm or deny if they use or used LibGen?

Did OpenAI really bought an ebook of every publication from Cambridge Press, Oxford Press, Manning, APress, and so on? Did any of investors due diligence, include researching the legality of the content used for training?
Copyright in the US persists for 70 years after the publisher's death.

So the earliest available copyrighted material would be all content published by anybody who died in the year 1953 or earlier.

If the author of an article published in 1950 still has a living author, the work is still copyrighted.
This is a little ridiculous. There are flaws with copyright law but making money from creative work would be even less viable than it is now if there were no disincentives at all to blatant plagiarism and repackaging right after initial creation.
That's all very knowledgable-sounding, but in reality, lots of people are using GPT every day for legitimately helpful and productive things.
> Open source models are actually _better_ at structured outputs because you can adapt them using tools like JSONFormer et al...

Yes, but you should also instruct the model to follow that specific pattern in its answer, or else the accuracy of the response degrades even though it's following your grammar/pattern/whatever.

For example, if you use Llama-2-7b for classification (three categories, "Positive", "Negative", "Neutral"), you might write a grammar like this:

```

root ::= "{" ws "sentiment:" ws sentiment "}"

sentiment ::= ("Positive" | "Neutral" | "Negative" )

ws ::= [ \t\n]*

```

But if the model doesn't know it has to generate this schema, the accuracy of classifications drops because it's trying to say other things (e.g., "As an AI language model...") which then get suppressed and "converted" to the grammar.
I don't think you understand what a measurement is. There's a very good, very short book that explains in more detail what I am talking about, in the context of physics experiments: https://www.amazon.com/Practical-Guide-Data-Analysis/dp/0521...
A minimum requirement for LLMs should be documentation of the corpus it was trained on.
She spent "$25,000 looking for companionship". It just happened to be on TikTok. I used to read about users (male and female) losing lots more on other, more conventional, dating sites.

From the article, it seems she would have found a way to spend this money eventually on other things:

"spent the year she retired traveling — dining in Dubai, sipping cocktails by the sea in Montego Bay, Jamaica, or strolling among monks in Kathmandu, Nepal."

Is she not partly (or wholly) responsible for this? She's not a young adult (with little life experience) who recently fell into a ton of cash. This is a 65 year old retired insurance investigator.

There should be some personal accountability considering that she was over-spending long before the COVID lock-down.

I realize there's a lot to say about dark patterns. I'm personally angered by how little oversight there is. But, in this case... is she like a gambling addict visiting a gambling site? That is... did she have an obsessive need to fulfill something in her psyche (for lack of a better phrasing)?
Yeah, the problem / benefit is never the one framework you added / removed, it is the mindset of reaching for another dependency as a default which leads to a behemoth which no one enjoys working with.
OK, so here's the deal with SSA and the running time of your compiler.

- You can convert code to SSA in something like O(N log N) or even close to O(N) if you get fancy enough. The conversion step is not very expensive to run, though it is annoying to implement. Converting to SSA is fine, that's not the problem.

- Optimizations implemented on top of SSA are cheap to run. That's sort of the point of SSA. So, that's not the problem.

- SSA optimizations achieve goodness when you have multiple of those optimizations running in something like a fixpoint. It's pointless to say "I have SSA" and then just implement one of those optimizations. I don't think MIR does that; like most SSA optimizers, it has multiple optimizations. The problem sort of starts here: SSA sort of implies that you're building an optimizer with multiple optimizations. Even if each opt is cheap, having SSA usually implies that you're going to pile on a bunch of them. So, you'll have cost either from death-by-a-thousand-cuts, or you'll eventually add an optimization that's superlinear.

- After your run SSA optimizations, you'll have nontrivial global data flow - as in, there will be data flows between basic blocks that weren't there when you started, and if you do a lot of different SSA optimizations, then these data flows will have a very complex shape. That's caused by the fact that SSA is really good at enabling compilers to "move" operations to the place in control flow where they make the most sense. Sometimes operations get moved very far, leading to values that are live for a long time (they are live across many instructions). This is where the problem gets significantly worse.

- Even without SSA optimizations, SSA form adds complexity to the data flow graph because of Phi nodes. You almost always want the Phi and its inputs to use the same register in the end, but that's not a given. This adds to the problem even more.

- Probably the reason why you went for SSA was perf. But to get perf from SSA-optimized code, you need to have some way of detangling that data flow graph. You'll want to coalesce those Phis, for example - otherwise SSA will actually pessimise your code by introducing lots of redundant move instructions. Then you'll also want to split ranges (make it so a variable can have one register in one part of a function and a different register in another part), since SSA optimizations are notorious for creating variables that live for a long time and interfere with everything. And then you'll definitely need a decent register allocator. No matter how you implement them, the combo of coalescing, splitting, and register allocation will be superlinear. It's going to be a major bottleneck in your compiler, to the point that you'll wish you had a baseline JIT.

Those things I mentioned - coalsce, split, regalloc - are expensive enough that you won't want them in a JIT that is the bottom tier. But they're great to have in any compiler that isn't the bottom tier. So, it's a good idea to have some non-SSA baseline (or template, or copy-and-patch, or whatever you want to call it) JIT, or a decent interpreter, as your bottom tier.
I think some of the really cool tooling improvements will likely require lowering to also be rewritten, but there already are a number of pretty nice tooling improvements that are available with JuliaSyntax.
For me , 99% of the time, obtaining information from a video is less time efficient than a written piece. I almost always ignore video links.

After reading the NYT article, I would say there was no need for me to spend an additional 15min watching the video.
They must be the most commonly abused substances, no? In any case pardon me for waxing poetic but substance abuse strikes a nerve.
Comparing these types of addictions probably isn't a good idea. Alcoholism, gambling and drug addictions are destructive in a way I doubt those of us who hasn't experienced it can imagine. Social media addictions are destructive in vastly different ways (unless you have family or friends who disappear down a dark conspiracy rabbit hole) and on a much larger scale. So while it isn't as damaging to the individual family as alcoholism, the overall cost of the degradation of society could easily surpass that of any other addiction, simply due to the number of people who are affected at some level.
It doesn't matter what's good for open source ML.

It matters what is legal and what makes sense.
Why in the world would the UAE want to get involved in that mess?
Careful now, merely suggesting that SMS might be past its prime is grounds for immediate execution amongst Apple critics.
semiconductors*
Why oppose what you probably support?

https://www.statista.com/statistics/1422765/south-korea-cann...

Probably similar to American values of Nixon-era war-on-drugs.

SK has mandatory military service. I had a coworker whose best service friend was shot while on border patrol. By his own forces. He got lost and wasn’t quick enough with the password when challenged.

Coworkers view: “He screwed up.”

Different world.
Yes, the Climate Crisis Is Now 'Gobsmacking.' But So Is Some Progress
Didn’t read the article. But currently curing my own myopia with measureable improvement. Yes, I know it’s impossible whatever. It’s happening. I believe what I see with own eyes (pun fully intended). There’s a not-yet-scientific theory behind it. See https://m.youtube.com/watch?v=XPIGDSY_xBs
They'd probably have a different business model, like selling clickbait articles written by AI with sex and controversy galore.

I'm not saying AI is better for journalism than NYT reporters, just that it's more important.

Journalism has been in trouble for decades, sadly -- and I say that as a journalism minor in college. Trump gave the papers a brief respite, but the industry continues to die off, consolidate, etc. We probably need a different business model altogether. My vote is just for public funding with independent watchdogs, i.e. states give counties money to operate newspapers with citizen watchdog groups/boards. Maaaaybe there's room for "premium" niche news like 404 Media/The Information/Foreign Affairs/National Review/etc., but that remains to be seen. If the NYT paywall doesn't keep them alive, I doubt this lawsuit will.
Injection of "smart insulin" regulates blood glucose levels for one week
No one I know IRL seemed to know what Threads is. Does anyone use it other than a few millenials?
I recently obtained my amateur radio license and I'm looking to start using it next year. I'm particularly excited to participate in ionosphere sounding studies that use ham radio during the North American eclipse in April.
People thinking to dismiss this should, period.
Consider that Open AI and similar companies are the only ones in the AI space with the market cap to build out profitable hardware projects which open source can't. Or maybe every investor is just dumb and likes throwing millions of dollars away so they can participate in a hype train.
I don't understand this argument. You seem to be implying that I could freely copy and distribute other people's works without commiting copyright infringement as long as I make the resulting product somehow less compelling than the original? (Maybe I print it in a hard-to-read typeface or smear some feces on the copy.)

I have seen low fidelity copies of motion pictures recorded by a handheld camera in a theater that I'm pretty sure most would qualify as infringing. The copied product is no doubt inferior, but still competes on price and convenience.

If someone does not wish to pay to read the New York Times then perhaps accepting the risk of non-perfect copies made by a LLM is an acceptable trade off for them to save a dime.
Just because it doesnt add up for you doesnt mean its not valid. Also, it is an illustrative example, not general rule for everyone affected. Im sure most users that get into fiscal problems get there with way less spent than 25k.
I've used AngelScript in the past for some hobby projects, and had a lot of fun with it.

https://www.angelcode.com/angelscript/
As the article mentions, between these reindeer sleeping while they eat and penguins sleeping for 4 seconds at a time, it's pretty amazing what we're learning about how animals sleep. I wonder if humans can ever learn to use these "other" means of sleep
“in the worst cases, minors would be discovered in grueling jobs like farming or construction.”

This is written by someone who, quite frankly, is almost suicidally stupid.

I would recommend only hiring kids who grew up in farming or construction.

Curtailing parents and employers from training kids in these skills is a recipe for civilizational collapse.
> Which includes the Duke Lacrosse players -- who were actually innocent.

She did say she takes every case (although she drew the line at a Nazi). Memory is unreliable, but it’s tough to argue that was the issue in the lacrosse case.

Leveraging that against a person who is risking everything to get justice against a person in power is a lot to put on them. Preventing that pressure opens up a way for manipulators to get through. Gödel probably has something to say about all that.

As an aside it’s interesting that in specific comments referencing the recent Altman events I have been repeatedly downvoted to -3.
Why shouldn't the creators of the training content get anything for their efforts? With some guiderails in place to establish what is fair compensation, Fair Use can remain as-is.
Definitely one version of the truth. I personally think the whole great resignation / quiet quitting narrative is a very convenient way to justify worker oppression.

I read the whole article and also didn’t catch the author mention layoffs once. His conclusion is that workers are exhausted because of.. too much communication? Hot take. How about the many large layoffs, false/rescinded offers, lower industry wages, the dearth of full time internal roles and the overwhelming number of shitty 2 month contracts for $50/hour?

This is what the intellectual priesthood does, basically. They write flowery rationalizations for barbarism so the electorate can feel better about it. Sickening
>One piece of insensitive metadata cannot be end-to-end encrypted — namely the date and time of events. This is so that we can send reminders (e.g. via email and push notifications) about events at the correct time.

I'm sure many people don't need to have reminders sent from a server, so that should be optional. I also disagree that it's insensitive metadata (in some contexts it can give an adversary significant info).
Advertising has existed ever since commerce was a thing, because of supply and demand mismatch. Boycotting advertising is just nonsense and as virtual signaling as it can get. Ask any business owner.

We want our privacy to be respected. We want to prevent false advertising. We can’t and don’t want to ban all advertising.
Apparently the account must be created before 2/13/2008:

https://github.com/minimaxir/hacker-news-undocumented#hacker...
Delivered is not opt-in, and in fact it isn’t even opt-out. Read receipts, on the other hand, are opt-in.
This is basically my observation, there is an insidious frog boiling effect to social media addiction where I look up and go "holy shit everybody is addicted" when nobody used to be. I used to be the only person using a computer recreationally at all.
OK, I also want to know now.
Interesting! You could automate writing the function definitions using Pydantic.
> See, I feel like that's almost the exact opposite unless you assume Apple and its internal legal department is made up of the biggest idiots on the planet. If they were intending on just infringing this valid patent and trying to get away with it, then they've literally handed the world a paper trail that makes them look as bad as possible without a literal email being published in the newspaper from Tim Cook saying "Yea, just violate the patent".

They don't really need to be idiots. They just need to trust that there is a reasonable chance that Masimo won't do anything about it and if they do, there is reasonable chance that Apple wins in court and if they don't there might be appeals and if not they might have come up with better non-infringing tech and if not then they can come to license agreement with Masimo. With that train of thought I think its pretty reasonable that Apple acted the way they acted.
Smokers are also self-responsible for every cigarette lit - they should be expelled from insurance and society taking these willing actions and doing harm to the rest of people /s
"Why can't AI at least cite its source" each article seen alters the weights a tiny, non-human understandable amount. it doesn't have a source, unless you think of the whole humongous corpus that it is trained on
A neural net is not a database where the original source is sitting somewhere in an obvious place with a reference. A neural net is a black box of functions that have been automatically fit to the training data. There is no way to know what sources have been memorized vs which have made their mark by affecting other types of functions in the neural net.
VR inevitably getting smaller and cheaper will give us the "hologram of person in the living room" sci-fi fantasy we've always dreamed of. It won't be a replacement, but similar to the way it's viewed in movies and TV shows as a "future phone call".
If you follow the idea that "the government should prevent predatory exploitation of vulnerable individuals" to its logical conclusion, you create a very authoritarian society that lacks creativity. There isn't a way the government can stop this. Maybe promoting programs and outreach for people to join community groups, churches, bowling leagues, etc. but otherwise there is no fix the government can put in to solve this.
I've heard the term before but not researched the thinking behind it. From Google/Wikipedia I'm getting a confused picture and one I'm not sure I like. According to wikipedia the word has its origins in the idea of "neurodiversity", which it describes in these terms:

> Neurodiversity is a framework for understanding human brain function and mental illness. It argues that diversity in human cognition is normal and that some conditions classified as mental disorders are differences and disabilities that are not necessarily pathological.

I absolutely agree with all of that, but the word "neurotypical" seems to suggest that there is a large, probably majority group that can all be lumped together and tagged with a single label, separate from those who are "neurodivergent". I don't think I'm comfortable with that at all.

Given I've been diagnosed with Tourette's syndrome, I am presumably considered "neurodivergent" in this world view. However I don't think there is some "normal" that I deviate from. Everyone I know has an entirely unique mind, and despite the diagnosis I don't see mine as deviating in a way that puts me in a group distinct from the mainstream. I know people who think in ways that are arguably more idiosyncratic than mine, but who haven't been diagnosed with anything and would presumably be judged "neurotypical".

Neurodiversity sounds like a great idea from what little I've just read: stop stigmatising particular "syndromes" and acknowledge the uniqueness and variation present in all human minds. But dividing the world into "neurotypical" and "neurodivergent" people seems like the exact opposite of that. Am I missing something?
Think your credit card rate is high? Some in Brazil pay 455 percent
Required reading if you're planning to win the lottery (or getany large lump sum of money really)

http://www.reddit.com/r/AskReddit/comments/24vo34/whats_the_...
Yeah I’ve combined two products, Gentrol and Invict Gold. The combination nukes large populations.
https://wapo.st/3ttXmdN
That’s just not true.
The technology that’s behind LLMs have been in use in many disciplines for decades. (Under the names “machine learning,” “statistics,” and now AI)

LLMs are just the ones that are popular right now because even non technical people can interact with them.

In the mid 2010s it was image classification, for example.
As a child of the 1970s and a teen in the early 1980s I was outside more than in even in cold Canadian winters. I have bad astigmatism and I'm also near or far sighted (can never recall which).

I know just my own life doesn't nullify the statement but all my friends were the same I mean outside but I don't know of them who has glasses as adults.
Ya i feel like this issue is people think an LLM will someday "wake up" no, LLM's will just be multimodal and developed to use tools, and a software ecosystem around it will end up using the LLM to reason how to execute, basically the LLM will be the internal monologue of whatever the AGI looks like.
I'm painfully aware
Yeah, just feel like the story would have been lot better without that setup.

I wonder if state really should limit everything we spend money on...
> But how that can be possible for an LLM?

They should have thought of that before they went ahead and trained on whatever they could get.

Image models are going to have similar problems, even if they win on copyright there's still CSAM in there: https://www.theregister.com/2023/12/20/csam_laion_dataset/
The large apartment building issue is a big one. I lived in a building (10 stories, 70 units plus commercial space on floors 1-3) for ~10 years. The first several years were great, not a single pest of any sort. And then the roaches (German cockroaches) started to show up.

The problem was that once they got into the building they were impossible to eradicate everywhere as no one, including the owners, were willing to bite the bullet and treat it as a whole-building problem. So instead you'd get little pockets of treatment and a never ending cycle was created.

Years later in our house we found and killed a single German cockroach. And of course, living in a city, if you find one that means there are many more. We were terrified. But after a single treatment by a pest control company we haven't seen any other activity for several years. Still have no idea if somehow we *did* only have that single one or what. But I'm not complaining.
Clearly if a law is bad then we should change that law. The law is supposed to serve humanity and when it fails to do so it needs to change.
I consider myself a savvy and cynical user of the internet, thinking I have some sort of mental protection from dopamine-controlling UX or content.

I have lost literal hours to youtube shorts. It generates the same re-dosing compulsions as cocaine or any other drug I've ever experienced.

It. Is. Fucking. Dangerous.
"Consciousness requires instincts in order to prioritize the endless streams of information. "

What if "instinct" is also just (pretrained) model weight?

The human brain is very complex and far from understood and definitely does NOT work like a LLM. But it likely shares some core concepts. Neuronal networks were inspired by brain synapses after all.
Is your position then that if a pre-adolescent child does not immediately report abuse with objective evidence and coherent testimony that we can only conclude nothing happened?
It was dobę. It is Linux
I'm a fan or Umka. It is inspired by Go and can be embedded into C programs.

https://github.com/vtereshkov/umka-lang
This is such an interesting take. What do you classify as intelligence?

From my perspective theres intelligence in a how to manual.

It seems like maybe you mean consciousness? Or creativity?
I hate that this will likely be decided by a 75 years old judge that hasn't been close to a computer since getting his 15 years old grandson to fix his patience game
You will never learn how to cook by listening to it. You will never learn to ski by listening to instructions about it. You will never learn 3d graphics programming by listening to podcast courses.

You will learn a lot about Roman history by listening to it. You will learn a lot about the Spanish language by listening to it.

If you avoid learning things that you can't learn by listening, then you will only ever learn things that can be learned by listening and that will bias your perspective about learning anything.
I'm sure people would be interested in seeing it even if it still has bugs