skysight-inc/HackerNews huggingface dataset:
Do they mention anywhere the definition of "low quality" data or the proportion of removed data that was low quality versus duplicate?

They mention "When upsampled, we expect SlimPajama to perform equal to or better than RedPajama-1T when training at trillion token scale." But i guess "upsampling" in this case is just explicit duplication of the training data. So the only potential gains would be from the removal of the low quality data?
There was a peer reviewed paper earlier in the pandemic where scientists used their knowledge of viral anatomy to argue it wasn’t engineered.

Subsequent scientific have disagreed.

But this isn’t purely historical.
There's someone on imgur who's been offering a similar service for fellow imgurites, but I believe they've actually been offering a go at actual translation. (Approximations necessary by the nature of dead languages and the lack of words like "smartphone".)
As far as libc, I should have clarified that I meant linking with musl libc, which can in fact be linked in statically, unlike glibc. So that part is not a problem for me.

As for the FASL compilation part, it sounds like I did indeed misunderstand the documentation, but I’ll need to digest your comment a bit more :)

Thanks!
They’ve reached their natural level of user base.

Now as they ramp up to an IPO, 3rd party clients are seen as a liability, not an asset.

They view anyone that complains as a vocal minority, the my don’t believe their MAU numbers will change in any meaningful way.

If anything, all the press around it just raises Reddits profile.

That’s my take on what’s going on, but I have no insider knowledge so I’m just guessing :-)
Banning COVID skepticism is commercially pretty easy, so while yes the Reddit revolters did win in that case, it was also a small ask as it was not like advertisers liked the content anyway.

I was thinking more of Victoria Taylor, where sure, the community did get rid of Ellen Pao, but they didn't get back AMAs and got an even less considerate and professional CEO.
A regressive tax?
In this case, I agree. This is just people being noisy and flapping their arms about for the sake of being noisy and flapping their arms about.

If users really cared, they'd delete their accounts and quit using Reddit.
Third party apps represents user control of the experience, which is unacceptable for the profit maximizing executives leading up to an IPO. The end goal of every big tech platform is to control the experience fully for ad delivery or other nefarious ends. To us, it is enshittification. To them, it is profit capture. It will happen again and again before we as a society establish safeguards against such abuse. It happened with Facebook, it's happening with Twitter and Reddit, and it will happen with Discord and other such platforms.
Users who will not read are nonetheless absolutely relevant because they are still users of your program.

Development resources are finite, so it's natural and proper to excise the unnecessary and focus on what is truly worth developing.

If maintaining text is expensive (translations/localizations) and at least some users will not appreciate them anyway, why keep the text if just using icons is cheaper and can suffice? I don't agree with this trend, but I do understand and respect where it is coming from.
> To choose the life of a tiger, one just should stop loving anyone

Tigers live lonely and avoid fighting other tigers to death (even the extreme case of males both courting the same female rarely leads to such an issue), probably in order to preserve their genus.

Lions live in 'societies' (well-structured prides) and routinely kill other lions (even cubs).

The average lion, albeit way less physically formidable than a tiger, is a very dangerous contender against a tiger: he hits to kill.
I suppose governments could mandate that businesses provide their employees with a stipend to cover tolls in addition to their regular wages if they require the employees to be in the office.
i...... was making fun of the OP who wrote the above comment.
> If reddit showed a desire to be frugal and fired all these awful dark pattern implementing UX devs who are devoid of professional ethics, and was ok breaking even instead of making money.

I suspect the direction to employ dark patterns comes from the top.
Also, they explicitly do have that right, as laid out by their TOS - https://www.redditinc.com/policies/user-agreement-september-...

> You retain any ownership rights you have in Your Content, but you grant Reddit the following license to use that Content:

> When Your Content is created with or submitted to the Services, you grant us a worldwide, royalty-free, perpetual, irrevocable, non-exclusive, transferable, and sublicensable license to use, copy, modify, adapt, prepare derivative works of, distribute, store, perform, and display Your Content and any name, username, voice, or likeness provided in connection with Your Content in all media formats and channels now known or later developed anywhere in the world. This license includes the right for us to make Your Content available for syndication, broadcast, distribution, or publication by other companies, organizations, or individuals who partner with Reddit. You also agree that we may remove metadata associated with Your Content, and you irrevocably waive any claims and assertions of moral rights or attribution with respect to Your Content.
The Reddit team linked to all of spez's comments at the top of the thread. They were quite easy to find (in Apollo, at least)
They better not have removed the good stuff, like the full texts of the subreddit dedicated to counting to a million, the logs of so many hashed numbers from various cryptos, and the tables of datamined stats from like every console game.
Yes they are. And they know it. Apple knows it. Microsoft, Google and Amazon all know it.

Privacy and security is the most scalable, reliable way to locking users in and stifling competition behind a lot of marketing about "protecting" users.
While nutomic is definitely known for being a lefty Socialist, and you're free to disagree with them on that, I am not aware of any noteworthy extremism. Unless there's something I am not aware of, he seems like a pretty rational person.
That was the way almost all ML research on music was done until recently- train for MIDi generation with input of other MIDI, or, at an even more fundamental level, just notes. If you go back, tons of ML music papers were written on generating believable sequences of Bach, Mozart, etc. because it was just note prediction.

Since the advent of transformers, and this idea of using text models mapping the natural language space to tagged music samples, and the music tokenizer acting directly on sampled audio stream (the bits of a .wav file, essentially) all the cutting edge work is going that route. Because it is producing high quality, finished audio streams directly. And I think part of it is because there is way, way more training data for actual audio than there is for MIDI alone (there are tons of free midi sites out there but a lot of it is garbage and it pales in comparison to what is already sampled and tagged in real audio libraries).

I imagine what will happen is... within two to three years these LM-transformer-music models will get so good that the audio will be damn near spotless sounding, and there will be additional methods developed to synthesize with more control directly with the models, to the point where wanting MIDI so you can use your own HQ synth isn't needed, because if you want "the lead synth to sound less digital and more like a classic Minimoog Model D" you just add that to another 'Music2Music" pass and out pops your sound.

For those who still want MIDI there is still work being done on traditional audio-to-MIDI modeling and I think you'd wind up just using that in the chain.
Order of magnitudes safer according to whomst, exactly? Whomst is supplying that data? And what exactly is their vested interest in claiming that it's safer?
Those 'capitalist forces' you're talking about are 'you have to pay for resources if you want to use them'.

But I'm sure this wouldn't be true in magical communist land. They'd be well up for ploughing resources into r/cats and absolutely wouldn't be sending you off to dig up a field to improve production for the next five year plan.
Each and every parameter (even "population size") has an interval of 'adequate' values. Too few of anything, or too much of it, leads to major downsides.
I wonder if a criterion based on "did it get you monetary value" is useful to make these judgements.

If you take a css color line from a page, could you have chosen another color to equal effect or chosen this line from somewhere else (i.e. is it common knowledge)? Is the color so unique that it would take someone a lot of money to have figured out that that was the "right" color?

If you take some code and then rewrite a substantial part of it, did it save you time? (= Money) ... that you would've spent had you not had that code to start with?
Yes, however once they demod everyone, they will find other mods willing to do the work. There are a lot of people on reddit, something like 500 million monthly active users, at least some of them would be able to mod subreddits.
Hehe that has nothing to do with having to watch the road because of stick shifting, that's the result of road safety design and setting very high demands on driver's permit. Where I'm from, it takes an average of 40 hours of driving lessons in which they drill you an driving safely, before you're able to pass the driver's license exam.
If Reddit had years of runway in an easy money macro climate and still can’t achieve profitability. How’s a startup/clone supposed to get up and running today?
Apologies to those accused of being conspiracy theorists, xenophobic, and spreading misinformation will be going out shortly.
Yes, professional ethics means rejecting unethical things from the top.
I ran one on battery power, IIRC some models run on voltages in the 12V-20V range, so it is pretty easy. Fun project. I got a portable monitor and keyboard, and… realized I’d reinvented the laptop, except it was really hard to balance all that stuff on my lap. Next time I just got a laptop, but I can still use all the old NUC peripherals so that is nice.
> but it isn’t a “scientific” question in the first place.

... which is true of the pandemic response in general. "Science" doesn't tell society how to react to something. Science is a process to test hypothesizes--it isn't a book of facts or direct answers on the trade-offs of various mitigation techniques. It can only inform, not dictate.
agreed. but as long as the investors are to move their shares during the IPO before a complete exodus occurs, they are perfectly happy with that outcome.
> * Multitrack Input - Upload your transcodes instead of generating then server side. Give viewers multiple video tracks to see action from all sides.

I've always wanted this. Instead of the streamer switching video inputs we could select from the viewer-side which perspective we want. I've also thought about things like NASCAR partnering with Valve/Steam to use their Valve Index for 360-degree views from each car on the track. I don't know why they're not marking VR to people who love NASCAR, it'd be such an odd and likely successful niche. It'd be cool to accept-in multiple video inputs and even patch them together in realtime on the viewer side (unless they're specifically disparate).
He's the only remaining co-founder.
Guess what, Discord already doesn't allow third party clients. It is also an information black hole, with no proper indexing and users are not allowed to download logs. It's just worse than Reddit, even without API.
more useless statistics to show to investors before the IPO to squeeze more money
Do you mean personal downside or societal downside? It could be argued that a well developed persona covering up innate sociopathy would be highly beneficial to a person and have no personal downsides, as long they as truly didn't care about others.
Reddit doesn't care about users who use third party apps, that's simply a fact. It doesn't matter if they are content producers as there are 500 million monthly active users on Reddit and once people either migrate to the official app (or quit, but I highly doubt that since people say they'll quit a lot of things but never actually do), they'll continue to churn out content.
So, science doesn't have a problem when results of experiments are faked, because science doesn't ask this question, it's a question for politics, forensics, and history? Nice try! Still your move.
Cosmopolitanism- more multicultural cross pollination due to trade and travel. Wealth disparity is another. The coasts are also richer than ‘flyover country.’ There are isolated places in New Mexico, the Deep South, and Appalachia that are grievously poverty stricken, to give some extreme examples.
Yes exactly. Even if it doesn’t work out in practice, a user forced into the official app is theoretically monetizable any number of ways, whereas a premium subscriber using a 3P app is only ever going to use the core product the way they always have. Their ability to shove whatever they want in front of the user while also mining their data is probably helpful for their IPO prospects.
> NSA can’t even stop their own tools from leaking, never mind take on this.

The NSA has kept plenty of vulnerabilities under wraps, the tool leaks were a pretty rare occurrence of the KGB/GRU trying to burn NSA ops without directly involving themselves.
"I absolutely do not believe in forcing sub-par and more expensive products on a populace in the name of reducing a tiny overall percentage of worldwide emissions at the cost of hundreds of billions of dollars."

We know fossil fuels are damaging the environment so we need to do the change over to an alternative. waiting because EVs are inconvenient now is not a choice. The advantage of technology is that it gets better as we discover problems. But that can't happen unless we start.

Also there's a subset of customers that can use the current EVs now without any difficulties. Why not go after those customers as the tech improves.

EVs aren't perfect now but in time they will be.
MTA costs make the Boston Big Dig look like a bargain, even at $22 billion.

I'm convinced, if they contract this out to first-tier construction firms from oversea that specialize in underground infrastructure (e.g. Europe, Japan, Korea), they can get the job done at 1/3rd the cost.
There’s a lab at U of A that accidentally infected their student researcher with cholera, and another case of campylobacter.

It’s just sloppy work, but when you’re there for 12 hours a day for 5-6 days a week, you’re bound to get sloppy
It's impressive this many 3rd party app users went through the hassle IMO (3% of the whole).
What problem would you solve by a “drive twice, pay for five” scheme?

I think that would incentivize people to drive more, not less.
Steve Huffman (ie spez) made a deliberate choice to act without integrity, putting it mildly.

The company hoping to IPO too… Heck, I’ve been a user for a decade, I would have bought some shares. They could have made it super interesting for retail.

Absolutely not going to happen now, since we have a better sense for how the CEO handles difficult situations. I can only imagine the shitshow it must be internally with leadership like that.
> Legislation will be written which will forbid companies such as github and gitlab to host models or any sort of AI building programs or data.

Too late. That's stuff's already everywhere on the Internet. It would be about as effective as attempts at banning piracy already are.
> If reddit showed a desire to be frugal and fired all these awful dark pattern implementing UX devs who are devoid of professional ethics, and was ok breaking even instead of making money. I would strongly consider a 3-5 dollar a month donation not associated with an account.

You are a low value user to them. Why would they remove the thing that gets people looking at more ads? Most people don't pay for subscriptions if they don't have to, and the 3-5 dollars you'd pay per month is really nothing to them. People live in a tech and power user bubble not understanding that the vast majority of Reddit's 500 million user per month base simply do not give a shit about any of the drama that's happening and will continue to see ads.
> Do your taxes go towards the fire department even if you never have a fire?

Fire departments provide protection from fire. I absolutely do use and depend on it.

> Do your taxes go towards the public parks even if you don’t use them?

This is indeed a subsidy. A pay-per-use system would allow to remove the subsidy. However, it's so small around here that it's inconsequential in the face of massive transit subsidies.

> Do your taxes go towards public schools even if you don’t have kids?

Nope. I will eventually have kids who will need schools. So not a subsidy.
That isn’t just html though is it

Edit - oh that wasn’t the rule I guess
Even if C# isn't supported for code navigation, you should still be able to ask questions as the LLMs will have seen C#.

If you want to try it out today (not using your own API key), you could sync something open source.
Probably so, but the theverge article and others like it will not go anywhere. This is ammo for future journalists to character assassinate the current Reddit leadership. Bad press is always available for later reuse.
The CEO’s lack of integrity is a signal.
This is the kind of writing you need to properly discuss the lab leak hypothesis. It's not perfect, there are no good links to sources which suggests a lot of it is made up.

However, this kind of writing should only happen after years or months of investigation. You can't do the lab leak panic 2 days into the pandemic. You can't even really do it half way through the pandemic.

I'm glad such investigations are being caried out. I only wish links to whatever is declassified from the investigations to be made public for such publications. Authors need to prove their research effort when it comes to such news.
On the site you have to click the "load more comments" link for anything negative to appear...

So if they look at their analytics later, they will probably discover the comforting fact that only people on 3rd party clients were downvoting the CEO.
I’d love to hear more about that. US unions seem broken in such interesting ways. Are they generally seen as a cost driver, apart from working to raise salaries and pensions?
> The really impressive thing is... if you follow a user profile link to a comment and vote, the vote doesn't count.

I've been a Reddit user for a while, but I never knew this. I tried doing a quick search, but it dates back to 2015 when it seems they were actually disabled all together from the profile page [0].

[0] https://www.reddit.com/r/help/comments/2nzzhg/if_i_go_throug...
Interesting, I recall it being the nerds of Reddit getting the users of Digg.
dark humor, my favorite haiku, one last time:

open your present!

no, you open your present!

Kaczynski Christmas.
Eh, I hate the model of giving free access to grow your userbase (which has contributed back to the platform through content), then leverage that later for profit. Either provide access for free, recognizing that in doing so you gain externalities through the added user engagement, user data to mine etc, or just don't do it. The only caveat would be the problem of LLMs etc mining all of reddit for free via API.
Are there any examples of blogs already doing this?
Indeed, how many of Reddit's 500 million users per month base actually use anything besides new Reddit and the official app? I'd say the vanishing minority.
University of Kansas Researchers Claim 99% Accuracy Detecting ChatGPT Fakes
I think it's more about being entertaining, rather than truly educational to someone who is already a dr.
Generally I'm okay with this idea, but considering the audience, I'm particularly curious about the background of the owners and staff. The Catholic Schools stamp in the footer does not instill me with confidence.
Yea the CEO's response was tone deaf and not tactful at all.

However, it seems insane that people are complaining about this for the following reason:

1. Reddit is not profitable, it is literally bleeding money.
2. No Reddit = No 3P apps to access Reddit.
3. The discussion that should be had is whether it is sustainable for Reddit to keep running it's servers and whether the recent decisions are made in favor of additional growth or survival.
I enjoy walkable cities. I don't live in New York, but I couldn't do my job as is without a car. I simply have too much equipment. There are probably many other people in the same position.

I feel like step A should be to build better transit, not punish drivers.
It is not just Tech, but similar in every other industry. Only those industries with cut throat competition would have better leadership ( Because they are forced to compete ).

The problem with Tech is that they are the primary beneficial of hyper growth with zero interest rate era and Smartphone revolution. In the space of 10+ years tech have grown from an unthinkable Trillion dollar market cap to now we have a single company with close to 3 trillion, two other company with close to 2 trillion and other rushing to trillion dollar club. And this is unlike previous bubble they have actual profits and balance sheet for their market valuation.

People working in tech, especially within BigTech are not only partly dictating the world and media's attention, they are also so out of touch they became aristocracy in the old era.
AT&T tried to copyright an empty file https://news.ycombinator.com/item?id=3528663
> Kaczynski May have said some interesting things

That take is strange to me.

He reminds me a lot of people I've been close to who suffered mental illness. He didn't want to be considered mentally ill, and his apologists don't like it either, and further, many who focus on his victims and crimes don't like it. But for me, that's the major story about him. It was clear to me the first time i tried to read the manifesto many years ago.

From that, his story is sad. He didn't need to go insane and start bombing people. He had potential to do other, better things.

I watched the Netflix documentary, and the commentary from his brother and sister in law was very moving. The brother, because he still loved him, but had to come to terms with what he did and do the right thing. The brother's wife, who it seemed flagged him as mentally ill from nearly the beginning.
Didn't work for me even after refresh, probably you and me we were disposed differently. Whatever, using archive.
I think this is a half baked approach.

It sounds nice. Think of something worthwhile. Do it. Repeat. Awesome.

There’s two main issues I see
1) there’s no connectedness. You could spend your life swirling in different directions instead of focused in one. Ironic given this technique is supposed to help you focus.
2) there’s no consideration for timing. I might think of 5 worthwhile things now, but what if I choose the one that can be done anytime because it’s fun, vs the one that needs to be done by tomorrow? It seems quite easy for some important deadlines (that I’ve committed to) to slip!
The vast majority of people who use Reddit do not read articles on The Verge or similar. In fact, they simply do not care about company news whose product they're using. How many articles on Facebook and Instagram came out about privacy concerns, and how many people actually stopped using them due to that? It's simply not a concern to most consumers.
This doesn't match my experience.
In London, residents of the congestion change zone get a 90% discount on the congestion charge.
> To the contrary, those in the highest income brackets are the ones most likely to walk to work

Stop misrepresenting the data. High incomes are still most likely to DRIVE to work.

They are _more_ _likely_ to walk to work than lower incomes, but:

1. The difference is slight.

2. The absolute numbers are around 5% of trips.