skysight-inc/HackerNews huggingface dataset:
>a prominent feature of dissidents in the USSR and Putin’s Russia is that they often retreated into private worlds (samizdat literature, organizing cultural events privately in their own flats, writing for their desk drawer) instead of overtly challenging the regime. To the point where such dissidents can be suspicious of those who are vocal

How times change. I can't speak on places I've never been, but in my homeland I have organized events in my home for folks from Russia and other places. I had a reputation as being a "milquetoast neoliberal" right up until the moment some old comrades saw me standing next to a crowd with my backpack despite always being the one who stood by the door, opening it only if it seemed certain it would be broken down to demand a warrant as folks filed out the back.

In modern times, activism seems performative -- lots of people who retweet and reshare things not attached to their real name, while a much smaller number took incredible risks -- financial, social, personal... to change the very architecture of the internet to make resistance more possible.

But I didn't bust a window during the G20 or write "ACAB" on my Tinder, so I'm not cool enough for the local collective.

It's ok to be VOCAL, as in... go to a protest. But if you do it performative, not with the expectation this is the beginning of a slow suicide... you're a fool.

We've got a generation that forgets things like the original members of one of the few true Russian punk bands I've encountered did not speak English, were thrown into a literal gulag, then had the name carried on by another generation as they rotted in the worst types of jail.

The "ulterior motive" you mention I oft see is oganized crime... they hate "the state" so they can keep young women (and men) addicted to drugs, pimped out, and, if they get out of line, scooped up by "the state" they claim to hate as they go muck about in so called civil society, stymying progress that would bring about true change such folks could live in harmony rather than scam credit cards and hook folks on overpriced black market drugs that if legalized, would still cause issues, but be more like alcohol in terms of issues created rather than a pathway to white slavery.

I've said it before and I'll say it again: to be a dissident is a forever decision, often a form of slow suicide, and no one should be shamed for taking another path, for life is precious and not everyone is suited for this work.

(I wasn't. I made bad decisions, and I'm stuck with them.)
What you didn't mention is that the Snapdragon X Elite has 12 high performance cores, making it a M2 Max competitor and not an M2 competitor, at least on the CPU side. The GPU is disappointing with no ray tracing support.
Anyone know how large it is?

They state the 1 trillion token dataset is 5TB.

Is it safe to assume this is 5TB * 30 = 150TB?

The code in the HuggingFace repo downloads data from url base: https://data.together.xyz/redpajama-data-v2/v1.0.0

https://huggingface.co/datasets/togethercomputer/RedPajama-D...
call the EU
If you have the image and the person reaches out saying it’s them and they want it removed, you have a pretty good idea of the legality. As stated, this isn’t a technical problem it’s a bureaucratic one. Most companies didn’t think they had to remove it so didn’t have steps in place to do so. Now a lot of them do, with GenAI just being the latest group of companies who feel they have an argument in favor of not having to do so.
IRAs have much lower contribution limits though. If you want tax-advantaged savings for retirement, those with access to a 401(k) have a huge advantage over those without. I would expect as a society we want people to properly prepare for retirement, but then we make the ability to do so contingent on your particular employer.
I wonder if tiktok is just one big hood culture. Where everyone is trying to defending their reputation. As any attack, no matter how minor is an attack on their honour.

Definitely feels like it based on that painters reaction.
Latin / Asian CORRUPTION ^* culture

It's not difficult to find tons of cases...

^* "Corruption continues to fester, aided by scandals surrounding the COVID-19 response, and is fueling popular outrage. In Peru, for instance, ministers received preferential treatment for vaccines, and in Argentina, government officials set up “VIP immunization clinics” for family and friends."

"Beyond these instances of favoritism and nepotism, the crisis has resulted in the further weakening of judicial independence and the rule of law. In Guatemala, President Alejandro Giammattei has presided over dramatic steps against judicial oversight in recent months, including the sacking of the country’s top anti-corruption prosecutor. These maneuvers—coupled with underperforming economies—have further dented public support for elected officials and trust in government."[1]

^* [1] https://www.atlanticcouncil.org/blogs/new-atlanticist/democr...
> The remuneration that labor and employees receive is never going to be in line with the value that they generate, precisely because the former group doesn't take any risk. They don't invest any personal capital and they aren't liable for anything. They can walk away any time, sometimes voluntarily, sometimes not. In return, they work fixed hours and get paid on a routine basis. The owners receive only what remains above and beyond all that, which could be great profits, just breaking even, or even losses.

The people at the top get an even better deal. They get given stock options, so they get the upside but not the downside. They can also walk away, but they'll get a big payout if they walk away involuntarily. They work fewer hours whether you're counting butt-in-seat time or making-efforts-about-work time (some people, bizarrely, compare the CEO's making-efforts-about-work time to the employees' butt-in-seat time and conclude that the CEO "works more").

> And in some situations, the "employers" do in fact lose a lot of money, while the "employees" walk away; the limited partners of Melvin Capital, for example, lost many billions of dollars, all while Melvin Capital itself continued to charge the 2% management fee.

You're flipping the categories. Being the "investor" can be a bad position, sure. Being the manager, the decision-maker, is where you can't lose. Concluding that that somehow makes employees better off than owners is ass-backwards.
I think their assumption is that if you’re the kind of pro that needs that many monitors, you’ll upgrade to the better chips they sell.

But it’s a frustrating limitation and remains one of the only areas their old intel based laptops were better at.
My biggest issue with the 4k iMac is that it's highest scaling option (smallest elements) is less than what you get on a regular 4k display.

The iMac I belive is capped at "looks like 2560x1600" while my 4k display "looks like 3008x1692".
Self reporting autism can be surprisingly accurate.
> The M1 chips have a unified memory architecture shared between GPU and CPUs. This is a masterstroke for performance.

No it isn't. It's a nice optimization to have, but it doesn't radically change performance. If unified memory was that drastic AMD's APUs from 2012 to 2015 wouldn't have been so forgettable which is where heterogenous compute with unified GPU/CPU memory was pioneered.

Also every phone SoC has unified memory, and yet only Apple's can compete with Intel/AMD x86 on performance. M1's performance ain't from unified memory (especially since mixed CPU/GPU compute on the same data is very rare)
>Why “of all things”?

Pardon my French, but: Because it's a fucking website, not a nonlinear video editor or a large language model. It's supposed run on low-end android devices, my aunt's 3 year old iPad, and the old thinkpad I've got in the basement, not just on my M2 machine.

What on earth does a web developer need all that memory for, beside the comically bloated Chrome browser and all the stupid Electron apps people shit out these days?

You end up needing 32 GB or more because without it you can't run Chrome, Slack, and VS Code on the same machine, because Electron is hot garbage.
Apart from Japan, I'd say America is the country that has historically come closest to being nuked, with the Soviet Union a close second.
Why are they lazy
Spend some time using Siri and you might change your mind.
Personal co-pilot with a fine-tuning and a VSCode extension
We show you how to fine-tune code LLMs on custom code corpuses covering various objectives such as infilling, QnA, etc. We provide details on data collection, parameter-efficient fine-tuning, and more. Finally, we show you how to build a VSCode Extension for your fine-tuned code LLM.
And new indices get created all the time, plus funds that follow those indices.

You often even get new indices specifically created to be easy to invest in (instead of optimizing for the older goal of being some measure of overall market performance.)

Vanguard and Blackrock don't necessarily dislike that their hands are bound with the indices. That avoids lots of thorny political problems.
What dev shop gives their engineers base model machines?
Looks like the latest MBA is only 0.1 lbs less than the equivalent MBP at 3.4 lbs. Feels like they used to be lighter.
Indeed, but that's a bit of an oxymoron as any Macbook Pro is not a "low/mid-tier priced machine"
Prediction as an objective basically forces the models to model the casual processes that create the text itself. It's not going to stop getting better unless the data is insufficient/unvaried or the architecture creates a bottleneck.

I think by the time the former is an "issue", we'll have a Super Intelligence on our hands anyway.

The latter is looking less and less likely to be a real hurdle. Very little inductive bias to steer away from crucial solutions, very scalable.
I read it in this voice.

https://youtu.be/v79fYnuVzdI?si=2iEdgEgx3Q-7RyI_

(Zathras Wrong Tool)
I thought 30 Rock made up the term. Had no idea it was a real thing.
Seems like a really good thinker.
I'll adjust this if I get time to update it later... :-)
If people don't need new laptops because their current ones already do everything they need, then reducing laptop production is good. Fewer resources and less pollution spent on things people don't need.
It’s absolutely not, and that’s fine. The video has statements that the machines are made to “last for years” and they want to save natural resources be making long lasting machines.

I’m currently at 4 to 5 years on laptops and 3 to 4 years on phones, and even then I hand them over to kids/friends/family who get a bit more use out of them.
false equivalence.
False equivalency at its finest. This is more akin to banning factories and people rightly saying our rivals will use these factories to out produce us. This is also a much better analogy because we did in fact give China a lot of our factories and are paying a big price for it.
ADHD and autism are comorbid in one direction (people with autism are more likely than the general population to have ADHD, but people with ADHD are not more likely than the general population to have autism).
> What the heck are you talking about? What types of apps do you think you can’t find alternatives for on the Mac?

It's not about finding alternatives. I did for a lot of mac's default. It's about replacing the default option. On Ubuntu, you can remove the default login screen and use KDE's panel alongside the i3 window manager. Because they're not tightly coupled together. Imagine if you could have replace the MacOs top bar, because it is a program that just answers to some IPC protocol? Or the window manager would expose windows and their placements so you could script a layout without the accessibility workaround.

> And why wouldn’t you want SIP by default?

I want it, which is why it's not disabled on my computers. But I'd like to set my own snapshot of what I meant to preserve instead of Apple's.

> Do you run your Linux box using root?

I don't but I'm always a real sudoer and I have the capability to do `su root` anytime.

As I've said, it's about expert mode, not something on by default, but that can be and the system has been built to support it.
> you put that information on the internet, you have no expectation to privacy

That was the expectation until Zuckerberg came along. People were putting tons of stuff on BBSs, intranets, and other stuff 20+ years beforehand because people had the idea of "consent" back then existed: using someones information for a purpose they didn't intend was (and still is) wrong.
I’m not a native English speaker, but I can speak 4 languages. My previous manager always suggested me to take some English class when we had the 1:1. Once a day, I told him: I’m speaking English with you, is because I can speak English, but you can ONLY speak English.
I experience this as well, it's a pretty common autistic perspective. Not sure exactly why. Seeing need can be overwhelming as a result as my brain is not filtering out the "should i weigh my potential discomfort to help this person?" question, in the way or degree that many/most neurotypical brains do.

oddly enough, autistic people can have an extremely heightened sense of empathy and moral justice compared to the average population. this seems to me to personally have some very distinct upsides and downsides.
Perhaps the historic returns from a passively managed index fund would bypass these concerns?
4k displays are peanuts these days. A Mac mini + a 4k display would cost about the same as an iMac. But in a few years when the mac mini is useless you can keep the same display.

Or if you buy a nicer mini then you can get a nicer display later on. The iMac is still limited the base M3 CPU, while the current mini is available in either M2 or M2 pro. Hopefully they update the Mini with M3 pro because that's what I've been waiting for.
Can someone explain to me like a noob how this ("this" being the data hosting and download access) works? Am I understanding correctly that they are releasing code for filtering common crawl data that is out there, and the result of this filtering is the dataset?

To further elaborate on this (possibly wrong) understanding:

- Each person can then run their own processing, possibly duplicating effort(?)

...but on the good side, giving each person the ability to tweak the pipeline to suit their needs.

- There is no torrent of already processed data because __________?

- Looking at file lists for this on Hugging Face, some files seem to be stored in Git Large File Storage. Are these already processed files that together constitute the dataset? Or are these Common Crawl files that are selectively listed and pulled for processing?

What options are there to preemptively obtain a copy, in case of any possible eventual takedown of the dataset, any assurances about access aside? I am reminded of parts of the pile.

Obviously I'm super clueless here... please be gentle and share anything you know or correct anything I've got wrong.

I'm not asking about training, if that wasn't obvious. Just about obtaining the dataset.
We created https://veilmail.io
To stop bots, web crawlers and spammers from scooping up your email address from your website.
Maybe the knowledge of the bystander effect makes people consciously avoid it. Plus all those set-up shows where they get people to do "off" shit and see how people react.
If you use an AI spell checker then will your resulting text all be without copyright?

If you use an AI coding assistant then will the written code be without copyright? Or will the code require a disclaimer that says some parts of it are AI generated?

You're also going to have to be very precise on defining what AI means. For most people a compiler is as magical as AI. They might even consider it AI, especially if it does some kind of automatic performance optimizations - after all, that's not the behavior the user wrote.
> However, if CO2 as a working fluid results in a smaller plant, it might be worth it for some applications.

It's not a great fixed power plant, but if it's smaller, it might be useful when you need a few megawatts of portable generating capacity. Caterpillar sells a megawatt Diesel in a shipping container. Here's a megawatt gas turbine in a small trailer.[1] Maybe this is useful in that niche.

[1] https://turbinepowersolutions.com/1mw-compact-generator/
> they want to save natural resources be making long lasting machines.

Apple always comes from a position of strength. Again, they're saying as much as they're not saying.

Also, if they really cared about long lasting machines: slotted ram and flash please, thanks!
I’ve become obsessed with pattern languages lately. If you read Timeless Way of Building, you realize we got it all wrong. What everything thinks of as a “pattern” is missing the point entirely. It’s the pattern language that has power.

He even calls out atomic design and all of the flaws with it—no two atoms are actually identical. So the result is we have these rigid design systems that discourage variation because, imo, we can’t be bothered to define the things that make something alive.

https://hillside.net/index.php/a-pattern-language-for-patter...

My favorite so far—a pattern language for creating a pattern language
My setup used to consist of a VESA mounted iMac Pro which was really nice since it doubled the amount of free desk space between having no separate computer and the whole unit floating thanks to the VESA arm. The arm also helped with keeping cables corralled in a way a monitor stand wouldn’t since it has channels for that.
>They are most definitely doing this to combat cheaters. I tried out Cronus + KBM on my friend's Xbox S and it was comical.

I have sold a half-dozen Cronus Zen adapters in person via Craigslist/OfferUp.

Every single buyer claimed that it was for a friend, brother, etc.
I can't drink during/before flights at all, it destroys me
>"includes car payments on a BMW, the latest iPhone, and other by-no-means-necessary expenditures

"The latest iPhone" is the new "Avocado toast and starbucks". Inflation wise, the iPhone 3GS is only marginally more expensive than the iPhone 15, while delivering far more value. I struggle to understand how ~$75/mo for someone making 100k/year is a deliberating expense for the purpose of wealth signaling especially when that purchase likely delivers far more than $75/mo of actual economic value.

Conversely, those 100k/year earners are likely concentrated in some of the highest CoL areas in the country and simply wouldn't be 100k/yr earners in lower CoL areas. Rent and housing has continue to explode but the idea that these 100k/yr earners are hedonists is starting to feel like a thought terminating cliche to me.

The price of an iPhone has been pretty much constant for 15 years when adjusted for inflation, but 1bdr Rent (adjusted for inflation) in San Francisco is up 60% in that same time period.

Lets say a 100k earner in 2009 did the responsible 30% of income on rent, and spent 2,500/mo. A 100k/yr earner in 2023 would be spending 4,000/mo on a comparable apartment. They might need a roommate, or almost HALF of their income would go to rent. If Earner 1 was saving 10% of their income every month, that would be completely eaten by rent in earner (2) scenario, making them paycheck-to-paycheck. No "iPhones or BMWs" required; and I haven't yet touched the other non-luxury cost of living increases.
> I'd probably struggle to name three living painters (the claim in the title wasn't about "artists" but "painters").

Hockney, Hirst (even if he only moved into painting fairly recently), Kit Williams. But yeah I'm struggling to come up with a fourth.

> It's actually kind of interesting. There's tons of living actors, authors, directors, and musicians that are household names on a global scale. But architects, painters, poets or sculptors? Everyone I can think of is dead.

Architects I disagree with, but for the rest there's a lot more competition lately. Painting never really recovered its social standing after the rise of photography. There are a lot of alternatives to a poetry reading, many of them more enjoyable or at least more accessible.
I believe you can "option+click" to reveal all the resolution, which would expose the higher native one.
Interesting distinction, thank you
I find this notion interesting. What makes you think AI will automatically kill humans?
The M2 Max has a TDP of 79 W. I gave the Snapdragon's results at 23 W. The 80 W configuration scored even higher.

Where did you see that there was no ray tracing support? Qualcomm introduced hardware accelerated ray tracing in the previous generation.
You can watch your blood oxygen dip when flying, I don't know how significant the effect is on performance but as a sea level dweller there seems to be some observable difference in the data.
Linux works pretty well these days, too.
Unless you plan to retire with a very expensive lifestyle, the contribution max of $22,500 per year is very fair, plus you can also put $6,500 max in a roth IRA. That's almost $30,000 per year in tax advantaged accounts. More if you're in you're 50s. If you were to max your accounts for any reasonable portion of your career, you would retire with millions. Most people don't make enough to hit the max every year, thankfully, retirement will still work without going near the max.

The problem is that people don't put anything in, or only put 1-3% in. My friend works in HR at a company that employs a lot of engineers. These are people that are educated, can do 6th grade math, and make decent incomes. I think the average contribution in the department was a little over 4%. Those people are going to retire with $150k in their account and have to life off social security but they shouldn't blame it on anyone else. I know a lot of people are struggling in America right now, but a lot of retirement savings shortfalls are just ignorance.

The only policy solution to this is to force some kind of deduction from paychecks into retirement accounts. Australia and Singapore do this and it works reasonably well.
I really don’t understand the drama and slow motion trainwreck about machines doing fast food. It is so obvious and I cant imagine why a new entrant hasn’t just done it and pushed the market forward.

Please tell me some ghost kitchen on Doordash is already doing this and nobody knows, because the current reality is ridiculous.
I have 32 gigs of ram just to browse the internet and maybe fiddle with some other things.

I'm using 26 at the moment with no virtual machines running.
I like to exploit these things but not because of autism, but opportunity. The shorter queue at the cinema that no one joins, for example, because they didn't notice because of the big queue.

It is worth taking note of what other people are doing though. Maybe not so much at airports that should have everything running like clockwork, but some places communication of new information is poor, done verbally so not everyone hears. It is worth asking people "why you doing that" sometimes.
RIP Target Display Mode.

The hilarious thing is that the Studio Display is basically just a stealth Target Display Mode device, considering how it's running a trimmed down OS on a phone chip.
I love this site and read it regularly. Everyone I know must be tired of the "software development manifesto" that is grug brain.

>complexity very, very bad

>given choice between complexity or one on one against t-rex, grug take t-rex: at least grug see t-rex
What's your swap used and memory pressure in Activity Monitor? Regarding Chromium browsers, I have noticed that they tend to unload tabs more aggressively these days.
"don't make me look bad" is like the neurotypicals prayer