skysight-inc/HackerNews huggingface dataset:
What yuliyp wrote is basically it. Although the individual shards weren't really small, even by modern standards.

> Considering all the transactions in flight, and everything?

If I remember, we used --flush-logs --master-data=2 --single-transaction, giving it a consistent point-in-time dump of the schemas, with a recorded starting point for binlog replays, enabling point-in-time and up-to-the-minute restores. Nowadays you have GTIDs so these flags are obsolete (except --single-transaction).

--single-transaction does put extra load on the database—I think it was undo logs? it's been a minute—which caused some hair-pulling, and I believe they eventually moved to xtrabackup, before RocksDB. But binary backups were too space-hungry when I was there, so we made it work.

Another unexpected advantage of mysqldump vs. xtrabackup, besides size, was when a disk error caused silent data corruption on the underlying file system. Mysqldump often read from InnoDB's buffer cache, which still had the good data in it. Or if the bad block was paged back in, it wouldn't have a valid structure and mysqld would panic, so we knew we had to restore.

> And did you ever Test disaster recovery with that setup?

Yes! I wrote the first version of ORC. This blog post is from long after I left, but it's a good summary of how it worked: https://engineering.fb.com/2016/10/28/data-infrastructure/co...

It wasn't the best code (sorry Divij)—the main thing I'm proud of was the recursive acronym and the silly Warcraft theme. But it did the job.

Two things I remember about developing ORC:

1) The first version was an utter disaster. I was just learning Python, and I hit the global interpreter lock super hard, type-error crashes everywhere, etc. I ended up abandoning the project and restarting it a few months later, which became ORC. In the interim I did a few other Python projects and got somewhat better.

2) Another blocker the first version had was that the clients updated their status by doing SELECT...FOR UPDATE to a central table, en masse, which turns out to be really bad practice with MySQL. The database got lock-jammed, and I remember Domas Mituzas walking over to my desk demanding to know what I was doing. Hey, I never said I was a DBA! Anyway, that's why ORC ended up having the Warchief/Peon model—the Peons would push their status to the Warchief (or be polled, I forgot), so there was only a single writer to that table, requiring no hare-brained locking.
https://www.collabora.com/news-and-blog/blog/2021/06/14/zink...

As of summer 2021 there was some support for exactly this.
Up here in the Canada we see record lows too. But we also see record highs. The instability of the jet stream makes both our extremes more so, and we get hit with the bad conditions on both ends.
Wow, very similar experience with a flight that had to be re-booked for the next day. They swore up and down in Paris that I’d be compensated for the hotel stay, but I couldn’t get them to commit in writing even after a two hour conversation.

It was baffling that they weren’t worn down by that point. I suppose that was their thinking too.
Fair enough. What you describe definitely seems apparent in the show (a variety of anime styles, none of which really have the style a person might associate with Disney), so I'm not surprised to hear that.
> There is a reason TV companies get fined when someone says a "bad" word.

This is actually really complicated and possibly (likely?) unconstitutional.

They basically can do limited censorship because of FCC v. Pacifica [1]

But that failed when applied to the internet. [2]

And it even fails sometimes when applied to TV. [3]

A different court in the future may very well overturn FCC v. Pacifica without anyone passing a new Federal law.

And States already are almost certainly prevented from outright censoring porn because:

a) legal porn has already been ruled *not* to be federally obscene via Miller test. [4]

They have to use the 'actionable indecency' bit from Pacifica to censor (ie. these ID laws) otherwise first amendment protected material. [6]

b) the first amendment is incorporated and thus applies to the States [5]

[1] https://en.wikipedia.org/w/index.php?title=FCC_v._Pacifica_F...

[2] https://en.wikipedia.org/wiki/Reno_v._American_Civil_Liberti...

[3] https://en.wikipedia.org/wiki/FCC_v._Fox_Television_Stations...

[4] https://en.wikipedia.org/wiki/Miller_test

[5] https://en.wikipedia.org/wiki/Incorporation_of_the_Bill_of_R...

[6] https://en.wikipedia.org/wiki/Actionable_indecency
I’m not positive this is a winner for normie users. The exclusivity of a user name is important, I want @mark, not @mark.abcdef while I know there is an @mark.abcdęf out there.
He later clarified consumers of his bs would be harmed.
I still appreciate these pieces because they help educate people. If it dissuades even a few people from signing up for these apps, or forces another app to adopt a more private approach, all the power to them.
Microsoft has historically been the biggest proponent for using FPGAs for AI.

It’s not that you can’t use them, and there may be narrow cases where they have a benefit. There are always trade-offs to be made.

But that doesn’t make them the best hardware for AI (there’s silicon overhead that will never be used) and it doesn’t change the fact that they’re much harder and slower than bare metal CUDA to optimize for, in a fast moving field.

Look at it this way: if you have a fixed DL architecture and a fixed set of network weights, there’s no question that you could come up with an ASIC that only does that, that will be cheaper than an FPGA or GPU, faster, and use lower power too. It will be the perfect inference solution for that specific problem.

It would also be obsolete in a few months, before the chip comes back from the fab.
Clairvoyance is perhaps also not optimal.
Great, so you've updated your knowledge base, it's got garbage targeted to make it attractive to the model, and now your model is outputting garbage. It's the exact same problem Google has fighting the SEO spammers. Now the model is significantly less useful, exactly as suggested.

We've already seen exactly this happened with search. There's no reason to believe that LLMs are immune.
I'm sure this is going to be a very unpopular opinion here...but Microsoft Access 2000 was amazing for managing small databases shared on a LAN. You could build relational tables, and it managed all the keys, etc. You could build a CRUD app in less than an hour for almost any data an organization might have.

You could then scale up to ODBC or SQL databases as time went on. It was part of that golden era of tools that did lots of useful things, and could be used by those with domain knowledge, right before .NET infected Microsoft.

If you needed to interface with specialized hardware (as I did a few times), you could use VBA or Delphi to do that work, and tie it into the back-end, while providing a good UI for the person operating the hardware.
There was that subreddit, r/hermancainaward, where you could spend all day reading tales of people who weren't afraid of Covid, until they were. Then they died.
And refuses to pay the agreed upon severance.

Also, Meta is a massive company. If Meta did not hire “Dozens” of former Twitter employees that would be far more suspicious because it would probably indicate they were going out of their way not to hire Twitter employees, since they would likely hire “dozens” of Twitter employees purely based on statistics.
Funnily enough I just had a similar interaction with Lufthansa but the result was much different, within half an hour of filling in the relevant form I got the reply with the proper compensation amount and within 2 days entering my bank details the transfer was complete. Good to have the view on different airlines
This Microsoft attitude of embrace everything, I don't know how far this will take them.
> If the PS2 had been Sony's first console, they probably would have lost

I disagree. The PS2 had a year head start, a solid early lineup, and a built-in DVD player (this was huge). The XBox also had little traction in Japan, not just from a consumer perspective but a developer perspective as well. It certainly would have been a closer race had the two consoles released at the same time though.
Even solar panels aren't emissions-free. They take 1-3 years to payback the emissions used to create them, which is a great trade (a decrease full-lifecycle emissions as compared to do) for people who would already be consuming the power they'd create, but is still an increase in full-lifecycle emissions when created to supply power to someone who wouldn't otherwise have access to that power. Anyone who is without stable electricity today should gain access to it, by all means, but that is a net increase in emissions as compared to today.

Stable supplies of food (and fertilizer and machinery to grow and process it), clean water, refrigeration, transport, (somewhat ironically) HVAC, lighting, and some amount of outputs of manufacturing are desired by all.
Horse heads are my go-to.
> Many of their newer cards are barely 'competitive'

The 4060 is the only card this generation that's a flop, and I wouldn't consider one in four being "many".

> I don't think it's that hard to see, actually.

It is if you're not looking or trying to be disingenuous. Every generation has introduced new features and had noticeable impacts on the consumer products in its category (games). DLSS alone has been a game-changer, pun intended.
This is that any different with regular usernames? Like @mārk
Emacs' Magit is an excellent interface for git.

e.g. committing the staged changes would involve just "cc". Rewording the last commit is "cw", amending is "ce", and fixing up earlier commits is "cf".

Checking out a new branch is "bc", whereas creating a new branch is "bn".

Fetching to the default origin is "ff", likewise pushing is "pp".

But aside from the keymap being very terse, it's also highly discoverable. You're shown all the git commands, and before invoking a command, all the options for that command.
The market for GOUs is declining because crypto is over and because the GPUs are so underpowered and overpriced that people don’t want to buy them.

And if GPUs cost so much to make, why do they get discounted so drastically when the manufacturers eventually decide to compete?
Show HN: Build an AI slackbot in minutes with Stack AI
Hey folks!

I am Bernardo from Stack AI (YC W23). We are a team with the mission of enabling any company to use AI to power their operations.

Here I am sharing a brief video showing how to build your own Slack AI bot in a few minutes with our platform.

Stack AI is a no-code platform to build internal tools with Generate AI. we have integrations with the most popular LLMs, databases, documents, and vector stores.

You are all invited to try it here: https://www.stack-ai.com/ (free version included)
To be clear Russia is already using cluster munitions in Ukraine.

They are banned because many have a dud rate which means civilians can be hurt by unexploded ordnance.
Likely a matter of the parents in richer neighborhoods being able to donate more time and money to the local school than in poorer neighborhoods. The buildings are better, there are more resources available to teachers, more extra-curricular activities, skilled teachers fight to be posted there. Certainly things can be improved at schools in poorer neighborhoods, but I doubt it could be equalized to the point where kids won't benefit from being bussed to the richer neighborhood schools.
No, I was just drinking at the time (so for a bit I may have been an alcohol induced ENTJ)... My reply was a little rude. I apologize for that. That wasn't a productive way for me to express my disagreement, and I should have chosen my words more thoughtfully.
I'd say AMD still has worse software than Nvidia too, even before GPGPU/CUDA. About a year ago, I swapped a 1080TI with a friend's 5700XT because he was having crashing issues with games. I use it fine now with Linux drivers, so I doubt it was a hardware issue.
If it was five times slower was that then 5 billion years?
It's a bit unfair to ascribe it to sheer luck. They were focused on the compute related possibilities all the way back with the GeForce 3 in 2001. Presentations from its launch were already talking about the potential of a "parallel compute monster" [1].

They saw the potential of GPU compute very early on, invested in it long term and as a result eventually ended up dominating the market. The others didn't seriously commit and so they fell behind. AMD still can't seem to commit, while Intel seems to be working hard on catching up but isn't quite there yet.

[1] https://developer.download.nvidia.com/assets/gamedev/docs/GF...
Appreciate the interest. Honestly, most of the cool stuff was getting to play with toys that all the other talented engineers developed; I had a relatively narrow piece of the pie. I did write up a bit in a sibling reply.
Well, the capabilities (or lack thereof) of the person(s) doing the categorizing is rather important as well.

For example, I am a conspiracy theorist, and the number of nasty things that have been said about "me" by literally delusional Normies over the years gets a little annoying after a while. It would be a real shame if these chickens were to come home to roost at a particularly inconvenient time.

Anyways, I wish you and your Rational crew best of luck with your climate problems!
Don't we have a user here named ChatGTP?
Wonder if this person is still able to use Air France?

aka, I'd kind of expect them to be banned now
Ask HN: Path to become a self taught quant or learn financial concepts
Hello ,

What are some free or paid resources available to help you learn more about quantitative finance

Also I do have experience using python
Spanish conquest was centuries after the collapse of lowland Mayan civilization.
You can see changes caused by a 1 degree temperature rise?

Such as?
Because their firmware actually does what the docs say it will instead of segfaulting when people attempt to use it for anything outside of gaming.
That's... Super interesting. Guess this is due to customer demand somehow. Surprised edge has that sort of clearance from the rest of the biz to make these sorta calls.
My personal take on the land of cyber security frameworks - and especially security standards - is that a good security team should be able to read through a list of controls (e.g. those in NIST 800-171) and express a reasoned opinion on each one with respect to the company's security posture. They are fantastic tools for reminding you what things you might have overlooked and driving a discussion about how your organization is approaching security - basically regardless of what type of company you run.

That's where the value stops - once you give lawyers, policymakers, and insurance companies access to these documents it becomes an unending game of regulatory capture, responsibility derogation, and box-ticking.

You end up with people who have zero context for technology running around demanding to see evidence that your smart toaster implements 12.2.14.1.5b "The centralized time server must enforce separation of duties" before it can be added to the network or some other such incoherent nonsense.

These standards always start in the right place, but they get used in the most frustrating ways because people who don't understand how technology works are, invariably, the auditors and assessors who apply these standards since true technologists can easily find more gratifying jobs doing literally anything else.
Surveillance requires resources.
You would cream your pants if you happened to have even 10% of the PC gaming GPU market. Like literally.

Stop downplaying markets because of X. The market-share of the PC gaming market is higher than most modern countries of the world.
Embodied, self-replicating, autonomous agents?
Their post is dripping with that peculiar tone of abuser melodramatics, really sick stuff.
I wonder why they put '/e/ OS' on this instead of standard AOSP or LineageOS. The UI looks like an attempt to be as close as possible to iOS - but I'd imagine the target market for a Fairphone 4 and the target market for any iPhone has nearly zero overlap.

Of course, assuming you can just put your own ROM on it, it doesn't matter, but it just seems like so much work for little to no reason to me.
I don't check my email unless it's to verify a signup, or send attachments. I currently have 13,169 unread emails, and I don't care.

I'm out of the work force, so that might not be a good strategy for you.

My friend does what mikecoles suggests, has his own domain, and generates a unique email address for each contact/organization he interacts with, so he can figure out where the spam came from.

If I were to somehow reenter the workforce, I'd keep keep my current personal emails out of it, and rely on the spam filtering of my employer along with obscurity, to keep things down. Sign-ups would be through a sacrificial second address I'd beg out of IT.
I'll point out a few things that maybe you have noticed but not correlated because they're not obviously "headline grabbing" (in a personal sense).
I'm in Australia too (Melbourne), and have travelled to Europe several times in the last 25 years. Have you noticed that the "overnight low" temperatures and aren't as low as they used to be? If you're an avid gardener or a farmer (or know one), have you noticed plants flowering/blooming earlier/later? If you're a bird watcher, have you noticed changes in migration timing?
I'd also point out that unless you're nearer the polar regions (which have sustained higher temperatures over time), you may not personally notice changes. This also depends of course on how old you are. I was born in the 60's. Winters in Melbourne are decidedly different these days from those of my childhood.
This seems like it could be pretty useful for doing immutable FS A/B updates
Contaminated beach water pollution report
> Nvidia has what like 82-84% market share

That's the PC consumer market. Every Xbox and PlayStation shipped in the past decade has had an AMD GPU.
You do realize the irony in that statement, correct?
If tech workers don't mass unionize soon, corporations will find cheaper labor
Corporations are loving the tech layoffs as devs scramble and compete amongst each other for lower wages. Companies are taking advantage of this and offering lower wages or equal wage to a year ago.

https://www.theinformation.com/articles/pay-falls-for-many-tech-workers-as-the-downturn-hits-home

https://www.businessinsider.com/tech-workers-willing-pay-decrease-high-salaries-remote-layoffs-survey-2023-6
AMD actually IS competing, just not so much in gamer space (though they are actually competing there as well, just not with top end)

The MI 300 and MI 250 are making huge inroads to the point where they are finally pulling folks away from CUDA.
"I had a US$10k guitar in that bag and have the receipts to prove it!"

:D
I've written a twitter clone in PHP once, it's not hard. Throw in some Ajax to auto refresh, and you'd have something similar to what they have been using this whole time.
incidentally why I like proxmox. it's the best of both worlds.
There is only one way to settle this:Cage match.
For certain definitions of responsible. I don’t think this class of model can be deployed responsibly in this context, because it has no guarantees on correctness.
I think it’s a little different. Maybe I’m just a nerd but some domains are cool and some are not.
[alias]
br = branch
co = checkout
d = diff
dc = diff --cached
ec = config --global -e
latest = log -1 HEAD
please = push --force-with-lease
st = status

Aliases for git can be added to ~/.gitconfig
It is almost an XKCD style piss-take.
Bummer! Edited the answer. Not sure about the off-by-one though.
Say the string is str[] = "spp\0". n = strlen(str) is 3.
In the end, res would be 1 and 2 * res - n == -1.
Except it isn't blind and it isn't belief? A hypothesis that has been amply supported by decades of evidence of many forms is hardly a subject for "blind belief".
Consider the economics. There are HUGE companies with a history of influencing legislature, lobbying an lying to everyone, whose existence depends on us to continue not caring about climate change. People like us can hardly imagine the amount of money they are throwing at us in the form of marketing, lobbying, astroturfing, etc. They are literally making money off us not taking action.

Otoh, I cannot think of a single billion dollar company that got where it is by being climate friendly.
The simple answer is that they don't -- all the health metrics like heart rate, exercise, etc. collected by iOS and Android are both locked behind pretty stringent privacy walls. To get access you'll see (on iOS, not sure about Android) a popup asking for the app to connect to your health info, which I haven't seen happening.
This is just so fun to watch.

As a VIC-20 and C=64 owner in my youth, I've always had a soft spot for this kind of 8-bit kit. And this is my favorite YouTube channel, from the way it is (not) monetized to the way he lovingly plays his own intro/outro music, and the amazing geeky themes he's covered, such as his home network and building his solar shack, his electric car experiences, the nostalgia tour of Texas Tech, all his amazing restoration videos and the endless RetroBrite applications. There's just something for everyone in there.

And the visual touches are great too. Love his tee shirt collection and the occasional glimpse of cat.

As for the X16, it's an amazing dream project, and it would've been my dream too, if I had stayed as an electrical engineer. I'd love to own one of these, for bragging rights. And I'm so excited that Jeri Ellsworth had a few things to say!
If humanity was smart, one month every year would be a quiet month with travel banned, and one year every twelve years would be a quiet year. But humanity as a whole is still dumb as rock, it can't stop its own urges even for a moment.
I'll answer this in good faith. I can't help but be skeptical yet practice a version of "pascals wager" but apply it to climate change. I drive an electric vehicle, power my house with solar, reduce air travel, etc. I have 2 major issues: The first is that the environmental damage we are currently doing-- destruction of our oceans, polluting our air and water, etc. will destroy our planet in a few generations any ways, climate change not required. Second is that I am skeptical of our governments response. I don't believe they genuinely care about solving it other than making money off it. Does it really matter if I am skeptical? I am doing what little a normal citizen is expected to do to fight it.

*edit: fixed spelling
What’s exactly the benefit of this other than making the domain space more toxic than it already is with parking, squatting, etc?
I'd push back on this, and say it's a pretty distinctively bad place to start, unless you're starting at Allstate in a parallel universe where Allstate hasn't spent the last 20 years doing this stuff and indirectly influencing these frameworks.
I've come to nickname this type of behaviour "rat profiteering" where companies intentionally either degrade or never properly implement certain processes which, on paper, do not provide to the bottom line. Maybe there's an actual term for it.

For some reason customer service has fallen into this mode in almost all large corporations.
Forgive me as I’m out of the loop. What propaganda are you referring to?
Too late IMO. Twitter the incumbent, Threads just popped up out of nowhere with a whole heap of users.

People switch when other people switch, generally. Those tired of Twitter now have an easy place to call home, there's not going to be any momentum to then want to switch again.

Mastodon tried, and did get some following, but IMO is too complicated in concept for the common user. Bsky on the other hand just blew it.