skysight-inc/HackerNews huggingface dataset:
Sorry, everything I know about this comes from experience so there aren't any books I can recommend. (:

Although I could probably recommend you a hands-on project/exercise to do:

- Write a simple memory allocator in C/C++/Rust/Zig/any similar systems language using raw `mmap` and `munmap` syscalls (run "man 2 mmap" in your terminal for details). This is how fundamentally almost every program allocates memory on the lowest level (with some exceptions, but I'm not going to get into that).

- Allocate a bunch of memory with your allocator without actually reading/writing from than memory and check the program's RSS, then write to it and check the RSS again. Try allocating more memory than you have RAM and see if it works. Run the program under `perf` and check the page faults counter - see how the page fault number changes if you a) never write to the memory you allocated, b) only write to a single byte per page, c) write to every byte you allocated, d) write twice to every byte you allocated.

- Play around with the `madvise` syscall ("man 2 madvise"), in particular with `MADV_DONTNEED`.

- Try `mmap`ing on a file on your disk. `mmap` it with multiple processes at the same time.
Yawn.
Scrum is a standard that eliminates the need for figuring out and agreeing about a bunch of things. This has great value in the real world. What would the author do instead?
Is scrum “perfect”? No. Does it solve all problems? No of course not.
But it’s not meant to. It’s an abstraction layer on top of the complex mess that is software development and team coordination. Blaming the abstraction layer when something goes wrong is typically a strawman. Like blaming the REST API when it’s actually the database that’s slow.
if your market is not usa or Asia, you actually get DDoSed by using cloudflare et all more often (>1) than not (=0)
Scrum is alright but shouldn't be taken to the extreme. We went from Waterfall Model, planning absolutely everything up-front, to the opposite extreme of planning nothing up-front. Somehow people think that's totally normal and still think process is everything.

I've been around the tech industry long enough to see companies dogmatically pursuing certain ideas only to switch to the opposite ideas later... And, at all times, everyone is 100% sure that this way is the only way it should be done. Nobody ever gets any credit for saying "Hang on, maybe we should find a middle ground."

The root problem is that most humans are a mix of crazy and stupid. We go from one crazy extreme to the opposite crazy extreme.
Oy. Why add politics to this. Maybe just stay on topic.
if scrum isn't working, you're clearly not having enough meetings!
Nice, but they totally missed the opportunity to say 'Thanks for your patience while we get our ducks in a go'.
Real scrum has never been tried.
Fully agree, doing reactive autoscaling when the actual boot time is slow is an inherently hard problem. We've done years of research into building specialized VMs (unikernels) and fast controllers to be able to provide infra that allows VMs/containers to cold start, and thus autoscale/scale to zero in milliseconds (eg, a simple Node app cold starts in ~50 ms). If interested, you can try it out at kraft.cloud, or check out info about the tech in our blogs (https://unikraft.io/blog/) or the corresponding LF OSS project (www.unikraft.org).
> as usenet admins once did for news spools

Message-per-file was abandoned pretty quickly once the volume started to go up in favour of things like Diablo's "huge file that's a circular buffer" approach. Then the tuning was more about, IIRC, how big you could make inodes to efficiently handle huge (100s of GB) files (not really a problem for mail messages!)

(although I have to say I am 20 years out of usenet admin and maybe things have swung back towards the INN style - it does make long retention easier and modern filesystems are probably much better. Back then we were experimenting with everything from JFS to XFS to FreeBSD to ...)
Not with any known technology.
I had a knee-jerk reaction ready to dismiss this post, but it actually makes a good point and it makes it well.
Glad to have helped. (:
Where would peasants earn revenue to pay rent for enterprise software?
I have 4 kids. Having a centrally visible (kitchen wall), huge (A3 or bigger) zero power consumption display of the family calendar is absolutely fucking essential to my and my spouse's scheduling needs, by which I actually mean our sanity.
Unfortunately no they can't. China themselves, the biggest producer in the world, only has the equivalent of a few days of winter consumption of Germany. Batteries to smooth out the production yearly is still sci-fi.

There's no replacement for a nuclear plant yet for this purpose until a very large breakthrough is made. The only realistic large scale storage at this level is a dam and since the tech is old, most places in the developed world where one can be built has one already.
You missed the part where your “small modular energy producing unit” only works during the day and when it doesn't rain though.

That's true you cannot spread nuclear everywhere in the world due to political instability constraints. But at the same time, the majority of CO2 emissions come from countries which have access to nuclear technology already…
Zero is neither A nor B or C...?
>I suppose because you want to have more ships to store your nuclear armed planes in more places around the world.

Why? ICBMs are good enough and much cheaper. Also, launching missiles from submarines can be very effective.
> separate

Then you start running into race conditions when updating / reading. The great thing about Maildir is that the updates can be done atomically - saves you a lot of locking and complexity.
> The challenge on top is the replacement of coal after the exit from nuclear power.

Solar when the sun is shining, windmills when the wind is blowing, batteries, hydro, and maybe 1 backup nat. gas plant when somehow all of that is out and you need to ramp up.

Looks like some more wind and a lot of batteries is what's left.
Show HN: My 20-year-long journey from Tester to Software Engineer
Hello Dear HN Folks.

I would like to share with you my journey from testing to software engineer in test, then build engineer, DevOps engineer, cloud engineer, and software engineer today.

It took me from 2004 to 2024 today. It was quite the ride and I tried to write down my experience during this journey. I still have doubts, fears and everything.

I wanted to inspire those who also wished to embark on this journey that it's not impossible. It is hard though. Not gonna lie. And I had some luck along the way for sure.

But with passion and stubbornness and determination one can go to places. :)

Please understand that I don't think testing is bad. Quite the opposite. I believe my career in Testing has led me to the engineer I am today. Always with Testing in mind first!

Anyways. I hope it's an enjoyable read.

Thanks and Godspeed!
yes you are correct. the top comments disagreeing are either full of wrong basic concepts or are very dense in detail while hand waving the important parts and from CDN-for-hire employers.
650k avg revenue for past few years, COGS around 350k, Gross Profit 300k, 80k expenses, SDE 220k, EBITDA 170k. Catering is also a major source of revenue.
A functional government has a monopoly on violence. Funding public sector R&D is tax money well spent, but it's still monopoly money.
Reflective LCD with backlight is called "transflective LCD" and they have been in use for years: https://newhavendisplay.com/blog/transmissive-vs-reflective-...
But he DID tweet the ref to the movie, so that's settled.
Climbing Gyms Are Unionizing. What Does That Mean for the Climbing Community?
If I recall, one of the creators of scrum boiled it down to two elements: a cycle and a reflection on that cycle. All scrum types revolve around that in different ways, and it seems most orgs fail to understand this.

The biggest tool of scrum is having cycles, and then reflecting on the cycle in order to move it in the right direction, but most of the time there are still quarterly planning and bad adherence to the sprint planning (bringing in new work in the middle etc), which defeat the purpose of scrum to begin with. Additionally, scrum should be owned by the contributing team and that almost never happens, as it is controlled top-down by managers and leadership.
The cafe doesn’t wake me up several nights in a row at 3am.
Which in turn compiles itself into Javascript, such that you can run the SMLtoJS compiler in the browser, e.g. it should be possible to make it accept <script> tags with SML code.
Show HN: Online Tasbih Counter.Count all your dhikrs
The Online Tasbih Counter features a simple and user-friendly interface. Tap the 'TAP' button to increase the count by one with each press. The 'Decrease' button decreases the count by one each time it is pressed. The 'Reset' button allows you to reset the count, and it will request your confirmation before doing so. Additionally, the counter automatically saves your count on your device. When you leave and return later, it will resume counting from where you left off.
Which is doubly stupid given that teaching algorithms for arithmetic is a useless skill and has been for 40 years.

Just focus on the ideas, maths is beautiful, pen and paper accounting is not.
Install Qubes OS,

Create disposable template for the browser with deleted browser dot-folder with no network,

(Optional) create appvm qube (or disposable template + disposable) for ProtonVPN or Mullvad

Create named disposable qube utilising the disposable template for the browser, and either sys-whonix or your VPN qube for network, and enjoy the most anonymous internet you will ever get!
It would be awesome if this could also search my Obsidian notes at the same time, and if it worked seamlessly on all of my devices.
Seems almost exactly what I was asking to a e-book reader: fast refresh, powerful enough and potentially open to run user apps and allow offline work; price is nice too. My only complaints are the use of Android, no 13" version that would be a godsend for technical books with graphs and diagrams, and the apparent lack of a headphones connector. Not sure about the latter as the web page is absolutely atrocious to navigate if one is after actual information instead of fancy graphics.
I plan to continue to to wait for the PineNote to mature, because I will always sacrifice functionality to get more openness, but I'm glad something is happening also among the others. Its screen refresh speed is fantastic; I hope they will license the technology to others too, and possibly make panels alone available for sale. As a maker, I would welcome even a reduced speed (say 5-10 fps) version of the raw panel for sale at a decent cost for tinkering.
> Hire only the lowest cost employees, I demand it!

Nobody said that. There’s a difference between “don’t hire the top 1% most expensive developers in the world” and “hire only the lowest cost employees”. Wikipedia can comfortably avoid the extremes on either end of the spectrum.
If "it's too expensive" were the reason why people are having fewer children, then paying women to have babies would work. But the article's title claims that it doesn't work.

A fundamental reason why fertility is below replacement is that when people have choices about what to do, they take them. A significant minority don't have kids, another minority (or majority) delays having kids so long that they can only have one or two. Part of the cause of this is the change of marriage from being a cornerstone of adult life, something to build your life on and around, to the capstone, something that marks success. So it is delayed by a decade or two. Yes, culture does play a role in shaping choices.

Women have been persuaded to adopt male values and standards of success as goals for themselves to achieve: high status career, high status goods like a large house in a good neighborhood, and so on. At the same time they have been persuaded to devalue traditionally female things like relationships and community wellbeing. Indeed: society, culture, will have to radically change to bring fertility above replacement.
The business sale was a transfer of assets sale, so the previous owner taught me everything.
Customizable Dataset Generation via Simulation
“Capitalists will sell the rope to hang them”

Lenin

> Is it just because it would be impossible to have an industrial base in a world where Asia exists and can produce everything that could be built in the US for 1/5 the cost?

It's not impossible, had the US kept capital control and tariffs there would have been no way for Asia to catch-up at all. But the free trade ideology and greed led the US where it is now.
Better yet, use a container.

Distrobox[1] automates the process of installing popular distros released in the past decade or so in containers.

For games in particular, Proton[2] (a game-specific Wine fork) or one of the Steam container runtimes[3] (for native Linux games) might also be worth a try.

For a non-Steam game:

1. Install and run the Linux Steam client (Steam account required).

2. Add the game to the Steam library: "Add a Game" → "Add a Non-Steam Game…", choose game executable.

3. Right click on the game, choose "Properties" → "Compatibility" → "Force the use of a specific Steam Play compatibility tool", and choose a version of Proton or container runtime (the most recent non-experimental version is probably a sane default).

4. Make sure the selected Proton or container runtime version is installed. These should be available for installation from the Steam library by default. If you can't find them, click the dropdown above the search box in the Steam library, make sure "Tools" is checked, and make sure the "Show only ready to play games" option ("play" arrow in a circle icon to the right of the same dropdown) is disabled.

5. Launch the game from the Steam library.

[1] https://distrobox.it/compatibility/#containers-distros

[2] https://github.com/ValveSoftware/Proton

[3] https://gitlab.steamos.cloud/steamrt/steam-runtime-tools/-/b...
Stupid Filter Corpus (2007)
I'm sure this happens because my senses haven't been dulled down enough to just shrug and gloss over these, but the AI-generated filler image after the first full paragraph just jars me out of the reading groove and makes me just drop the article. It feels derisive.

How is this better than just grabbing a photo of an actual get out of jail free-card from somewhere?

https://commons.wikimedia.org/wiki/File:Get_Out_of_Jail_Free...

(CC-BY)
I wonder if anyone remembers the stupid filter project around 2007.

There was an attempt to filter out stupid comments in social media using a vector filter as a plugin for wordpress initially. Project somewhat fell though since it turns out it's quite hard to filter out stupidity in the internet.

While the main source code may be outdated, the corpus may still be of some use in training modern LLMs based content moderation or at least a historical curio of humanities attempt to stem the tied of stupidity.

I've converted the original MySQL dump into an sqlite database and csv file so it should be easier for anyone interested to give this corpus a shot with new machine learning advances these days.
yes, academia should totally love this, but my experience is that they just all got used to reading papers on their laptops or tablets.

but I would totally love this. in fact, I have a remarkable tablet just for reading "papers" (ahem Dungeons & Dragons PDFs). but switching quickly between pages is tricky there...
> The "right" way that he presents at the beginning of the song is a way that I've never encountered anyone doing. It's actually fairly interesting:

> "Three from 2 is 9, carry the one"; it seems to be a completely algorithmic way of doing the calculation, where you end up with the right answer at the end, but it's completely detached from what's actually happening.

I can't understand what you're trying to say. The only difference in the patter is whether you carry the one before or after you subtract 3 from 2. "Both" approaches have you do the same thing in the same way. What's the contrast?
Google's AI Overviews are out of control
> The first electric car was built decades _ago_.

Well over a century ago, in fact. For quite a while early on, they were more popular than internal combustion cars.
> Something like this that you could load your own Linux flavor onto

Did you consider PineNote?
> Except there wasn't any promotion. The only thing close would be Sams tweet,

Yeah, that's promotion.

> but this was not an official statement

Yes of course it was. That's what being a CEO fricking means.
> "If failure cannot be attributed to Scrum, then neither can success."

I don't think this is true, given the "Get out of jail" arguments he is attacking. A proper tool used in its intended way for its intended purpose is intrinsically useful. You can say the same about any tool: If you use a hammer to cut a cake, the resulting mess is your fault. A broken hammer is not an error with hammer as a concept. If you successfully hammer in a nail, the hammer played a crucial part in the success. I can't think of an instance where failure would be the hammer's fault.

If you think the hammer is to blame for not being suited to cut cakes, well, that changes things.

Am I missing something?

(I am only talking about the quoted truism. I am not qualified to talk about scrum.)
I disagree with Carmack on this, I'm on the other hill.
The press-on-release affords me the chance to bail at the last minute. It's probably because my brain is defective, but then consider it a handicap aid! But something about the way I work, makes it that my last cognition will often happen as I'm holding down the button, and it's not uncommon for me to realize that "oh shit, this is the delete button, I meant to save!" and! With the do-on-release, I can keep holding down the mouse button and carefully move the cursor OUTSIDE the button, so that the action is not executed.

Lot's of places, I want faster response (the controls in computer games, yes, of course!) but NOT in interface elements, there I want the response on release, so I have the extra opportunity to realize my fuckup and amend the situation.
Europe isn't importing immigrants to prop up the pensions…
That, and at night a LED device is literally putting a flashlight in direct line of sight, which does not help in making one sleepy (even with night mode stuff cutting some blue light it's still a flashlight, albeit tinted) so more potential for extended late hours doomscrolling. OLED is kind of better than LCD but still.

Comparatively eink relies on ambient lighting (backlighted ones have it backwards in that regard)
Could you please email me (jgc@cloudflare.com) with the support ticket or other details so I can look into this?
There’s more talented developers outside of high CoL places than inside. The comparison is not with one other place, the comparison is with the entire world.
Capital punishment is amoral also because it is inherently ignorant.
> Apple, like all the other cloud companies does not delete anything.

This is patently false. Ive literally, personally, implemented safeties and mechanisms to responsibly remove customer content multiple times.

Ive worked for both Apple and AWS and both companies take customer content and privacy very seriously. So much that it actually impedes support and business operations.
And Let's Encrypt actually provides an API for this: https://letsencrypt.org/docs/revoking/#using-a-different-aut...

I don't think it makes a significant difference (I believe browsers don't implement revocation in any meaningful way), but the option exists.
> And of course the elements song is a total banger.

That's an odd one to mention; he has nothing to do with its musical qualities. He didn't compose it.
I don't know about the reasons of the parent but in my case after some time I was unable to upgrade Xcode on a new MBP 2019 with 128 GB even though it was the only app installed! It was about disk space management when installing via the App Store (not to mention growing space requirements). Downloading it manually solved the problem.
That's absolutely something I do not want after paying almost 800 dollars. Why do you assume that I want to sync my data to the cloud? I maybe want to rsync my stuff to another device of my own. Will I need an account to access the Android store? Again something I don't either want and dislike. And finally will I need to customize it to have root access? I also don't want to do that, I should fully own the thing and do whatever I want. That's what I meant.
I prefer transglutaminase over Elmers.

But that's a matter of taste.

I used Elmers just for finger prints and other simple one-off moulds for my hobby.
> WASM is also pretty fast these days so..

ironically everything is petty fast and everyone waste that speed adding things that allow for a cheaper labour. wasm included. it went from a "have some expertly optimized code in the browser" to "just compile this hide cpp thing and ship as a react component" to then "it allows our servers to run any crap without knowledgeable staff in each language"

we added so many Layers to cheapen labour that now all the labour costs goes into managing the Layers.
Sometimes CEOs say things that are the best political fit for their own personal interests.

1) faces threat of being swamped in US market by Chinese imports

2) builds cars in Chinese market and doesn’t want to appear to be protecting #1

3) exports cars built in China to other markets

Smart guy, but not really genius level thinking.
I can’t really talk much about this yet because legally, until my E2 visa is approved, I can only be in the owner role, not operator. Right now, I pay my friend to be the manager.

Once I am in the clear, I’d be happy to open source the process of acquiring a SMB and running it. I basically become a business broker myself for this one deal, thanks to the broker I worked with.
Can somebody please define a specification on how to store emails in SQLite? Seems to be the only sensible approach if you ask me.
On the subject of replacement parts cost vs total Apple 1st party repair cost, a recent video I watched by UK YouTuber "Mrwhosetheboss" did a comparison of cost, turnaround time and other aspects between three different iPhone repair options and highlighted some of the dynamics at play:

* "Phone repairs are getting ridiculous - Here's why.": https://www.youtube.com/watch?v=oreZytDYoEU

From my admittedly biased outside perspective, the repair process he experienced (and previous coverage by multiple other outlets about "DIY repair with official Apple tools") certainly strongly suggests that Apple is trying to do as little as possible in terms of pricing & availability to support 3rd party or DIY repairs to meet their legal/PR obligations.

So, if official 1st party parts pricing isn't competitive with total 1st party repair cost I'm going to assume it's intentionally obstinate behaviour and that the blame lies wholly at Apple's feet.
It's a perfect example, that rule is not there to make it easier to play the game, it's there to make it harder.

This is common in lots of sports, think about pistol shooting, you're supposed to shoot one handed, arm straight, shoulder to target. That's NOT the best way to shoot if your goal is to hit the target, it's the best way to shoot if you want a challenge.
Alternative title: How to destroy your OS by not understanding your OS.

Don't take this the wrong way. Nice write up. :)

......

Sudo ... why would you sudo a command that you don't understand?

RTFM ... all of the behaviour you experienced is well documented. There are no surprises.

POSIX and UNIX utils are flexible and powerful. This is why we love them. Don't blame the hammer.

Sandbox anything you extract and review it. Extract in a test environment. Extract without sudo and copy the files and permissions you need.

tar -tv is simply tests the archive and outputs the paths. You ignored what it told you - that it would overwrite ./ :)

#### Never ever do this!
$ sudo tar -C / -xvfp xbps-static-latest.x86_64-musl.tar.xz

Insanity.

Cheers :)