skysight-inc/HackerNews huggingface dataset:
> Zero-copy formats usually turn out to be worse for use as in-app data structures, because they have to carefully control memory allocation and layout in a way that makes it hard to mutate an already-constructed message.

Oh, I never thought of it that way, but that makes perfect sense. I guess I just assumed messages would be collections of pointers and buffers living "somewhere" in memory, but of course the actual layout can make a ton of difference.

I guess there is an implicit rule that if you are dealing with inbound structures in a read-only fashion, passing around the serial structure is OK for when the field access cost is minor compared to the copy cost, but if you want to mutate it, or doing lots of access operations where that isn't trivial, it makes sense to copy into your own data structure.
I use github projects with a Research/Maybe, Todo, In Progress, Testing, and Done columns. Each item has a checklist of steps needed to complete the item. For example, I might have an item that is "Workers have an inventory" and a bunch of steps to do that "Add an inventory component, add a take item event, etc." that are markdown checkboxes.

This lets me do some 'design' via listing out all the classes/touchpoints, while still giving me the flexibility to tear stuff up, shuffle it around, and not lose state.

I'll also often keep one text file with very tactical todos, stuff I was in the middle of typing out when interrupted, so I can quickly get back into flow state.
Yeah, I dislike banning TODO comments from passing through both for the reason that they're so coupled to the code they reside along that turning them into an issue is rarely helpful, at least as I write them, and that they can convey a lot of information to future readers of the code about intent, about parts of the code the author regarded as shortcuts and maybe a pointer on how to shore them up, about likely shortcomings or gotchas, and so on. Unless you just allow TODO-like comments to remain but without literally having "TODO" in them, which is silly.
Google docs outline; a glorified design doc and todo list.

Project management isn’t project execution. It’s ok to focus on doing the thing and not your notes to self about doing the thing.
Maybe not the "good guys" in an absolute sense, but as a US citizen, I would expect the US to be more aligned with my interests than the Chinese government.

All countries are attempting to spy on each other. Of course they are. If you expect your country not to because of some misguided belief that this would make them a "good guy" you're just asking for your country to be weaker than others.

It's not cognitive dissonance. That's like saying, "Gee you don't like when the other team scores a goal, but you sure are happy when your team does it!"
I love RSS, I used to have an OPML file of hundreds of feeds (mainly blogs/ppl I follow but also various company news feeds and other news content). Don’t know when it happened but for a few years I didn’t have a RSS reader because the sw just got too unmaintained and bad (on macOS / iOS).

But a few months back I finally took the time and set up a reader. Now I again get annoyed by sites that don’t offer feeds of their content. But RSS is still hands down the best eay to be notified and on top of vast amount of new content of various sites all over the Web.
> I'll eat my hat for this, but effectively the mitigation to this is clearing all caches and internal buffers in the CPU on each context switch.

Are you talking about software context switches or hardware (hyperthreading) ones?

If HW threading constantly clears caches wouldn't it cause a huge performance loss? Isn't that something that can occur 1-100 million times per second?

Sadly, software context switch cache clearing is pretty much given these days.
Yes, do to their large population and slightly higher average quantitative abilities (at least if you trust their PISA scores), they have roughly 20x more 4 sigma people than America.

Chinese technological dominance seems likely even ignoring embryo selection. This will likely be amplified by better agglomeration in cities.

Were western institutions capable of thinking long-term, this would add to their desire for human enhancement.
If I were a teacher, I would begin an introductory chemistry course with these words: “Chemistry is the single most important area of knowledge today and for all foreseeable future. (Sorry physics.) This is because the world we live in
and we ourselves are built from atoms, and because all future progress, the very evolution of the human being, all rest now on our understanding of the limitless possibilities presented by an ability to control atoms’ behavior. It is chemistry, in its modern sense, that holds the key to the future of the humankind. We may never reach the stars, we may never understand the “true nature” of elementary particles - but that’s OK, because 99% of what’s really important for us in the world we live in can indeed be modeled - and controlled - based on the simple view of the world as a bunch of atoms interacting in certain ways.”
In my experience, a big danger is when someone higher in the company hierarchy is a former developer who no longer writes code.

Such person will perceive the new language features or libraries as "too clever, and not really necessary", will voice their opinion loudly, and you can't make them learn and find out that it's actually simple and useful. (And, yes, lambdas in Java 8 were an example of that.)
I think good mentorship, good code review, and good tests are critical to anything, including Common Lisp. We are very strict about that and we’ve had excellent results. Non-sense and language game-playing is quickly and earnestly called out, and everybody lives a better developer life.

I’ve been on Lisp teams where that wasn’t the case and it was a free-for-all with macros and other things. That was a disaster and the code base was a gigantic Rube Goldberg contraption. But bad hygiene is possible in any environment, though Lisp has the capacity to amplify it.
> This is why, in general, ideas that involve lots of actors changing their behavior contrary to incentives, instead of changing the incentives, are fundamentally flawed.

Indeed, this is what drives the Tragedy of the Commons - everyone acting according to their individual incentives, maximizing their individual benefit, but while exploiting an unregulated limited common resource, and externalizing the cost of doing so upon the commons.

There are two solutions paths which are not mutually exclusive: put a higher price on the resource use or externality, and find a more efficient way to achieve meet needs.

In many cases, the current incentives and resulting approaches keep us stuck in local maxima. An example is commuting in
single occupancy personal vehicles in urban areas in the US. When you consider the layout of our cities and the limited mass transit availability, it very often makes more individual sense to drive when you consider factors like transporting children to school/activities, grocery shopping, appointments, etc.

Sometimes the costs are actually to the individual rather than the commons, or are delayed in impact to the commons. In the previous example
hours spent sitting in a vehicle instead of walking deprives individuals of opportunities to burn calories to control
their weight, resulting in a variety of health issues.

The problem is that there are a powerful set of interests who are interested in maintaining the current approaches and incentives at all cost. Again, in the transportation example above, these would include the fossil fuel extraction and highway expansion industries.
An eBay Addiction, a Logic Analyzer, and a VR Game
I put my projects (especially private ones) in GitLab, so I use their project management features. I like them a lot! Better than any other project planning tool I've used at any job (JIRA and GitHub and ZenHub)
The graph in the article, with private credit showing both higher and much smoother returns than corporate bonds and loans, is a fantasy, perhaps caused by using portfolio manager marks for the private loans in the absence of a traded market.
I came to a similar conclusion. You should write every email as if it were public, because it's entirely likely that it will be. They can be forwarded, made public through legal discovery, or exposed in a data breach (eg. Sony/North Korea).

Forget security for a second, imagining every email as public record will make you more considerate and less biased writer. And from a business perspective, email should be viewed as a public legal record, because in some cases it will be used that way.

That's not to say that there shouldn't be private messaging options, it's just that email isn't one of them and was never really built to be. PGP was always sort of a tacked on solution with a lot of faults (no forward secrecy, plenty of meta data leakage, usability issues)

All that being said, I still left Gmail for Fastmail. Just because I consider every email I write to be public doesn't mean I want Google getting a free pass to mine and sell my data.
Yes? That was, after all, concretely the claim made by the administration before the invasion (recall the joke by Dave Chappelle about yellow cake)

There's also plenty of evidence that Iraq had (known, small) stockpiles of chemical weapons, too (last I checked those were classed as WMD), which are widely accepted to be a likely cause of gulf war syndrome and a contributing factor to congenital disease in some parts of iraq.

Mind you: I'm not claiming that it's ethical to invade a country on shoddy pretenses.
True, though I still think it's preferable to use for business, purchases, and logins. If I'm using an email besides Gmail, at least it means that I have a shot in that Google won't immediately know that I signed up for X service or made X purchase. Sure, they probably can figure those things out in other ways, but I'm not going to willingly hand everything directly to them.

Part of the reason I use Protonmail(and pay for it) is because I want to support the notion that the web can be made up of different services as opposed to all being calls to .google.com or .facebook.com.
Setting Annual Goals
https://carrd.co/ by https://twitter.com/ajlkn - great for building small/simple websites/landing pages - seems still growing since its premiere.
I agree that the title is pure clickbait, I disagree that the article completely divorces itself from the premise the title implies. This whole thing where science journalism drums up this huge controversy after the fact when enough science on a topic has been performed to think that maybe a particular explanation is a bad one is a symptom of organizations that have to drum up a saucy narrative to sell.

It is perfectly natural to fund science that seems like a good idea at the time, and not fund ideas that seem less plausible than the prevailing explanation, and while it does suck that it takes a while to overturn the idea that the idea is good, representing our 20/20 hindsight as some irredeemable inertia with conspiracist overtones is a big problem.
I disagree with much of your comment:

> I lost a lot of faith in Proton when I learned how much funding they took from the EU.

Unless the origins of the money are unethical (e.g. blood money), it's not where it comes from that matters, it's what's done with it. I haven't seen any misconduct from ProtonMail and the EU's motivations for giving the money seem to be economic, which makes a lot of sense. They want competitive EU tech companies.

> It just runs entirely counter to evidence we’ve seen of Snowden, 5eyes/14eyes, and other programs that the EU truly wants end to end encrypted comms for people.

The EU is not a member of the 5 eyes nor 14 eyes, some of its member states are. The EU is composed of 28 member states, so not even half are participants in those groups.

Even if the EU were a member of the 5 eyes, the EU is not a monolithic entity. The SIGINT arm of the EU (if such a thing exists) may very well oppose end to end encryption while the economic arm promotes it. The same is true in the US, where the NSA attempts to break encryption while the Department of State funds Tor development.
Multi-Cloud Monitoring and Observability with the Metrics API [audio]
I've just started using Feedbin about a month ago, and although my HN firehose feed is at like 1100 something, it definitely limits the rest of the HN feeds. The show and ask feeds are both stuck around 400 something.
Don't know why you were downvoted but...

> What if it's in support of an opinion?

I think opinions are great if they state their claims and reasons in a respectful manner and don't throw out very false narratives on purpose.

> ...real ad on a real platform. The other is paying for fake interactions to project a false response..

You're right. I'm jaded and feel I'm over advertised to on search engines, blogs & social media platforms. I feel they're shoved down your throat & ruin the quality of the platform. I feel a lot of ads or "sponsored posts" try their hardest to hide the fact that it's an ad. They often blur the lines of accurate claims. I don't even need to go down the route of "influencer" or "affiliate links" that hide it even more. At one time in my life, I felt there was a clear distinction between ads & authentic word of mouth promotion of an item. That was probably way back when TV blurred out logos. I haven't felt that way in a long time. I believe "real ad" is such a gray area these days that I am having a hard time seeing anything wrong with regular people making money off this advertisement hysteria instead of companies. Especially since most of the companies in question here are doing highly unethical things with their user's data.

You can take the above paragraph & state 2 wrongs don't make a right or point out several fallacies made. At the end I would argue that the paid likes are only a small part of a larger problem of advertisements. Yes I would like to see paid likes become irrelevant but I think there are bigger issues.
#3 can also backfire badly. Personally I would avoid it.
What would you recommend for a shop that has some mature projects they'd like to add a bunch of tests to, to improve speed and confidence in future changes?
I'm stealing this.
iftop (and ifstat) are part of my preseed file, along with tcpdump, (and htop/iostat/pidstat/mpstat)

For a router I'd also put ntopng on.
I first found it helpful to see how many moves it takes a knight to jump from one square to another by looking at the vertical and horizontal axes:

| 2
| 3
| 2
| 3
|2 3 2 3 K 3 2 3
| 3
| 2
| 3

Then by looking at the diagonals:

|4 2 4
| 2 3 2
| 4 2 4
| 2 3 2
|2 3 2 3 K 3 2 3
| 2 3 2
| 4 2 4
| 2 3 2
|
|

Finally looking at the map:

|
|8| 4 3 2 3 2 3 2 3
|7| 3 2 3 4 1 2 1 4
|6| 4 3 2 1 2 3 2 1
|5| 3 2 3 2 3 K 3 2
|4| 4 3 2 1 2 3 2 1
|3| 3 2 3 4 1 2 1 4
|2| 4 3 2 3 2 3 2 3
|1| 3 4 3 2 3 2 3 2
| +----------------
| a b c d e f g h
> Which is maybe less problematic if college is free but obviously everyone wants a job after four years of study.

Someone is still paying for the college. If it's not the student, it's society as a whole. And public money is not an infinite resource.
What Are CSS Percentages?
One of reasons I did my Sciter Notes (https://notes.sciter.com) is to track ideas and progress (see checkmark list button). Idea definition frequently require hyperlinks, images, etc. so todo.txt is not enough in case of UI related stuff.

Also to track customers, their licenses and services.

Sciter Notes is storing data strictly on local drive and so the data is not shared with third parties.
I would imagine complacency is far more economically valuable than intelligence.
We've become quite adept at pointing out the conflicting incentives, scaling problems vis-a-vis mobs, and hidden rights violations users agree to without realizing the implications. There is, however, another aspect to this we don't talk about much.

Who suffers the most here? It obviously not the social media platforms. They adapt their code and move on. It's not the users, at least in the long run. The problem has been identified and resolved. It's not the people selling likes. They get punished, bail out on some fake accounts and get new ones. Even if you could somehow ban individuals from using platforms, there's a million more people willing to create fake likes from where those came from.

It's the poor, as always. The people who know the system is rigged, know the system has to be gamed in order to make money, and are desperately looking for a way to be competitive and get ahead. So they buy some fake likes, then get destroyed by the social media companies. Perhaps they've already invested a lot of time in their presence before they got desperate. In either case, they're not running fake ids. It's just them. And they don't know enough tech to move on. They get slammed for life for making a poor moral choice. Why? Because they're easy to find and it's easy to punish them.

That's whack.
Well, that’s what school children are asked to write all the time.
Oh my, Sonnenschuld!!!! I feel you, I have felt this so often and talked about it too, but me and my colleagues didn't come up with this neologism :D Can we use it, can we, can we, bitte?!
Yes. Watching 20 news/tech/community sites plus torrent announcements for automated download.
I love this.

It's incredibly creative and fun. I had an E-Reader growing up, which was a similar concept but suffered from problems in that it was trying to fit a disposable experience onto an expensive piece of dedicated hardware. The scanning experience was sub-par and the ecosystem just didn't lend itself well to trading or hiding cards. The E-reader was trying to match a disposable, tiny experience to an expensive, closed ecosystem, and that discordance meant that it just didn't work very well.

But this -- everyone has a phone that can read these, you don't have to install anything, anyone can print them out and share them. I see this and immediately start thinking of fun things to do with the platform. I love the physicality that's kind of missing from fantasy consoles like Pico-8.

This is wonderful, I hope you continue working on it.
As a developer, seeing a TODO in there is a non-issue. I appreciate the context from the previous developer and I don't feel any sort of pathological urge to stop what I'm doing to fix that TODO (unless it's actually relevant to what I'm doing, in which case, I appreciate that it's there). The way you're phrasing things suggests that you don't trust developers to manage their workload. Is that the case?

Also, the notion that developers shouldn't be involved in "business information" is a non-starter to me. They should absolutely be involved, it's a big part of the job. If they wrote it as a TODO instead of adding something to the issue tracker, they probably thought that it was an issue that did not need to be raised to non-technical people or project managers. You know how managers talk about "managing up" all the time? Dev's do that too.
I'd love to keep it in RAM if I could. The problem is, the library I'm familiar with (pandas) typically seems to take more memory than the original csv file once it loads it onto memory. I know this is due to bad data types but in certain cases, I cannot get around those.

However, even if I could load it all into memory at once, and assuming it takes 200 gb, I'm still using a master's student access to a cluster. So I get preempted like it's nobody's business. Hence why I prefer a smaller memory footprint even if I take up cpus at variable rates through a single execution.

I did try to write my own multiprocessing code for this, but the operations are sometimes too complicated (like groupby) for me to rewrite everything from the ground up. If I'm not reliant on serial data communication between processes (like you'd need to sort a column), I can get it done pretty easily. In fact, I wrote my data cleaning code with this and cleaned up the entire file in half an hour because single chunks didn't rely on others.

However, if you have some idea of how to run these computational loads in parallel in python or any other language on single compute instances (like the size of a laptop's memory of 16 gb), I'd really love to see it. Thanks.
Some foundries have purposely held back on scaling improvements, precisely because the older, coarser processes can still find a lot of use and be optimized in other ways. One can also see Intel's iterative improvements on their 14nm++++ process in the same vein.
How exactly should they do it?
I don't. I just pick the thing that is the most painful at this time.
"As a hiring manager myself I really hate it when candidates slag off their current/former employeer. It's a real put off. However if you can turn a negative experience into a positive then it shows that you're not just bitter and/or a bad team player but rather that you use all experiences to help enhance your capabilities as a productive employee."

What's wrong with being bitter when you are wronged by your manager or employer?

"and/or bad team player"

Sounds like blaming a victim to me.

Seriously, imagine you got robbed, beaten and humiliated how would you feel listening to someone telling you that being bitter about that is bad and it's your own fault?
The backlash against Crichton was well-founded. He used the grain of truth that it's sometimes hard to get new ideas in science funded to build a crazy denialist foundation on that made for exciting fiction, but terrible description of reality.
The 3-4 years you do a PhD are also years out of the workforce for making a good salary. If you do a PhD then you really want to consider its impact to your working life.
Sadly very little I do will be useful to you. The 8266 version is very, very limited. You'll be able to deauth and set the time with nntp, and that's about it.

But also: I'm trying to work out a way to open source my work. My employer produces software for smart watches and wearable tech. Even if I don't know about that part of the business, they're kinda tricky about open source project policies.
Seven Habits of Highly Effective Programmers (2012)
So great ! A combination of constrained simplicity with a physical support that you can hold in your hands !
I like both concepts, moreover in software where its now rarer than ever. Mostly because there is no more truly useful application. But you found one !
Thanks for sharing, I don’t know yet to do with it but it made my day.
Be Ready to Talk with Parents About Direct-to-Consumer Genetic Testing
To be honest, I’ve had it come up with free verse poetry that was actually quite thought provoking.
Totally agree. The idea that chemistry is separate from physics is pretty dumb anyway. I'm kinda talking out of my blowhole here, but it seems the reason chemistry and biology are distinguished from physics is that there are a lot of emergent phenomenon that we didn't and in many cases still can't predict from the fundamental physics. But, it's still there. Maybe chemistry should be called molecular dynamics or something like that. Jazz it up a bit.

Also, more explosions and experiments with fart gas.
That one was a case of electronic gremlins in one particular plane together with a quite particular edge case in the software, based on reasonable assumptions.
https://news.ycombinator.com/item?id=13364762 has interesting discussion.
>Just Google "buy reddit upvotes" and the internet is full of folks who will sell you a million Likes for cheap

Some years ago I made a post on /r/learnprogramming that TL;DR was along the lines of "go to college, great ROI, plus for your first job most employers auto reject resumes without a degree" or something along those lines.

I was offered $500 up front and $500 referral bonuses to edit my comment to link to a fake degree mill. IIRC they charged something like $1500 for a fake degree and one year of service for employer education checks/transcripts. (by the by, if you're going to run a fake degree mill out of a residential address in San Mateo, use a VPN!)

Point being, Reddit comments are ripe for abuse.