skysight-inc/HackerNews huggingface dataset:
Thank you so much for going through API.

> pK and sK naming are conflicts with Primary Key and Surrogate Key

naming the keys wasn't easy for me. I had to keep in mind that I am matching each node with each other. It's important to know how to deal with the registry that's why I tried to keep siblings/parent/children as sK/pK/chK and I thought it's easier to be remembered this way.

> Node api & DocumentFragment

The main idea here is owning the nodes to be manipulated as an object. In node API you can get the node and traverse up/down. While following DFlex approach you can traverse through the whole DOM tree including siblings at no cost.

Why? because basically, you read the node only when "it's mounted" then you can deal with Web API by doing write-only. Your browser won't repaint or do any extra steps to get the nodes. This leads to the next part: letting the app interact with nodes by animation. It won't hurt the user experience and let the app change the DOM node smoothly.
Ahhh, that makes a lot of sense. Thank you for taking the time to answer my question!
Well I'm messing with it now, it is very green. I will probably contribute to this project. It seems like the maintainer pretty much wrote a script to download openaddresses data and write it into an obf file with the map file for the region. It is a good approach, but the map regions are smaller in the releases and it is probably very messy to put it all together.
(Full disclosure -- I'm the primary maintainer / author of Snebu)

I would like to see how these compare against Snebu (https://www.snebu.com), now that it supports encryption. The project has been around for a number of years, but had a bit of a code refactoring when encryption was added.

The interesting approach that it take is it uses GNU tar to grab the files, optionally passes it through the included Tarcrypt (https://www.snebu.com/tarcrypt.html) filter, (which LZOP compresses then encrypts the file contents while keeping tar-compliant headers within the tar file). The tar file is then ingested by the Snebu backend, each backed up file is written to the data store (vault) and compressed (if it arrived in plain text, instead of processed via tarcrypt). The metadata (filenames, size, owner, permissions... etc, client name, backupdate, retention schedule) is stored in an SQLite DB (the backup catalog).

The encryption (handled exclusively by tarcrypt so the audit footprint is small) uses public key encryption (in the usual manner -- the RSA public key encrypts a randomly generated key, which in turn is used with AES-256). You can specify multiple RSA key files, so you can have a backup key (or keys) if you want. You can also change keys any time. Since backupsets are snapshot/deduplicated, you may (most likely will) have files in a restore set that are encrypted with different RSA keys. Not a problem, you will be prompted for the passphrase for each one at the beginning of the restore (and if you use the same passphrase when changing out keys, you only have to enter it once).

(BTW, tarcrypt can be used outside of Snebu -- it may eventually get spun off as its own project).

Other unique features that others lack:

* Key files are for a backup set, not tied to the repository

* Both push and pull backups are supported -- pull backups (initiated by the server) don't need any agent or client software installed (except tarcrypt if encryption is used)

* Granular user access permissions -- you can grant a user access to backup, but not delete, or access to restore specific hosts, etc.

* Multiple-client support. You can have dozens of clients on the same backend repository (I have about 75 or so in a development lab environment).

* Low dependency count -- doesn't require specific versions of python or other dependencies. Written in C, depends on lzo2, sqlite3, openssl.

Main drawback compared to tools such as Restic is that it is server-based, in that a client can't back up to "dumb storage".

Compared to Borg and Restic, only file-level deduplication is performed. Compression is a bit weaker (but fast), so size is a bit bigger than Borg (but smaller than Restic).

Snebu has a smaller developer base. This should be easier to fix when the internal code structure documentation is finished.

Automated end-to-end tests aren't included in the repository. This is being addressed.
Skylight for iOS
https://apps.apple.com/us/app/skylight-sun-clock/id110775991...
But at least you can host the world wide tileset for $11/mo on linode! It’s not the data, but it’s still valuable and easy.
Show HN: Powerful Python Pattern Matching Library
This is causing outrage because it is US citizens who are killed without review, but I guess it is fine when the US is killing non-citizens, right?
my bank automatically sorts all of my expenses and I review them and update miss characterizations. It has done through a phone app, it is effectively zero work

I keep all large expenses small my rent has never been more than $800 a month. I do this by living with people.
Stanford University Supplementary Essays
> Once you start writing complex scripts you have a choice -- you either do it imperatively, or declaratively.

I don't think declarative programming exists. I think it's just a regular old program with a poorly defined interface. Moreover, I think the claims of idempotence are overblown to the point of near falsehood.

Declarative Infrastructure is really just Configuration Management applied to cloud infrastructure rather than operating system software. Neither have really solved anything, other than turning the management of complexity into a Sisyphean task. Forever pushing drifting state back up the hill.

Compare this to Immutable Infrastructure, where state never drifts. One never "fixes" a container once deployed, or a package once built and installed. One merely rolls back or upgrades. Any uncertainty is resolved in the build and test process, and in providing both all the dependencies and the execution environment.

I think eventually people will wise up to the fact that Terraform is just puppet for infrastructure. I think the real fix is to make the infrastructure less like an operating system and more like versioned packages. Install everything all at once. If anything changes, reinstall everything. Never allow state change.
Meanwhile the backwards state of Wisconsin has a special extra tax for hybrid vehicles, and then an even larger extra tax for electric vehicles [1]. The justification was that hybrids don't pay their "fair share" of fuel taxes - but it's not like I see the state government putting a huge tax on diesel fuel to tax the heavy trucks that actually are causing road wear. [2]

[1] https://wisconsindot.gov/Pages/dmv/vehicles/title-plates/fue...

[2] https://streets.mn/2016/07/07/chart-of-the-day-vehicle-weigh...
Developers of certain apps should run to Congressional antitrust committees. Some of them already have.
I think you’re right about the current state (not quite there, especially in raw $$s), but the potential is finally good enough that folks are investing seriously on the software side.

The folks at Framestore and many other shops already don’t do more than XX GiB per frame for their rendering. So for me, this comes down to “can we finally implement a good enough texture cache in optix/the community” which I understand Mark Leone is working on :).

The shader thing seems easy enough. I’m not worried about an OSL compiled output running worse than the C-side. Divergence is a real issue, but so many studios are now using just a handful of BSDFs with lots of textures to drive, that as long as you don’t force the shading to be “per object group” but instead “per shader, varying inputs is fine”, you’ll still get high utilization.

The 80 GiB parts will make it so that some shops could go fully in-core. I expect we’ll see that sooner than you’d think, just because people will start doing interactive work, never want to give it up, and then say “make that but better” for the finals.
Serious question -- at the point that it becomes precedential and can be done, effectively willy nilly, what difference does it make if the AG said it? This isn't as if the lawyer just said it in passing, and the lawyer knows full-well that this may become case law. If the DOJ starts using the precedent (which can be argued that they'd be arguing for such a thing), is that when we should be worried? It sounds very much like you're okay with the fact that a DOJ lawyer went in front of a judge and argued this because, "hey, what's the harm?".

Just because the judge thinks something is appalling doesn't necessarily mean that they won't rule in favor of the appalling statements/argument.
The loneliness of fighting cancer in a pandemic
> I need to open a very large CSV file in Python, which is around 25GB in .zip format. Any idea how to do this in a streaming way, i.e. stopping after reading the first few thousand rows?

Replace the `file_paths` list in my proof of concept with your large file(s), delete the rest (lines 61-68, 77-79) and it should just work.
Was it really sold to the taxpayers? Were taxpayers ever really asked whether they want it?
You're not wrong, but most of this wasn't known at the time his prize was awarded.
You think they don't? No working class backgrounds on HN?
> I'm really impressed you walk out of paid work because of the issue tracker your client uses.. It sounds a bit like they dodged a bigger bullet than you did tbh mate.

> I can't imagine how strongly you feel to turn down contractor rates due to a ticket system.. I mean, come on?

It may be the case that they are in such high demand they have practically free choice of work. That's how I interpreted it, at least.
I heard this narrative before. Three thoughts:

- People concentrate on the tool (technology) vs. goal (value)

Let say you need to handle a million users in the past (read: "provide value to million users"). It would be an unbelievably huge effort back in 1996, requiring _A LOT_ of logistics. For most companies, it would take years to reach out to these million users. And god forbid you to need to send out an update.

Fast track to 2021. One person can put the code in a docker, drop it in AWS Kubernetes, scale it up and be able to serve million users by the end of the day. (BTW. I am not saying that you don't need to do marketing/sales and so on, but purely engineering/distribution end up being way simpler).

Oh... BTW. All these people can use this new service on the go, because everybody has a computer in his pocket with access to the internet. And get update to it pretty much instantaniously.

I don't care that a new language has curly brackets or a new programming paradigm invented each year or once a decade. I care how much value could be created. And tools/languages/frameworks/infrastructure in 2021 provides a way to build way-way more value

- You don't need to improve a hammer that much

The first hammers date back ~3 millions year ago. There were relatively few improvements to it for a looong time. The idea is still the same (a heavy head and a long arm).

If the tool works well, you don't need to reinvent it that much. You invent other, more complex, and specialized tools.

- Ignoring real achievements

There were dozens of things mentioned here in this thread, which wasn't mentioned in OP (LLVM, Mobile, ML, and dozens and dozens of others).
I saw an intriguing comment yesterday on here about how the Extreme Ultra Violet Lithography machines that are producing our cutting edge processors are "the greatest achievement of science and technology on the planet"[1]. I can believe it. And it's fascinating how that affects geopolitics, much as other science and technology has in the past (the printing press, nuclear energy, etc)

I'm not OP, but why I think this Wikipedia article is relevant is because the more I actually learn about the world and history the more I begin to wonder whether in fact _mercenarism_ not technology is the defining trait of modern civilisation (and by extension I wonder about whether this is true for HN as a whole too). The great leaps were made by traders, rather than scientists, those willing to exploit and enslave rather than innovate and create. Of course they feed each other, think of the Marine Chronometer[2]. But if indeed mercenerism is the defining characteristic then it makes a lot more sense to think about societal collapse, because the fundamental design of the West, like many other civilisations, is based on logistical exploitation, which, unlike technological innovation, is fundamentally unsustainable.

And as a hacker, to me, such a design flaw cannot be patched away. Not that I advocate surrender, but rather, how do we, as hackers, minimise the impending destruction of a failing system? I wonder if one of the first steps is to stop wasting energy on any efforts based on the idea that we can fix this? Rather how can we, if it is even possible, gracefully manage the collapse?

1. https://news.ycombinator.com/item?id=25361028

2. https://en.wikipedia.org/wiki/Marine_chronometer
Oh, that is pretty much exactly what I was thinking of! Thanks for the link :)
How does that compare to xz?
One thing that I've realized is that sometimes starting on those little easy tasks and crossing them off builds momentum for the day and then you can tackle the long/unpleasant ones. It's like doing a warmup set, it will get you in your workplace and started on doing things.
Nice. One page I visit daily had a nice dark background, and a bright-white glaring input form next to the text-panel that can't be dismissed. Not any more. Thanks!
The Professionalization of Mental Health Services Is Ruining Friendship
Show HN: I made a Chrome extension to hide sensitive information on a web page
Make sure what you're using goes through an FDA certification process.
It exists and it's called Elm. it's not work backwards compatible, but it's a really solid language
We never stopped declaring war; declarations of war don't require particular magic words; the Afghanistan and Iraq AUMFs, for instance, were each valid conditional (and, in the former case, broadly open-ended) declarations of war.
It's as much a declared war as any since World War 2.
I've been proposing this kind of system to universities for years, but they are never going to change or improve, they are permanently crippled and unable to evolve.
How does developing a backup application differ from developing other projects?

What do you test differently? What do you avoid changing? How do you avoid breaking things? How do you get enough beta testers when the costs of failure are so extreme?
Good side effect of that is strong culture. It doesn't get diluted by diversity.

I can only imagine what it would have been like to travel to another country many decades ago before globalization and travel. Here is Tokyo 100 years ago: https://www.youtube.com/watch?v=MQAmZ_kR8S8

The simplest of things - a tunic or a shirt is commoditized by the entire globe. Everyone on the whole globe just wears a shirt/pants. Each nation had their own attire and it was just normal to wear skirts in Scotland and suits in England, and kimonos in Japan. This was erased by globalism and diversity. It may be that shirt/pant combo is actually superior attire due to some particular measurable quantity, but I suspect it was because of English imperialism.
NYC UFO sightings in 2020 are up 283% from 2018
What certification process?
Yes, clearly they awarded the prize not only before he did anything to earn it but before he did anything at all.

Hopefully they consider their decisions going forward, but that seems unlikely.
> the deliberate overthrow of middle east governments that created the power vaccuum filled by ISIL

I assume you mean in countries outside of Iraq? "Deliberate overthrow", citation please?

I remember a friend in 2003 saying Bush's Iraq misadventure is going to fuck up a lot of things in the middle east... I can't believe how right he turned out to be.

As far as I understand it the Arab Spring came about due to social unrest due to food shortage brought about by climate change (a 2010 forest fire in Russia burned a lot of grain, Russia stopped exporting them, food prices shot up: https://duckduckgo.com/?q=russia+forest+fires+grain+prices+a... ).

Incredibly that has also lead to a lot of war-fleeing refugees, and the rise of right-wing populism in Europe. Also Brexit and Trump?
This is my strategy as well. My best tactic is device selection. I'm rocking an iPhone SE (4" form factor). (Side note: Big kudos to Apple for fully supporting this phone - my first iPhone)

The small screen and keyboard discourage any extended use of my phone.
> Also, BLAKE3 is faster than MD5 and also far more secure, so if you're saying "It's okay I'm using MD5 because I want a faster hash and SHA-256 is too slow," there are options other than SHA-256.

True, but BLAKE3 isn't shipped as part of the standard library of many (any?) languages, whereas MD5 is. There are third-party implementations for a lot of languages, but using one of these brings up a lot of problems:

1. Are you sure the implementation doesn't have any bugs? AFAIK, the BLAKE3 team has only created C and Rust implementations, so anything else likely hasn't received the same level of care.

2. How are you going to notified of bugs or vulnerabilities in the implementation? For your language's standard library, it's usually easy to get notified of any bugs or vulnerabilities, but you're probably not going to get that from some random implementation on Github.

3. Pulling in the dependency can be an attack vector in itself. For example, if you use the Javascript implementation on NPM, you're now going to have worry about the NPM author having their account compromised and the package replaced with malicious code.
Hey, can that be made circular? The state killing someone randomly without any cause or reason will necessarily have to be a state secret so ... state secret is always involved!
That's a pretty sound technical argument, sadly.

My understanding is that Idlib is mostly where the Russian and Syrian Air Forces were bombing the Turkish-backed jihadis. I wonder if the Turkish Air Force (largely equipped with US ordnance on US-made F-16s) was flying sorties in the region as well?
Year's End
That's not the average cost per person; it's simply the total amount of health care spending, in all categories, in the US divided by its population.
Not to add the amazing iOS setup experience. It was surprising to say the least.

Edit: been using it for 5-6 years now. Got three 3yr plan. It has been awesome and I can configure my own deliverability settings or leave it up to fastmail. I have it so that other services will send me failure reports but I haven't had issues at all.
I'm late - but yep, totally agreed personally. I can always add clothing and largely stay indoors.

In the heat I can't remove clothing, and even if I largely stay indoors even a 15 minute outdoor walk will require changing and showering.

That said, I can also walk the dog in 0C weather without winter clothing on and feel completely comfortable so we may be outliers :)
"Immigration as a solution for fertility" is rooted in the assumption that the developing world stays forever poor and keeps producing surplus fresh meat for you to attract and assimilate, which is some combination of offensive, racist, and also deeply incorrect.
Even the states of the ternary computation seem to be up for grabs [1]. My first feeling was that the balanced ternary states would be nice, but as you start building trytes (i.e numbers) the representation doesn't seem great.

I couldn't find anything after a very quick search, but if not already done, I want to start referring a ternary bit as a 'tit'!

[1] https://en.wikipedia.org/wiki/Ternary_computer#Types_of_stat...
> "Deliberate overthrow", citation please?

Libya.

Or as the BBC referred to it, "the worst mistake of Obama's presidency".

It's already largely a settled question that US State Dept policy and actions during that administration massively contributed to the formation of ISIL.

The difference between the Bush and Obama administrations in the middle east is stark. Despite destabilizing Iraq, the US military stayed on the ground and at least attempted to create a stable transition of power (and over time largely succeeded, at least by comparison).

Obama's destabilizing actions were followed up by abandonment and power vaccuums filled up by extremists that we armed. This is no-brainer kind of shit that we stumbled our way into, Homer Simpson style.

His foreign policy disasters weren't limited to the Middle East either, considering our lack of intervention and abandonment of our southeast asian strategic allies during the Scarborough Shoal incident.
thanks for the link, you weren't alone
> one would think that a formal declaration of war would be needed

The legal existence of a war has established rules in US law, and a Congressional declaration is one way they happen (though not exclusive what you probably mean by a “formal declaration of war”, which suggests magic words).

> otherwise anybody can be killed just under umbrella of "War on Terror" or "War on Drugs" or "War on Littering and Jaywalking"...

The War on Terror has a legal declaration, which is expressly conditioned only on Presidential determinations, so requiring declarations doesn't actually meaningfully prevent that scenario when Congress is feeling lazy.
Should not developers then be expected to generate a certain return for Apple in terms of sales, or risk being removed from the store?
A compelling critique that Go's embodiment of the "Worse is better" philosophy from Unix is to its detriment.
The time consuming aspects of new product dev are normally not around the time it takes to write the code. It's translating product requirements into solvable problems, logic flows that solve those problems, bumping into unseen edge cases in the product concept, and coming to consensus about what compromises are acceptable in the prototype, bumping into sharp edges while you flesh solutions out because you didn't anticipate a thing when you started your base design or didn't understand the relationships between objects and functionality when you kicked the project off.

These problems that take the most time in any project are mostly human, conceptual, product, and communication problems. Not code problems.

Once you have sorted out all of these problems and solved them, a rewrite in a different language with a better design moves very quickly. You don't have to double the runway or the time to MVP. Time estimations are always wrong anyway. But in my experience when I've gotten buy-in for this approach I would guess it adds 25-30% of actual time overhead to a roadmap. Prototypes always take longer than expected, and an immediate redesign/rewrite takes less time than expected.

Selling this approach to leadership really boils down to clearly identifying the value of developer time. It's not code; it's solving business problems. Once those are conceptually identified and solved, the design and code tend to fall into place without a ton of trouble. The problem is that no one really knows what the business problems are until you try to solve them and really dig into the details.

Prototypes should be understood as the process of defining the problem space and uncovering all the hidden issues that people haven't really thought through just yet. MVPs should be an actual product based on that exploration and problem definition and solving. What I'm suggesting here is really just a process boundary that reflects the difference between the two things.

"Can runway handle that?" is really a lot like asking if you can afford to build a product at all.
The difference of course being that trump was actively trying to fuck over millions and this user was just pointing it out. God right wing people are pathetic.
TIL alcoholic ice cream is a thing.
I always feel like we’re a vampire society that figures out how to make human-like blood without having to take it from humans.

Will need to look into these textured vegetable protein for the sake of the animals.
Handtrack.js: A library for prototyping realtime hand detection in the browser