skysight-inc/HackerNews huggingface dataset:
What’s your experience like at other storage outfits?

I only ask because your post is a bit like singing praises for Cinnabon that they make their own dough.

The things that you mentioned are standard storage company activities.

Checksum-all-the-things is a basic feature of a lot of file systems. If you can already set up your home computer to detect bitrot and alert you, you can bet big storage vendors do it.

Keeping track of hard drive failure rates by vendor is normal. Storage companies publicly publish their own reports. The tiny 6-person IT operation I was in had a spreadsheet. Hell, I toured a friend’s friend’s major data center last year and he managed to find time to talk hard drive vendors. Now you. I get it — y’all make spreadsheets.

There are a lot of smart people working on storage outside AWS and long before AWS existed.
Trying to decide whether in Newspeak* the brand would be "Ministry of Demand" or "Ministry of Scarcity".

Given that their work travel guide and versatile "capsule" complete with backpack is great:

https://www.ministryofsupply.com/about/travel-light-guide

Let's go with "Ministry of Demand".

* Actually, it was named after another Ministry of Supply of the same era as the inspirations for 1984's ministries. But, not really doublethink, more about material technologies: https://en.wikipedia.org/wiki/Ministry_of_Supply_(clothing)
more and more programming. still not great. just good-ish.
There might be no reasoning in a single pass which outputs a single token. But in the loop where the output of the LLM repeatedly gets fed back into its input, reasoning is clearly happening:

The LLMs lay out how to go about figuring out the answer, do a series of calculation steps and then come up with an answer.

If you add "Please answer in just one short sentence." to the prompt, even the top ones get it wrong.
These are the esoteric and technical arguments that scare me into still using a swapfile and which maybe answer why I see my swap space being used when I have like 60 GB of RAM free (neither of which make any sense otherwise). :p
"Please note that this leak only occurs with iCloud Private Relay on iOS 15"

All software has bugs. I think it is more interesting to see how companies respond to reported issues. And how they improve things.

Is OpenSSL "theatre" because it had (bad!) bugs in the past?
Yes many years ago. The only annoyance I have is GMaps not remembering recent places. So you have to type in an address every time. Still outweighs being tracked all the time.
This is my perspective as well. Be able to apply, or write an appropriate tool for a job, and recognize a given tool's suitability for a task. This means, you don't identify yourself as a "python programmer", "react programmer" etc, but are able to evaluate a range of tools. And, understand how the tools work, and know how to build one. This likely will involve some low-level (think register-level) code. Or for web stuff, being comfortable with network architecture and web standards.

Another way of phrasing it: Being a general, cross-domain programmer, vice a provincial one. Being able to recognize when a best-practice or dogma in a given domain isn't applicable, because you are familiar with multiple sets of these practices, and therefor recognize their mutual inconsistency.
I just manually look at it in the inspector's network tab. The "template" is already loaded and you can see how big the JSON is and optimize that if necessary. You can also turn on redraw debugging with the React debugger if necessary, but that's not usually a bottleneck.

The fresh page load is usually the worst case scenario, so inter page navigation once the framework is already cached is generally much faster. Combined with preloading of the JSONs on hover, it can be nearly instantaneous for the user.
People seem to think I'm arguing for "free markets" because I'm arguing against rent controls. I'm not. In fact, quite the opposite. I'm just recognizing that people respond to incentives, and we need the incentives to be aimed at lowering housing costs and not just "protecting" incumbents.

The problem of unaffordable housing is solved by creating and incentivizing an artificial oversupply of housing.

There are many ways to do this. Vienna, for example, did this with public housing. Econ nerds will argue for a land value tax. Houston, Texas, does it in the worst way possible... by creating an unsustainable sprawling mess that will collapse in exactly the way that Strong Towns predicts.

>how can "free market" supply increases lower housing costs?

Ultimately, if we eliminate the political/regulatory constraints for the sake of argument, the cost of housing is just the marginal cost of building the next unit of housing. There isn't any way around that, so if you want to live in Manhattan, say where high rises exists, the marginal cost of housing will be more expensive than, say, a tiny house in woods somewhere.

If that marginal cost of housing becomes unaffordable, even for the government, then we have a real economic problem that needs to be solved apart from housing. We are dealing with that in California, as simply the cost to actually build something is has become so inflated, that it is unaffordable for the city to even build public housing.

How we can get people to create an oversupply of housing in a private market, we could do in various ways. Property taxes is the easiest: land value taxes, or say, high property taxes with a large discount for each resident that lives in the taxable area. Ultimately, in this view, housing should be a cost... not an investment. Because under the rubric I put forward, there is no reason housing should appreciate in price in real terms far beyond the marginal cost of the housing itself.

While there are ways to do this practically, the problem is that they tend to be politically unpopular for the reasons I listed earlier... people don't actually like change, or density, and will often vote against it whenever they can. Dealing with this is a political problem... one that requires having difficult conversations with both capitalists and socialists about what we actually want, and whether we want affordable housing, or whether we want a "kind of place" to live in, because we usually can't do both in the most desirable areas to live.

It's a tough problem, and it's one I've thought deeply about for decades as I've unfortunately grown up in, and live in since, high-demand areas with increasingly unattainable housing situations, and I've heard all the argument, and think most people are not typically concerned about creating sustainable solution over quick-fixes.
You didn't understood anything it seems. I'm not suggesting, I'm telling you how this will end.

Don't you think that we are extremely tired of seeing French vandals --again-- assaulting and destroying Spanish fruit trucks while the gendarmerie just watch the cargo burn?. This people is attacking legal EU companies and the French police act as necessary accomplices that allow it. French government couldn't care less; they even do jokes on TV about it. Is the same stupid stunt since 70's, each time they need a scapegoat to divert the attention.

Do you think that this will increase the appetite of Spaniards for French products in the near future?. I seriously doubt it. Each action triggers a reaction

Second. Quality controls on EU is not a new thing. A lot of people works detecting and stopping dangerous products since decades. Thousands of this products are silently stopped and removed each year so, why do you think that this is suddenly breaking news? Have you heard about the recent scandal of Spanish strawberry farmers stealing water and sucking dry the Doñana National park?
Defending a criminal is a completely separate thing to abetting a perjury.
Well, I know what my first PR would be to this repo: it's missing the ScriptEngine plumbing <https://docs.oracle.com/en/java/javase/11/docs/api/java.scri...>, which I think is a prerequisite for use in any sane JVM setup

One will also want to watch out for the "yes, but" in their parser around reserved words: https://github.com/TopchetoEU/jscript/blob/v0.9.6-beta/src/j... I'm not an ES[0-9] ninja enough to know what the practical implication is of those decisions, but nor do I think hiding them in some comments down in the Parser is the correct way to advise folks of that choice
DBeaver – open-source database client
Don't confuse "didn't lose a defamation lawsuit" with "didn't get it wrong".
Yes. I don't trust Google.

(Is the setting meaningfully respected? Who knows.)

I might like this feature if there were a way I could have true sovereignty over the data (ie. stored locally in a manner they cannot hoover back up with an app update, and which is captured by my own backup infrastructure).
I can’t tell if this is genuine or sarcasm. Well done.
The Only Force Stronger Than Polarization? Rising Home Prices
I did try a version with the text outside of the bars but struggled to make it work in a way I was happy with.

Do you have any other feedback? What is it specifically about the UX that you find clumsy? I'm still quite new to this sort of thing and do want to improve.
No.
"They need to eat" is a bullshit excuse.
Everything is justifiable by "they need to eat".
Even in the 64gb case you're still losing out since the OS will use free memory as file cache.

No swap just means you think everything ever allocated should always stay in ram. In pretty much every system there's going to be a few GB that were allocated but never really needed. I'd rather that not be true but since it is I'd like that stuff paged out to give the os more file cache.
Why? I mean, if crappy code is so crappy that even LLMs cannot fix, then I imagine it will pay well. I'm in!
Depending upon how big (how essential or important) the hit target was, and how much damage the attack caused, both monetarily and how many people were severely effected (adversely). It could very well be handled by an intense military action from one or more branches of our armed forces. But being on the world stage, certain rules apply; these 'rules vary with the political climate at the time. Currently in the allied portion of the world, typical opinions tend to go with what they see; most of the time this will translate to an opinion of "Little was actually harmed...". No matter what the ACTUAL cost to repair the target is estimated to be. So you can bet that the pre-prepared (if you will) 'set response' is to task our cloak and dagger cyber-spook types to construct a cyber-weapon designed to hit one of their weak points and then return fire with a cyber-shot that will do the same to (if not worse) at whomever we determined was the guilty state, sponsoring (or hosting the group guilty of the attack activity(ies), if we couldn't get an equal or better result in damage scores, other responses would be considered as either an alternative to, or else in addition to the cyber attack response.
Use cells from prego-juice to make lil guts
These are more practical tutorials, but very much a "bottom up" style of learning: https://github.com/practical-tutorials/project-based-learnin...

Not listed there but I also found Ben Eater's 8 bit computer a fantastic learning tool.
Doesn't a professor committing academic fraud constitute exceptional circumstances?

If an advisor at the university is doing misconduct, the grad student should consult a lawyer.

The lawyer doesn't yet have to be facing the university, but you need advice.

All the anecdata I've heard is that elements of the university will be adversarial and underhanded in response to legitimate and constructive raising of something that elements would rather be buried.

The sketchy people will want to make the student go away, ideally an international student who can be sent back to their country, or otherwise neutralized. It's harder to come back from that. Having a lawyer from the start helps avoid being neutralized.

Some universities might be more or less sociopathic than others, and a rare school might be genuinely warm and fuzzy and benevolent in every aspect. But I strongly recommend starting by assuming that, for some elements of the university, it's much like a big for-profit corporation in behavior, only one accustomed to better PR and less accountability.

(I have a fondness for university ideals, and there are particular ones, and especially particular professors, who I respect highly. But there's realistic advice some people really need to hear, if they don't want to throw away brilliant careers in which they've invested their lives thus far.)
HTML version for mobile users: https://arxiv.org/html/2403.01010v1

last 2:

- "50% of marriages end with divorce. The other 50% end with death."

- "If a man tries to fail and succeeds, which did he do?"
I think it might be this. Funnily running powercfg –energy in cmd reported

> S1 Sleep Supported false
S2 Sleep Supported false
S3 Sleep Supported false
S4 Sleep Supported true

Which... seems quite wrong given I can put my laptop to sleep lol. But thanks for the pointer, even though I was aware LTT did the video on sleep it'd fallen out of my memory (pun not intended).

Edit: I think I partially solved it. Running powercfg /a reveals...

The following sleep states are available on this system:
Standby (S0 Low Power Idle) Network Connected
Hibernate
Fast Startup

The following sleep states are not available on this system:
Standby (S1)
The system firmware does not support this standby state.
This standby state is disabled when S0 low power idle is supported.

Standby (S2)
The system firmware does not support this standby state.
This standby state is disabled when S0 low power idle is supported.

Standby (S3)
The system firmware does not support this standby state.
This standby state is disabled when S0 low power idle is supported.

Hybrid Sleep
Standby (S3) is not available.
The hypervisor does not support this standby state.

(I have hyper V enabled.) So it does look like S0 sleep is the culprit.
The optics are price being more reflective of supply and demand. Doesn’t more accurate pricing ensure more optimal allocation of resources? I don’t see why that would be a bad thing.
Are you sure "virtual address space" is the right terminology for what you're meaning?
Underneath the software, there’s still a filesystem with files.

If you stand up an S3 instance with Ceph, you still have a filesystem on spinning rust or fancy SSDs. There’s just a bunch of stuff on top of that. It’s cool, but to say that there’s no filesystem is simply what the customer or middle person sees, not what is actually happening.
Yikes... it seems like you've built aristocracy into the system. I would hate to be someone accidentally not born in Stockholm.
You can solve (b) by hiring people to do this for you.
How investors get risk wrong – more volatile stocks do not outperform
> SSD space is dirt cheap (unless you get it from Apple), I'm not losing any sleep over losing a few gigs to a swap file to keep that from ever happening.

I don't lose sleep over space on my SSD either, but I don't want thrashing either. As a user I get no real feedback on the memory usage of my applications until everything gets slow. Fortunately it's easy to configure Firefox to unload idle tabs, but it might be better if -at least for GUI apps- I could confidently configure no swap.
How do you expect to have a curious conversation when you phrase questions that way? If that's not what you're after on this topic, fair enough! I don't like that people are trying to hash this out on HN either. But that's the rule for this place.
I have to drift to sleep to https://youtu.be/9L3M2WC5LPA at maximum volume to drown out the haunting images. D:
This ^. It's impossible to knowingly delete all the data. I wouldn't expect an ad company to delete valuable data so I'd expect they just hide it from you.
Dear Tim, It's time to get lost in the music
Winter is standard time, so that's your "normal" time with short days, and most people are awake for all sunlight hours — so moving it around doesn't do much.

Summer, you take an hour of sunlight from the early morning (somewhere between ~3-7am, depending on time of year and your latitude), and "move" it to the evening where nearly everyone can enjoy it.

What your describing with the blanket analogy is exactly what people are proposing with permanent DST in the winter. It will be dark through late morning. The USA tried that once in the 70s for a year, then abandoned it when everyone who initially supported it realized they actually hated it.
Excited to see what’s to come, I find that chaining a few scripts with a few prompts can create some pretty cool functionality.
I don't think that's gonna happen... unless I don't keep learning. Let me explain:

I started my career over a decade ago. I knew PHP and MySQL only. Then I moved onto other companies, learnt other stacks (frontend, node, postgres, cloud, go, python, datadog, ci/cd, docker, k8s, aws, etc.). Nowadays it's not hard for me to find a new job. But what would have happened if I stayed with PHP and MySQL and never learnt anything else? I would be jobless.

So, I'm not afraid of LLMs replacing me. I think they will open the door to more jobs in IT, actually.

I just need to keep learning (and AI has nothing to do with this).
Same boat. But hey, last year I had to get a 30GB dataset into memory so you never know... Though now I'm smart enough to optimize better.
I don’t remember if the system default was changed but the default for all databases created by Apple apps was switched to WAL mode in the iOS 4 timeframe.

The infinitely growing WAL problem is a real problem though. Often that is caused by devs accidentally leaking or abandoning a never closed read transaction. I think there’s a new wal2 mode in development to address that issue. Obviously the best solution for now is to not have such long lived readers in the first place.
Now replace “PE” with “CEO” and you have the same dynamic, which is what the previous post was trying to point out.

The question is about who has an ethical duty to the public and how to hold them accountable as such. I’m not sure why it applies only to one group when there’s a reasonable precedent that engineers also have an ethical duty to the public.
British English? American? Or maybe Indian?
You're assuming that because they're naked women that their purpose must be sexual.
>By the way, LWTN was not once found to have wrong reporting on any of their subjects.

There is no law for "wrong reporting". LWTN has not lost a defamation suit, which is very narrow.

"Wrong reporting" is a much broader ethical category of lying by omission to create a narrative or choosing unreliable sources. Think of things like NYTimes and the Iraq War. Or basically any article of the format "x% of some group wants Y evil thing".
I disagree. Nano vs mili vs micro is not in the least intuitive compared to seeing how much longer something is.

That’s why we have graphs and charts in the first place.
Can we please stopping the cringe-meme of blaming MBAs? I assure you, engineers are just as prone to fall for greed and being unethical and sycophantic as MBAs, doctors, journalists or software engineers.
The S3 checksum feature applies to the objects, so that’s entirely orthogonal to erasure codes. Unless you know something I don’t and SHA256 has commutative properties. You’d still need to compute the object hash independent of any blocks.

Source: https://docs.aws.amazon.com/AmazonS3/latest/userguide/checki...
I replied with the following, because I think this article is (unsurprisingly) extremely one-sided. Google's impact (damage imo) on the big picture browser and standards landscape cannot be ignored.

"Funny how you don't mention your former employer Google at all as the biggest ad/spyware/surveillance browser company in the world.

Google has used its giant browser market share to push standards that only benefit them, to drive more people to its services, to lock in users to Chrome. Google has used every opportunity as THE search engine monopolist to steal users away from other browsers with many dirty tricks.

I think that is a good reason to build your own browser? "

https://mastodon.social/@st3fan/112072401334707481
I think that’s part of the issue. For example, if you require engineers to have licenses and stamp designs, this gives engineers more leverage for pay. This extends to software engineering as well.
From a submission standpoint, as I write this, FDA seemingly cares more about cybersecurity than your medical device actually demonstrating safety and efficacy within intended use. The time that review teams have to review any given device has stayed the same, but fear-driven, heavy-handed cybersecurity regulations (which must be followed) have been added to the mix.
Disclaimer up front: I somewhat agree with the performance sentiment towards databases, however I feel that index performance is a different thing, because it gives you a larger budget for features further up the chain that make a meaningful non-performance difference for users, e.g. dynamic skew estimation and adaptation saving you from manual performance tuning.
To make an additional performance point about my use-case, the work I linked is not competing with on-disk databases but with in-memory datastructures like nested hash-maps and I would argue the points from the article that you linked in that scenario, but with the scales adjusted appropriately (think ns and us instead of us and ms).

To answer the question, prolly trees have a deterministic structure based on the chunking properties of their hash function. So their deterministic structure is a result of using a hash to identify nodes, and only implicitly defined over the contained keys (by rolling the hash over the leafs).

Tries on the other hand, by virtue of being prefix trees, have a structure that is deterministic and directly based on the keys that they contain. This also allows you to compute a hash for each node (determined by they key range it represents) but because hashing is now orthogonal to the structure, you can choose tradeoffs more flexibly.

You can for example use an incremental hash function [1], which in my case is SipHash for the leaves and xor as a combiner (Note the importance of using a keyed hash function like SipHash when XOR is used as a combiner, see the XHASH attack in [1].)
So whenever a child is updated the new node hash can be maintained as `node.hash = (node.hash xor old_child.hash) xor new_child.hash)`.

The original Nom author actually considered PATRICA Tries and HAMTs, but dismissed unhashed prefix-tries due to bad performance. I didn't run into this yet in my use-case however, and I suspect that the overhead of string interning, indirection vs direct pointers, and more expensive hash-functions, will always outweigh in the in-memory case.

I'm still very interested in using prolly trees in the on-disk case, hence my question about latency :D

1: https://cseweb.ucsd.edu//~Mihir/papers/inchash.pdf

2: https://github.com/attic-labs/noms/blob/master/doc/intro.md#...

BTW can you point me to where the "unicit" term originates from? a quick google search only ever shows it used in your writings :D
Imitation is the truest form of flattery...

For this product: what's up with that 4GB RAM in such a small / cheap SBC that's rather sparse in connectivity & storage options?

For deeply embedded uses, uC board like RPi Pico seems more appropiate. Or go wild & do similar things with GPU-included, 256/512MB boards like RPi Zero.

For a tiny desktop machine: sure, but if you need an add-on connector board to be useful, wouldn't a compute module + carrier board be more appropiate? Or a slightly bigger board with more connectors?

Maybe this is targeted at specific application(s) that need gobs of RAM but not much else?

Or is 4GB RAM that cheap these days that manufacturer included it anyway?
If that's what it was going to be, that's what they'd call it.

We've entered a new era. Dune costs more to see at the theater near me than other movies. The default movies are not discounted. Dune just has an extra fee for being popular.