skysight-inc/HackerNews huggingface dataset:
What about LSM trees? Something like RocksDB is very efficient at deleting. A delete operation is a tiny write (a tombstone) and then the actual deletion is done via compaction in the background with entire tablets being freed at once when the live data is evacuated. It's actually most efficient when deleting large ranges - when just replacing data it's not so efficient due to the write amplification.

That said, I agree with you in general. An under-used technique is to simply encrypt everything and then use a key store that is guaranteed capable of deleting data. This makes it easy to comply with legal deletion requests even across backups, though of course, you need to manage the keys very carefully and ensure that they are also backed up.
Ah so it's like Hasura, it's a BaaS platform. Unfortunately I don't like putting all my logic in the client only.
Cool, that's the value of languages with macros: adding useful features which help combat needless infrastructure code (AKA boilerplate).
Yotta claimed to be functionally equivalent to having a normal interest-bearing account with an excellent interest rate, and using a small portion of the interest to buy some lottery tickets. Buying lottery tickets might be dumb, perhaps even shameful (although I disagree as long as it’s not to excess), but it by no means implies that you deserve to lose your savings.
Wake me up when s3 supports wrie at offset. Until then it’s all gimmicky. Writing small objects and retrieving them later is very inefficient and costly for large data volumes. One can do roll ups, sure, but with roll ups there’s no longer a way to search through the single rolled up file. One needs some compute to download the complete file and process it outside of s3.
You can use React with or without SPAs. Not saying you didn't know that. Just pointing out they're separable.
Do you have experience working in big software companies or not ? Is this advice also valid for those refusing to work in big software companies or not ?

(Or is this about monopolies using underhanded tactics to try to shut down high profile projects of their smaller competitors ?)
Your restrictions sound quite challenging, good luck!

Last year I solved all the problems in C without external libraries [1] and I enjoyed it a lot. It forced me implement some low-level stuff that I had forgotten how to do (e.g. a heap) and to write some numerical routines myself (easier than you'd think!).

[1] https://github.com/sebastianotronto/aoc/tree/master/2023
Building 10x Better
This is why systems such as WarpStream regularly runs compaction jobs to more efficiently store objects and cut down on API calls.
Steam Deck hits 17,000 games playable and verified
Giving open-source contributors equity
Hi all,

I'm a startup founder working on developer tools for robotics. I'm still working out my business model, but my plan is to open source the core of the product and offer some SaaS addons and integration services to make a profit. I've been thinking about how to build an open-source community, and one idea I had was to give equity to contributors.

I could put out "bounties" worth a number of points for bug fixes or features. Each bounty is worth a number of points. All of the total points would convert to 5-10% of the company in an exit event, or once the company raises a certain size round. Employees/founders/investors would be exempt from earning points.

I see ways that this system could be abused (such as assigning a 1,000,000 point bounty to someone I want to give equity to right at the end) and I'm not sure how to write this in a way that contributors are guaranteed to get a fair share. What ever I do, I'll have some form of TOS written up by a lawyer.

What do you think? Would this make you more likely to contribute to an open-source project? Does this sound like a turn-off to future investors? Have any existing projects implemented something like this?
"Depression is more of an "it is hopeless" take which is not logically sound - even if life is meaningless the sensible thing to do is leave a peaceful & cheerful existence as best can be managed."

It is usually more concrete in the sense of "it is hopeless, that I get into a state of happiness again". Which might or might not be correct. So calling depression not logical .. is a potential tough thing to say.
You can use wayback_machine_downloader to automate downloading the archived pages https://github.com/hartator/wayback-machine-downloader/
Given how prevalent Asthma is among the western population, this is exceptional news. (1-in-10 to 1-in-5, according to the CDC).

Is anyone better versed on the causes, though? Prevention is better than cure after all- and much better than just treatment.

I’m curious if something in our environment is causing this, because you would presume that natural selection would have run its course on us, as without treatment I would certainly not have made it into adulthood.
What are the states? I didn't say give me a count of the states. I said give me the algorithm for determining whether any given state of the universe corresponds to whatever human you are reducing to a Markov chain. I don't care if it's practical or not because it seems like you're convinced this algorithm exists even though you have never actually gone through the trouble of actually formalizing it. So I'm doing you a favor, you will either learn about your ignorance or you will make your argument algorithmically formal and actually prove that people are equivalent to Markov chains.
Feels like there should be ways to mitigate this, like having a waiting list and booting users for inactivity after a certain amount of time. That way the community stays active but doesn't get flooded.
That's like saying you don't want to go for a run, because professional marathon runners are so focused on time
It's a wrong argument. "what was coming to them" was not winning but still keeping their money. Gambling is different because you risk losing what you put in.
His ideas provide a useful filter with words personal qualities, and the moderation of virtues in Nichomchean Ethics pretty much describes what it means when we say someone is 'honest.' it's a foundational read, along with the stoics.

the provocative aspect of Aristotle today is that for people who see themselves as not on the level of citizens and who reject being compared by the virtues he (and later, aquinas) articulated, the judgment implies they are somehow moral or spiritual fugitives from it. if I'm not patient, friendly, magnanimous, courageous, charitable, ambitious, truthful, etc, am I really an inferior or less worthy person? according to who? in that sense, the current concept of intersectionality is a kind of secular re-blessing of people marginalized by those values so as to organize them into a movement to dismantle this dominion of judgment by ancient virtues. viewed this way, Aristotle's values and how they support a conceptual moral "kingdom of god" are this movements shared enemy. I get that normal people want to see these things as just human progress vs. quaint old ideas, and not view the value of Aristotle today through the lens of eschatology, but if one did, it illuminates some aspects that should raise at least some eyebrows.
I wonder if there is a write guarantee, i.e. can we be certain the function only returns when the entry has been written to durable storage?

Or is it best effort?
The difference isn't that much (around 10% IIRC), but gigabit internet service needs a 2.5 GbE connection to your router if you want the full speed that it's capable of.
No, of course it is not from cold storage; instead the produce is flying around the world so that you can have them whenever you want.

Cold storage, jets, and long-haul trucking are particularly bad for some types of produce, not so bad for others.

Anyway, I’m not fighting the modern world, I like having tomatoes in January. But this article and discussion is about how you can have good apples, or you can have year-round apples at scale, but you can’t have both. And a lot of that comes down to the supermarket training consumers to expect the same produce every week.
I also don't like it, last year we had a private leaderboard at work and I realized being crazy enough to wake up at 5:50 every and solve at least part 1 would give me an edge. But the "wake up at 5:50" part is what I enjoyed the least.

However, there are other ways to rank yourself against others. You can order your private leaderboard by number of stars, or make your own leaderboard using their APIs.
I'm Canadian. So who's we? And yes the point is that there is a debate. Constantly bringing up the American boogeyman in online debates implies that there isn't any actual debate in Canada, and that's it's only controversial outside of the country
Random reads and sequential writes are enough to build a log-structured database, but S3 does not really support the latter.
It’s actually surprisingly efficient if you batch writes at the expense of some added latency. The WarSyream team found that batching into chunks of either 4MB of data or 250ms was optimal.

Downside is the 250ms latency. But then again, a fair amount of workloads can deal with 250ms of latency.
It is terrible for me on my desktop too :(
I find Ada/SPARK2014 much easier to learn than Rust, and given its legacy, Ada programmers are of a higher quality for the high-integrity market than Rust at the moment. The fandom of Rust is a positive and attracts a lot of early adopters, but it still does not approach the portfolio of high-integrity software out there in Ada/SPARK2014.
The theory of Markov chains (or Markov processes in general) has nothing to say about what happens inside the function that maps observations to predictions of the next state, as long as the function is stateless/memoryless.

It is a different level of analysis than neural network architecture and covers a very wide types of models. The Markov chain structure of a model allows for some kinds of understanding of behavior of the models fulfilling its assumptions, e.g. finite range of dependencies, existence of a stationary distribution and crucially for transformer-type architectures that they can be trained in a purely parallel manner.
Yeah plugged into my switch. The back bone of my home network is 10G and will be unaffected by the router's limitations even when I get a 100G switch.

It's disappointing the 1G link will only limit the potential downloads of my internet activity if it ever jumps from 110Mbps to over 1Gbps.
I would guess something like Apache Iceberg would be something close to this?
https://iceberg.apache.org/

Is a table format which can be use via trino, spark, flink, java apis, pything API?
Because we can assume that these problems necessarily cannot be in the training set of any current LLM (and are hard enough, i.e. they should be more than mere variations on existing problems), I'm wondering if they can be a good benchmark to get a better sense of how good they really are at problem solving?
Well, with "all tech people" i actually meant ">everyone working in tech (or like the HN community<", and i was serious about that: I havent met one person in the business on the tech side who didnt profit from it?

Hm, because of which wording do you imply "general availability"? Interesting take! :)
Yes, they are asking for it. But ignoring the context around it is extremely disingenuous. When you request to die because of lack of adequate care (due to our shitty health system), it is very different than requesting it because of incurable, unbearable pain. You are also ignoring the incentives that it cause, and already handwaived the cases where it was shown that staff was suggesting MAID when it shouldn't have.
GL.iNet is based in Hong Kong, which is Chinese.
Thanks to “goofys”, I am able to map an existing directory to S3 buckets, so I am never locked into AWS.

(The goofys is faster than s3fs because it’s not totally POSIX compliant.)

I am a big fan of setting up a full stack on a COMMODITY SERVER and it just working. You can outsource your video transcoding and storage to vimeo, AWS etc. but you don’t have to! You can use your own hard drive in your home to run a social network for instance.
You have it exactly backwards. Since React does all the DOM updates automatically, my massive project, with 100s of thousands of TypeScript LOC, has zero DOM calls in it. lol.
We are building tonbo: https://github.com/tonbo-io/tonbo , An embedded KV database allows to use S3 as storage backend, and we are trying to implement SQLite virtual table on it: https://github.com/tonbo-io/sqlite-tonbo a real pay-as-you-go DB.
> The platform uses Hibernate - for this, you need to create your entity class, a mapping class and a SQL script, and these things have to be somehow in line to each another to make it work; before LLM, you had to type those files.

Do you really need an LLM for that? Sure LLMs can do that but they're overkill, no?

My internship and first proper job (2011-2012) was at a consulting firm that used Hibernate. They managed to auto-generate all these things with an Excel macro. I'm willing to bet some JetBrains plugin can do that too without LLMs.
I just copy and paste into a local text file, but I bet there’s a tool if you want to do it programmatically already (unless curl’ing is your idea of fun!)
Recent Linux Improvements That Impact TCP Throughput [pdf]
When I started at Google it has a very Montessori-like atmosphere. Really brilliant people there who were given a lot of autonomy to go and figure things out.

By the time I left, almost nine years later, the culture was dominated by fear and conflicting top-down directives — and the autonomy was gone.
(author here)

Currently, there is durability guarantee. The call returns only after successful write to S3. This is close to fsync in a single node system. I plan to add a relaxed write mode

I am tracking the issue here: https://github.com/avinassh/s3-log/issues/4
For fun? To prove that it is possible? As a learning activity?

There are millions of reasons to write software other than "faster" or "more features".

I can imagine this being convenient (albeit risky) when migrating Windows to Linux if you really can't afford a spare disk to backup all your data.
Ask HN: Successful one-person online businesses?
This question was asked 3 years ago (https://news.ycombinator.com/item?id=7367243) by me, and I'm curious what it looks nowadays. How many people on hacker news are running successful online businesses on their own? What is your business and how did you get started?
> Defining successful as a profitable business which provides the majority of the owners income.
(2013)

Direct link https://www.amazon.com/b?node=23977790011 and https://www.amazon.com/b?node=23973089011
I’m not sure that 1) is such a win for MLS here.

If I lose my phone, I want to get all my security footage back by entering my passphrase etc on my new phone.

In other words, I want the “encrypted cloud storage” security model from [1], not the encrypted messaging security model from Signal etc.

[1] https://eprint.iacr.org/2024/989
Does the current GenAI path lead to AGI?
I struggle with this question. It’s rationally hard to see a token predicting machine (no matter how good) lead to reasoning and understanding of our world. Surely feels like a different approach is needed which may not extrapolate from the current rapid success of Transformer based GenAI approaches.

Would love to hear thoughts from the HN community.
Not just passing knowledge but having disparate regimes mutually value that same knowledge. Quite a shift happened between the times when the Romans would kill an Archimedes to what we’ve seen very recently in WWII where scientists would be spared even from the legal system due to the perceived value of their technical knowledge by the victors.
(author here)

definitely!

I plan to add a batch write API. Also, an API where it buffers till it reaches certain size or a timeout to write to S3

tracking the batch write here: https://github.com/avinassh/s3-log/issues/3
It's absolutely true that we don't think about it much. When I was first taught balanced binary trees, deletion wasn't even a topic that needed to be learned. Same thing later when I was taught balanced binary trees. Then again in hash tables. It's an operation that's overlooked in CS education.
Comfortable enough to not be worth undergoing extreme pressure to succeed like people do in China and India. Even a skilled tradesman is a highly paid career in America but it's poverty in China.
At least on iOS, Reader mode in safari fixes it right up
I would prefer a 48 hour day, so that I could get everything done that needs to be done.

Or maybe a 72 hour day, so I'd have time for things that I'd just enjoy.
I mean it feels pretty obvious that he's lying since Joe has to ask him for specific examples like 5 times.
It's my understanding that in the context of append-only skip lists, like what RocksDB uses for memtables, you can see wasted space at the end of a block within an arena but no fragmentation between records within a block. SSTables are another story.
The shenanigans I have seen…

Given a choice between two metrics, managers will usually choose the most gameable, indirect, activity-oriented metric, even if it is far less useful for driving results.

And I can’t blame them. That’s the game. They have to make a number go up, their boss also has numbers that need to go up, and so on. In the worst cases, everyone is complicit in creating a forest of bullshit numbers that went up even while the company tanked.
That’s really cool! I’m personally really interested in serverless DB offerings. I’m not sure if yours scales well, but I always seem to hit the limits of a single RDBMS instance at some point as a product matures.

There are plenty of ways to scale out traditional RDBMS, but serverless offerings make it so easy to scale out.
You may be interested in:

"Aristotle's Physics: a Physicist's Look"

My take is that it was hard to find a better theory, the usual explanation of scholastical dogmatism is to shallow.

https://arxiv.org/abs/1312.4057
I completed last year's in Scryer Prolog and it was a joy. Some problems were almost impossible due to the lack of mutation (Karger's algorithm comes to mind), but file parsing was a breeze and I find Prolog programs generally beautiful. My favourite syntactical feature is the full stop at the end of clauses.
Ask HN: How do you make your coffee?
I recently bought an AeroPress and have been enjoying lighter roasts with it, something I didn't think I'd ever enjoy. Before that, I usually preferred a dark roast french press, or a Nespresso if I didn't feel like making coffee. Black, no cream or sugar.

I'm sure some of you here are much more of a connoisseur than I am, so feel free to share.
Dashcams (including bikecams and helmetcams) are a great idea and AFAIK there's not much of a privacy concern with them as they record to local storage and usually in a common video standard (e.g. mp4).

Hopefully as more people use them, there should be more chance of video footage being available from other vehicles if you're involved in a RTC and don't have one yourself. There's also the protective effect of people uploading bad driving to the police where the police are interested in road crime - hopefully providing the police with a very cheap way of having visibility in lots of places.
Transformers only care about N words/tokens of context. That was the primary reason they became the dominant language model architecture.

A system being a Markov chain doesn't say anything more about the function mapping inputs to states than that the function has no memory and has access to the full state that affects the transition probabilities to the next state.
It's nobody's Bismuth.
> CVE-2017-11882 and the NTLM relay attack come to mind, for example. Down the line they weren't actually fixed, and are continuously being used by a lot of ransomware / malware campaigns.

Your own sources indicate CVE-2017-11882 was fixed in November of 2017. The title of the blob.0patch.com article is

> Did Microsoft Just Manually Patch Their Equation Editor Executable? Why Yes, Yes They Did. (CVE-2017-11882)

clearly indicating that Microsoft fixed the issue, contrary to your statement that they 'weren't actually fixed". The body content is consistent.

> NTLM relay attack

NTLM is bad, no question. It's based on a bad threat model - it assumes network admins can secure their corporate networks. Microsoft also fixed most of the issues in NTLM with NTLMv2 back in the Windows Vista and Windows 7 era. And Microsoft announced they will disable all NTLM versions by default within the Win11 lifetime. The biggest problem (unsurprisingly) is non-Microsoft software which has hardcoded the use of NTLM. It's fair to criticize Microsoft here for making available a technology that required so much from corporate network admins and leaving it available (and with use in Microsoft products) for so many years. At the same time, it's misleading to characterize these problems as "weren't actually fixed" - concrete issues with NTLM within its security model _were_ fixed and new technologies were created with better security models.

- https://techcommunity.microsoft.com/blog/windows-itpro-blog/...

> The link I gave you is the only disclosure/advisory page that Microsoft offers, don't blame me for them not offering a better UI. Ask them to do better.

You're mistaken. Microsoft has deep links for each CVE.

- https://msrc.microsoft.com/update-guide/vulnerability/CVE-20...
Thin CA will wick into the grain of thin veneers acting as a stabilizer. Epoxy is thicker and doesn't penetrate as deeply.

There are methods to get epoxy deeper, but they require significant equipment. Search for "stabilized wood" if you're curious.
What's so hard about Day 12?
It's just

+/'{x:".",x;H:(-1+;1+i-)@'+|\m*i:!#m:x=\:"#."
R:(x=x)({[h;d;x;y;z](z#0),+\(((-z)_~"#"=x)&z_d>z)*(*y),(-z+1)_y-0^y h}. H)[x]/y
(*|R)-R@*|0,&1_*+m}.''1({("?"/:5#,x;,/5#,y)}.')\@[;1;.:]'" "\:'0:`:i/12.txt
*browser not os feature :)
Just remember laws <> morality.
“Works on my machine” in general is a huge problem in dev culture.

I understand the desire to work on machines with lots of power and memory with a nice high res display and fiber connection. It makes the experience a great deal nicer. Even so, we should be keeping old and/or thoroughly mediocre devices around and testing on them periodically so we don’t succumb to illusions of good performance.
For most of these vulnerabilities the risk is low, but keep in mind that your web browser runs random untrusted code from all over the Internet in a VM with a JIT compiler. This means you can't rule out the possibility that someone will figure out a way to exploit this over the web reliably, which would be catastrophic.

"Attacks only get better."
Video marked private ?
Modern LLMs are very good at solving programming puzzles like that. As soon as it recognizes which algorithm needs to apply, it's just massaging the data to the right format.
True, maybe I think to much based on the morality. I often think "this does not feel right, so there must be a law against/for it"
Is there a secondary market for cloud compute credits?

Start one and have some initial seed credits to sell so you have 1 side of the market.
He's right. You have a project with two source files in it. That's basically not at any kind of scale he was talking about, and is easily classified as brochure-ware, from an architectural standpoint, simply because there's no architecture to it at all. Just a monolithic file.
Not just cost of living is lower, but standard of living is too. I know people in China who had full-time jobs but would recover meat from other people's rubbish to eat, or who lived illegally in a garage. That's homeless-level lifestyle for America and doesn't require any job at all.