skysight-inc/HackerNews huggingface dataset:
Streaming databases are often a good fit for building real-time apps on top of large-scale data.
Designing streaming databases is a complex task bc of the constraints involved in handling streaming data.

What are the 4 principles for building the most efficient streaming databases for your app?

1. Auto recovery-
Streaming databases are used in highly regulated domains like healthcare, financial systems, etc. Such systems cannot fail, bc if they do, the outcomes can be fatal.

Since failure is not an option, auto recovery is one of the most critical DB design principles, in this case, bc it is what ensures a streaming database can continue to accept queries even if one or more nodes fail within the cluster.

2. Exactly once semantics-
In the case of streaming databases, auto recovery in failure cases is not enough. Unlike traditional database design, streaming database design should ensure that the results lost during the time of failure do not affect the downstream consumer.

Exactly once semantics guarantees that a message will be processed only once & the results will be accurate enough so that the consumer is oblivious to the failure incident.

3. Handling Out Of Order Records-
Good database design considers handling out of order records as a critical aspect. Since they are used in highly sensitive applications where the order of processing is very important, streaming databases must handle them graciously.
Btw, some of the reasons that may cause out of records are network delays, producer unreliability, and unsynchronized clocks.

4. Consistent Query Results-
streaming databases have to balance between the staleness of the data and levels of consistency to optimize performance. It is tough to accomplish consistency in writes because of the distributed nature of these systems.

There are 2 methods to solving the problem of consistent query results:
-By ensuring that writes are not confirmed till the time, all queries originating from that stream complete.

-To do it at the querying engine level. The querying engine delays the results of the specific queries requiring strong consistency guarantees until all the writes are confirmed.
Seems like a cheap ripoff of Endlesss, which is far more mature and allows very easy live jamming without fuss:

http://endlesss.fm/
> Reduction in variable capital costs required to meet peak demand.

If I understand your point correctly it is the opposite - cloud not only lets you trade capex for opex, but also allows for opex variance. Yes, clouds do let you scale up and down (if the application is designed to do that) easily, however how many businesses do really have high load and geography variability?

That is the core point behind cloud vs on-prem: capex vs opex and opex variance.
> Enter, the humble space. And punctuation. And a standardized system of word order.

The word order is more important in some languages than in others. English is a great example of the former, as its words rarely change form, so the word order carries a lot of semantic meaning. In other, like Slavic languages, the meaning is most often changed by suffixes, prefixes and other word-altering mechanisms, so you can in many cases completely mangle a sentence's word order and it would still be perfectly intelligible, although sounding a bit strange (and often archaic, which implies that the "standard" word order has changed over time).
I'm sorry - but the mental image of someone playing T-side on dust2 while on a plane and the sound "bomb has been planted" on max volume just echoes throughout the cabin is too hilarious!
I'm also aware of https://www.flipsampler.com by the YouTuber and electronic music producer Andrew Huang. I've had good feedback on this app from my musically talented friends. I can't provide any judgement in this area myself as while I am an ardent music fan and a keen observer of music production mastery of others, I have not been blessed with the necessary skills or propensity for developing them myself, unfortunately.
Congrats, this looks great!

I think on the desktop the columns could be wider, so the preview text wraps on fewer lines and more results fit in vertically for quick eye scanning.

Did you think about having the ability to display multiple primary search engines besides Google like DuckDuckGo? A while ago I switched to DDG as my default search engine and learned to trust that the search results are good enough. On occasion, I have a FOMO and fall back to Google anyway. It would be a neat feature to have them shown side-by-side.

Another example is Brave Search. I like the ideas behind it, but will not experiment with it as a default engine as an early adopter due to possible friction. With a meta engine like Swurl I could keep having Google/DDG as the primary engine and include other emerging engines like Brave Search in another column to take it for a low friction/risk test drive (perhaps configured through URL parameters).
How do committees invent? (The origin of Conway's Law)
No, but if the other side's official state media is admitting that they might have screwed up mass conscription in their desperate haste whilst nationalist bloggers fume about military defeats and the government threatening them for reporting on them, whilst you're arguing things are going smoothly for them and the reason they're losing territory they now claim to be Russia's is because they casually withdrew their 85% of their army for unexplained "democratic" reasons, you have no interest in truth.
> The sleepless nights and diaper changes are a mere blip on the scale of a lifetime with kids. You deal with it, then the kids grow up quicker than you think. Don't let the idea of the first few months/years define your entire decision for how you want to structure your family for the rest of your life.

This is just a common feature of our perception of time not constrained to child rearing. Past years seem to have gone by quickly while the present moment seems to have an eternity in front it. It's also a common feature of our perception to rationalize past decisions as foundation of the current moment ("wouldn't trade it for the world") without really understanding the counterfactuals (are you sure you wouldn't?).

Anyway I agree one should generally not let the experience of a few years of hardship detract from a life direction they may find fulfilling, but one should also not take the present for granted or be readily willing to subscribe to a miserable present in hopes that it blossoms into a worthwhile future. We're too bad at predicting the future to make those trades reliably well (though the aforementioned bias will (mis)lead us into thinking we're quite good at it).

> You actually like hanging out with your own kids. I talk to a lot of people who are anchored to some negative experience they had 10 years ago babysitting for someone else's kids, as if that was representative of parenting life. It's not at all. At the end of the day, I actually rush to finish up my work so I can have more kid time. It's fun.

You shouldn't be so ready to extrapolate your experience to the hypothetical future experience of others who are already skeptical. Your 10 year ago babysitting example sounds like a strawman anecdote. I know plenty of people who simply don't enjoy the company of children, their own included. There is of course a biological propensity to have an outsized affection and enjoyment of one's own children, but that is not universally applied to everyone, and not everyone finds endless joy in experiencing the world through the eyes of a child or playing the role of caregiver. Some certainly do and that's great, but it's not a universal truth.
For me, the most inspiring music app on iOS is Endlesss (http://endlesss.fm) because it allows me to share ideas with my fellow music-makers seamlessly .. hours and hours of jams have gone on and on because of the easy to use interface and very well integrated sharing of clips between users ..
I am writing an interactive mini-book on quantum error correction. The existing resources are all pretty out-dated.
You need to understand the engineering to set a sensible budget. What should the concrete budget be for a new 50-story skyscraper in New York City? You'd need to know quite a bit about the specific building and the construction market to answer that question. You couldn't just be some MBA with a spreadsheet.
At least in Germany it's worse but generally fine, you can achieve <20ms ping for online gaming within or near Germany. Fiber is for sure better through but probably won't make a difference in day2day.
It's annoying, but to be fair, there's a pretty visible 'let me read it first' button. Not so bad.
Haha, thanks! The user count is abysmal, as predicted. Nobody wants this.
Yes, maybe he would then have had a legitimate reason to use the term 'Autopilot'.
The primary issue is

* there isn’t any sort of provider like Openreach where all the ISPs share some portion of the network (in Openreach’s case, the last-mile network) so every ISP has to build every last inch to the home themselves

* generally speaking, ISPs have to get permits from localities, which are often cash-strapped and thus looking to scrape as much money as they can from an unsympathetic sector
manager of 70 people at FANG

Ultimately being a manager is a choose your own adventure, with an already running team, it is often possible to do almost nothing and claim credit for your staff's work.
> But also, anything can happen. Anything can happen. Your kids could be born with lifelong conditions or issues. They could be healthy at young ages, but develop special conditions as they hit early childhood or late adolescence. They could struggle with lifestyle issues (violence, drugs, alcohol, crime, etc).

I could never understand how people are so easy to punish someone with life. Especially someone who they'll love unconditionally. I didn't like my life from the start despite it being fairly decent in objective terms.
Children cost the most thing during the first year. Even a 1.5 years old gives you plenty of time to do stuff. You either wake up early or sleep late. Arrange with your spouse to take turns. Etc. At least 4 hours of free time.
Auto-correct is the enemy of multi linguals.

It's near impossible to chat with my friends in a language different to my phone's primary language.
You shouldn't stop flow to unused rooms, maybe limit or reduce but not stop. You don't want too high/low humidity or temperatures in one room.
Same experience. I watched one Jordan Pterson Youtube Shorts, now at least 20% of my Shorts are Jordan Peterson/conservative.

I can't be the only one who thinks Youtube Shorts algorithm is incredibly dangerous. It's the ultimate echo chamber.

Even if I have some conservative views and agree with some of Jordan Pterson's takes, I still find it insanely dangerous to society. Too much content of left/right can make people more extreme in their views - especially if the content algorithms optimize for more and more extreme views.

Not enough has been said about Youtube Shorts' algorithm.

Also, does TikTok have this issue? Or are TikTok videos on the more casual/fun side?
Projects that bring the metaverse to sports
Tristan is still my favourite pinball game to this day. I remember my dad playing it on whatever old Mac he had back then and I got to try it every once in a while. I like the simplicity of its design and I come back to playing it on my iPhone whenever I get bored.

It’s amazing you can still download the original apps on http://www.littlewingpinball.com and there is so much background information on there. I also love Crystal Caliburn II, which they ported on iOS too.
> it was helpful to reach an obituary word count.

I'm pretty sure you meant "obligatory" word count. But "obituary" is an awesome accident. Like Copilot is waiting, happy to sum up your life in a tidy paragraph, when the time comes.
You come up with a plan to go to Mars without any holes in it ...
Nice message. After being fired from like 6 jobs or something, I've tried to emphasize this vocally. I have abysmal short term memory, miserable sleep management, and I lose track of calendar stuff and different task tracking systems easily. But I can code, and I can communicate pretty well. So I try to emphasize this if it comes up. I deeply suck at managing communication in support requests with customers, and expecting me to be as good anyone else will just be telling me to start looking for another job, because I'll try and burn myself out only to fail. If it's absolutely crucial I never miss a meeting, as dumb as it is, I'm going to miss some here and then.

I like trying to get better at the things I've discovered some way to get progress at, but I hate trying to push myself to try and be perfect at something I can't.
Getting internet early is often a curse since companies priorities build outs where they have no coverage at all. That being said, 3 MB/s should get you very high on the 'to upgrade ' list...
That makes sense. What the long-term effects of such 'performance enhancing' tools might mean for how its users think, or externalise those thoughts, is hard to call.

I also wonder what it means if everyone is farming out parts of their intellect to similar models, which might be limited pathologically, by training data or enforcement.
I am in early 30s and have 2 kids. Didn't particularly want kids before but also not resistant of having. Absolutely the best decision in my life. The difficult part is that experience is hard to be shared. One can only tell other their own experience but other won't share the same experience. It is like seeing the color red, we sort of know what red feels like, but only sort of. Your red is never my red, and we will never know the difference.

Every weekend is exhausting, yes. After work means another shift of work/chore, yes. They drip food all over the floor, the quibble with each other endlessly, they break everything in your house. Yes, yes, and yes. But it is joyful, it is satisfying, it is fulfilling, it is irrational. And I only get so much time together with them. Assuming 8 hours a day before turning 12 yo and maybe 12 hours a week from 12-18yo, that's about 4.5yr worth of time. 4.5 yr is really a tiny blip in our life. Treasure it while we can
I just purchased it and system volume control works fine.
As I said to prox, I took the site at face value (I didn't bother to view the source—couldn't be bothered). However, I'm now mildly curious why sites like this are so slow. Has anyone done a decent objective analysis of load speeds versus actual content versus the other extraneous dross?

Clearly, it'd be easy to compare 'apples' with 'oranges' thus quite a difficult analysis to get real figures.
Starlink generally has 20-40ms of latency. Speed for fixed residential connections is different depending on congestion and trees - 50Mbps to 400Mbps for download and 10-100Mbps for upload from what I have seen.
What are their wife's doing? Maybe the chores are inequally distributed and they sacrifice more career wise
The growing lore around occupancy networks is that they can detect all objects
I really don't think that's the case. I've had enough exchanges with dang and observed enough of his moderation (visible to anyone by looking at his comments <https://news.ycombinator.com/threads?id=dang>) that the notion that HN's moderators apply undue favouritism to HN companies seems ... unlikely. There are notable cases in which the bloom is well off the rose --- Reddit, Qurora, and Uber, notably --- that your argument has little support.

Instead I think that this really is a case of well-intentioned moderation rules, generally quite reasonably applied, having pernicious exceptions and edge cases. I suspect dang himself would tend to agree that tone and topics tend to have a status quo advantage, as I'd noted above. He and I have had this disagreement a few times, and the ultimate mission of supporting intellectual substance (as 93po noted above) is almost always the standard that he defends.

Though interestingly the top result by popularity searching "by:dang intellectual" shows a vehement defence of a progressive viewpoint against an oppressive one:

<https://news.ycombinator.com/item?id=7978950>

Again: I think this is an instance of disagreement, not a pronounced or intentional site moderation bias. Mostly I'm in awe of dang's patience, consistency, and level-headedness in moderation. It's a tough job.

And sometimes, or probably often, the role of fighting an inequitable or ineffective status quo involves a lot of repetitive messaging.
Thanks for sharing. These positive experiences will help people be more convinced it can be done.

On the flip side, for the people who are struggling, this might make them feel even worse about themselves.

How can we help them?

Do you know any examples of people who struggled, but then turned it around?

I guess these guys you mentioned struggled at one point right
No the other way around - easily emittable, letting the backend in turn do the heavy lifting to lower it.
I've felt this way for a really long time with touchscreen keyboards in general. I'm pretty sure I'd be overall faster when taking into account accuracy with my old 9-button dumb phone and no autocorrect. I used to be _really_ fast typing on those things, and could do so without looking at the screen to make sure my fingers were going where I thought they were. I had actually considered trying to find an Android phone featuring physical buttons (9 buttons, not a full keyboard) for this reason.
Everybody getting PreCheck and all those other features is basically lessening security, but only if you pay.
Maybe because relative humidity is more expensive to control? in an ideal case it's just moving and mixing different levels of air temperature and humidity, but in reality you need to de-humidify or add humidity
You ever just put a show on or pick up a book spontaneously, without really having a particular show or book in mind before you started?

This is kind of like that, call it 'directed spontaneity'. You open the app to see interesting stuff, but you don't know what exactly that might be in advance. The app learns some basic stuff about you using your interactions on content then tries to guess. You either like the stuff the app shows you or you don't.

The hashtag system was very good at filtering content to what you generally like in your feed and the Explore view, but it wasn't set up for you to fully guide your own experience in search of very particular content using individual hashtags.
I appreciate the idea and implementation.

However this is literally GQ magazine implemented as a search page which overwhelms the user with irrelevant information.

That's why old Google was cool: clean and relevant. I don't see anyone looking for efficiency (not social media but a search page) would want to change that.
As someone who dabbled in adding basic tagging to a database recently, this take feels absolutely spot-on. I’ll draw on it when evolving our system forward.
I once spend several euros sms-ing instead of what I thought was Signal-ing with someone in another country. Since then I keep the two strictly in 2 different apps.

I certainly wont mourn for this. Sms gets super expensive to other countries (outside the EU), it also gets super expensive when you don't pre-pay for a bundle (it's 2 eur for 1000 messages, then 25ct per message after that, ridiculous). Imho dutch carriers did everything they could to kill sms, and now I'm happy for it. The only bad thing is that my society at large seems to have chosen Whatsapp as it's replacement...
Ditto, mine are not all down until 9.30, or worse. Then I am too knackered and shell-shocked to actually get anything done, yet wont actually do the sensible thing and go to bed early as too guilty with the chores still to do...
Electric planes are not 'far' away. They will see service for shorter routes this decade most likely.
A new way to go through maths topics,
https://mathuvue.pythonanywhere.com/

the guiding principle is to give reasons why we should bother with a problem.
I have a couple of feedback that I have received that I need to implemebt.
> “Hey, this is a novel virus and so our guidelines will have to change as we find out more"

Gee that’s not what I heard at all, what I heard was ‘this is science, and anyone who disagrees or doubts is an idiot and deserves to die and is responsible for killing grandma’

*edit

Oh look here’s the comment where anyone who doubts or disagrees is an idiot:

https://news.ycombinator.com/item?id=33258738

I guess we should applaud them for not celebrating the death of anyone who doubts.
You have to add a new line in between bullets to have a new paragraph in the numbered list you wrote. Perhaps you can still edit within the hour of posting.
Are you ok with anyone in the world watching the videos or are they for customers only?
> and yet we fall for it all the time

Really? Do "we"? Everyone keeps warning of these issues while getting laughed out of the room. At some point I have to believe that most of society actually actively wants to be screwed over.
I personally gave up on this product a long time ago. The only way I see this panning out is via extremely aggressive enterprise sales schemes and a further reduction of hobbyist accessibility. Good riddance from the hobbyist perspective...
What did you expect instead? 3 nines %? 80% of the time?
Kagi search introduces Team plan
What Musk should have done is create a company that is owned 50% by Tesla, 50% by SpaceX and they should be developing a electric airplane.

If you are willing to do the necessary investment, I think there is huge potential to build an airplane that goes significantly further then planes like the Aviation Alice or what Heart Aerospace ES-30 is doing.
For what it's worth, I never owned a car in my life.

(I currently live in Singapore, which has excellent public transport.)

My suggestion was conditional: if a city has already decided that Uber is better than public transport, then they should still not give Uber money. But instead, give the money to poor people.

However: public transport only really makes sense when you have enough density.

If you have the typical North American rules that make density illegal, even the best public transport won't safe you. In fact, it might be throwing good money after bad money.

I don't say that density needs to become before public transport. Just the opposite: you need to put transportation in place before people come. But you also need to make density legal before you think about public transport.
A Rust based ML model analyzer
You can stay in the village or move to the big city in the other country and make the big money that ends up supporting them. That pattern persists a lot the world over.
> I agree, if you're going to provide financial assistance it should go to those in need, but I don't think non-poor people need or want to be saddled with an added expense to replace the public transpiration services they already have and use.

In places where public transport works and is used, I agree.
You can rent someone else’s already-racked bare metal, of
course. Hetzner has server people to do all that crap for you.
Well that's what the sensors are for...

I like to have CO2+humidity+temperature sensors in each room, and then when any go out of an allowable range you open the vent.

I sometimes also install PM2.5 sensors hooked up to the vent because unattended cooking or toasters can make a lot of PM2.5 and not much of anything else.

Also obviously you want the vent to open proportionally to how in-range the measurements are, otherwise you end up with a vent opening and closing every 5 minutes all day long which is very annoying.
There's nothing controversial.

You like working in an office. Cool. Go work in an office.

I don't like working in an office. Cool. I work from home.

The only thing that's changed is that we have more choice now. Like when I finally landed the first job where I didn't have to wear a tie anymore.