skysight-inc/HackerNews huggingface dataset:
Not sure if Julia counts as popular, but Julia.
I don't think you can represent arbitrary data in a pdf AND have pdf viewers actually render it. If the pdf format screws precision (and I'm not surprised it does, it screws paragraphs and often only contains metadata to reconstruct lines of text), it should not be used as a data interchange format.

Pdf is for print and human eyeballs. It's brilliant for those 2 things and not much else.
New Teams client just rolled out with a switch to test the old and new client. Let's hope this is a step in the right direction.

First impression is all system sound cutting out and meetings losing sound :S
"compromised" might be a word used by the tech community to refer specifically to technical compromises, but the word means something much more broad outside of tech forums.

> then anything substantially made in the US, Australia, South Korea, Israel or Kazakhstan (non-exhaustive list) should be considered compromised.

Not really, because many of those countries you listed have mutual treaties of cooperation and are not hostile to each other.
> Our understanding of astrochemestry is still limited enough, that we cannot say with confidence that a given signature requires a biotic process to produce.

It will always be possible to find a new extreme edge case to deny far easier and more common processes that leave around biosignatures, it's the exact same rhetoric used to handwave away the methane in the martian atmosphere.
There is indeed Spark support for writing new data into Pinot (https://docs.pinot.apache.org/basics/data-import/batch-inges...) as well as to query it (https://github.com/apache/pinot/blob/master/pinot-connectors...).

This does not run inside the Pinot cluster - you can use standard Spark execution engine to run this ingestion. In addition, Pinot also supports an out of the box ingestion capability from batch sources using the Minion framework (https://docs.pinot.apache.org/basics/components/cluster/mini...) that does not need any external component (like Spark)
Not really.

The causes of WWI are complex, but the simplest summary is that the great powers of Europe reached a point where a war between any two of them would necessitate a war between all of them. To argue that Schlieffen contributed to WWI, you need to first argue that Schlieffen is the only thing that makes the German military believe it can win a two front war (which I think reverses cause and effect), and also argue that a German military believing that a two-front war is unwinnable would have caused the German government to work assiduously to keep war from breaking out (which I find unbelievable, given the tenor of Wilhelm's foreign policy).

In the actual event, Belgium doesn't play a major role in Britain's entry into the war (it's an easier sell than "diplomatic reasons we haven't exactly been telling you about" though, which is why it's played up so heavily). But look at a topographic map of Europe, and you'll realize that the easiest route from Germany to France is to go through northern Belgium [1], avoiding the more difficult terrain of eastern France. Even absent the specific Schlieffen plan, it's likely that German war plans would involve going through Belgium anyways, especially if your goal is as rapid a capture of Paris as possible.

If you look at the history of German war plans against France, essentially every modification is about pulling yet more troops from the invasion through Belgium to other sectors of the war, whether it be somewhere on the Eastern Front, or the direct border with France. This is really at odds with the mythologization of the Schlieffen plan, and I suspect that some of that myth-making comes from the apparent near-success of the German advance on Paris. People can look at how close it came to Paris and think that, had only Moltke not diverted yet another division of troops elsewhere, the Germans could have made it. Ignoring the fact that it failed because German logistics was literally keeling over dead [2], and pushing any more Germans into that army would have broken the logistics system faster.

[1] Incidentally, probably the biggest blow to the "original" Schlieffen plan (the actual war plans change considerably over time) is removing the plan to also march through the Dutch province of Limbourg, which now requires the entire Germany army to squeeze through a 12 mile gap near Liège.

[2] This of course referring to horse-drawn wagons, with the horses dying from overwork.
There was a similar story in comp.risks (anyone remember that?) back in 1986. When ordering a custom plate, you could put down three choices. The guy applying could only think of two choices ("SAILING" and "BOATING"). If he couldn't get one of those, he didn't want a custom plate, so he put "NO PLATE" as the third choice. Of course that was the plate he got. He ended up getting 2500 parking tickets, since any car with no plate was marked on the ticket as "NO PLATE".

The full story with references: https://catless.ncl.ac.uk/Risks/3/12#subj1
This explanation makes sense:

the police use NV for "Not Visible"

https://news.ycombinator.com/item?id=37580270 (thanks mabbo)
Your comments seem to closely reflect mine. I'll have to take your advice and give it another go. It's everything all the others want to be. The architecture with distributed bookkeeper underneath seems so much more advanced.
Had the same question. Did you figure out?
Our use of data is WILDY inefficient currently.

Current training systems extract information on everything from every input.
We don't read a cookbook to learn about space, but these models are twiddling weights all over these massive spaghetti balls of logic.

Looking at the data we have, the literal collection of all human knowledge and lamenting not having more is like standing on a ladder sideways.

But it's really starting to feel like pile of ladders is getting tall enough to bootstrap.

And these massive inefficient systems filled with data and churning matrixs will be set in order. And all the ladders laid end to end.
It's a lot of work to implement the file storage from scratch and there are good options out there (e.g. BigTable which has crazy latency SLAs)

If you get the building blocks right it can be fairly easy to build a decent composable OLAP cube. We built the core stack in under 30KLOC and used it at scale for non-trivial stuff. https://medium.com/hstackdotorg/hbasecon-low-latency-olap-wi...

There's a lot more good tech than we had 10 years ago and it should be easy (and fun) to roll high-level stacks that have top performance these days. Something that feels like and lightweight like a library but scales out linearly.
A great self-hosted pairing might be Postal https://github.com/postalserver/postal
> 1/10th of a thou

What is this unit?
Ask HN: Dear GitHub the browser memory sucks
I've gone through 3-4 Firefox upgrades in Linux over the last several months and have consistently watched GitHub tab memory balloon out from 1gb to 30gb+ each and every time. At first I thought it may have been a Firefox or distribution bug, but only GitHub blows things up so bad.

Why is this so terrible? I don't use other browsers so perhaps a Firefox only bug? Do they check this?

Have had a couple friends confirm, but HN community? Thoughts?
Nothing is interesting about overrated Python though
I actually went through all projects listed in [1] because I remember this very quirk. It turns out that there are many such libraries that have two variants of encode/decode functions, where the second variant prepends a varint length. In my brief inspection there do exist a few libraries with only the second variant (e.g. Rust quick-protobuf), which is legitimately problematic [2].

But if the project in question was indeed protobuf.js (see loeg's comments), it clearly distinguishes encode/decode vs. encodeDelimited/decodeDelimited. So I believe the project should not be blamed, and the better question would be why so many people chose to add this exact helper. Well, because Google itself also had the same helper [3] [4]! So at this point protobuf should just standardize this simple framing format [5], instead of claiming that protobuf has no obligation to define one.

[1] https://github.com/protocolbuffers/protobuf/blob/main/docs/t...

[2] https://github.com/tafia/quick-protobuf/issues/130

[3] https://protobuf.dev/reference/java/api-docs/com/google/prot...

[4] https://github.com/protocolbuffers/protobuf/blob/main/src/go...

[5] Use an explicitly different name though, so that the meaning of "encoding/decoding protobuf messages" doesn't change.
https://github.com/protobufjs/protobuf.js/wiki/How-to-revers...

Prepending the message with the length means the message is length-limited. Seems standard practice here.
I’d like to see both, please
All that copyrighted (fair-use) content uploaded to YT attracts a lot of viewers. They are not doing anyone a favor by hosting it.
I still telnet to ports, but they're not default anymore.

Quite handy telnet is
This is very similar to a trap I fell into with some off-brand LZ4 libraries that are laying around on Github. One, called "golz4" sounded harmless but it's actually designed to be compatible with this python mistake: https://python-lz4.readthedocs.io/en/stable/lz4.block.html

Length-prefixing an otherwise standard format, by default, kept me confused for some hours.
Latency Meter for Accurate Gaming
Arduino-based device presents itself to PC as mouse, sends a mouse movement (not click), and measures time until image on screen changes.
Definitely not the same level of WTF, but I worked on one of my favorite bugs I've ever seen super early on in my career.

I joined a tiny digital agency maintaining wordpress sites and about a month in one of our customers files a ticket that their website was broken. Just a white page, no error, no nothing. I ask my boss if I should switch to work on it and he goes, "Nah, this customer does that every few months and there's never anything wrong. It's something with their hosting or something (they were self hosting a site we built and maintained). Just take a look at their site when you have time to say you did and close it as can't reproduce."

Two days later I have some spare time so I take a look and sure enough, everything is working as expected. A few months pass, same ticket from the same customer, I pick it up a day or two later and everything is working as expected. A few months later, same thing, but this time I have nothing I'm working on so I pick the ticket up immediately and sure enough the website is broken. I immediately show my boss and he's like "well, I'll be damned" and then tells me to fix it. I poke around for a few hours, but can't figure it out, so I call it a day. When I get in the next morning, things are working as expected, so we're both like "wtf?"

I don't remember how exactly I ended up figuring this out or even all the details of the bug, but the root of the issue ended up being that who ever wrote the code for the site had some code that revolved around the current date and they'd hardcoded that there was always 30 days in the month. When ever the current date was the 31st of the month this code broke and took down the website, but by the time the 1st rolled around the code worked again.
Halo was a much better game series when Microsoft was worth a lot less.

Increased stock valuation doesn't mean better games.
Stoic philosophy, finding a meaningful life, and the cancer treatment struggle
I see where you are coming from. But, as an NRI, I found the writing authentic.
Just like American English, English English, Australian English, it is Indian English. Nothing to be unproud of and criticized about..

I’d perhaps be happy to see translation options as
Indian English, American, UK etc on a modern humorous tone :-)
Also, loop bodies already did have their own scope each iteration.

I wouldn't say either behavior is non-lexical. The only thing changing is which lexical scope these variables go into.
Would be interesting to know what’s the plan regarding supporting effects in melange. IIRC jsoo (the another OCaml to JS compiler) is doing some whole program analysis to compile to efficient CPS.
I know it's still kind of early days for nushell but recently, nushell has broken env/config format a couple of times.

If you use this as your main shell, that's annoying and frustrating. I know it's "ZeroVer" but I'd rather they at least warn first "this syntax will be unsupported in the next version" or something.

A shell can be like a second home, you don't want to upgrade your home only to find that a meteor has immediately crashed through the roof.
Large black holes are the most spherical things in the relative sense, not in an absolute sense; although more so than pico-black holes, which are not very spherical.

Light cones/the 4d-radii of causality are* perfectly spherical.
Where is the donate button so we can keep the domain and website up forever?

Wish we could have saved nissan.com
replicate.com would be the pricing concern
Have you all read any old Apple II source? One reason very early on was to seed the PRNG (rnd() function) with variable input.

https://www.applefritter.com/content/random-number-generatio...

Maybe it carried over to modernity in the same way the apocryphal pot roast tale did: https://www.psychologytoday.com/us/blog/thinking-makes-it-so...
Elon Musk is, first and foremost, a government leech and will follow the free money.
There are directives, and there are regulations. There is a difference.
We don't (can't) look for them. Current telescopes are not big enough and governments refuse to pony up the money for anything better. Even JWST was a disaster in terms of finances and time, there's zero chance anyone is going to pay 100-1000x as much for something better.

That's the entire point of the headline. Scientists are forced to search for 'wunderwaffe' solutions to make these observations.
I would not be surprised if there is some P(controversy | viewing user, time elapsed since original flagging) metric, and when it goes below a threshold, certain non-prestige or international ads can be shown - ads not likely to cause any problems.

Because someone, at some point, got an email that looked something like https://www.justice.gov/d9/2023-09/416421.pdf (via https://news.ycombinator.com/item?id=37572692 ) - and one does not simply see an email like that and not implement this kind of thing.
…..because we all have a Facebook account, and are on there at all times, and expect to reach the authoratitive information for fire services on there?!
I think some of the things coming out of Russel Brand is lunacy, however I'm also 10000% against censorship. Youtube stepping against Russel Brand is virtue signalling at it's finest, when Russel Brand has not been convicted of any crimes. A small group of people can claim X did something evil against them, and Youtube will run with it blindly.
"Why didn't I consider it earlier?" was my first thought. Then, "Maybe I talk too much and think too little?"

Your idea is definitely easy on the wallet, but I should've mentioned before that accuracy is crucial.

When it comes to speech recognition accuracy:

- Windows might work well, since Office 365 has good speech recognition features.

- The speech recognition on macOS isn't as accurate, and iOS might have the same problem.

- As for Chrome and Google Docs, their speech recognition quality is lower, and Android might be similar.
They're just Br*tish, I think.
I wouldn't recommend trying nu unless you're willing to live on the bleeding edge, but if you're already on the bleeding edge, I would recommend using rustup to install rust and cargo to install nu (then you can use cargo-update to keep nu up to date).

https://crates.io/crates/nu

https://lib.rs/crates/cargo-update
Ask HN: How to search for replacement part numbers?
Given that Google, Bing, Duckduckgo and even eBay seem to have now a search field that doesn't actually search for the specific keywords you are looking for...how does one search for replacement parts for say, their old laptop or smartphone? Yesterday I got so damn frustrated looking for a CPU heatsink for a PGA946 socket that I was almost losing it.

How can anybody use Google or Bing for shopping if it's only recommending useless crap you did not search for?

They seem to have completely disabled the "quotation mark" feature, as well as the +"must contain" search operators.

Maybe it's time for a search engine or website/directory focussed on finding replacement parts online?

Geizhals also seems to only have new parts in their listings, not old ones.
You have a whole lot of words here and are making a lot of claims and provide no evidence. This story is still way too early to say whether any allegations have substance or not, but one of your claims was:

> In fact, the Times' investigation seems to insinuate that the 16 year old Brand was dating when he was 31 approached his publisher seeking an apology before being rebuffed. That seems to me to be the most likely origin for the investigation.

When I Google ‘why is Russell Brand being investigated now’ I get this in one of the first results[0]:

> The women said that they only felt ready to tell their stories after being approached by reporters, with some citing Brand's newfound prominence as an online wellness influencer as a factor in their decision to speak.

This directly contradicts what you said, and I can see why others think you’re giving deference to the media. If you have a source for your claim I’d be glad to revise my stance.

I don’t know what the truth of the matter is, but after hearing Russell Brand admit openly to a lot of gross stuff, it seems like he’s not trying to hide anything here. I’ve also seen accounts from other women who have completely different stories about how he did not mistreat them (and they spoke openly without having actresses speak for them).

All that to say, it’s still way too early to say anything one way or the other. But blindly trusting that the media has no agenda seems unwise.

[0]: https://time.com/6315326/u-k-police-urged-to-investigate-sex...
So glad there is at least one other human being out there who understands what a huge step backwards NFSv4 was.

NFSv3+wireguard is approximately the perfect network filesystem protocol.
Insect pests and radiation: SIT, inherited sterility, biological control
I can't wait for that to happen
The title makes it sound like The Matrix.
Kafka trails for employees in the country...
The thing is, you go to the Doctor's office and they weight you, measure your height and take your BP, irrespective of time of day and rarely giving you five minutes to sit and relax. If it reads high your doctor gets the report and reaches for his prescription pad.

Its a single momentary snapshot in time taken under less than ideal conditions on which a long term medication decision is based, often with attendant side effects.
My understanding is that the proper way to chart for a BP problem is to take BP twice a day, once before lunch (after sunrise metabolic amplification affects are have waned) and again before right dinner time. These readings done daily for a week, and averaged are your real blood pressure readings.
And then of course there are also the confounding effects of white-coat syndrome.[1]

So, not to downplay the absolute importance of detecting hypertension and treating it asap, but the way it gets done is both perfunctory and quite prone to false positives. This methodology sells extra meds for spurious reasons...

[1]https://www.wikiwand.com/en/White_coat_hypertension
I wouldn’t be surprised if Unity adopted the per install price model to strangle AppLoving because they’ll waive the fee if you use Unity’s ad network.

They seemed very desperate when they tried to “buy” Unity last year (they were really actually asking Unity to buy them)
I don’t know about bug free, but Code Complete claims that the space shuttle project shipped a million lines of code with no bugs in production.
And SLC is for their other customer, Intermountain Healthcare

https://www.deseret.com/2022/10/4/23385813/drone-delivery-in...
I think the writing is on the wall.

There don't seem to be any arguments beyond the trivial observation that things could slow down. But they haven't slowed down.

New models keep surpassing us (in some cases the whole human race) dramatically in new areas of greater generality, while their "weaknesses" also improve dramatically.

It's hard to imagine where a fully multi-modal model, with long context, and a sense of information confidence, and ability to manage its own notes/whiteboard information, will not exceed us. On top of improving in all the areas it already outdoes us.

People are working on each of those improvements right now. (By fully multi-modal I mean text, audio, image, video, simulated and real physics, touch, motor control, team communication, software/internet access, and whatever other senses or decision forms are helpful.)

I don't see a general AI vastly smarter than any one of us, or all of us together, taking longer than 2030-2033 time frame.
You've made very good points about smart clients, but at some point one has to ponder if it's worth it or one should just not use kafka in the first place.

I've seen databases used as messaging queues and if it was up to me, I'd never do that. It's usually "but we already have kafka + db, why burden ourselves with another messaging technology?", which is fair.

> You can stream messages into a buffer and process them in parallel, and commit the low watermark offset whenever it changes, as described above. I've implemented this in .NET with Channels and saturate the CPUs with no problem.

That is very nice -- certainly seems better than just batch processing of kafka messages, but you're still just kicking the can down the road.
How large do allow the buffer to become and what do you do when it's getting too large?

You probably use a DLQ.

Don't get me wrong, I think the buffer idea probably works most of the time.
The same trick would work with python just as well. There’s nothing about Python’s status as an interpreter which would stop them from adding a python semantic version somewhere in each python program - either in a comment at the top of each source file or in an adjacent config file. The comment could specify the version of python’s semantics to use, which would allow people to opt in to new syntax (or opt out of changes which may break the code in the future).

Eg # py 3.4
It may not have had an end when he wrote it.
https://www.wsj.com/articles/india-threatens-jail-for-facebo...
> Hacker

I think he ran a tennis ball factory before EA. He really has no background in tech..
Yes this. If I want to I can kick every Republican or MAGA hat out of my cafe with no legal risk. But I can't kick them out because they are Christian / Muslim or Black / White or Gay / Straight. Some of these things are considered to be outside of the control of the individual. They are innate. You can't choose if you're white or gay or to some degree Christian. If you're thinking that the religious exception feels weird given the rest on the list, I'd agree. But at the same time religious indoctrination in childhood when a child has literally no recourse but to follow what their parents say puts them at a major disadvantage to coming to terms with reality. If I acknowledge that a fundamentalist Christian growing up in the US would be just as likely to be a fundamentalist Muslim were they born in a different country really puts into question the "choice" aspect of religion. Some folks manage to escape it, but for most the social and cultural aspects and risk of ostracization keep them in the fold.
It's indeed a shame that protobuf has so many bit patterns available for the first byte (lowermost 3 bits can't be 6 or 7, and 4 cannot be also used alone), and some of them could have been used for a unified length-delimited framing format.
Objects on the stack don't participate in the GC (technically they're GC roots). Half of the reason you want to be able to put variables on the stack is because the stack variables are managed by lifetime and therefore the GC doesn't have to collect them.