skysight-inc/HackerNews huggingface dataset:
One thing that isn't really covered in this article is relevance calculations.

A surprising (to me) thing about PostgreSQL FTS is that it doesn't do TF/IDF or BM25 relevance calculations.

These calculations take statistics about the entire corpus into account - they do things like ranking a document higher if it contains terms from the search which are statistically rare in the overall corpus.

PostgreSQL FTS uses how often the search terms appear in the document as part of the ranking score, but doesn't look at how common/rare individual terms are. https://www.postgresql.org/docs/current/textsearch-controls....

OpenSearch/Elasticsearch uses BM25: https://opensearch.org/docs/latest/opensearch/rest-api/expla...

SQLite stores these kinds of statistics and can support BM25 or TF/IDF or custom ranking functions. I wrote more about that here: https://simonwillison.net/2019/Jan/7/exploring-search-releva...

Meilisearch does something a bit different (on reading this I don't think it considers full corpus statistics, but I may be misinterpreting that): https://docs.meilisearch.com/learn/core_concepts/relevancy.h...

It looks like Typesense only considers the documents, not the overall corpus: https://typesense.org/docs/guide/ranking-and-relevance.html
Sure, Silicon Valley could have been MORE successful. But it's a bit like telling LeBron James that he might have been better at basketball if he had eaten more protein in his breakfasts. It's like, really? I'm happy with being really fucking good. I don't need to change up anything.
«I try to find non-traditional tourist destinations. Cities that are viewed as ugly, or without a lot to see. Cities where the residents are more focused on living their life, for themselves, not for a global audience.»

This resonates so much with an experience I have had once. My wife and I visited Japan for a couple weeks and we went to 4 cities: 3 big classic ones (Tokyo, Kyoto, Hiroshima), and a small city that a relative used to live in: Beppu, which is not at all a tourist destination. In fact Beppu is so off the radar that one of the only guided tours available there to see local gardens and one monastery was by a guide who didn't even speak English. I didn't see a single restaurant menu in English. There was not much to do except randomly exploring neighborhoods and trying random shops, walking along canals, people-watching, bathing in the local hot springs (which were completely empty), etc. We were immersed in a tiny city with just people living their normal lives. And yet, Beppu was my most favorite experience in Japan. It felt like the real Japan.
"How Linux Works" from no starch press is very good for a bunch of stuff that is not taught in CS.
"we will simply adapt."

You will adapt, as a person who likely lives in a colder country in the global north. A country that has tight immigration laws and that has been the prime beneficiary of emissions to date.

Tough luck to the other folks, right? They should have been born in a different country. They deal with the consequences of your pollution, as their political system crumbles and nobody lets them migrate.
Since there are three incorrect responses to this comment already:

Anyone saying “UTC” is wrong. Unambiguously wrong if offsets are supported, and in foolish contexts like this where offsets are not supported, still wrong due to common sense and custom.

If there is no offset, there is no offset. It’s what is commonly called a naive or plain datetime. How it should be interpreted is explicitly undefined if offset-capable, and implicitly undefined by strong custom if not offset-capable; but it will generally mean in the local time zone, whatever that is—and it could be relative to a particular machine or a particular user. This is often suitable for social use, but completely unsuitable for machine history-recording use.

So: the question is rhetorical, unanswerable, thereby demonstrating why nmz’s position is unreasonable.

(Actually, only probably unreasonable because nmz’s wording wording with its “X” and “y” is not clear and may be using the term “timezone” subtly—the trouble is it’s used to mean three different things: firstly and most properly, a name for a set of rules about which time offsets to use when, e.g. “Australian Eastern Time” or “Australia/Melbourne” as it’s called in the IANA Time Zone Database, which roughly means AEST (+10:00) for half the year and AEDT (+11:00) for the other half, but conveys the rules as they have been through time; secondly, a somewhat less correct colloquial usage, a named time offset, e.g. “AEDT” or “Australian Eastern Daylight Saving Time” for +11:00; and thirdly, fairly clearly into the realm of misuse but still very common, a time offset like “+11:00”. If nmz was using the term “timezone” more precisely to mean one of the named concepts and expressly not an offset, then yeah, times written that way do require memorising a whole database, whereas offsets are straightforward to calculate, though it’s definitely harder having to do two calculations than the just one if it starts at UTC.)
Wallet Security: The ‘Non-Custodial’ Fallacy
That's the argument that they make, duplicitously.
Imagine a world where bees can't see the centers of flowers.
Easier from a perspective of organization and governance, too. Energy policy can be managed with existing institutions. If you want to launch a megafleet to block the sun, who they hell do you ask for approval? The UN? How many countries do you need to sign off on it?
One time I built a product demo-ing a physician directory, I used pictures of Dr. Strange, Mr. T as Dr. T, Zoidberg–it was comedy gold.

Boss made me use boring stock photos instead :(
This is more of a disparaging analogy than a law.
Wouldn't a powered USB hub do this?
Calm down. There are plenty of other, more serious links for you to click on this site. No need to be a buzzkill.
That's certainly aspirational...but a long way from getting words down on a blog.
Ah yep, you’re right, thanks for the correction. It’s not a fix, though, just buys us a little time. We have to stop polluting if we want to avoid catastrophe - we likely have to get to net negative. So we’d still have the multi-billion people coordination problem.
Are you recommending a lawsuit? Is there a possible way for recourse without a lawsuit?

Would it be good idea or bad idea in general to convert code into a SaaS product? That could be an alternate way that can potentially recoup the amount that is in non-payment.
In reply I would ask them "so you think hiding passwords is wrong?" And also "so no one should share secrets with you because you cannot keep them?"
The usual account takeover playbook involves mining socials etc for the answers to password reset questions, and given the LexisNexis mentions in the article I would guess that’s what happened.
I think the evidence is basically:

1. He was a spy

2. He now lives in Russia
Link to the paper: https://www.dgp.toronto.edu/~mooncake/papers/SIGGRAPH2001_Tu...
It depends on where you live.

Your work has no value without customers, though. You won't be able to just deploy it as a SaaS and watch the money roll in.

If you had a contract, take him to small claims court. It should be a slam dunk. Otherwise write it off and remember to have a good contract in the future (and maybe even escrow).
> I'd say that any "development job" that is about software development is not trivial like you say.

I did say, "simplified too." Yes, there's other things you might have to learn, but being able to, "take data from some place, then stick it into a database"; and "take data from a database, and send it to some other place" is a fundamental skill set for a lot of dev jobs.

You might be working at a FAANG and get to do fancy cutting edge development that never touches a database. But a lot of us at banks, insurance companies, etc are piping data into/out of a databases or other endpoints all day long.

> An "endpoint-to-database" job doesn't exist

9 of the 10 dev jobs I've ever had amounted to this, including my current one. Half of my job is maintaining a Go-backend bolted to a Postgres DB, and the other half is piping data from various APIs into BigQuery or vice versa.
Also adding your barriers to entry: staff, facilities, process, etc. It doesn’t help you saving on servers over a cloud provider if your procurement process means you have people sitting idle for 6 months.
The source code of that page is beautiful.
Sure, but every government--even the generally good ones--accused dissents of lying even when they aren't.

Was the Steele Report disinformation? Depends if ask you Donald Trump or the FBI. Was the Hunter biden laptop disinformation? Depends who you ask. Was "vaccines don't prevent covid" disinformation? Depends on when you ask the CDC.

You could avoid a slippery slope by drawing the line at intentionally and knowingly telling a mistruth--that's essentially where US defamation laws draw the line. But that is almost never where the line is drawn. Under that definition of lying, Anti-vaxers aren't lying--they are just wrong.

And on the slip side, when the government intentionally lies--masks don't work--its not disinformation--its a messaging technique.
> Isn't this sort of how ministries work in the UK

yes

> you have a dedicated civil service that does most of the work and then a politician that may or may not know whats going on setting direction?

this is the ministers and their private secretary.

> have watched "The Think of It"

you should also watch "Yes Minister" i find it a bit more charming if a little dated, but also quite real.
That's not what capitalism means. That's corporatism, if anything, assuming (as a sensible default) that corporations are the ones holding monopolies.
Imagine a world without skin cancer by launching giant space sails is like saying: imagine a world without white people.

People have evolutionarily adapted to the sun by producing melanin in their skin, but for some reason aerospace is the only answer?

Why the West (and frankly many on HN) seems so content on destroying the natural world for problems that only matter to a subset of rich people somehow still surprises and amazes me.

There are distinct advantages to making the internet unlivable, so that insane comments like this don’t have to exist anymore.
Likewise, I had a go at trying to improve on JSON and this is my attempt:

https://github.com/tlocke/zish

Any comments / criticisms gratefully received.
Cops rush to sweep everything under the rug. Military leadership make an EXAMPLE out of every rulebreaker.
> You don't need k8s for a small operation, just spin a couple of VMs and set them up via a few lines of Ansible.

You can replace "couple VMs" with a dedicated Hetzner/OVH/Kimsufi server, it'll be the same except you won't get ripped off on egress bandwidth and performance.
"Once these systems get complicated enough, it gets really hard to do that."

That's why I qualified it. Obviously if you're working in neural nets, you're not going to be cracking open that hood. But one of the dirty secrets of ML is you don't always need those techniques. There's the space of problems where linear regression and similar techniques are all you need, there's the class of problems where it doesn't matter what you throw at it you're not getting anything, and the "in between" where deep learning and such helps certainly has some interesting problems in the space, but it isn't necessarily the majority of problems you encounter in the wild.

The scary thing is that not being able to crack open the hood doesn't mean the model isn't complete nonsense. It just means you can't examine it.
Perhaps I misunderstood your point, but building nuclear plants can't be priority one because we don't have time to wait around for them to be built. We should be building them in parallel with more immediate initiatives that can buy us time.
https://github.com/ternding
Hey Chris - I wanted to drop a note here to thank you for what you've done for me personally. I found you first on Twitter I don't know how long ago and your posts there really brought home to me the point about how we were all talking past each other and don't engage in real conversations with people who might have different viewpoints from our own.

When my kids were younger we went on a camping trip every summer in a state park. There was this one group of people that we would hang out with each year (I called it "redneck corner") who were easily the most friendly and welcoming people in the entire campground. They would feed you, watch your kids, hand you a beer when you came by and we would just sit by the campfire and shoot the shit until the wee hours of the morning. They had nothing in common with me and my world and I loved it. I still remember their stories today.

Reading this post of yours today reminded me of those times, your writings (I loved Dignity), and the need for me to get out of my private office in my house and actually meet people who are different from me again. Until I figure out how to do that, I want to thank you for everything that you do to help me better understand the world a little bit better.
> Maybe it's that more recently Apple switched the bundled cables from A to C, but didn't provide a charger brick, so people who still only had USB-A chargers were SOL?

It started with the 11, but only for the Pro models. 12 everything was USB-C.
IMO it should be somebody who can build a Linux kernel module or a single page web app. They can do explicit memory management in C, or query a DB via ORM. But the way it's used is usually just "can write both server and client JavaScript."
When making a real steam engine you use piston rings, you don't really machine to exact tolerance except where you're showing off how precise you are. The rings are consumable, they also flex since they're split rings (they're a C), which lets them expand as they wear. They're usually softer material or a slide compatible material with the cylinder walls. This makes them sacrificial and saves the much more expensive cylinder.

You see them in literally every modern engine and I'm sure absurdly far back, even though they have better precision now.

Your 1966 south bend is likely several orders of magnitude better than that emco, those things are more meant for wood, and imagine if you needed to align your spindle on your lathe every time you used it how inaccurate it'd be.
Ars in 2008 was the place where people found out you could run arbitrary floating point computations on a GPU. I've never heard anyone talking about it but without those forums deep learning would still be this thing that looks interesting but is really hard to train at scale and no one bothers with.
> I suppose it still holds true. Explicit photos are only something to keep hidden because there is a perception that they are wrong.

Is that why? We all shower and change clothes on a regular basis(I assume), there's nothing wrong with it. Yet, I'm sure most of us do that in private perhaps only in front of a romantic partner. Something doesn't have to be taboo to be personal or private.
Plus don't forget why Egypt was fertile: The farmland got regularly flooded by the river. Can't do much while it's flooded, just go and help out on the pyramid project.
Who among us has never complained about a manager or some company C-suite. While there's NOTHING wrong with that, could you imagine those comments being shown to them? Could you imagine what might happen after that?

Just because I'm not building a bomb in my basement doesn't mean I want all my dirty laundry trotted out in front of the world.
The excuse used to be "it's God's will". Now it's "it's AI's will".
My personal favorite is "if you do not know what you are looking for why are you looking."

If they know what they are looking for, have a warrant. It is that simple to me.
I'd only note that the Vidal quote is from 1975. Much has happened since then.

To oversimplify (as he does), I'd say that both parties leaned very hard into his descriptions of them. They've exchanged members and eliminated nearly all of the overlap. So much so that I'd deny that they are really "one party", if they ever were.
Roll it out to 1 station, if that works, then 5 more. If that works, insert some earplugs and do the rest.
The author of this tool commented below; Julia simply wasn't included in the list. Plugging it in gives it quite a high score compared to other languages (top ten in 2/3 categories).

Anecdotally, I feel like I see article "on" julia at least as often as rust on HN. I totally expected it to come "second" on most categories, and was very surprised not to see it there.

Then I realised that most julia articles would rarely introduce the julia component as "in Julia"; certaintly not in the same way that people tinkering with rust would be keen to report it as such. If anything I have noticed that most articles on Julia tend to be a bit backdoorish (i.e. the title is on, say, differentiation, but then you go to the article and it's basically an article about julia).

So I think it's just a side-effect of the methodology used to rank languages; not sure if it reflects actual market-share or the result of a vocal community engaging HN specifically, but julia definitely has a much stronger presence on HN than implied by this tool/article.
Networking, not just firewalls, is about looking at a packet, opening it up, and either passing it along to the next link in the chain, or making a change to (typically) the header and sending it along.

There's a TTL or Time To Live value to make packets eventually die, otherwise, packets could potentially move from router to router forever. So at a minimum, your firewall, or router, rewrites the header to Decrement the TTL by one with every hop.

Which spawns a really interesting thought experiment that results in the creation of the traceroute utility.
It strikes me as still true. Does it not to you?
There has to be a book or two that explores this! The closest thing I can recall is the Animatrix/Matrix series exploring the concept of blotting the sun out with some sort of artificial clouds.
I want a doctor who isn’t beholden to the state.
I love how this one comment thread and its replies highlights the importance of being a good visual communicator. One bad image, one bunch of confusion.
There was a lot of mixed messaging rom governments, but frankly that was largely because for the first 6 months to a year we knew very little about the virus. A lot of recommendations and policy was based on best estimates and working assumptions, and some of these turned out to be wrong. Mistakes were made, lockdowns were introduced earlier or later than they should have been, assumptions about transmissibility were made based on super-spreader events that turned out to be statistical outliers.

Mistakes were inevitable, I remember having a conversation with my brother back in March 2020 where we came to the conclusion that given the lack of data mistakes would be made, and these would be used by conspiracy theorists and be politicised to spread dangerous and even deadly propaganda that would get a lot of people killed. I dearly wish we had been wrong, but here we are.
i mean "average man". the modulated example sounded a lot like the stereotypical "gay voice", how is that observation worrisome? since that voice is intentionally not like a regular man i don't see how it's problematic.
I understand you based your answer on OP's comment, but you should not assume everyone has a charger that is compatible with the newer iPhones. And the prices are totally different as well.

There is a regulation in Brazil that determines newly purchased products should come with any components essential to the use of such (expensive, i.e., $1450+ in Brazil) products. In the case of iPhone, this means coming with a charger. Just like you, Apple assumed everyone in Brazil would have an Apple compliant charger sitting around, but the regulation exists exactly to avoid it.

I can see them using to constraint their warranty, so when a problem happens to the phone they would have an excuse not to fix it: "oh, we see here you haven't been using a compliant charger. Warranty voided."
You might like Friedensreich Hundertwasser, he designed buildings lacking straight lines, sometimes even undulating floors.
Sure but you can't legally sell a product using the leaked keys AFAIU. Plus this supports 4K (albeit at 30 Hz). This board is built around what appears to be a fully legit HDMI chip with HDCP compliance best I can tell (MS2130? Github page also mentions a couple other related chips... one of them has to be the HDMI chip), though I'm having trouble finding a datasheet link because Google is dominated by this Hackaday page.

Why the HDCP people tolerate such a chip/don't tightly control who can buy it is what I'm asking... I'm guessing maybe this is an "off label" use of a chip that was meant for more mundane HDMI decoding uses. Which kinda illustrates why HDCP is silly and an annoyance for consumers that doesn't really stop the "real" pirates making content rips people are downloading.

Though I didn't intend this as a loaded question, I might totally misunderstand what's going on technically speaking and would love for someone who knows about this to explain.
This is a really cool project. You should submit it as a toplevel post. (A shame there's no website / that the README doesn't embed images of example outputs, though.)
The WikiReader: A ragtag community is keeping this aughts Wikipedia gadget alive
Non-precision items can be more field expedient to fix. If you're 30 days from the factory do you want something only they can fix, or something you can with the local blacksmith or an axe, rope and a log?
Do you have a nintendo switch? The one that comes with it is like that - https://store.nintendo.com.au/au/nintendo-switch-ac-adapter....

See also Lenovo laptop chargers - https://www.lenovo.com/au/en/p/accessories-and-software/char...

I have a bunch of things like this around the house. I'm not trying to deny the existence of usb-c female power adapters, but IMHO they are a more recent phenomenon than usb-a female power adapters, and the male-ended usb-c power adapters that ship with many devices.

I'm not trying to justify whatever's going on in Brazil, but usb-c female to lightning or usb-a male to lightning would be generally easier to accomodate, for me. I also have (for instance) usb-a female sockets in the car.
not sure what you mean? my only point is if there's an unconscious bias concern it's pretty hard to accurately address in situations where people don't just play music.
Yes, the site has crabs, too.
It will help, we need these big efforts.

But it won’t reduce ocean acidification via too much CO2.
> The software will put (some hard, some soft) limits on the kinds of things that will be posted, and the kinds of posts that will be seen. These choices will affect the emotional tenor of the experience of using it in a very directly McLuhan-y way.

True. Being neutral is a nice goal, but unachievable. Every choice has a color, some dull, some bright, but colored nonetheless.
How is Germanwings Flight 9525 (Lufthansa Group) counted under this system?
YES!

I've long thought that once a person attains a certain level of success, roughly including college degree, certain military rank, managerial position of certain scope at medium-large company, etc., they should be subject to random political service in state or federal legislature or executive branches. Perhaps after one term, they can stand for re-election for maximum of two terms, 10 years max, to take advantage of experience gained. Pay should be greater of a set level or 110% of their max earnings in previous 5yrs (so service is not punitive).

There would of course be some random evil and grifters, but their concentration and ability to embed for life would be very limited.

How we get from constitutional structure to there is another question.
Alan Moore’s from Hell Isn’t Just About Jack the Ripper