skysight-inc/HackerNews huggingface dataset:
The thing with Linux is that it’s extremely fragmented. We could be running totally different setups from both a hardware and a software perspective.

When using Linux i’ve regularly encountered the “it just works” argument and then been disappointed when it in fact did not.

The only thing I can do is accept that my own experience with Linux is unique and try to optimize for my own situation. Nvidia has historically been decent for me but AMD has been significantly better.
Except maybe a file with really long lines.
> I’ve certainly had people visit who think of themselves as fit and they get gassed out by regular New York walking life

It's interesting how things become normal once you do it every day. I used to live in a fifth floor apartment without lift. Quite a few stairs to climb. Three things come to my mind.

a) You very quickly learn not to forget anything when leaving the house.

b) There is some perverse sense of satisfaction in having guests over and walking up the stairs together; and purposefully keeping a calm breath whilst the guests are wheezing and complaining.

c) Some tradesman was working on one of the floors. I will never forget the sight of him carrying something heavy up those stairs whilst practically breathing through the cigarette in the corner of his mouth.

For very legitimate reasons life like this is not for everybody. But I would say for able-bodied healthy people it would be good to have a bit of regular forced exercise like that.
Every website with google ads becoming unusable. And also, every site using google captcha.
Low-voltage differential signaling
A few quick comments:

> But it’s important for hobbyists and tinkerers to be able to participate in the AI ecosystem

Totally agree! This was a big part of my original motivation for creating the TPU Research Cloud program. People sometimes assume that e.g. an academic affiliation is required to participate, but that isn't true; we want the program to be as open as possible. We should find a better way to highlight the work of TRC tinkerers - for now, the GitHub and Hugging Face search buttons near the top of https://sites.research.google/trc/publications/ provide some raw pointers.

I'm sorry to hear that you've personally had a hard time getting TPU v3 capacity in europe-west4-a. In general, TRC TPU availability varies by region and by hardware generation, and we've experimented with different ways of prioritizing projects. It's possible that something was misconfigured on our end if your TPU lifetimes were so short. Could you email Jonathan the name of the project(s) you were using and any other data you still have handy so we can figure out what was going wrong?

Also, thanks for the kind words for Jonathan and the rest of the TRC team. They haven't lost any power or control, and they are allocating a lot more Cloud TPU capacity than ever. However, now that everyone wants to train LLMs, diffusion models, and other exciting new things, demand for TPU compute is way up, so juggling all of the inbound TRC requests is definitely more challenging than it used to be.
He’s saying it’s not antisocial because he’s a better judge on how he wishes to expend himself for society.
I could have written this same comment. I fully understand where the mental irrationality comes from. I’ve done therapy etc. But what I call “the hearth of the city” means it’s hard to ever really relax. Caring for a family accelerated it.
step 0: maybe use FastAPI instead.
Reminds me of "there's no speed limit" https://sive.rs/kimo
You have just solved an issue for me that has, apparently, bothered me for 30 years. When I was a kid, I saw that book at a bookstore and was so enthralled with it, but I had just started learning C and it was way too expensive for my parents to buy. I have occasionally over the years tried to figure out what book it was but didn’t have any success… until today! So thank you!!!
Ehhh I mean you're not wrong, but I wouldn't say you're fully right either.

You can absolutely send stuff to a thread pool executor or process pool executor and then never await the returned value/never have it "return until interrupted, but the issues with shared memory (or really, the lack thereof in comparison to ex C) are still present to my understanding.

Then again, I mean you can always spin up a sqllite server or something on the same machine, but that's stupid heavy and more of a workaround than a solution. Super excited for nogil.

https://docs.python.org/3/library/concurrent.futures.html#co...
I'm not the one you're asking. But the thing about Java is the library. It's like Barbie - it has everything.

You feel slower in Java? I'm not saying you're wrong. But are you enough faster in another language to enable you to write (and debug!) functions that Java gives you for free? Or, do you not need many of those functions?
I love this article about bad faith arguments in formalized debate that’s actually a very vague culture war complaint
I think the failure isn't IPv6 itself, but the dreadful prospect of having to step from the boat to the dock: simultaneous production implementations of ipv4 and IPv6 in the same organization.

Mostly this is a DNS headache, especially if you're already segmented into a bunch of different split horizons due to organizational boundaries or vpns or what have you, and unlike software networking is almost necessarily done direct to production as staging is extraordinarily complex and expensive, and again unlike software development is not part of the daily iteration cycle but instead of once or twice in a decade type of thing.

anyone managing or responsible for managing that infrastructure is going to need an extremely compelling reason to pursue a switch thanks to the two systems obstacle.
FWIW I've also had browser RAM consumption issues in life, but it's been mitigated by extensions like OneTab: https://chrome.google.com/webstore/detail/onetab/chphlpgkkbo...

For now, local LLMs take up an egregious about of RAM, totally agreed. But we trust the ecosystem is going to keep improving and growing and we'll be able to make improvements over time. They'll probably become efficient enough where we can run them on phones, which will unlock some cool scope for Khoj to integrate with on device, offline assistance.
I believe you can aggressively reject clear users from cutting in front of you because it’s privately managed
I alluded to this on Mastodon recently [1], and I strongly agree. Here's a copy of the toots:

---

Thought that just crossed my mind: what if - a law that mandated any service accessed over the web must not interfere with any attempts to develop or use third party clients?

Not a software license. A law, with actual teeth and massive fines for companies (it's always companies) violating it.

Discord banning folks for using Ripcord? Yeah that'll be $(insert massive fine here) per user banned. Your credit union? Sure, write your own mobile app for it.

Like GDPR, but a hundred steps further.

To give it proper teeth, the fines for willful infringement should be basically company-ending events, because fuck abusing users. No $1000 slap on the wrist. Nah, "up to 5% of company net profit for the year of occurrence, or $X minimum amount, whichever is higher" (to handle unprofitable VC-backed entities) or something truly fear-inducing.

And no, I can't currently think of anything that should be excepted from this. If you think you can write a better GUI for the SaaS version of TurboTax and not land yourself with tax fines, go for it, dude. The law should allow you to do that, too.

[1]: https://merveilles.town/@klardotsh/110749363058611919
This post reminds me of a founder I worked for. We had a pitch meeting where one of the prospective investors laid out exactly why the founder’s idea was fundamentally flawed based on the investor’s personal experience as a past founder working on a variant of the same idea. The investor also explained what paths forward our founder could take with clear and actionable ideas before the rejection.

After the rejection the founder told us “the investor is biased because he failed so if we succeed it will hurt his ego” and proceeded to ignore all his advice. Well 6 months later when we tried to get users on the platform everything the investor had said turned out true and the startup limped along for another couple years on angel funds, thankfully without me.
There's a massive amount of developers who unfortunately either don't know or don't care about efficiency. They'll blindly run commands with huge resource consumption with no second thought (or even an idea that such a thing is happening.)

It wasn't long ago that a developer I was working with seemed to have entirely not comprehended the idea when I asked why he was searching for and downloading a dozen-MB PDF just to open (i.e. delete when closed) every time he wanted to look up one thing in it! I accumulate documentation for a project and keep most of it open throughout; I thought that was a usual thing to do, but apparently others will go online to search for that information every single time, then close the browser and reopen it whenver they need to look up something else.

More publicly, it's also not long ago that Docker, and more relevantly, PyPI, have been getting worried about their bandwidth usage: https://news.ycombinator.com/item?id=24262757 https://news.ycombinator.com/item?id=27205586
He says:

"For instance, if you are pitching a research lab without a specific plan to profitability (e.g. Mistral AI), then YC is not for you. "

So does YC fund similar companies [with "better" founders]?
What is so wrong with Web Environment Integrity? It's a great policy, and the notes CLEARLY outline how the main benefit is going to be for the users and website developers. If you're not doing anything wrong, then you shouldn't have an issue.
https://www.twilio.com/docs/lookup/v2-api/
Not the person you replied to. I use Cmd-Tab for most app switching, and trackpad configured for four-finger swipe up/down (Mission Control / App Exposé). The dock is set to auto-hide and I rarely use it for navigation.
That's what I don't get, you have such grear confidence in legal barriers but keep in mind, your therapist also has assistants/staff sometimes, they take notes that could get leaked/stolem, they could get hacked if it is digitally stored,etc...

I mean, some shit I wouldn't even dare speak out loud anywhere near a smartphone or network connected device. These days, you say the wrong thing and they'll put you in a 72hr psych hold and ruin your life (having to explain that to your work/spouse!).

Beyond that, these people are experts at manipulation (to an end they consider good), they could take that information and get you to think in a way that is undesirable to you.it could be life changing but it that change does not have to be positive. Your putting your faith in a lot if humans and a lot of processes and checks working right.
In Florida??
The observation that YC companies tend to share a common shape is a pretty easy one to make. Who gets accepted or not is clearly a matter of fit and equally clearly has strong random chance effects.

Analyzing why the fit wasn't there is interesting. Your framing as "should have been accepted" (???) seems like you're thinking about this in a very different way from how it works.
The Screwed-O-Meter (2013)
I wonder how pedantic you could legally get with that.

Cloudflare has never been compelled to give up information to an agency called AAA.
Cloudflare has never been compelled to give up information to an agency called AAB.
...etc.
Retraction, Gangnam style!
Tailscale is so good. One of the best pieces of software I've used in a long time. It just works, and it's really good at what it does (VPNs into your private network, regardless of the route to it)
what evidence concretely?
The title is lifted verbatim from the abstract:

> Those trends, in addition to decreasing diagnoses in foreign-born persons, contribute to rising evidence that leprosy has become endemic in the southeastern United States.

and the paper itself says the same thing in the summary:

> In summary, our case adds to the growing body of literature suggesting that central Florida represents an endemic location for leprosy.

How is that misinformation?
0_o

Did I miss something? Does nodes/highland have good shared memory semantics these days?

I've always felt the best analogy to python concurrency was (node)js, but I admittedly haven't kept up all that well.
#5 seems most likely.
While I've said something like this comment scores of times in my life, and it's definitely a necessary corrective for a lot of optimists who don't think too hard about how they think, I don't think it's a useful place to stop. It's not hard to get unanimous agreement with "be a realist!" because it's framed so the alternative is irrationality/delusion. But even among people who agree that the goal should be to reason under uncertainty and assess risks clearly, there will be a spectrum of risk tolerance, and I don't think it's the worst thing ever to describe that as "optimism" vs. "pessimism"! (I fully acknowledge this isn't the dominant usage, but I think some spaces lean this way)

In this context, I tend to read the parent claim as something like, "great success requires willingness to sometimes take worse-than-even odds or pursue modestly-negative-EV opportunities". I'm not sure I agree with the strongest version of that, but I think it's likely that the space of risky paths to great achievement is richer than that of cautious ones.
> The ingenious people that are always right are invariably courteous, polite and a pleasure to be around.

My experience in both academia and business was/is very different: to those who are insanely competent, you typically had (in some sense) to "prove" by diligence and intelligence that you are "worthy" their time.

I can understand that attitude really well: otherwise a lot of people would insanely waste their time, and the respective people would get nowhere.
This was crazy since Processor Technology (this is hosted on sol20.org) already had a good system, as did others. A good lesson in standardization failure.

I remember Tarbell being the popular one, though the Wikipedia doesn’t say so particularly. IIRC it was just a recording of the Bell 103 modem signal.
> intentionally-faulty software

> the maintainer only caved

> he's harming his users with his stubbornness

A gentle reminder that you're not entitled to other people's free labor. It's one thing to disagree with technical decisions made by the project, but the shaming and name calling is a bit too much.
On Apple ][ (/e, /c, etc.) there was some non-standard DOS version (I don't think it was ProDOS, but something else) that was first geared towards using the 80 column mode (PR#3), but then it had the notion of directories.... but it was still storing everything in one big "flat" list, though each "file/dir" would have a parent index, so "cd someDir" and then "dir" would (I guess) just allow files that have in their parent_id as that dir.

But after all, that's how you did any kind of "pointer" programming in language without pointers (like Apple Basic which was my first language) - you'll store things in array, and use indices (much like Databases)...

Maybe it's somewhere in archive.org...
> Multiprocessing. The answer is to use the python multiprocessing module, or to spin up multiple processes behind wsgi or whatever.

I assume mod_wsgi under apache was not the answer here due to memory constraints. That being said, why not serve from disk and use redis for a cache. This should work well unless the queries had high cardinality.
by the way, if you only need a validation of a number, no need for Twilio: this is a great lib https://github.com/giggsey/libphonenumber-for-php
Some private cloud execs I talked with ballparked it at $15-25mm [1].

[1]: (I wrote this) https://gpus.llm-utils.org/nvidia-h100-gpus-supply-and-deman...
What especially is "2023" about this? This has been a ~good way for almost a decade now, even though poetry and other hot-new alternatives have muddied the ecosystem with all of their pros and cons...
It also only technically protects EU citizens/residents. Some companies extended that infrastructure to US folks willingly, but certainly not all.
Or perhaps those traits are unrelated?

Smart people can be assholes, they can also be excellent humans.
This could’ve been an interesting article. E.g.:

- how to use flask with recent pytest versions (testing isn’t totally trivial in flask IME - maybe it’s better in 2023?)

- recent language features that make flask nicer

- best ways to deploy, maybe given that the devops landscape has changed a ton since flask started

- special preparations for NoGIL?

- compare the best flask event loop vs fastapi performance. could be interesting to see if there’s a gap and if it is closing/widening over time. (can I avoid async/await?)

etc
Nxyz to be acquired by Snowflake, sunsetting API service
Neeva's sister company is also acquired by Snowflake.
> Between the three big pieces of legislation passed in President Biden’s first two years — *the Bipartisan* Infrastructure Law, the Inflation Reduction Act, and the CHIPS and Science Act — *the Democrats* are trying to fundamentally reshape American industrial policy.

Interesting editorializing.
SFO is owned by the city and county of San Francisco, but that's beside the point.

The TSA should run its own line because it's the one imposing the screening requirement.
Yea a more realistic title would be - "We got rejected from YC, what I thought we did wrong"
TRC is supposed to be the “something better”. This insider TPU stuff is for the birds. If TRC can only offer 4 hours with no preemptions, that’s fine, but they need to be up front about that. Saying that TPUs preempt every 24 hours and then killing them off after 45 minutes is… not very productive.

As for their comments, the third screenshot is the key; they’re agreeing that the situation is bad. They’re a friend, and they’re a little indirect with the way they phrase things. (If you’ve ever had a friend who really doesn’t want to be wrong, you know what I mean; they kind of say things in a circular way in order to agree without agreeing. After awhile it’s pretty cute and endearing though.)

I was particularly pessimistic in those DMs because it came a couple months after I thought I’d give TRC one last try, back in January, which was roughly a year after I’d started my “ok, I’m losing hope, but I’ll wait and see” journey. In the meantime I kept cheerleading TRC and driving people to their signup page. But after the TPUs all died in less than two hours yet again, that was that.

I have a really high tolerance for faulty equipment. This is free compute; me complaining is just ungrateful. But I saw what things were like in 2019. “Different” would be the understatement of the century. If my baby wasn’t being incubated in the NICU today, I’d show the charts where our usage went from thousands of cores down to almost zero, and not for lack of trying.

It also would’ve been fine to say “sorry, this is unsustainable, the new limits are one tpu per person per project” and then give me a rock solid tpu. We had those in 2021. One of our TPUv3s stayed online for so long that I started to host my blog on it just to show people that TPUs were good for more than AI; the uptime was measured in months. Then poof, now you can barely fire one up.
Alternatives to HuggingFace or a path forward for the OSS community?
Embarrassingly parallelizable problems are extremely common in my life. I end up breaking out of python to use gnu-parallel, which is fine but annoying.
Let me ask you instead: "how you intend to prevent matrimonial fraud?"

…

You can not. Because that is not how world works - crime did happen, happens, and will happen. You can stop attempts or fight it by education or by arresting criminals but never eliminate or prevent it.

"You need signals of some kind to know whether a visitor is likely to be malicious or not."

Innkeeper in 13 century: "I need signals of some kind to know whether a visitor is likely to be malicious or not before he enters." - See how ridiculous it is?

You are being being wrong here - you don't have 'visitor' but 'client' and as far as I'm concerned you do not spy on every client to "know" if he "is likely to be malicious or not". You may be suspicious of client activities but that is what you can realistically do.

Also define "fraud and abuse" because this can mean many things which may have many solutions.
Ashes to ashes, dust to dust, Twitter to X
As with all the previous posts from dhariri.com, it's kind of clickbait.
> That's an admission that they don't know the target's age

That's what they start with, but a picture is a pretty good way to figure out if someone is likely to bee underage and they also do significant investigation before turning this over to the police.

> And of course nobody is going to post a picture of a CHILD-child, since that's obviously a huge red flag that will get them caught.

This idea that people never post obvious criminal activity online is kinda silly when we're discussing people getting outed by... posting obvious criminal activity online. You can say it shouldn't be criminal, but there are democratic means to change that and actual locations where prostitution is actually legal, like that county in Nevada.

Nobody in the article seems to dispute that they catch actual child sex slaves, though. The main complaint is the unsubstantiated idea that they're catching mostly adults, but no evidence of this is presented. Instead, you're reading a lot of things between a lot of lines to infer that and claiming these inferences are obvious when they're not.

> Children don't tend to have high school diplomas almost ever.
> it's hard for a minor to get a tattoo at all.

Better, but hardly proof. And you can still be trafficked when not a child if you're being held against your will. It's not like adult sex slaves are faring any better or like they don't exist and deserve sympathy.

> The longer you have your license, the more time there is for a picture of it to get posted.

I got mine at 16, posting it is something you're more likely to do when young and dumb.

> So they're handing this stuff over to cops and at best just hoping they won't prosecute any of the people they consider to be victims. That's, um, irresponsibly optimistic.

The DAs have standards about this, they're not going to randomly prosecute someone forced into slavery and the cops are the best people to actually deal with this since it's their literal job in society.

Also I have to note that your solution here is to ignore people being forced into literal slavery because you disagree with a democratically created law and want it changed by fiat instead of trying to actually fix it.

I get that there's a sort of trolley problem, but one might think that maybe they could do something legal or change the law instead of demanding that people ignore child sex slaves being sold online because they might get caught breaking a law they, and you, disagree with.
yep. people seem to forget that the whole API key is a recent invention. for many years you could just access many APIs anonymously. this should still be possible. if abuse is an issue, all they need to do is set rate limits for anonymous access. GitHub does this, and even Instagram.

the only point of an API key is to extract information from API users that would otherwise be anonymous.
The reason for using metaphors is because most users don't understand the more direct comparables.

Pretty much all non-technical users -- and a great many technical users -- have never heard of SafetyNet and don't know what it does.

Metaphors are imperfect; that's inherent to their very nature. That doesn't make them useless.
What is an abstract far away problem for other countries is more of a concrete immediate “we are screwed if we continue to YOLO“ problem in China. And even they can only move so quickly in their renewable energy build out.