skysight-inc/HackerNews huggingface dataset:
(disclaimer: i wrote that post)

It is not. We rely on more than User Agents because they are too often faked, so it is not just marketing. There are other signals we see that confirm whether the request came from a "legitimate" AI scraper, or a different scraper with the same user agent.
I think "design" here means something like "graphic design"?
Chinese EVs leave other carmakers with only bad options
Pffff, 30 years of IT and I just realized that today (if the name was indeed intended; if not it is a cool coincidence)
How to search for actual videos instead of random shorts that people put together on a phone for some god-forsaken social media credit? Protip: you can't filter out those "shorts".

How to block some posters from ever showing up in my search results?...
It makes me feel so old to hear Windows XP described as "retro-computing". >smile<
Shift Left Meets Kafka: Testing Event-Driven Microservices
That's true. Right up until you look at Haiku and its vector icons. But I get it. Everyone has to look the same.
I would if YouTube were user respecting for paying users. I pay for a lot of other media fwiw
> Being the best gets you noticed (in a good way), and screwing people over gets you noticed too (in a bad way),

ah, to be young again...
Doctors live and die by testing. If tests don't show anything, you don't have anything.
There are people who create checksums of iso's and there's people like me.

And then there are people who do not read the ToS and then there's also nobody else.

I miss the simplicity of windows xp. sometimes.
Gell-Man amnesia effect! (Or very similar ...)
> They are absolutely complementary, and implementing a real world secure system will layer both- one starts with a mathematically secure heavily publicly audited system, and adds obscurity in their real world deployment of it.

Ok, let's start with a 'mathematically secure heavily public audited system' - let's take ECDSA, for example - how will you use obscurity to improve security?

> If you have the resources and ability to, for example, develop your own internally used but externally unknown, but still heavily audited and cryptographically secure system, is going to be better than an open source tool.

Literally all of the evidence we have throughout the history of the planet says you're 100% wrong.
Or offer two search results when they suspect one is spam and see which one a user likes and train off of that, just the way they do now with ChatGPT.
We definitely do not live in that ideal word where this is often enough true. Just take a look at the zerocarb/carnivore community and, just as a random example, IBD and Chron's remission, or keto and type 2 diabetes, etc.
> She will be fired soon

https://x.com/elonmusk/status/1851985438933668337

Interestingly both sides have now turned against Lina Khan. The Biden admin appointed her and loved her the first 1.5 years. But then she blocked some geopolitically important deals like Nvidia's attempt to buy ARM and the Biden admin's attempt to make Tiktok US into a legally independent US entity (but still owned by ByteDance). Now the Biden admin is treating her like she doesn't exist.

But I can't really blame her unless US laws are changed to say that mergers and acquisitions should be given more leeway for geopolitical reasons.
Amazon is publicly claiming that they have saved hundreds of millions on jvm upgrades using AI, so while it feels trivial - because before that work would end up in the "just don't do it" pile - it's a relevant use case.
Crazy expensive compared to what they actually make off of ads. Who can justify this?
Feel bad for the author. This was clearly an information pump. They just wanted info from them. That’s it. Of course google lies. Of course they steal. It’s Google and it’s not 2007 anymore. Don’t trust them. Don’t engage with them. They just steal and harvest from others. They couldn’t even keep a simple chat app running. It’s a trash company filled with trash people who will talk down their nose at you while destroying the fabric of society. Pretty par for the course these days for anything tech though. I work in tech and can say we are awful, vampiric, and pretty much useless people who get off on having power over people through knowledge. If you approach most software engineers with that understanding they are much easier to deal with, but that doesn’t make them and the industry any less parasitic. I hate my career choices.
Google has to sell its AI some how. The problem is that businesses will see this and want to fire head count because they go, "Well I guess AI can do it for freeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee!". Nope no way is it writing code freely.
By not it, do you mean those features aren’t available yet, or you don’t see the value in them?
> I brought up that it seemed reminiscent of Chronic Lyme's disease, and he said that yes, that's also a very questionable diagnosis.

I live in New Hampshire, the people I know who got lyme and say its chronic/it ruined their life are all vegan, and one vegetarian. The people who are not called it a bad week. I suspect diets (specifically diets of deficiencies) play a somewhat tragic role in a lot of these patients.
I do wonder how much of this is self-fulfilling atrophy. You're tired and sick, so you stay in bed. Then you get weak, making you more tired. Hopefully she can turn things around, regardless of underlying causes.
> There are other signals we see that confirm whether the request came from a "legitimate" AI scraper, or a different scraper with the same user agent.

Great! What are these signals? That seems to be the meat of the post but it's conspicuously absent. How are we supposed to validate the post?
Chinese EV Is Now the Fastest Sedan Around the Nürburgring
Show HN: X to Voice – Generate a Unique Voice from Your Twitter Profile
Hi HN,

We just launched “X to Voice” an open-source app that generates a unique voice using your X (Twitter) profile. It works by extracting your profile data and creating a custom voice with our newly released Voice Design API.

The API is live from today and allows you to generate a unique voice from any prompt you provide. We’d love for you to try it and share your feedback.

Check it out: https://www.xtovoice.com/

GitHub: [https://github.com/elevenlabs/elevenlabs-examples/tree/main/...]

Happy to answer questions and hear your thoughts!
I don't really blog, and I've forgotten all the juicy details at this point. It was an old thinkpad that just barely booted up windows ME and then couldn't do anything useful. VectorLinux was a really great match for it, I think they claimed to have fiddled with the kde libraries at the source level and ripped out a bunch of things to make it all snappier - I don't know to what extent that's true, but that crappy little laptop allowed me to run firefox, openoffice, skype, matlab and latex (not all at the same time - at most two) for my first year of uni.
David Bowie said it better

“If you feel safe in the area you’re working in, you’re not working in the right area. Always go a little further into the water than you feel you’re capable of being in. Go a little bit out of your depth. And when you don’t feel that your feet are quite touching the bottom, you’re just about in the right place to do something exciting.”
This is a big factor. The whole reason I have a truck is so I can get away for the weekend maybe once a month.

Adding 2-3 recharge stops is a deal breaker for a weekend warrior. Nobody wants to spend an hour charging stop before they get to a campground or when they heading home to get ready for work on Monday.
it's definitely an interesting topic, because my skeptical mind is easily split in one of two ways-

either 1) it's a real phenomena that is under-diagnosed and ignored by medical professionals (something I believe happens) or 2) it's not a real condition and patients who suffer from it are suffering from a mix of mental illness combined with other real diseases that are exacerbated (something that I believe happens)

both sound like very real, very possible problems, and neither one seems more likely to me than the other. Or perhaps it's a big mix of both, on a case by case basis.
Not viable. They are going to use user agents that look like those coming from completely normal human users.

"Verifiable signature"? That's a dangerous road to go down, and Google actually wanted to do it (Web Integrity API). Nobody supported them and they backed out.
That seems fine. When a billionaire buys one of the largest social networks on the planet and takes it private, it's probably best for the FTC to look into that with heightened scrutiny.

(In unrelated news, FERC spends a lot more time looking at companies with huge oil-extraction operations, like BP, than at individual small independently-owned wells).
A tad surprised that curvature isn't discussed? With such a massive screen, the distance from your eye to the middle of the screen, and eye to the corners, are very different - unless you sit far away. Your eyes thus need to change focus all the time. That's AFAIK why those ultra wide screens are curved - and I find that the more curve they have (smaller radius), the better it is. With such a massive screen, I guess it would be best if it was part of a sphere! (Curved both ways)
What that misses is that the author is hosting a Mastodon server, so those images don't even have to originate from their own website. If I hosted a porn account on my server and one of the author's users followed it, they'd see the images served from the author's server[0] even though that's not where it came from.

It would be like emailing porn to someone and then filing an abuse claim to their email host that their account has porn in it. Well, yeah, but they didn't put it there.

[0] This is the default in the Mastodon software, and it's a good thing. If one of my posts goes viral, my poor little server won't get flooded with O(num_followers) requests, but O(num_of_servers_with_followers) which is going to be a tiny fraction of the size. Admins can turn that behavior off on a per-server basis.
The difference is that, AFAIK, those bigger AI crawlers do respect robots.txt. Google even provides a way to opt-out of AI training without opting-out of search indexing.
>While Star Citizen initially had the stated goal of being a return to old school game design

What? In what way? What part of "We are going to build a giant space MMO" and spending like ten minutes worth of pitch time waffling on about how "look! Each of the 16 thrusters on this little spaceship are physically simulated! That's so important to someone playing a space MMO!" and right from the beginning allowing you to pay to win was "old school game design"?

Star citizen from the very very beginning was clearly a trap of "More immersion means more better", which is interesting because they really were not showing off anything especially immersive. None of the presentation for kickstarter really showed off anything that seemed like exciting space ship combat. It only really sold the kind of vague dreams that people have and never think through.

Then, after saying they wanted to build a giant MMO, they chose a game engine that could not even offer reasonable multiplayer performance and support. Years later Chris would waffle on in an update about how "Oh we had to go and implement object synchronization over the network" at a time when both Unity and Unreal offered that as built in functionality, as if that kind of statement from the Lead of the project is anything other than an admission of utter incompetence at choosing Cryengine.

But, they had to have the pretty visuals to sell the kickstarter I guess. Shows you were their priorities were.
I found that I was getting random bot attacks on progscrape.com with no identifiable bot signature (ie: a signature matching a valid Chrome Desktop client), but at a rate that was only possible via bot. I ended up having to add token buckets by IP/User Agent to help avoid this deluge of traffic.

Agents that trigger the first level of rate-limiting go through a "tarpit" that holds their connection for a bit before serving it which seems to keep most of the bad actors in check. It's impossible to block them via robots.txt, and I'm trying to avoid using too big of a hammer on my CloudFlare settings.

EDIT: checking the logs, it seems that the only bot getting tarpitted right now is OpenAI, and they _do_ have a GPTBot signature:

2024-10-31T02:30:23.312139Z WARN progscrape::web: User hit soft rate limit: ratelimit=soft ip="20.171.206.77" browser=Some("Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; GPTBot/1.2; +https://openai.com/gptbot)") method=GET uri=/?search=science.org
I'm curious how ChatGPT Search improves recall and reduce spams. I can see how LLM helps find the most relevant content. However, it is still hard to find the right content, especially in a domain that has tons of spams. For instance, when I search for a product review on Google, I get back many review sites that look so legit that I have hard time telling which ones are spammers.
I've absolutely no objection to building new things. I'm not against fusion as a "thing we can do". I hope the project in France is successful.

What I'm saying though is that the economics of fusion don't work. The temperature range, magnetic fields etc won't ever be 'cheap'.

Look, going to the moon wasn't economic, but it got us GPS and satellite TV which definitely are. Fusion may give us other unexpected benefits. But it'll never be the 'energy too cheap to meter' that was envisaged in the 1950s.
This is really cool. I've been working on a RAG application to answer customer support tickets on and off for the past couple months. The whole time I never put together that vectors could "get out of sync" when swapping out the embedding model.

I probably won't use this right now when my app is so small because it of the complexity managing another service introduces. But I imagine as it gets bigger this would make things simpler.
Great question, yeah I do. Right now it backs up to a separate NAS on my home network. Every once in a while I'll copy the most important directories onto a microSD card backup, but its usually going to be at least a few weeks out of date.
Great article -- I'm going set aside some time with a notebook and pencil today and give this a try.

I'm not sure I agree with the left brain/right brain, analytical and logical vs creative and emotional dichotomy. I think good design work can be just as analytical as it is creative. I think it has to be when it comes to UI and UX.
Back pain is in many cases psychosomatic, but that doesn't make the pain any less real. Your brain is just another organ and it can attack your body, just like your immune system does when you suffer from an auto-immune disease.
"Dear butt-hurt lefties" is about as clear a marker of ideological battle as exists!

Now that I read your comment more closely I see that you intended it differently than I thought. I'm sorry I didn't get it right the first time. On the other hand, the way you phrased it guaranteed that a lot of readers (like me) wouldn't get it right, so I'd say the expected value* of the comment remains negative even though you intended it more positively than that.

* https://hn.algolia.com/?dateRange=all&page=0&prefix=true&que...
Other than ease of set up, why would any one use this over training their own large language model from scratch using magnets?
I think that's the right broad question. Though LLMs properties mean that for some number of cases they will either make the results worse, or more confidently present wrong answers. This prompts the question: what do we mean by "quality" of results? Since the way current LLM interfaces tend to present results is quite different from traditional search.
I’m a bit surprised to hear that is the state of migrations in Rails. Being a Django developer I’m used to having most of the points you mention covered for a really long time already.

It’s timeless by looking at a captured schema, that doesn’t change with later code changes. Which means you can’t import / use methods of models and have to copy those over. So a different way than using the vcs for this, but still.

Not sure I’d name the second point “scalable”, but you can easily do data migrations as well.

It is really easy to use!

And you can certainly write tests for it, although it isn’t included in the framework [0]. But you can do that with just SQL too [1].

What I find much harder with (somewhat) larger dbs, is is a) determining whether it will lock up too much and b) whether it backwards compatible (so that you can roll back). Which is splitting in these pre- and post-migration steps as the article mentions. We currently use a linter for that but it is still a bit basic [2].

[0] https://www.caktusgroup.com/blog/2016/02/02/writing-unit-tes...

[1] https://tapoueh.org/blog/2017/08/sql-regression-tests/

[2] https://github.com/3YOURMIND/django-migration-linter
But the converse is not true? There is no guarantee the crawler is not amassing data for model training, or that a crawler (AI or otherwise) does not disguise itself as a normal user?
The window to do something about China is quickly closing.
Smallest dinosaur egg ever found confirmed in China
Consumers won't be offered all three years extended Windows 10 security updates
Has Ampere released any new cpus lately? Love the idea of ARM in the datacenter, but seems like the single thread performance has fallen behind desktop processors like the M3.
I was skeptical of LLM search until I saw Arc Search in action with its "browse for me" functionality.
Here is the comparison:

Claude Electron app vs Claude Safari PWA

Pros:

* Can be opened with a customizable shortcut

* Takes less RAM (400 MiB < 600 MiB)

Cons:

* Needs to be downloaded

* Weight 150 MiB

* Slower to start

* Loose language localisation

* Loose Safari's capabilities:

- Printing the content of the current page

- Speech2Text

- Accessibility

- ...
Microsoft just delayed Recall again
Ask HN: Recommendations for language when building API?
Hello all,

I am building a backend API and I have free reign to choose a language to build it in. I know it will deal with async and I heavily prefer statically typed languages, so those are my two preferences.

I work as a C++ programmer but obviously no way I am using that. I am a big fan of Rust, but I know async is painful and why put up with borrow checker when GC is fine.

The two I am leaning towards is Go and Kotlin, but very interested in opinions. My experience in either is basically 0
It’s relatively simple to detect crawlers writing one from scratch could take a few weeks if the infrastructure was in place.

With salaries though finding an externally managed solution might be cheaper.
Pony: High-Performance, Memory-Safe Actors
Why are you worried about this? Have you read something related?
> It feels like it incentivizes the police to minimize their understanding of the law so that they can believe they are following it.

It is not so lax as that. It's limited to situations where a reasonable person who knows exactly what the law and previous court rulings say might conclude that a certain action is legal. In this case, other Federal Circuit courts have ruled that similar actions are legal.
Sophos Used Custom Implants to Surveil Chinese Hackers Targeting Firewall 0-Days
I really wish that Tech people would not go outside of our purview to comment on medicine. Knowledge about how to build and maintain software does not give us any useful intuitions or insights into medicine, but the gigantic egos in this industry turn us all into pundits about what other professions are doing wrong. Stop trying to second guess and cherry pick medical studies that you half read.
The data only partially supports this

https://www.cdc.gov/nchs/covid19/pulse/long-covid.htm

The age peak is at 40-49 years. Indeed it's much higher in women but also even higher in transgender and bisexual people. It's almost as if stress from constant microaggressions makes you more susceptible to illness. What do I know, of course, I am not a doctor.
That takes time, interest from the medical community, and expensive studies. People with a chronic and unrecognized condition don't have that luxury.

But actually, yes, some of them have, maybe not for this particular condition, but one can make reasonable inferences that some are worth trying. And anecdotes have value too.
In https://medicalxpress.com/news/2024-07-covid-puzzle-pieces-f... the author says: "The intense scientific effort that long COVID sparked has resulted in more than 24,000 scientific publications, making it the most researched health condition in any four years of recorded human history."

Conveniently he provides the search term used to produce the "24,000" figure:

https://pubmed.ncbi.nlm.nih.gov/?term=%22long+covid%22+or+%22pasc%22+or+%22post-acute+sequelae+of+covid-19%22+or+%22postacute+sequelae+of+covid-19%22+or+%22post-acute+sequelae+of+SARS-CoV-2%22+or+%22postacute+sequelae+of+SARS-CoV-2%22+or+%22post+covid+condition%22+or+%22post+covid+conditions%22+or+%E2%80%9Cchronic+covid-19%E2%80%9D+or+%E2%80%9Cpost+covid-19+condition%E2%80%9D+or+%E2%80%9Cpost+covid-19+conditions%E2%80%9D+or+%E2%80%9Cpost-covid+condition%E2%80%9D+or+%E2%80%9Cpost-covid+conditions%E2%80%9D+or+%E2%80%9Clong+covid-19%E2%80%9D+or+%28%22long-term%22+and+%22COVID-19%22%29+or+%28%22longterm%22+and+%22COVID-19%22%29+or+%28%22long-term%22+and+%22SARS-CoV-2%22%29+or+%28%22longterm%22+and+%22SARS-CoV-2%22%29+or+%E2%80%9Cpostcovid+condition%E2%80%9D+or+%E2%80%9Cpostcovid+conditions%E2%80%9D+&sort=date
Jaywalking is now legal in New York City
Yeah, but traffic appearing to come from normal users can be throttled and/or CAPTCHA'ed while still allowing Google and Bing to crawl to their hearts content so your SEO isn't affected.
Russia Targeting Ukrainian Military Recruits with Android, Windows Malware
I’m old enough to remember the release of Windows 3.0! (Before that I used Windows 2.1 and was technically around for all Windows releases, but didn’t hear about the release.)

But just last month, when I installed Windows 2000 on a new-old-stock laptop from 2008 (which was surprisingly challenging as well), I realized that it does start to feel retro by now…
And how much do you trust that shit? Has anyone set up a honeypot as an experiment?
I read once about an institution that had a computer on the top of a mountain in the Rocky Mountains (IIRC).

The modem dpeed was in low one-digit bytes per second so you were careful thinking about what you send.
I think there will be two companies instead of just one.
I had the same issue with TikTok/ByteDance. They were using almost 100gb of my traffic per month.

I now block all ai crawlers at the cloudflare WAF level. On Monday I noticed a HUGE spike in traffic and my site was not handling it well. After a lot of troubleshooting and log parsing, I was getting millions of requests from China that were getting past cloudflare's bot protection.

I ended up having to force a CF managed challenge for the entire country of China to get my site back in a normal working state.

In the past 24 hours CF has blocked 1.66M bot requests. Good luck running a site without using CloudFlare or something similar.

AI crawlers are just out of control
https://archive.ph/e5LgM
The House doesn't have authority to fire an Executive appointee.

They could, hypothetically, impeach her. If they can come up with a high crime or misdemeanor she's guilty of.

"Making a judgment call on allocating investigative resources" probably isn't that.
There isn't one, it's just an Electron app that opens slower than the webpage and flashes white before it appears.

You'd think, a company that has such powerful AI and no restrictions on requests to it would be able to bash out truly native apps no rather than something that looks quite shoddily made, like making your electron app not flash white when in dark mode is amateur level stuff.
Whether it's 10mw or 1gw, the fuel problems remain. Procuring, securing and disposing of waste gets harder, not easier, with the number of reactors, not their size.
EmeraldWhale steals 15,000 credentials from exposed Git configurations